2024-03-28T12:20:38.392 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-28T12:20:38.393 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi --owner scheduled_pdonnell@teuthology --description fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/5 tasks/fsstress validater/valgrind} --archive /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627784 -- /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627784/orig.config.yaml 2024-03-28T12:20:38.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T12:20:38.777 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627784 branch: wip-batrick-testing-20240327.230800 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/5 tasks/fsstress validater/valgrind} email: pdonnell@redhat.com first_in_suite: false job_id: '7627784' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-batrick-testing-20240327.230800 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 ms die on skipped message: false osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow request - SLOW_OPS - MON_DOWN sha1: e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15 valgrind: exit_on_first_error: false mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20240327.230800 sha1: e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15 owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 7752 sha1: e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15 sleep_before_teardown: 0 subset: 1/512 suite: fs suite_branch: wip-batrick-testing-20240327.230800 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi076.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKoVmuWtstY1F4pmLD7TPY+oHB/CloLT8YY5gHm7dEB8VWk/9iZCnaTXaYD2Tk8Wu046YyZSIUllyuA2kemHSA0= smithi111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBfQWoGPgePB57Hor7i65p0t39xO2uMXVtp++yXP/eOgqz74SrpH/MpsUTir+Z2ZyZ+H/9SR1yOA352WOHAbyNs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-28_07:14:07 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-28T12:20:38.777 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/qa; will attempt to use it 2024-03-28T12:20:38.778 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/qa/tasks 2024-03-28T12:20:38.778 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-28T12:20:38.779 INFO:teuthology.task.internal:Checking packages... 2024-03-28T12:20:38.801 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15' 2024-03-28T12:20:38.801 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-28T12:20:38.801 INFO:teuthology.packaging:ref: None 2024-03-28T12:20:38.801 INFO:teuthology.packaging:tag: None 2024-03-28T12:20:38.801 INFO:teuthology.packaging:branch: wip-batrick-testing-20240327.230800 2024-03-28T12:20:38.801 INFO:teuthology.packaging:sha1: e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15 2024-03-28T12:20:38.801 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-batrick-testing-20240327.230800 2024-03-28T12:20:38.942 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2499-ge0e48ba6-1jammy 2024-03-28T12:20:38.943 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-28T12:20:38.950 INFO:teuthology.task.internal:no buildpackages task found 2024-03-28T12:20:38.950 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-28T12:20:38.956 INFO:teuthology.task.internal:Saving configuration 2024-03-28T12:20:38.971 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-28T12:20:38.977 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-28T12:20:39.002 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi076.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-28 12:14:37.059966', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEbhQzdA1lltN9dJwjL4Q06qZpOUQ6xyk0vYSw4rjVXB'} 2024-03-28T12:20:39.026 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-28 12:14:37.058227', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBPAXPP/wCyKjwonxjHOXiAgtJquVuWhGMQLQBLKcLE8'} 2024-03-28T12:20:39.026 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-28T12:20:39.033 INFO:teuthology.task.internal:roles: ubuntu@smithi076.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-03-28T12:20:39.033 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-03-28T12:20:39.033 INFO:teuthology.run_tasks:Running task console_log... 2024-03-28T12:20:39.098 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb50651d4c0>, signals=[15]) 2024-03-28T12:20:39.098 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-28T12:20:39.104 INFO:teuthology.task.internal:Opening connections... 2024-03-28T12:20:39.104 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi076.front.sepia.ceph.com 2024-03-28T12:20:39.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T12:20:39.189 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi111.front.sepia.ceph.com 2024-03-28T12:20:39.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T12:20:39.265 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-28T12:20:39.271 DEBUG:teuthology.orchestra.run.smithi076:> uname -m 2024-03-28T12:20:39.277 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2024-03-28T12:20:39.277 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-03-28T12:20:39.324 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-28T12:20:39.324 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="Ubuntu" 2024-03-28T12:20:39.324 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="22.04" 2024-03-28T12:20:39.324 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-28T12:20:39.324 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_CODENAME=jammy 2024-03-28T12:20:39.325 INFO:teuthology.orchestra.run.smithi076.stdout:ID=ubuntu 2024-03-28T12:20:39.325 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE=debian 2024-03-28T12:20:39.325 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-28T12:20:39.325 INFO:teuthology.orchestra.run.smithi076.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-28T12:20:39.325 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-28T12:20:39.325 INFO:teuthology.orchestra.run.smithi076.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-28T12:20:39.325 INFO:teuthology.orchestra.run.smithi076.stdout:UBUNTU_CODENAME=jammy 2024-03-28T12:20:39.325 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-03-28T12:20:39.357 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2024-03-28T12:20:39.362 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2024-03-28T12:20:39.362 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-03-28T12:20:39.407 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-28T12:20:39.407 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2024-03-28T12:20:39.407 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04" 2024-03-28T12:20:39.407 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-28T12:20:39.407 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy 2024-03-28T12:20:39.407 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2024-03-28T12:20:39.407 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2024-03-28T12:20:39.407 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-28T12:20:39.408 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-28T12:20:39.408 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-28T12:20:39.408 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-28T12:20:39.408 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy 2024-03-28T12:20:39.408 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-03-28T12:20:39.431 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-28T12:20:39.440 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-28T12:20:39.446 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-28T12:20:39.446 DEBUG:teuthology.orchestra.run.smithi076:> test '!' -e /home/ubuntu/cephtest 2024-03-28T12:20:39.449 DEBUG:teuthology.orchestra.run.smithi111:> test '!' -e /home/ubuntu/cephtest 2024-03-28T12:20:39.455 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-28T12:20:39.461 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-28T12:20:39.461 DEBUG:teuthology.orchestra.run.smithi076:> test -z $(ls -A /var/lib/ceph) 2024-03-28T12:20:39.494 DEBUG:teuthology.orchestra.run.smithi111:> test -z $(ls -A /var/lib/ceph) 2024-03-28T12:20:39.506 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-28T12:20:39.565 INFO:teuthology.run_tasks:Running task kernel... 2024-03-28T12:20:39.579 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-03-28T12:20:39.579 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-03-28T12:20:39.579 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-03-28T12:20:39.580 DEBUG:teuthology.orchestra.run.smithi076:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-28T12:20:39.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T12:20:39.585 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-03-28T12:20:39.793 DEBUG:teuthology.task.kernel:sha1 for client.0 is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T12:20:39.793 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-28T12:20:39.793 DEBUG:teuthology.orchestra.run.smithi076:> uname -r 2024-03-28T12:20:39.799 INFO:teuthology.orchestra.run.smithi076.stdout:5.15.0-56-generic 2024-03-28T12:20:39.799 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T12:20:39.799 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-28T12:20:39.799 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-03-28T12:20:39.799 DEBUG:teuthology.orchestra.run.smithi076:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-03-28T12:20:39.855 INFO:teuthology.orchestra.run.smithi076.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-03-28T12:20:39.999 INFO:teuthology.orchestra.run.smithi076.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-03-28T12:20:40.000 INFO:teuthology.orchestra.run.smithi076.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-03-28T12:20:40.000 INFO:teuthology.orchestra.run.smithi076.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-03-28T12:20:40.000 INFO:teuthology.orchestra.run.smithi076.stderr:hint: 2024-03-28T12:20:40.000 INFO:teuthology.orchestra.run.smithi076.stderr:hint: git config --global init.defaultBranch 2024-03-28T12:20:40.000 INFO:teuthology.orchestra.run.smithi076.stderr:hint: 2024-03-28T12:20:40.000 INFO:teuthology.orchestra.run.smithi076.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-03-28T12:20:40.000 INFO:teuthology.orchestra.run.smithi076.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-03-28T12:20:40.000 INFO:teuthology.orchestra.run.smithi076.stderr:hint: 2024-03-28T12:20:40.000 INFO:teuthology.orchestra.run.smithi076.stderr:hint: git branch -m 2024-03-28T12:20:40.001 INFO:teuthology.orchestra.run.smithi076.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-03-28T12:20:40.003 DEBUG:teuthology.orchestra.run.smithi076:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-03-28T12:20:40.068 DEBUG:teuthology.orchestra.run.smithi076:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-03-28T12:20:40.126 DEBUG:teuthology.orchestra.run.smithi076:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-03-28T12:21:33.742 INFO:teuthology.orchestra.run.smithi076.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-03-28T12:21:33.742 INFO:teuthology.orchestra.run.smithi076.stderr: * [new branch] main -> origin/main 2024-03-28T12:21:33.775 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20190312 -> 20190312 2024-03-28T12:21:33.775 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20190416 -> 20190416 2024-03-28T12:21:33.775 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20190514 -> 20190514 2024-03-28T12:21:33.776 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20190618 -> 20190618 2024-03-28T12:21:33.776 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20190717 -> 20190717 2024-03-28T12:21:33.776 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20190815 -> 20190815 2024-03-28T12:21:33.776 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20190923 -> 20190923 2024-03-28T12:21:33.776 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20191022 -> 20191022 2024-03-28T12:21:33.776 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20191215 -> 20191215 2024-03-28T12:21:33.776 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20200122 -> 20200122 2024-03-28T12:21:33.776 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20200316 -> 20200316 2024-03-28T12:21:33.781 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20200421 -> 20200421 2024-03-28T12:21:33.781 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20200519 -> 20200519 2024-03-28T12:21:33.781 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20200619 -> 20200619 2024-03-28T12:21:33.781 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20200721 -> 20200721 2024-03-28T12:21:33.781 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20200817 -> 20200817 2024-03-28T12:21:33.781 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20200918 -> 20200918 2024-03-28T12:21:33.781 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20201022 -> 20201022 2024-03-28T12:21:33.781 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20201118 -> 20201118 2024-03-28T12:21:33.781 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20201218 -> 20201218 2024-03-28T12:21:33.781 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20210208 -> 20210208 2024-03-28T12:21:33.782 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20210315 -> 20210315 2024-03-28T12:21:33.782 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20210511 -> 20210511 2024-03-28T12:21:33.782 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20210716 -> 20210716 2024-03-28T12:21:33.782 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20210818 -> 20210818 2024-03-28T12:21:33.782 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20210919 -> 20210919 2024-03-28T12:21:33.782 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20211027 -> 20211027 2024-03-28T12:21:33.782 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20211216 -> 20211216 2024-03-28T12:21:33.782 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20220209 -> 20220209 2024-03-28T12:21:33.782 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20220310 -> 20220310 2024-03-28T12:21:33.782 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20220411 -> 20220411 2024-03-28T12:21:33.783 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20220509 -> 20220509 2024-03-28T12:21:33.783 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20220610 -> 20220610 2024-03-28T12:21:33.783 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20220708 -> 20220708 2024-03-28T12:21:33.783 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20220815 -> 20220815 2024-03-28T12:21:33.783 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20220913 -> 20220913 2024-03-28T12:21:33.783 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20221012 -> 20221012 2024-03-28T12:21:33.783 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20221109 -> 20221109 2024-03-28T12:21:33.783 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20221214 -> 20221214 2024-03-28T12:21:33.783 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20230117 -> 20230117 2024-03-28T12:21:33.783 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20230210 -> 20230210 2024-03-28T12:21:33.783 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20230310 -> 20230310 2024-03-28T12:21:33.784 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20230404 -> 20230404 2024-03-28T12:21:33.784 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20230515 -> 20230515 2024-03-28T12:21:33.784 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20230625 -> 20230625 2024-03-28T12:21:33.784 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20230804 -> 20230804 2024-03-28T12:21:33.785 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20230919 -> 20230919 2024-03-28T12:21:33.785 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20231030 -> 20231030 2024-03-28T12:21:33.785 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20231111 -> 20231111 2024-03-28T12:21:33.785 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20231211 -> 20231211 2024-03-28T12:21:33.785 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20240115 -> 20240115 2024-03-28T12:21:33.786 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20240220 -> 20240220 2024-03-28T12:21:33.786 INFO:teuthology.orchestra.run.smithi076.stderr: * [new tag] 20240312 -> 20240312 2024-03-28T12:21:37.957 INFO:teuthology.orchestra.run.smithi076.stderr:Updating files: 51% (1850/3598) Updating files: 52% (1871/3598) Updating files: 53% (1907/3598) Updating files: 54% (1943/3598) Updating files: 55% (1979/3598) Updating files: 56% (2015/3598) Updating files: 57% (2051/3598) Updating files: 58% (2087/3598) Updating files: 59% (2123/3598) Updating files: 60% (2159/3598) Updating files: 61% (2195/3598) Updating files: 62% (2231/3598) Updating files: 63% (2267/3598) Updating files: 64% (2303/3598) Updating files: 64% (2327/3598) Updating files: 65% (2339/3598) Updating files: 66% (2375/3598) Updating files: 67% (2411/3598) Updating files: 68% (2447/3598) Updating files: 69% (2483/3598) Updating files: 70% (2519/3598) Updating files: 71% (2555/3598) Updating files: 72% (2591/3598) Updating files: 73% (2627/3598) Updating files: 74% (2663/3598) Updating files: 75% (2699/3598) Updating files: 76% (2735/3598) Updating files: 77% (2771/3598) Updating files: 78% (2807/3598) Updating files: 79% (2843/3598) Updating files: 79% (2853/3598) Updating files: 80% (2879/3598) Updating files: 81% (2915/3598) Updating files: 82% (2951/3598) Updating files: 83% (2987/3598) Updating files: 84% (3023/3598) Updating files: 85% (3059/3598) Updating files: 86% (3095/3598) Updating files: 87% (3131/3598) Updating files: 88% (3167/3598) Updating files: 89% (3203/3598) Updating files: 90% (3239/3598) Updating files: 91% (3275/3598) Updating files: 92% (3311/3598) Updating files: 93% (3347/3598) Updating files: 94% (3383/3598) Updating files: 95% (3419/3598) Updating files: 96% (3455/3598) Updating files: 97% (3491/3598) Updating files: 98% (3527/3598) Updating files: 99% (3563/3598) Updating files: 100% (3598/3598) Updating files: 100% (3598/3598), done. 2024-03-28T12:21:37.962 INFO:teuthology.orchestra.run.smithi076.stdout:HEAD is now at e068ccf0 Merge branch 'robot/pr-0-1711100280' into 'main' 2024-03-28T12:21:37.983 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.0... 2024-03-28T12:21:37.983 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-28T12:21:38.215 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g1df0c7e8a235/ 2024-03-28T12:21:38.215 DEBUG:teuthology.orchestra.run.smithi076:> rm -f /tmp/linux-image.deb && echo linux-image-6.8.0-g1df0c7e8a235_6.8.0-g1df0c7e8a235-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g1df0c7e8a235/ --input-file=- 2024-03-28T12:21:38.217 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi076.front.sepia.ceph.com to complete... 2024-03-28T12:21:39.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28 12:21:39 URL:https://4.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g1df0c7e8a235/linux-image-6.8.0-g1df0c7e8a235_6.8.0-g1df0c7e8a235-1_amd64.deb [39278344/39278344] -> "/tmp/linux-image.deb" [1] 2024-03-28T12:21:39.726 INFO:teuthology.orchestra.run.smithi076.stderr:FINISHED --2024-03-28 12:21:39-- 2024-03-28T12:21:39.726 INFO:teuthology.orchestra.run.smithi076.stderr:Total wall clock time: 1.5s 2024-03-28T12:21:39.726 INFO:teuthology.orchestra.run.smithi076.stderr:Downloaded: 1 files, 37M in 1.4s (27.5 MB/s) 2024-03-28T12:21:39.730 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on client.0... 2024-03-28T12:21:39.730 DEBUG:teuthology.orchestra.run.smithi076:> sudo dpkg -i /tmp/linux-image.deb 2024-03-28T12:21:39.959 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package linux-image-6.8.0-g1df0c7e8a235. 2024-03-28T12:21:41.942 INFO:teuthology.orchestra.run.smithi076.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-03-28T12:21:41.946 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-03-28T12:21:42.058 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking linux-image-6.8.0-g1df0c7e8a235 (6.8.0-g1df0c7e8a235-1) ... 2024-03-28T12:21:45.628 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up linux-image-6.8.0-g1df0c7e8a235 (6.8.0-g1df0c7e8a235-1) ... 2024-03-28T12:21:45.735 INFO:teuthology.orchestra.run.smithi076.stderr:update-initramfs: Generating /boot/initrd.img-6.8.0-g1df0c7e8a235 2024-03-28T12:22:07.230 INFO:teuthology.orchestra.run.smithi076.stderr:Sourcing file `/etc/default/grub' 2024-03-28T12:22:07.240 INFO:teuthology.orchestra.run.smithi076.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-28T12:22:07.262 INFO:teuthology.orchestra.run.smithi076.stderr:Generating grub configuration file ... 2024-03-28T12:22:07.585 INFO:teuthology.orchestra.run.smithi076.stderr:Found linux image: /boot/vmlinuz-6.8.0-g1df0c7e8a235 2024-03-28T12:22:07.604 INFO:teuthology.orchestra.run.smithi076.stderr:Found initrd image: /boot/initrd.img-6.8.0-g1df0c7e8a235 2024-03-28T12:22:07.888 INFO:teuthology.orchestra.run.smithi076.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-28T12:22:07.895 INFO:teuthology.orchestra.run.smithi076.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-28T12:22:07.950 INFO:teuthology.orchestra.run.smithi076.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-28T12:22:07.955 INFO:teuthology.orchestra.run.smithi076.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-28T12:22:08.089 INFO:teuthology.orchestra.run.smithi076.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-28T12:22:08.089 INFO:teuthology.orchestra.run.smithi076.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-28T12:22:08.089 INFO:teuthology.orchestra.run.smithi076.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-28T12:22:08.135 INFO:teuthology.orchestra.run.smithi076.stderr:done 2024-03-28T12:22:08.303 DEBUG:teuthology.orchestra.run.smithi076:> dpkg-deb -c /tmp/linux-image.deb 2024-03-28T12:22:08.311 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./ 2024-03-28T12:22:08.311 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./boot/ 2024-03-28T12:22:08.311 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 4474334 2024-03-25 03:29 ./boot/System.map-6.8.0-g1df0c7e8a235 2024-03-28T12:22:08.323 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 170899 2024-03-25 03:29 ./boot/config-6.8.0-g1df0c7e8a235 2024-03-28T12:22:08.323 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11551744 2024-03-25 03:29 ./boot/vmlinuz-6.8.0-g1df0c7e8a235 2024-03-28T12:22:08.346 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/ 2024-03-28T12:22:08.346 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/kernel/ 2024-03-28T12:22:08.346 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/kernel/postinst.d/ 2024-03-28T12:22:08.346 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/kernel/postrm.d/ 2024-03-28T12:22:08.346 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/kernel/preinst.d/ 2024-03-28T12:22:08.346 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/kernel/prerm.d/ 2024-03-28T12:22:08.346 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/ 2024-03-28T12:22:08.346 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/ 2024-03-28T12:22:08.347 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/ 2024-03-28T12:22:08.347 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/ 2024-03-28T12:22:08.347 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/ 2024-03-28T12:22:08.347 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/ 2024-03-28T12:22:08.347 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ 2024-03-28T12:22:08.347 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 490441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/aesni-intel.ko 2024-03-28T12:22:08.347 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-28T12:22:08.347 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-28T12:22:08.347 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-28T12:22:08.347 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 93073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-28T12:22:08.347 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 106689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-28T12:22:08.348 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 152137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-28T12:22:08.348 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-28T12:22:08.348 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-28T12:22:08.348 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 83849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-28T12:22:08.348 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-28T12:22:08.348 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 47177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-28T12:22:08.348 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 47169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-28T12:22:08.348 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 51689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-28T12:22:08.348 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-28T12:22:08.348 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 42529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-28T12:22:08.348 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 58481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-28T12:22:08.349 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 50385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-28T12:22:08.349 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-28T12:22:08.349 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-28T12:22:08.349 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/ 2024-03-28T12:22:08.349 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/ 2024-03-28T12:22:08.349 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/ 2024-03-28T12:22:08.349 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 41425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-28T12:22:08.349 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpuid.ko 2024-03-28T12:22:08.349 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/msr.ko 2024-03-28T12:22:08.349 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/ 2024-03-28T12:22:08.349 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 354225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-28T12:22:08.350 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 886129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-28T12:22:08.350 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 2294793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-28T12:22:08.430 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ 2024-03-28T12:22:08.430 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 53833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/af_alg.ko 2024-03-28T12:22:08.430 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/algif_hash.ko 2024-03-28T12:22:08.430 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/algif_skcipher.ko 2024-03-28T12:22:08.430 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-28T12:22:08.430 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-28T12:22:08.430 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-28T12:22:08.430 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/asymmetric_keys/ 2024-03-28T12:22:08.430 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-03-28T12:22:08.430 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/ 2024-03-28T12:22:08.430 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-28T12:22:08.430 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-28T12:22:08.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-28T12:22:08.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-28T12:22:08.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-28T12:22:08.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-28T12:22:08.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-28T12:22:08.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-28T12:22:08.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-28T12:22:08.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-28T12:22:08.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-28T12:22:08.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 38705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-28T12:22:08.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-28T12:22:08.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-28T12:22:08.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-28T12:22:08.431 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 35177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-28T12:22:08.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-28T12:22:08.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-28T12:22:08.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 47673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cryptd.ko 2024-03-28T12:22:08.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-28T12:22:08.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_simd.ko 2024-03-28T12:22:08.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-28T12:22:08.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-28T12:22:08.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-28T12:22:08.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-28T12:22:08.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-28T12:22:08.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-28T12:22:08.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-28T12:22:08.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-28T12:22:08.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lrw.ko 2024-03-28T12:22:08.432 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-28T12:22:08.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-28T12:22:08.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-28T12:22:08.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-28T12:22:08.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-28T12:22:08.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-28T12:22:08.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-28T12:22:08.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-28T12:22:08.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-28T12:22:08.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 143025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-28T12:22:08.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-28T12:22:08.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-28T12:22:08.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-28T12:22:08.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-28T12:22:08.433 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-28T12:22:08.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-28T12:22:08.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-28T12:22:08.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xts.ko 2024-03-28T12:22:08.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-28T12:22:08.434 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ 2024-03-28T12:22:08.434 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ 2024-03-28T12:22:08.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_extlog.ko 2024-03-28T12:22:08.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-28T12:22:08.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-28T12:22:08.434 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/apei/ 2024-03-28T12:22:08.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/apei/einj.ko 2024-03-28T12:22:08.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-28T12:22:08.434 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-28T12:22:08.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-28T12:22:08.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-28T12:22:08.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 104417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-28T12:22:08.435 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ 2024-03-28T12:22:08.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-28T12:22:08.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 89929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci.ko 2024-03-28T12:22:08.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-28T12:22:08.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 88305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci.ko 2024-03-28T12:22:08.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-28T12:22:08.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-28T12:22:08.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-28T12:22:08.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-28T12:22:08.435 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-28T12:22:08.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-28T12:22:08.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-28T12:22:08.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-28T12:22:08.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-28T12:22:08.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-28T12:22:08.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-28T12:22:08.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-28T12:22:08.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-28T12:22:08.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-28T12:22:08.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-28T12:22:08.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-28T12:22:08.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 35169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-28T12:22:08.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-28T12:22:08.436 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 52169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_legacy.ko 2024-03-28T12:22:08.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-28T12:22:08.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-28T12:22:08.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-28T12:22:08.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-28T12:22:08.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-28T12:22:08.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-28T12:22:08.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-28T12:22:08.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-28T12:22:08.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-28T12:22:08.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 32481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-28T12:22:08.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 37689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-28T12:22:08.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-28T12:22:08.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-28T12:22:08.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_radisys.ko 2024-03-28T12:22:08.437 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-28T12:22:08.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rz1000.ko 2024-03-28T12:22:08.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-28T12:22:08.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-28T12:22:08.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-28T12:22:08.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-28T12:22:08.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-28T12:22:08.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-28T12:22:08.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-28T12:22:08.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-28T12:22:08.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 83249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-28T12:22:08.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 70297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-28T12:22:08.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 37273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-28T12:22:08.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-28T12:22:08.438 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-28T12:22:08.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 38169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-28T12:22:08.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-28T12:22:08.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-28T12:22:08.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 44697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-28T12:22:08.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-28T12:22:08.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-28T12:22:08.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-28T12:22:08.439 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ 2024-03-28T12:22:08.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-28T12:22:08.439 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/ 2024-03-28T12:22:08.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 124385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-28T12:22:08.439 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/ 2024-03-28T12:22:08.439 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/ 2024-03-28T12:22:08.439 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 113801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-28T12:22:08.439 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/ 2024-03-28T12:22:08.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 964745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-28T12:22:08.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 169697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-28T12:22:08.440 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/ 2024-03-28T12:22:08.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 94209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-28T12:22:08.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 116329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-28T12:22:08.440 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/ 2024-03-28T12:22:08.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 110321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-28T12:22:08.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 98185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-28T12:22:08.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 263633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-28T12:22:08.440 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/ 2024-03-28T12:22:08.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 98105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-28T12:22:08.440 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/ 2024-03-28T12:22:08.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 58761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-28T12:22:08.440 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ 2024-03-28T12:22:08.440 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/applicom.ko 2024-03-28T12:22:08.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-28T12:22:08.441 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/ 2024-03-28T12:22:08.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-28T12:22:08.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-28T12:22:08.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-28T12:22:08.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-28T12:22:08.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-28T12:22:08.441 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ 2024-03-28T12:22:08.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-28T12:22:08.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 148513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-28T12:22:08.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-28T12:22:08.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 139305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-28T12:22:08.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 70865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-28T12:22:08.441 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 53409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-28T12:22:08.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-28T12:22:08.442 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/ 2024-03-28T12:22:08.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 84001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-28T12:22:08.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/nvram.ko 2024-03-28T12:22:08.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 32073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-28T12:22:08.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 51017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-28T12:22:08.442 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/ 2024-03-28T12:22:08.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-28T12:22:08.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-03-28T12:22:08.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-03-28T12:22:08.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 32761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-03-28T12:22:08.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-28T12:22:08.442 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-28T12:22:08.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-03-28T12:22:08.443 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/xillybus/ 2024-03-28T12:22:08.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/xillybus/xillybus_class.ko 2024-03-28T12:22:08.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 50841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/xillybus/xillybus_core.ko 2024-03-28T12:22:08.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-03-28T12:22:08.443 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/clk/ 2024-03-28T12:22:08.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/clk/clk-palmas.ko 2024-03-28T12:22:08.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 47721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/clk/clk-si5351.ko 2024-03-28T12:22:08.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/clk/clk-twl6040.ko 2024-03-28T12:22:08.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/clk/clk-wm831x.ko 2024-03-28T12:22:08.443 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/ 2024-03-28T12:22:08.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-28T12:22:08.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-28T12:22:08.443 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-28T12:22:08.444 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ 2024-03-28T12:22:08.444 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ 2024-03-28T12:22:08.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 70425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-28T12:22:08.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 246777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-28T12:22:08.444 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/ 2024-03-28T12:22:08.444 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/ 2024-03-28T12:22:08.444 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/ 2024-03-28T12:22:08.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 570217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-28T12:22:08.444 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-03-28T12:22:08.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-28T12:22:08.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-28T12:22:08.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-28T12:22:08.444 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/ 2024-03-28T12:22:08.444 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 70409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-28T12:22:08.444 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/ 2024-03-28T12:22:08.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-28T12:22:08.445 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ 2024-03-28T12:22:08.445 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/ 2024-03-28T12:22:08.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-28T12:22:08.445 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ 2024-03-28T12:22:08.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 122793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-28T12:22:08.445 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ 2024-03-28T12:22:08.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 80297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-28T12:22:08.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 35665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-28T12:22:08.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 41633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-28T12:22:08.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-28T12:22:08.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-28T12:22:08.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-28T12:22:08.445 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-28T12:22:08.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-28T12:22:08.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 51937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-28T12:22:08.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-28T12:22:08.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-28T12:22:08.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 56729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-28T12:22:08.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-28T12:22:08.446 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/ 2024-03-28T12:22:08.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-gpio.ko 2024-03-28T12:22:08.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-max14577.ko 2024-03-28T12:22:08.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-max77693.ko 2024-03-28T12:22:08.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-max8997.ko 2024-03-28T12:22:08.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-palmas.ko 2024-03-28T12:22:08.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-rt8973a.ko 2024-03-28T12:22:08.446 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-sm5502.ko 2024-03-28T12:22:08.447 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/ 2024-03-28T12:22:08.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/dmi-sysfs.ko 2024-03-28T12:22:08.447 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/efi/ 2024-03-28T12:22:08.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/efi/efi-pstore.ko 2024-03-28T12:22:08.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-28T12:22:08.447 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/ 2024-03-28T12:22:08.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-adp5520.ko 2024-03-28T12:22:08.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-amd8111.ko 2024-03-28T12:22:08.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-arizona.ko 2024-03-28T12:22:08.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-da9052.ko 2024-03-28T12:22:08.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-da9055.ko 2024-03-28T12:22:08.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-dln2.ko 2024-03-28T12:22:08.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 77745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-f7188x.ko 2024-03-28T12:22:08.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-generic.ko 2024-03-28T12:22:08.447 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-28T12:22:08.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-03-28T12:22:08.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-kempld.ko 2024-03-28T12:22:08.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-lp3943.ko 2024-03-28T12:22:08.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-max7300.ko 2024-03-28T12:22:08.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-max730x.ko 2024-03-28T12:22:08.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-max732x.ko 2024-03-28T12:22:08.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-03-28T12:22:08.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 47441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-pca953x.ko 2024-03-28T12:22:08.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-pcf857x.ko 2024-03-28T12:22:08.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-rdc321x.ko 2024-03-28T12:22:08.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-sch.ko 2024-03-28T12:22:08.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-sch311x.ko 2024-03-28T12:22:08.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-tps65912.ko 2024-03-28T12:22:08.448 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-twl4030.ko 2024-03-28T12:22:08.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-twl6040.ko 2024-03-28T12:22:08.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-28T12:22:08.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-vx855.ko 2024-03-28T12:22:08.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-wm831x.ko 2024-03-28T12:22:08.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-wm8350.ko 2024-03-28T12:22:08.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-wm8994.ko 2024-03-28T12:22:08.449 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/ 2024-03-28T12:22:08.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-a4tech.ko 2024-03-28T12:22:08.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-apple.ko 2024-03-28T12:22:08.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-28T12:22:08.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-28T12:22:08.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-28T12:22:08.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-belkin.ko 2024-03-28T12:22:08.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-cherry.ko 2024-03-28T12:22:08.449 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-chicony.ko 2024-03-28T12:22:08.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 60657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-cp2112.ko 2024-03-28T12:22:08.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-cypress.ko 2024-03-28T12:22:08.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-28T12:22:08.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-28T12:22:08.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-28T12:22:08.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-28T12:22:08.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ezkey.ko 2024-03-28T12:22:08.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-28T12:22:08.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-generic.ko 2024-03-28T12:22:08.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-28T12:22:08.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-28T12:22:08.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-28T12:22:08.450 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-28T12:22:08.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-28T12:22:08.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-28T12:22:08.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-28T12:22:08.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kensington.ko 2024-03-28T12:22:08.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-28T12:22:08.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-28T12:22:08.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-28T12:22:08.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-28T12:22:08.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 42841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-28T12:22:08.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lg-g15.ko 2024-03-28T12:22:08.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 57969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-28T12:22:08.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 101537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-28T12:22:08.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 80897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech.ko 2024-03-28T12:22:08.451 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-magicmouse.ko 2024-03-28T12:22:08.452 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-microsoft.ko 2024-03-28T12:22:08.452 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-monterey.ko 2024-03-28T12:22:08.452 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 50273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-28T12:22:08.452 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 32489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ntrig.ko 2024-03-28T12:22:08.452 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-28T12:22:08.452 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-28T12:22:08.452 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-28T12:22:08.452 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 72841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-28T12:22:08.452 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-28T12:22:08.452 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-28T12:22:08.452 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-28T12:22:08.452 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 35521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-28T12:22:08.452 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-28T12:22:08.452 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-28T12:22:08.453 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-28T12:22:08.453 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-28T12:22:08.453 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-28T12:22:08.453 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-28T12:22:08.453 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-28T12:22:08.453 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-28T12:22:08.453 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-28T12:22:08.453 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-28T12:22:08.453 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-28T12:22:08.453 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-28T12:22:08.453 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-28T12:22:08.453 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-28T12:22:08.453 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-28T12:22:08.453 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-28T12:22:08.454 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 51153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-28T12:22:08.454 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-28T12:22:08.454 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-28T12:22:08.454 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-28T12:22:08.454 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-28T12:22:08.454 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-28T12:22:08.454 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-28T12:22:08.454 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-28T12:22:08.454 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-28T12:22:08.454 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 70977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-28T12:22:08.454 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-28T12:22:08.454 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 143377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-28T12:22:08.454 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-28T12:22:08.454 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-28T12:22:08.455 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-28T12:22:08.455 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 269209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid.ko 2024-03-28T12:22:08.455 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 32225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-28T12:22:08.455 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/usbhid/ 2024-03-28T12:22:08.455 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 125625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/usbhid/usbhid.ko 2024-03-28T12:22:08.455 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/usbhid/usbkbd.ko 2024-03-28T12:22:08.455 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/usbhid/usbmouse.ko 2024-03-28T12:22:08.455 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 218865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-28T12:22:08.455 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/ 2024-03-28T12:22:08.455 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 64297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-28T12:22:08.455 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 90089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-28T12:22:08.455 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 304913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-28T12:22:08.455 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ 2024-03-28T12:22:08.456 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 66793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-28T12:22:08.456 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 61809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-28T12:22:08.456 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-28T12:22:08.456 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-28T12:22:08.456 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-28T12:22:08.456 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-28T12:22:08.456 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-28T12:22:08.456 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 97881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-28T12:22:08.456 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-28T12:22:08.456 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 45457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-28T12:22:08.456 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-28T12:22:08.456 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-28T12:22:08.456 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-28T12:22:08.456 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-28T12:22:08.456 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 74313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-28T12:22:08.457 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-28T12:22:08.457 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 69305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-28T12:22:08.457 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-28T12:22:08.457 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 38977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-28T12:22:08.457 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 55105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-28T12:22:08.457 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 49817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-28T12:22:08.457 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 58521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-28T12:22:08.457 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 40721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-28T12:22:08.457 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-28T12:22:08.457 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-28T12:22:08.457 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/da9052-hwmon.ko 2024-03-28T12:22:08.457 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/da9055-hwmon.ko 2024-03-28T12:22:08.457 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 49233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-28T12:22:08.457 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 99505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-28T12:22:08.458 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-28T12:22:08.458 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-28T12:22:08.458 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-28T12:22:08.458 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc2103.ko 2024-03-28T12:22:08.458 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-28T12:22:08.458 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 66889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-28T12:22:08.458 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 94593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-28T12:22:08.458 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 41305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-28T12:22:08.458 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-28T12:22:08.458 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 55353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-28T12:22:08.458 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-28T12:22:08.458 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-28T12:22:08.458 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 46705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-28T12:22:08.458 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 45433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-28T12:22:08.459 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hih6130.ko 2024-03-28T12:22:08.459 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-28T12:22:08.459 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-28T12:22:08.459 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-28T12:22:08.459 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-28T12:22:08.459 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-28T12:22:08.459 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-28T12:22:08.459 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-28T12:22:08.459 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 140129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-28T12:22:08.459 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/jc42.ko 2024-03-28T12:22:08.459 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-28T12:22:08.459 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-28T12:22:08.459 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-28T12:22:08.459 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 48505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-28T12:22:08.459 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-28T12:22:08.460 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 38841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-28T12:22:08.460 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-28T12:22:08.460 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-28T12:22:08.460 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-28T12:22:08.460 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-28T12:22:08.460 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 72737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-28T12:22:08.460 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 46057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-28T12:22:08.460 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 37817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-28T12:22:08.460 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-28T12:22:08.460 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 108745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-28T12:22:08.460 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-28T12:22:08.460 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-28T12:22:08.460 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-28T12:22:08.460 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-28T12:22:08.460 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-28T12:22:08.461 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-28T12:22:08.461 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-28T12:22:08.461 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-28T12:22:08.461 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-28T12:22:08.461 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-28T12:22:08.461 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-28T12:22:08.461 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-28T12:22:08.461 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-28T12:22:08.461 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-28T12:22:08.461 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-28T12:22:08.461 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-28T12:22:08.461 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 35681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-28T12:22:08.461 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mc13783-adc.ko 2024-03-28T12:22:08.461 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-28T12:22:08.461 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-03-28T12:22:08.461 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 47785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-28T12:22:08.462 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 119841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-28T12:22:08.462 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 61433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-28T12:22:08.462 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 59641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-28T12:22:08.462 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 82713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-28T12:22:08.462 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 54337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-28T12:22:08.462 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-28T12:22:08.462 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ 2024-03-28T12:22:08.462 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-28T12:22:08.462 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-28T12:22:08.462 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-28T12:22:08.462 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-28T12:22:08.462 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-28T12:22:08.462 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-28T12:22:08.462 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-28T12:22:08.462 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 82473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-28T12:22:08.463 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-28T12:22:08.463 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-28T12:22:08.463 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-28T12:22:08.463 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-28T12:22:08.463 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-28T12:22:08.463 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-28T12:22:08.463 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-28T12:22:08.463 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-28T12:22:08.463 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 32041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-28T12:22:08.463 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-28T12:22:08.463 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-28T12:22:08.463 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 40481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-28T12:22:08.463 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-28T12:22:08.463 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 40353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-28T12:22:08.463 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 37281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-28T12:22:08.464 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-28T12:22:08.464 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-28T12:22:08.464 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-28T12:22:08.464 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-28T12:22:08.464 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-28T12:22:08.464 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-28T12:22:08.464 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 43441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-28T12:22:08.464 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 52361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-28T12:22:08.464 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 53201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-28T12:22:08.464 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 58257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-28T12:22:08.464 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 79833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-28T12:22:08.464 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 71249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-28T12:22:08.464 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 63129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-28T12:22:08.464 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 71225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-28T12:22:08.464 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 101377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-28T12:22:08.464 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 119409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-28T12:22:08.465 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-28T12:22:08.465 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 35521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-28T12:22:08.465 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-03-28T12:22:08.465 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-03-28T12:22:08.465 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/ 2024-03-28T12:22:08.465 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/ 2024-03-28T12:22:08.465 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-28T12:22:08.465 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-28T12:22:08.465 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/ 2024-03-28T12:22:08.465 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-03-28T12:22:08.465 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 32473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-03-28T12:22:08.465 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-03-28T12:22:08.465 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-28T12:22:08.465 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-28T12:22:08.465 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-28T12:22:08.466 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-03-28T12:22:08.466 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 6825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-28T12:22:08.466 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-03-28T12:22:08.466 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 50289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-28T12:22:08.466 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-28T12:22:08.466 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-28T12:22:08.466 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-28T12:22:08.466 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-03-28T12:22:08.466 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-03-28T12:22:08.466 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 67681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-28T12:22:08.466 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-28T12:22:08.466 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 47793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-28T12:22:08.466 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-03-28T12:22:08.466 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-28T12:22:08.466 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-28T12:22:08.467 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-03-28T12:22:08.467 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-28T12:22:08.467 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-28T12:22:08.467 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 50969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-28T12:22:08.467 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-03-28T12:22:08.467 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-28T12:22:08.467 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-28T12:22:08.467 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-03-28T12:22:08.467 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-03-28T12:22:08.467 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-28T12:22:08.467 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-03-28T12:22:08.467 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-28T12:22:08.467 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-28T12:22:08.467 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-28T12:22:08.467 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-28T12:22:08.467 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 47561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-03-28T12:22:08.468 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-28T12:22:08.468 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-28T12:22:08.468 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-28T12:22:08.468 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/muxes/ 2024-03-28T12:22:08.468 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-03-28T12:22:08.468 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-03-28T12:22:08.468 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-03-28T12:22:08.468 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ 2024-03-28T12:22:08.468 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ 2024-03-28T12:22:08.468 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 273513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-28T12:22:08.468 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 883777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-28T12:22:08.468 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 69177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-28T12:22:08.468 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 324233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-28T12:22:08.468 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 97825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-28T12:22:08.468 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 282329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-28T12:22:08.468 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 66049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-28T12:22:08.469 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/ 2024-03-28T12:22:08.469 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/ 2024-03-28T12:22:08.469 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 493129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-28T12:22:08.469 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/ 2024-03-28T12:22:08.469 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 420529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-28T12:22:08.469 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/ 2024-03-28T12:22:08.469 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 741609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-28T12:22:08.469 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ 2024-03-28T12:22:08.469 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 296785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-28T12:22:08.469 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/ocrdma/ 2024-03-28T12:22:08.469 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 153705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-03-28T12:22:08.469 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/usnic/ 2024-03-28T12:22:08.469 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 169089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-03-28T12:22:08.469 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ 2024-03-28T12:22:08.469 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ 2024-03-28T12:22:08.470 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 266529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-28T12:22:08.470 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ 2024-03-28T12:22:08.470 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 100257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-28T12:22:08.470 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ 2024-03-28T12:22:08.470 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 111329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-28T12:22:08.470 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ 2024-03-28T12:22:08.470 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 128657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-28T12:22:08.470 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ 2024-03-28T12:22:08.470 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 129793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-28T12:22:08.470 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/ 2024-03-28T12:22:08.470 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/evbug.ko 2024-03-28T12:22:08.470 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/ff-memless.ko 2024-03-28T12:22:08.470 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/ 2024-03-28T12:22:08.470 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-28T12:22:08.471 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-28T12:22:08.471 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 41449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-28T12:22:08.471 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 41705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-28T12:22:08.471 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/ 2024-03-28T12:22:08.471 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-03-28T12:22:08.471 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-03-28T12:22:08.471 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-03-28T12:22:08.471 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-03-28T12:22:08.471 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 37273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-28T12:22:08.471 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-03-28T12:22:08.471 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/lkkbd.ko 2024-03-28T12:22:08.471 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/lm8323.ko 2024-03-28T12:22:08.471 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/lm8333.ko 2024-03-28T12:22:08.472 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-03-28T12:22:08.472 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-03-28T12:22:08.472 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-03-28T12:22:08.472 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-03-28T12:22:08.472 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/newtonkbd.ko 2024-03-28T12:22:08.472 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-03-28T12:22:08.472 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/qt1070.ko 2024-03-28T12:22:08.472 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/qt2160.ko 2024-03-28T12:22:08.472 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-03-28T12:22:08.472 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/stowaway.ko 2024-03-28T12:22:08.472 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/sunkbd.ko 2024-03-28T12:22:08.472 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-03-28T12:22:08.472 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-03-28T12:22:08.472 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-03-28T12:22:08.472 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/xtkbd.ko 2024-03-28T12:22:08.473 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/matrix-keymap.ko 2024-03-28T12:22:08.473 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/ 2024-03-28T12:22:08.473 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-28T12:22:08.473 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-28T12:22:08.473 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 123177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-28T12:22:08.473 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 89377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-28T12:22:08.473 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/gpio_mouse.ko 2024-03-28T12:22:08.473 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 335857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/psmouse.ko 2024-03-28T12:22:08.473 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-28T12:22:08.473 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-28T12:22:08.473 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-28T12:22:08.473 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-28T12:22:08.473 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/ 2024-03-28T12:22:08.473 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 109553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-28T12:22:08.474 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/ 2024-03-28T12:22:08.474 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-28T12:22:08.474 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-28T12:22:08.474 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/ct82c710.ko 2024-03-28T12:22:08.474 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-28T12:22:08.474 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/parkbd.ko 2024-03-28T12:22:08.474 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/pcips2.ko 2024-03-28T12:22:08.474 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/ps2mult.ko 2024-03-28T12:22:08.474 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-28T12:22:08.474 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serport.ko 2024-03-28T12:22:08.474 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-28T12:22:08.474 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/ 2024-03-28T12:22:08.474 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-88pm860x.ko 2024-03-28T12:22:08.474 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-adp5520.ko 2024-03-28T12:22:08.475 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 59649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-bd2802.ko 2024-03-28T12:22:08.475 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-28T12:22:08.475 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-da903x.ko 2024-03-28T12:22:08.475 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-da9052.ko 2024-03-28T12:22:08.475 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-gpio.ko 2024-03-28T12:22:08.475 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-28T12:22:08.475 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3533.ko 2024-03-28T12:22:08.475 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm355x.ko 2024-03-28T12:22:08.475 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3642.ko 2024-03-28T12:22:08.475 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-28T12:22:08.475 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp8788.ko 2024-03-28T12:22:08.475 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-max8997.ko 2024-03-28T12:22:08.475 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-mc13783.ko 2024-03-28T12:22:08.475 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-menf21bmc.ko 2024-03-28T12:22:08.476 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-pca9532.ko 2024-03-28T12:22:08.476 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-pca955x.ko 2024-03-28T12:22:08.476 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-pca963x.ko 2024-03-28T12:22:08.476 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-28T12:22:08.476 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-tca6507.ko 2024-03-28T12:22:08.476 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-wm831x-status.ko 2024-03-28T12:22:08.476 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-wm8350.ko 2024-03-28T12:22:08.476 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ 2024-03-28T12:22:08.476 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-28T12:22:08.476 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-28T12:22:08.476 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-28T12:22:08.476 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-28T12:22:08.476 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-28T12:22:08.476 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-28T12:22:08.476 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-28T12:22:08.476 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-28T12:22:08.477 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-28T12:22:08.477 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/ 2024-03-28T12:22:08.477 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/ 2024-03-28T12:22:08.477 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 647033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-28T12:22:08.477 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 40473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-28T12:22:08.477 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 93313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bufio.ko 2024-03-28T12:22:08.477 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 47433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-28T12:22:08.477 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 155801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-28T12:22:08.477 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 107929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-28T12:22:08.477 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-28T12:22:08.477 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 53761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-era.ko 2024-03-28T12:22:08.477 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-28T12:22:08.477 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 41425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-28T12:22:08.477 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 32641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log.ko 2024-03-28T12:22:08.477 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 49441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-mirror.ko 2024-03-28T12:22:08.477 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 77865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-28T12:22:08.478 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-28T12:22:08.478 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 70977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-28T12:22:08.478 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-region-hash.ko 2024-03-28T12:22:08.478 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-28T12:22:08.478 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-28T12:22:08.478 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 109433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-snapshot.ko 2024-03-28T12:22:08.478 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-28T12:22:08.478 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 181761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-28T12:22:08.478 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 53729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-28T12:22:08.478 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-zero.ko 2024-03-28T12:22:08.478 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/ 2024-03-28T12:22:08.478 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 199825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-28T12:22:08.478 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 37313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-28T12:22:08.478 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 100833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-28T12:22:08.478 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 126361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-28T12:22:08.479 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 368481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-28T12:22:08.479 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/ 2024-03-28T12:22:08.479 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/ 2024-03-28T12:22:08.479 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 178041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-28T12:22:08.479 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 63233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-28T12:22:08.479 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 46241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-28T12:22:08.479 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 37113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-28T12:22:08.479 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 123225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-28T12:22:08.479 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 80913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-28T12:22:08.479 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 52857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-28T12:22:08.479 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/ 2024-03-28T12:22:08.479 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/88pm800.ko 2024-03-28T12:22:08.479 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/88pm805.ko 2024-03-28T12:22:08.479 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/88pm80x.ko 2024-03-28T12:22:08.479 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/arizona-i2c.ko 2024-03-28T12:22:08.479 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 123625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/arizona.ko 2024-03-28T12:22:08.480 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/bcm590xx.ko 2024-03-28T12:22:08.480 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/cros_ec_dev.ko 2024-03-28T12:22:08.480 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/dln2.ko 2024-03-28T12:22:08.480 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/janz-cmodio.ko 2024-03-28T12:22:08.480 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 53481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/kempld-core.ko 2024-03-28T12:22:08.480 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lm3533-core.ko 2024-03-28T12:22:08.480 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-03-28T12:22:08.480 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lp3943.ko 2024-03-28T12:22:08.480 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 56961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-28T12:22:08.480 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-28T12:22:08.480 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/max8907.ko 2024-03-28T12:22:08.480 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mc13xxx-core.ko 2024-03-28T12:22:08.480 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-03-28T12:22:08.480 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/menf21bmc.ko 2024-03-28T12:22:08.480 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/pcf50633-adc.ko 2024-03-28T12:22:08.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/pcf50633-gpio.ko 2024-03-28T12:22:08.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/pcf50633.ko 2024-03-28T12:22:08.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-03-28T12:22:08.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/retu-mfd.ko 2024-03-28T12:22:08.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 80329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/si476x-core.ko 2024-03-28T12:22:08.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 48361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-28T12:22:08.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 51201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/tps65010.ko 2024-03-28T12:22:08.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/tps6507x.ko 2024-03-28T12:22:08.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-28T12:22:08.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-28T12:22:08.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-28T12:22:08.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 44249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wm8994.ko 2024-03-28T12:22:08.481 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ 2024-03-28T12:22:08.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-03-28T12:22:08.481 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 48385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ad525x_dpot.ko 2024-03-28T12:22:08.481 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/ 2024-03-28T12:22:08.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 46489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-28T12:22:08.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-28T12:22:08.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-28T12:22:08.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 45489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-28T12:22:08.482 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/c2port/ 2024-03-28T12:22:08.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-03-28T12:22:08.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 35489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/c2port/core.ko 2024-03-28T12:22:08.482 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/ 2024-03-28T12:22:08.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-28T12:22:08.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ds1682.ko 2024-03-28T12:22:08.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/dummy-irq.ko 2024-03-28T12:22:08.482 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/echo/ 2024-03-28T12:22:08.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/echo/echo.ko 2024-03-28T12:22:08.482 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/ 2024-03-28T12:22:08.482 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-28T12:22:08.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-28T12:22:08.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-28T12:22:08.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 32905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-28T12:22:08.483 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/genwqe/ 2024-03-28T12:22:08.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 152041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-03-28T12:22:08.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hmc6352.ko 2024-03-28T12:22:08.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-28T12:22:08.483 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ibmasm/ 2024-03-28T12:22:08.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 72505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-03-28T12:22:08.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ics932s401.ko 2024-03-28T12:22:08.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-28T12:22:08.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-28T12:22:08.483 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/ 2024-03-28T12:22:08.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 42409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-28T12:22:08.483 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-28T12:22:08.483 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/ 2024-03-28T12:22:08.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 126137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-28T12:22:08.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 56361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-28T12:22:08.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 313545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-28T12:22:08.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/phantom.ko 2024-03-28T12:22:08.484 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ti-st/ 2024-03-28T12:22:08.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 74289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ti-st/st_drv.ko 2024-03-28T12:22:08.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-28T12:22:08.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-28T12:22:08.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-28T12:22:08.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 48337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-28T12:22:08.484 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/ 2024-03-28T12:22:08.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 183513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-28T12:22:08.484 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ 2024-03-28T12:22:08.484 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/ 2024-03-28T12:22:08.484 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 491561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-28T12:22:08.485 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/ 2024-03-28T12:22:08.485 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/ 2024-03-28T12:22:08.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 105929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-28T12:22:08.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 40209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-28T12:22:08.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-28T12:22:08.485 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/ 2024-03-28T12:22:08.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 458905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-28T12:22:08.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-28T12:22:08.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-28T12:22:08.485 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ 2024-03-28T12:22:08.485 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/ 2024-03-28T12:22:08.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 45953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-28T12:22:08.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 42185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-28T12:22:08.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 130657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-28T12:22:08.485 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 68777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-28T12:22:08.485 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ 2024-03-28T12:22:08.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 38041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-28T12:22:08.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 64609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-28T12:22:08.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-28T12:22:08.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 101609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-28T12:22:08.486 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/ 2024-03-28T12:22:08.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 54617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-28T12:22:08.486 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/ 2024-03-28T12:22:08.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 69161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-28T12:22:08.486 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/ 2024-03-28T12:22:08.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 59985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-28T12:22:08.486 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/ 2024-03-28T12:22:08.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 41385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-28T12:22:08.486 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/ 2024-03-28T12:22:08.486 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 54609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-28T12:22:08.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 49185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-28T12:22:08.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 87449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-28T12:22:08.487 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/ 2024-03-28T12:22:08.487 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/ 2024-03-28T12:22:08.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 97185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-28T12:22:08.487 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-03-28T12:22:08.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 102481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-28T12:22:08.487 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-03-28T12:22:08.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 90185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-28T12:22:08.487 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/ 2024-03-28T12:22:08.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 81313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-28T12:22:08.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 69537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-28T12:22:08.487 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/ 2024-03-28T12:22:08.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 78377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-28T12:22:08.487 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 176689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-28T12:22:08.487 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-03-28T12:22:08.488 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 1434449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-28T12:22:08.488 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 128361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-28T12:22:08.488 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/ 2024-03-28T12:22:08.488 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 131265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-28T12:22:08.488 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 314321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-28T12:22:08.488 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/ 2024-03-28T12:22:08.488 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/ 2024-03-28T12:22:08.488 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 323681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-28T12:22:08.488 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/ 2024-03-28T12:22:08.488 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-03-28T12:22:08.488 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 193537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-28T12:22:08.488 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-03-28T12:22:08.488 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 347161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-28T12:22:08.488 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-03-28T12:22:08.488 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 1045321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-28T12:22:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-03-28T12:22:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 166129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-28T12:22:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-03-28T12:22:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-28T12:22:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/ 2024-03-28T12:22:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/ 2024-03-28T12:22:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 204185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-28T12:22:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/ 2024-03-28T12:22:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/ 2024-03-28T12:22:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 69425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-28T12:22:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 61417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-28T12:22:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 141153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-28T12:22:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 51361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-28T12:22:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 62825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-28T12:22:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-28T12:22:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/ 2024-03-28T12:22:08.489 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 60665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-28T12:22:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 62825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-28T12:22:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 45481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-28T12:22:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ec_bhf.ko 2024-03-28T12:22:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/ 2024-03-28T12:22:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/ 2024-03-28T12:22:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 281193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-28T12:22:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 49449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-28T12:22:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 51777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-28T12:22:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fujitsu/ 2024-03-28T12:22:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 45545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-03-28T12:22:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ 2024-03-28T12:22:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 90297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-28T12:22:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/ 2024-03-28T12:22:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 295673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-28T12:22:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/ 2024-03-28T12:22:08.490 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 584297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-28T12:22:08.551 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/ 2024-03-28T12:22:08.551 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 245977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-28T12:22:08.551 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/ 2024-03-28T12:22:08.551 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 944449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-28T12:22:08.551 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/ 2024-03-28T12:22:08.552 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 288481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-28T12:22:08.552 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/ 2024-03-28T12:22:08.552 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 514337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-28T12:22:08.552 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/ 2024-03-28T12:22:08.552 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 93465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-28T12:22:08.552 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-03-28T12:22:08.552 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 735129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-28T12:22:08.552 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-03-28T12:22:08.552 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 151649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-28T12:22:08.552 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 86985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-28T12:22:08.552 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/ 2024-03-28T12:22:08.552 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-28T12:22:08.552 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 102433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-28T12:22:08.552 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 122601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-28T12:22:08.552 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/ 2024-03-28T12:22:08.552 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-03-28T12:22:08.552 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 727377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-28T12:22:08.553 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 278825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-28T12:22:08.553 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-03-28T12:22:08.553 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-03-28T12:22:08.553 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 1122065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-28T12:22:08.553 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ 2024-03-28T12:22:08.553 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 52977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-03-28T12:22:08.553 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 40873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-03-28T12:22:08.553 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-03-28T12:22:08.553 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 95569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-28T12:22:08.553 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/ 2024-03-28T12:22:08.553 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-03-28T12:22:08.553 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 108401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-28T12:22:08.553 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ 2024-03-28T12:22:08.553 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 73609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-28T12:22:08.553 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 47793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-28T12:22:08.553 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/ 2024-03-28T12:22:08.553 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 151193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-28T12:22:08.554 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/ 2024-03-28T12:22:08.554 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 136793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-28T12:22:08.554 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/ 2024-03-28T12:22:08.554 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 50425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-28T12:22:08.554 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 42977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-28T12:22:08.554 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/ 2024-03-28T12:22:08.554 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-03-28T12:22:08.554 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 227841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-28T12:22:08.554 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 87009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-28T12:22:08.554 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-03-28T12:22:08.554 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 671985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-28T12:22:08.554 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/ 2024-03-28T12:22:08.554 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 42929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-28T12:22:08.554 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/ 2024-03-28T12:22:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 67273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-28T12:22:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 83801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-28T12:22:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-28T12:22:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 194057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-28T12:22:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/samsung/ 2024-03-28T12:22:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-03-28T12:22:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 104001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-03-28T12:22:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/ 2024-03-28T12:22:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 1066817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-28T12:22:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/ 2024-03-28T12:22:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 47001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-28T12:22:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/ 2024-03-28T12:22:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 54721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-28T12:22:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 63193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-28T12:22:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/ 2024-03-28T12:22:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 61417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-28T12:22:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 67289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-28T12:22:08.556 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 73249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-28T12:22:08.556 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 68041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-28T12:22:08.556 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/ 2024-03-28T12:22:08.556 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-03-28T12:22:08.556 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-03-28T12:22:08.556 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-28T12:22:08.556 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-03-28T12:22:08.556 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 495641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-28T12:22:08.556 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/ 2024-03-28T12:22:08.556 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 103177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-28T12:22:08.556 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 166041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-28T12:22:08.556 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 66265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-28T12:22:08.556 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 78713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-28T12:22:08.556 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/ 2024-03-28T12:22:08.557 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 50009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-28T12:22:08.557 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/ 2024-03-28T12:22:08.557 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 92337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-28T12:22:08.557 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/ 2024-03-28T12:22:08.557 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 79929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-28T12:22:08.557 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 83713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-28T12:22:08.557 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/ 2024-03-28T12:22:08.557 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 46305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-28T12:22:08.557 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-28T12:22:08.557 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/ 2024-03-28T12:22:08.557 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 59977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-28T12:22:08.557 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/fddi/ 2024-03-28T12:22:08.557 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 41177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/fddi/defxx.ko 2024-03-28T12:22:08.557 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/fddi/skfp/ 2024-03-28T12:22:08.557 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 217025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/fddi/skfp/skfp.ko 2024-03-28T12:22:08.558 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 74985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-28T12:22:08.558 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/ 2024-03-28T12:22:08.558 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 237241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-28T12:22:08.558 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/ 2024-03-28T12:22:08.558 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-28T12:22:08.558 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-28T12:22:08.558 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ 2024-03-28T12:22:08.558 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 85841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-28T12:22:08.558 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 62889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-28T12:22:08.558 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-28T12:22:08.558 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/ 2024-03-28T12:22:08.558 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-28T12:22:08.558 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-28T12:22:08.558 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-gpio.ko 2024-03-28T12:22:08.559 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-28T12:22:08.559 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-28T12:22:08.559 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-28T12:22:08.559 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 45049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-28T12:22:08.559 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-28T12:22:08.559 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/ 2024-03-28T12:22:08.559 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-28T12:22:08.559 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-28T12:22:08.559 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ 2024-03-28T12:22:08.559 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-28T12:22:08.559 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 49929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-28T12:22:08.559 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 44625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-28T12:22:08.559 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-28T12:22:08.559 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 44817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-28T12:22:08.559 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-28T12:22:08.559 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-28T12:22:08.559 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-28T12:22:08.560 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-28T12:22:08.560 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-28T12:22:08.560 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 81953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-28T12:22:08.560 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 76561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-28T12:22:08.560 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-28T12:22:08.560 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 99001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-28T12:22:08.560 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-28T12:22:08.560 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 49969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-28T12:22:08.560 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-28T12:22:08.560 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-28T12:22:08.560 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-28T12:22:08.560 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/plip/ 2024-03-28T12:22:08.560 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 43761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/plip/plip.ko 2024-03-28T12:22:08.560 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ 2024-03-28T12:22:08.560 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-28T12:22:08.560 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-28T12:22:08.561 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-28T12:22:08.561 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-28T12:22:08.561 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-28T12:22:08.561 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 42665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-28T12:22:08.561 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-28T12:22:08.561 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 32665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-28T12:22:08.561 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sb1000.ko 2024-03-28T12:22:08.561 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/ 2024-03-28T12:22:08.561 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 42385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-28T12:22:08.561 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-28T12:22:08.561 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 64553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-28T12:22:08.561 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/ 2024-03-28T12:22:08.561 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 107225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-28T12:22:08.561 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-28T12:22:08.561 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-28T12:22:08.561 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-28T12:22:08.561 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-28T12:22:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-28T12:22:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 86817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-28T12:22:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/ 2024-03-28T12:22:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 144345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-28T12:22:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/ 2024-03-28T12:22:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 307169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-28T12:22:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/ 2024-03-28T12:22:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 143993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-28T12:22:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ 2024-03-28T12:22:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-28T12:22:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/ 2024-03-28T12:22:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/ 2024-03-28T12:22:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 267721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-28T12:22:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 103353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-28T12:22:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/ 2024-03-28T12:22:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 131297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-28T12:22:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-28T12:22:08.563 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 85209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-28T12:22:08.563 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-28T12:22:08.563 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/ 2024-03-28T12:22:08.563 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/ 2024-03-28T12:22:08.563 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-28T12:22:08.563 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-03-28T12:22:08.563 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-03-28T12:22:08.563 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pci-stub.ko 2024-03-28T12:22:08.563 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 46361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-28T12:22:08.563 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/ 2024-03-28T12:22:08.563 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-28T12:22:08.563 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 146129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pcmcia.ko 2024-03-28T12:22:08.563 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 62065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pcmcia_core.ko 2024-03-28T12:22:08.563 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-03-28T12:22:08.563 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-28T12:22:08.563 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 112785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-28T12:22:08.563 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/phy/ 2024-03-28T12:22:08.564 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/phy/broadcom/ 2024-03-28T12:22:08.564 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-03-28T12:22:08.564 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/phy/samsung/ 2024-03-28T12:22:08.564 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-03-28T12:22:08.564 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/ 2024-03-28T12:22:08.564 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/ 2024-03-28T12:22:08.564 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 69025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-28T12:22:08.564 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/ 2024-03-28T12:22:08.564 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/ 2024-03-28T12:22:08.564 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 51217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-03-28T12:22:08.564 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_ec.ko 2024-03-28T12:22:08.564 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-03-28T12:22:08.564 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-03-28T12:22:08.564 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-03-28T12:22:08.564 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-03-28T12:22:08.564 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-03-28T12:22:08.564 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/ 2024-03-28T12:22:08.565 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 73593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-28T12:22:08.565 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-28T12:22:08.565 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-28T12:22:08.565 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 59561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-28T12:22:08.565 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-28T12:22:08.565 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 131937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-28T12:22:08.565 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-28T12:22:08.565 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 49017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-28T12:22:08.565 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-28T12:22:08.565 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 40161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-28T12:22:08.565 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-28T12:22:08.565 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-28T12:22:08.565 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/ibm_rtl.ko 2024-03-28T12:22:08.565 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/ 2024-03-28T12:22:08.565 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-28T12:22:08.565 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-03-28T12:22:08.565 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 44529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-28T12:22:08.566 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-28T12:22:08.566 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-28T12:22:08.566 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-28T12:22:08.566 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 42225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-28T12:22:08.566 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-28T12:22:08.566 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-28T12:22:08.566 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-28T12:22:08.566 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-28T12:22:08.566 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-28T12:22:08.566 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 48473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-28T12:22:08.566 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/ 2024-03-28T12:22:08.566 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/ 2024-03-28T12:22:08.566 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/88pm860x_battery.ko 2024-03-28T12:22:08.566 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/88pm860x_charger.ko 2024-03-28T12:22:08.566 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 54953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/bq2415x_charger.ko 2024-03-28T12:22:08.566 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 59497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/bq24190_charger.ko 2024-03-28T12:22:08.567 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/bq24735-charger.ko 2024-03-28T12:22:08.567 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-03-28T12:22:08.567 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/da9030_battery.ko 2024-03-28T12:22:08.567 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/da9052-battery.ko 2024-03-28T12:22:08.567 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/ds2760_battery.ko 2024-03-28T12:22:08.567 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/ds2780_battery.ko 2024-03-28T12:22:08.567 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/ds2781_battery.ko 2024-03-28T12:22:08.567 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/ds2782_battery.ko 2024-03-28T12:22:08.567 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/gpio-charger.ko 2024-03-28T12:22:08.567 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/isp1704_charger.ko 2024-03-28T12:22:08.567 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/lp8727_charger.ko 2024-03-28T12:22:08.567 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/max14577_charger.ko 2024-03-28T12:22:08.567 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/max17042_battery.ko 2024-03-28T12:22:08.567 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/max8903_charger.ko 2024-03-28T12:22:08.567 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/max8925_power.ko 2024-03-28T12:22:08.567 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/pcf50633-charger.ko 2024-03-28T12:22:08.567 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 37833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/sbs-battery.ko 2024-03-28T12:22:08.568 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/test_power.ko 2024-03-28T12:22:08.568 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/tps65090-charger.ko 2024-03-28T12:22:08.568 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/wm831x_backup.ko 2024-03-28T12:22:08.568 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/wm831x_power.ko 2024-03-28T12:22:08.568 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/wm8350_power.ko 2024-03-28T12:22:08.568 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/ 2024-03-28T12:22:08.568 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 58097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-28T12:22:08.568 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-28T12:22:08.568 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/ 2024-03-28T12:22:08.568 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/ 2024-03-28T12:22:08.568 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-28T12:22:08.568 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-28T12:22:08.568 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-28T12:22:08.568 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 41785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-28T12:22:08.568 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ 2024-03-28T12:22:08.569 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 70849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-28T12:22:08.569 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-28T12:22:08.569 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/ 2024-03-28T12:22:08.569 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-88pm80x.ko 2024-03-28T12:22:08.569 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-88pm860x.ko 2024-03-28T12:22:08.569 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-28T12:22:08.569 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-da9052.ko 2024-03-28T12:22:08.569 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-da9055.ko 2024-03-28T12:22:08.569 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-da9063.ko 2024-03-28T12:22:08.569 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-28T12:22:08.569 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 68473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-28T12:22:08.569 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-28T12:22:08.569 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-28T12:22:08.569 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-28T12:22:08.569 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-28T12:22:08.569 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-28T12:22:08.569 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-28T12:22:08.570 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-28T12:22:08.570 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-28T12:22:08.570 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-28T12:22:08.570 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-28T12:22:08.570 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 35865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-28T12:22:08.570 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-lp8788.ko 2024-03-28T12:22:08.570 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 37993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-28T12:22:08.570 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-28T12:22:08.570 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-28T12:22:08.570 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t86.ko 2024-03-28T12:22:08.570 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-28T12:22:08.570 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max8907.ko 2024-03-28T12:22:08.570 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max8925.ko 2024-03-28T12:22:08.570 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max8997.ko 2024-03-28T12:22:08.570 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max8998.ko 2024-03-28T12:22:08.570 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-palmas.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 46529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf50633.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rc5t583.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-s35390a.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-tps6586x.ko 2024-03-28T12:22:08.571 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-tps65910.ko 2024-03-28T12:22:08.572 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-wm831x.ko 2024-03-28T12:22:08.572 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-wm8350.ko 2024-03-28T12:22:08.572 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-28T12:22:08.572 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ 2024-03-28T12:22:08.572 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 77521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-28T12:22:08.572 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 57713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-28T12:22:08.572 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 55009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-28T12:22:08.572 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 135249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-28T12:22:08.572 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-28T12:22:08.572 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/ 2024-03-28T12:22:08.572 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 271385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-28T12:22:08.572 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 100529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-28T12:22:08.572 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/ 2024-03-28T12:22:08.572 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 356833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-28T12:22:08.572 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 295889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-28T12:22:08.572 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic94xx/ 2024-03-28T12:22:08.573 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 189089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-03-28T12:22:08.573 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-28T12:22:08.573 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/ 2024-03-28T12:22:08.573 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 108193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-28T12:22:08.573 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 38089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-28T12:22:08.573 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/ 2024-03-28T12:22:08.573 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 246913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-28T12:22:08.573 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/ 2024-03-28T12:22:08.573 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 1171857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-28T12:22:08.573 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/ 2024-03-28T12:22:08.573 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 238369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-28T12:22:08.573 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/ 2024-03-28T12:22:08.573 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 115305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-28T12:22:08.573 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 40777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-28T12:22:08.573 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/ 2024-03-28T12:22:08.573 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 308905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-28T12:22:08.574 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/ 2024-03-28T12:22:08.574 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-03-28T12:22:08.574 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 76033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-28T12:22:08.574 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-03-28T12:22:08.574 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 101417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-28T12:22:08.574 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 146745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-28T12:22:08.574 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 75969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-28T12:22:08.574 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 38201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-28T12:22:08.574 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/ 2024-03-28T12:22:08.574 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 212329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-28T12:22:08.574 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 60497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-28T12:22:08.574 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/ 2024-03-28T12:22:08.574 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 78217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-28T12:22:08.574 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 157713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-28T12:22:08.574 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fdomain.ko 2024-03-28T12:22:08.574 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/ 2024-03-28T12:22:08.574 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 294881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-28T12:22:08.575 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 201721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-28T12:22:08.575 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 51113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-28T12:22:08.575 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 48937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-28T12:22:08.575 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/imm.ko 2024-03-28T12:22:08.575 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 43969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-28T12:22:08.575 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 265937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-28T12:22:08.575 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 101873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-28T12:22:08.575 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/ 2024-03-28T12:22:08.575 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 317129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-28T12:22:08.575 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-28T12:22:08.575 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 52857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-28T12:22:08.575 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/ 2024-03-28T12:22:08.575 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 315273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-28T12:22:08.575 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 145489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-28T12:22:08.575 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 53801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-28T12:22:08.575 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/ 2024-03-28T12:22:08.575 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 216345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-28T12:22:08.576 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/ 2024-03-28T12:22:08.576 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 2193953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-28T12:22:08.576 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/ 2024-03-28T12:22:08.576 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 73465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-28T12:22:08.576 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-28T12:22:08.576 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 310665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-28T12:22:08.576 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 85513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-28T12:22:08.576 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/ 2024-03-28T12:22:08.576 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 659585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-28T12:22:08.576 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/ 2024-03-28T12:22:08.576 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 119465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-28T12:22:08.576 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 78033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-28T12:22:08.576 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pcmcia/ 2024-03-28T12:22:08.576 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 81545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-03-28T12:22:08.576 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-03-28T12:22:08.576 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-03-28T12:22:08.576 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-03-28T12:22:08.577 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/ 2024-03-28T12:22:08.577 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 366305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-28T12:22:08.577 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 124593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-28T12:22:08.577 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ppa.ko 2024-03-28T12:22:08.577 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 55329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-28T12:22:08.577 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/ 2024-03-28T12:22:08.577 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 1876657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-28T12:22:08.577 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 85185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-28T12:22:08.577 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/ 2024-03-28T12:22:08.577 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 558897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-28T12:22:08.577 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qlogicfas408.ko 2024-03-28T12:22:08.577 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-28T12:22:08.577 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 261073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-28T12:22:08.577 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 173921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-28T12:22:08.577 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 280105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-28T12:22:08.577 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 97617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-28T12:22:08.577 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 73857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-28T12:22:08.578 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 44881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-28T12:22:08.578 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-28T12:22:08.578 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 115641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-28T12:22:08.578 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 46729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-28T12:22:08.578 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/ 2024-03-28T12:22:08.578 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 164865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-28T12:22:08.578 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 44849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-28T12:22:08.578 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 50225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-28T12:22:08.578 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-28T12:22:08.578 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 49921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/xen-scsifront.ko 2024-03-28T12:22:08.578 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ 2024-03-28T12:22:08.578 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 129345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-28T12:22:08.578 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/ 2024-03-28T12:22:08.578 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/ 2024-03-28T12:22:08.578 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 736665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-28T12:22:08.578 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/ 2024-03-28T12:22:08.578 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 49873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-28T12:22:08.579 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-28T12:22:08.579 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 42801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-28T12:22:08.579 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 931433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-28T12:22:08.579 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 44145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-28T12:22:08.579 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 122481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-28T12:22:08.579 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/ 2024-03-28T12:22:08.579 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 75497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-28T12:22:08.579 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/ 2024-03-28T12:22:08.579 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/ 2024-03-28T12:22:08.579 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/ 2024-03-28T12:22:08.579 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-28T12:22:08.579 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-28T12:22:08.579 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-28T12:22:08.579 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-28T12:22:08.579 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-28T12:22:08.579 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-28T12:22:08.579 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-28T12:22:08.580 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-28T12:22:08.580 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-28T12:22:08.580 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-28T12:22:08.580 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-28T12:22:08.580 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-28T12:22:08.580 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-28T12:22:08.580 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-28T12:22:08.580 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-28T12:22:08.580 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-03-28T12:22:08.580 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-28T12:22:08.580 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-28T12:22:08.580 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-28T12:22:08.580 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ 2024-03-28T12:22:08.580 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ 2024-03-28T12:22:08.580 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 78329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-28T12:22:08.581 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 57769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/moxa.ko 2024-03-28T12:22:08.581 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 50857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/mxser.ko 2024-03-28T12:22:08.581 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 108481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-28T12:22:08.581 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-28T12:22:08.581 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 67833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-28T12:22:08.581 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/ 2024-03-28T12:22:08.581 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/ 2024-03-28T12:22:08.581 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-03-28T12:22:08.581 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 59393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-28T12:22:08.581 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-03-28T12:22:08.581 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/altera_uart.ko 2024-03-28T12:22:08.581 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-28T12:22:08.581 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 72545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-03-28T12:22:08.581 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/ 2024-03-28T12:22:08.581 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 101969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-28T12:22:08.581 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/rp2.ko 2024-03-28T12:22:08.582 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 53169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/sc16is7xx.ko 2024-03-28T12:22:08.582 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/ 2024-03-28T12:22:08.582 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ 2024-03-28T12:22:08.582 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 545377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-28T12:22:08.582 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ 2024-03-28T12:22:08.582 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-28T12:22:08.582 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-03-28T12:22:08.582 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/ 2024-03-28T12:22:08.582 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 44465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-28T12:22:08.582 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-28T12:22:08.582 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-28T12:22:08.582 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_dmem_genirq.ko 2024-03-28T12:22:08.582 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_mf624.ko 2024-03-28T12:22:08.582 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_netx.ko 2024-03-28T12:22:08.582 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-28T12:22:08.582 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-03-28T12:22:08.583 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-28T12:22:08.583 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/ 2024-03-28T12:22:08.583 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/c67x00/ 2024-03-28T12:22:08.583 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 73201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/c67x00/c67x00.ko 2024-03-28T12:22:08.583 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ 2024-03-28T12:22:08.583 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 145753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-03-28T12:22:08.583 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-03-28T12:22:08.583 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-03-28T12:22:08.583 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-03-28T12:22:08.583 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-03-28T12:22:08.583 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/ 2024-03-28T12:22:08.583 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 87001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-28T12:22:08.583 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 51249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-28T12:22:08.583 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 47209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-28T12:22:08.583 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 89761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-28T12:22:08.583 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/common/ 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/common/ulpi.ko 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc2/ 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc3/ 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 452785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc3/dwc3.ko 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/ 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/ 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 60321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/u_ether.ko 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 51785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/u_serial.ko 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 42345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 92401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 50937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-03-28T12:22:08.584 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 122241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-03-28T12:22:08.585 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 59857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-03-28T12:22:08.585 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-03-28T12:22:08.585 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-03-28T12:22:08.585 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 57625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-03-28T12:22:08.585 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 85505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-03-28T12:22:08.585 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-03-28T12:22:08.585 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 58009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-03-28T12:22:08.585 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 67345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-03-28T12:22:08.585 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/ 2024-03-28T12:22:08.585 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-03-28T12:22:08.585 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-03-28T12:22:08.585 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-03-28T12:22:08.585 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-03-28T12:22:08.585 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-03-28T12:22:08.586 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-03-28T12:22:08.586 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-03-28T12:22:08.586 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-03-28T12:22:08.586 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-03-28T12:22:08.586 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-03-28T12:22:08.586 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-03-28T12:22:08.586 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-03-28T12:22:08.586 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 62361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-03-28T12:22:08.586 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-03-28T12:22:08.586 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 161193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/libcomposite.ko 2024-03-28T12:22:08.586 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/ 2024-03-28T12:22:08.586 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-03-28T12:22:08.586 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/bdc/ 2024-03-28T12:22:08.586 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 157593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-03-28T12:22:08.586 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 35993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-03-28T12:22:08.586 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 52921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-03-28T12:22:08.586 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 69609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-03-28T12:22:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 55945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-03-28T12:22:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 75961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/net2272.ko 2024-03-28T12:22:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 74977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/net2280.ko 2024-03-28T12:22:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 73009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-03-28T12:22:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 65873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-03-28T12:22:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 65993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-03-28T12:22:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 81401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-03-28T12:22:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 156321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-03-28T12:22:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/ 2024-03-28T12:22:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/bcma-hcd.ko 2024-03-28T12:22:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 80009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/isp116x-hcd.ko 2024-03-28T12:22:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 87249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-03-28T12:22:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 78769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-03-28T12:22:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 51385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-28T12:22:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811_cs.ko 2024-03-28T12:22:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/ssb-hcd.ko 2024-03-28T12:22:08.587 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-03-28T12:22:08.588 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/ 2024-03-28T12:22:08.588 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-28T12:22:08.588 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-28T12:22:08.588 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ 2024-03-28T12:22:08.588 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 41625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-28T12:22:08.588 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-28T12:22:08.588 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-03-28T12:22:08.588 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/cytherm.ko 2024-03-28T12:22:08.588 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ehset.ko 2024-03-28T12:22:08.588 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-28T12:22:08.588 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-28T12:22:08.588 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-28T12:22:08.588 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-28T12:22:08.588 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-28T12:22:08.588 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-28T12:22:08.589 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-28T12:22:08.589 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-28T12:22:08.589 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/lvstest.ko 2024-03-28T12:22:08.589 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/ 2024-03-28T12:22:08.589 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 64737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-28T12:22:08.589 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-28T12:22:08.589 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-28T12:22:08.589 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-28T12:22:08.589 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-28T12:22:08.589 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 70713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbtest.ko 2024-03-28T12:22:08.589 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 41809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-28T12:22:08.589 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-28T12:22:08.589 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/mon/ 2024-03-28T12:22:08.589 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 72801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/mon/usbmon.ko 2024-03-28T12:22:08.589 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/musb/ 2024-03-28T12:22:08.590 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 301593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/musb/musb_hdrc.ko 2024-03-28T12:22:08.590 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/ 2024-03-28T12:22:08.590 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-28T12:22:08.590 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-03-28T12:22:08.590 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-isp1301.ko 2024-03-28T12:22:08.590 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-tahvo.ko 2024-03-28T12:22:08.590 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ 2024-03-28T12:22:08.590 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-28T12:22:08.590 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-28T12:22:08.590 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-28T12:22:08.590 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 38009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-28T12:22:08.590 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 70273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-28T12:22:08.590 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-28T12:22:08.590 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 58113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-28T12:22:08.590 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 49713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-28T12:22:08.590 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-28T12:22:08.591 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 44177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/f81232.ko 2024-03-28T12:22:08.591 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 175097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-28T12:22:08.591 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 53009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-28T12:22:08.591 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 136977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-28T12:22:08.591 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 124737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-28T12:22:08.591 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 67673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-28T12:22:08.591 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-28T12:22:08.591 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-28T12:22:08.591 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 58129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-28T12:22:08.591 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 107425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-28T12:22:08.591 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 35513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-28T12:22:08.591 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-28T12:22:08.591 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-28T12:22:08.591 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 32857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-28T12:22:08.591 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/metro-usb.ko 2024-03-28T12:22:08.591 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 66353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-28T12:22:08.591 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 78121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-28T12:22:08.592 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 56241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mxuport.ko 2024-03-28T12:22:08.592 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-28T12:22:08.592 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-28T12:22:08.592 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-28T12:22:08.592 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 191817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-28T12:22:08.592 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 38977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-28T12:22:08.592 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 54257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-28T12:22:08.592 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-28T12:22:08.592 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 38017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-28T12:22:08.592 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-28T12:22:08.592 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-28T12:22:08.592 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 51529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-28T12:22:08.592 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-28T12:22:08.592 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-28T12:22:08.592 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-28T12:22:08.592 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 61385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-28T12:22:08.592 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-28T12:22:08.593 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-28T12:22:08.593 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-28T12:22:08.593 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 125513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usbserial.ko 2024-03-28T12:22:08.593 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-28T12:22:08.593 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 37305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-28T12:22:08.593 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/wishbone-serial.ko 2024-03-28T12:22:08.593 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-28T12:22:08.593 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ 2024-03-28T12:22:08.593 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 52753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-28T12:22:08.593 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-28T12:22:08.593 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-28T12:22:08.593 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-28T12:22:08.593 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-28T12:22:08.593 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-28T12:22:08.593 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-28T12:22:08.593 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-28T12:22:08.594 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-28T12:22:08.594 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-28T12:22:08.594 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-28T12:22:08.594 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-28T12:22:08.594 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-28T12:22:08.594 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 35241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-28T12:22:08.594 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 180281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-28T12:22:08.594 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/ 2024-03-28T12:22:08.594 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 67385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-28T12:22:08.594 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 71001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-28T12:22:08.594 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 103977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-28T12:22:08.594 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/ 2024-03-28T12:22:08.594 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/ 2024-03-28T12:22:08.594 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 162841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-28T12:22:08.595 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-28T12:22:08.595 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 103649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-28T12:22:08.595 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 76433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-28T12:22:08.595 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/ 2024-03-28T12:22:08.595 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 113657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-28T12:22:08.595 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-28T12:22:08.595 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 57993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-28T12:22:08.595 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 89049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-28T12:22:08.595 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/ 2024-03-28T12:22:08.595 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/ 2024-03-28T12:22:08.595 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-03-28T12:22:08.595 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/aat2870_bl.ko 2024-03-28T12:22:08.595 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/adp5520_bl.ko 2024-03-28T12:22:08.595 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 32505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/adp8860_bl.ko 2024-03-28T12:22:08.595 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/adp8870_bl.ko 2024-03-28T12:22:08.596 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-28T12:22:08.596 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/as3711_bl.ko 2024-03-28T12:22:08.596 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/bd6107.ko 2024-03-28T12:22:08.596 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/da903x_bl.ko 2024-03-28T12:22:08.596 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/da9052_bl.ko 2024-03-28T12:22:08.596 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/gpio_backlight.ko 2024-03-28T12:22:08.596 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/kb3886_bl.ko 2024-03-28T12:22:08.596 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-28T12:22:08.596 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lm3533_bl.ko 2024-03-28T12:22:08.596 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lm3639_bl.ko 2024-03-28T12:22:08.596 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lv5207lp.ko 2024-03-28T12:22:08.596 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/max8925_bl.ko 2024-03-28T12:22:08.596 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/pandora_bl.ko 2024-03-28T12:22:08.596 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-03-28T12:22:08.597 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-28T12:22:08.597 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/wm831x_bl.ko 2024-03-28T12:22:08.597 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/ 2024-03-28T12:22:08.597 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ 2024-03-28T12:22:08.597 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-28T12:22:08.597 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-28T12:22:08.597 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/matrox_w1.ko 2024-03-28T12:22:08.597 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/w1-gpio.ko 2024-03-28T12:22:08.597 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/ 2024-03-28T12:22:08.597 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-28T12:22:08.597 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-28T12:22:08.597 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-28T12:22:08.597 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-28T12:22:08.597 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-28T12:22:08.597 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-28T12:22:08.597 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-28T12:22:08.598 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-28T12:22:08.598 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-28T12:22:08.598 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-28T12:22:08.598 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 56329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-28T12:22:08.598 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 103025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-28T12:22:08.598 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ 2024-03-28T12:22:08.598 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/acquirewdt.ko 2024-03-28T12:22:08.598 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/advantechwdt.ko 2024-03-28T12:22:08.598 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-28T12:22:08.598 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-28T12:22:08.598 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/cpu5wdt.ko 2024-03-28T12:22:08.598 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/da9052_wdt.ko 2024-03-28T12:22:08.598 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/da9055_wdt.ko 2024-03-28T12:22:08.598 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/da9063_wdt.ko 2024-03-28T12:22:08.598 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/dw_wdt.ko 2024-03-28T12:22:08.598 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/eurotechwdt.ko 2024-03-28T12:22:08.599 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-28T12:22:08.599 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-28T12:22:08.599 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-28T12:22:08.599 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-28T12:22:08.599 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-28T12:22:08.599 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-28T12:22:08.599 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-28T12:22:08.599 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-28T12:22:08.599 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-28T12:22:08.599 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-28T12:22:08.599 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/kempld_wdt.ko 2024-03-28T12:22:08.599 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-28T12:22:08.599 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/mena21_wdt.ko 2024-03-28T12:22:08.599 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-03-28T12:22:08.599 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-28T12:22:08.599 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-03-28T12:22:08.599 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pc87413_wdt.ko 2024-03-28T12:22:08.600 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-28T12:22:08.600 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-28T12:22:08.600 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/retu_wdt.ko 2024-03-28T12:22:08.600 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-03-28T12:22:08.600 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-03-28T12:22:08.600 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-28T12:22:08.600 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sc1200wdt.ko 2024-03-28T12:22:08.600 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-28T12:22:08.600 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-03-28T12:22:08.600 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-28T12:22:08.600 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-28T12:22:08.600 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/twl4030_wdt.ko 2024-03-28T12:22:08.600 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-28T12:22:08.600 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-28T12:22:08.600 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-28T12:22:08.600 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-28T12:22:08.601 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wafer5823wdt.ko 2024-03-28T12:22:08.601 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-28T12:22:08.601 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wm831x_wdt.ko 2024-03-28T12:22:08.601 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wm8350_wdt.ko 2024-03-28T12:22:08.601 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-28T12:22:08.601 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/ 2024-03-28T12:22:08.601 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-28T12:22:08.601 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-28T12:22:08.601 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 47761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-28T12:22:08.601 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/ 2024-03-28T12:22:08.601 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 176337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-28T12:22:08.601 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 40081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-28T12:22:08.601 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 71145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-scsiback.ko 2024-03-28T12:22:08.601 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/ 2024-03-28T12:22:08.601 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-28T12:22:08.601 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ 2024-03-28T12:22:08.601 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/ 2024-03-28T12:22:08.602 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 158217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-28T12:22:08.602 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/adfs/ 2024-03-28T12:22:08.602 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 61681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/adfs/adfs.ko 2024-03-28T12:22:08.602 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/ 2024-03-28T12:22:08.602 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 163369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-28T12:22:08.602 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/afs/ 2024-03-28T12:22:08.602 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 1019049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/afs/kafs.ko 2024-03-28T12:22:08.602 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/autofs/ 2024-03-28T12:22:08.602 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 103185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/autofs/autofs4.ko 2024-03-28T12:22:08.602 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/ 2024-03-28T12:22:08.602 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 64585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-28T12:22:08.602 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/bfs/ 2024-03-28T12:22:08.602 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 41001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/bfs/bfs.ko 2024-03-28T12:22:08.603 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 38641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-28T12:22:08.603 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/ 2024-03-28T12:22:08.603 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 3487249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-28T12:22:08.603 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/ 2024-03-28T12:22:08.603 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 305841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-28T12:22:08.603 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ 2024-03-28T12:22:08.603 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 1335577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-28T12:22:08.603 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/ 2024-03-28T12:22:08.603 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 97713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-28T12:22:08.603 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/configfs/ 2024-03-28T12:22:08.603 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 108545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/configfs/configfs.ko 2024-03-28T12:22:08.603 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/ 2024-03-28T12:22:08.603 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-28T12:22:08.603 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/ 2024-03-28T12:22:08.603 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 644161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-28T12:22:08.603 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/efs/ 2024-03-28T12:22:08.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/efs/efs.ko 2024-03-28T12:22:08.604 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/ 2024-03-28T12:22:08.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 1527561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-28T12:22:08.604 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/ 2024-03-28T12:22:08.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-28T12:22:08.604 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/freevxfs/ 2024-03-28T12:22:08.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 42513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/freevxfs/freevxfs.ko 2024-03-28T12:22:08.604 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/ 2024-03-28T12:22:08.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-28T12:22:08.604 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/ 2024-03-28T12:22:08.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 1231233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-28T12:22:08.604 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/ 2024-03-28T12:22:08.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 141625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-28T12:22:08.604 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/ 2024-03-28T12:22:08.604 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 223177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-28T12:22:08.604 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hpfs/ 2024-03-28T12:22:08.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 193481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hpfs/hpfs.ko 2024-03-28T12:22:08.605 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/ 2024-03-28T12:22:08.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 74689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-28T12:22:08.605 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/ 2024-03-28T12:22:08.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 420329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-28T12:22:08.605 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/ 2024-03-28T12:22:08.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 281617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-28T12:22:08.605 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/ 2024-03-28T12:22:08.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 88897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-28T12:22:08.605 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/ 2024-03-28T12:22:08.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 490409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-28T12:22:08.605 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/ 2024-03-28T12:22:08.605 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/ 2024-03-28T12:22:08.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 81433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-28T12:22:08.605 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/ 2024-03-28T12:22:08.605 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 59337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-28T12:22:08.605 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/ 2024-03-28T12:22:08.606 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 117361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-28T12:22:08.606 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 1058273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-28T12:22:08.606 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 66345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv2.ko 2024-03-28T12:22:08.606 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 120169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-28T12:22:08.606 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 2041705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-28T12:22:08.644 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/ 2024-03-28T12:22:08.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-28T12:22:08.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-28T12:22:08.644 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/ 2024-03-28T12:22:08.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 1511641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-28T12:22:08.644 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/ 2024-03-28T12:22:08.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 582409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-28T12:22:08.644 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/ 2024-03-28T12:22:08.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-28T12:22:08.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-28T12:22:08.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-28T12:22:08.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-28T12:22:08.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-28T12:22:08.644 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-28T12:22:08.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-28T12:22:08.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-28T12:22:08.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-28T12:22:08.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-28T12:22:08.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-28T12:22:08.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ascii.ko 2024-03-28T12:22:08.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-28T12:22:08.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-28T12:22:08.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-28T12:22:08.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-28T12:22:08.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-28T12:22:08.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-28T12:22:08.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-28T12:22:08.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-28T12:22:08.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-28T12:22:08.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-28T12:22:08.645 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-28T12:22:08.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-28T12:22:08.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-28T12:22:08.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-28T12:22:08.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-28T12:22:08.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-28T12:22:08.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-28T12:22:08.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-28T12:22:08.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 94033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-28T12:22:08.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 142569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-28T12:22:08.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 165641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-28T12:22:08.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 118017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-28T12:22:08.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-28T12:22:08.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-28T12:22:08.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-28T12:22:08.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-28T12:22:08.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-28T12:22:08.646 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-28T12:22:08.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-28T12:22:08.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-28T12:22:08.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-28T12:22:08.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-28T12:22:08.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-28T12:22:08.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-28T12:22:08.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-28T12:22:08.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-28T12:22:08.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-28T12:22:08.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-28T12:22:08.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-28T12:22:08.647 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ntfs/ 2024-03-28T12:22:08.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 220457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ntfs/ntfs.ko 2024-03-28T12:22:08.647 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ 2024-03-28T12:22:08.647 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ 2024-03-28T12:22:08.647 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 244633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-28T12:22:08.647 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ 2024-03-28T12:22:08.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 440633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-28T12:22:08.648 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ 2024-03-28T12:22:08.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 54161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-28T12:22:08.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 2590681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-28T12:22:08.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-28T12:22:08.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-28T12:22:08.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 35729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-28T12:22:08.648 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/omfs/ 2024-03-28T12:22:08.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 53681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/omfs/omfs.ko 2024-03-28T12:22:08.648 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/ 2024-03-28T12:22:08.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 360897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-28T12:22:08.648 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ 2024-03-28T12:22:08.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 56929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-28T12:22:08.648 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/qnx4/ 2024-03-28T12:22:08.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/qnx4/qnx4.ko 2024-03-28T12:22:08.648 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/qnx6/ 2024-03-28T12:22:08.648 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 46601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/qnx6/qnx6.ko 2024-03-28T12:22:08.649 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/quota/ 2024-03-28T12:22:08.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/quota/quota_tree.ko 2024-03-28T12:22:08.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/quota/quota_v1.ko 2024-03-28T12:22:08.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/quota/quota_v2.ko 2024-03-28T12:22:08.649 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/ 2024-03-28T12:22:08.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 532161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-28T12:22:08.649 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/ 2024-03-28T12:22:08.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-28T12:22:08.649 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/ 2024-03-28T12:22:08.649 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/ 2024-03-28T12:22:08.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 2712385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-28T12:22:08.649 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/ 2024-03-28T12:22:08.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-28T12:22:08.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-28T12:22:08.649 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/ 2024-03-28T12:22:08.649 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 134705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-28T12:22:08.650 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/ 2024-03-28T12:22:08.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 91281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-28T12:22:08.650 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/ 2024-03-28T12:22:08.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 248329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-28T12:22:08.650 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ 2024-03-28T12:22:08.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 162737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-28T12:22:08.650 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/ 2024-03-28T12:22:08.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 4035417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-28T12:22:08.650 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/ 2024-03-28T12:22:08.650 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/locking/ 2024-03-28T12:22:08.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 80481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/locking/locktorture.ko 2024-03-28T12:22:08.650 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/time/ 2024-03-28T12:22:08.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/time/test_udelay.ko 2024-03-28T12:22:08.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 60257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-28T12:22:08.650 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ 2024-03-28T12:22:08.650 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 6729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-28T12:22:08.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 6433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc7.ko 2024-03-28T12:22:08.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 6929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-28T12:22:08.651 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/ 2024-03-28T12:22:08.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-28T12:22:08.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-28T12:22:08.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/interval_tree_test.ko 2024-03-28T12:22:08.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-28T12:22:08.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-28T12:22:08.651 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/ 2024-03-28T12:22:08.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-28T12:22:08.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-28T12:22:08.651 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/ 2024-03-28T12:22:08.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 6521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-28T12:22:08.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/memory-notifier-error-inject.ko 2024-03-28T12:22:08.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/notifier-error-inject.ko 2024-03-28T12:22:08.651 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/percpu_test.ko 2024-03-28T12:22:08.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/pm-notifier-error-inject.ko 2024-03-28T12:22:08.652 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/ 2024-03-28T12:22:08.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 143257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-28T12:22:08.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/rbtree_test.ko 2024-03-28T12:22:08.652 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/ 2024-03-28T12:22:08.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-28T12:22:08.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 38737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test-kstrtox.ko 2024-03-28T12:22:08.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test-string_helpers.ko 2024-03-28T12:22:08.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 4863217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test_bpf.ko 2024-03-28T12:22:08.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 48985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test_firmware.ko 2024-03-28T12:22:08.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 6273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test_module.ko 2024-03-28T12:22:08.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test_user_copy.ko 2024-03-28T12:22:08.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-28T12:22:08.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-28T12:22:08.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-28T12:22:08.652 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/xz/ 2024-03-28T12:22:08.652 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/xz/xz_dec_test.ko 2024-03-28T12:22:08.653 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/ 2024-03-28T12:22:08.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-28T12:22:08.653 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ 2024-03-28T12:22:08.653 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/ 2024-03-28T12:22:08.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 55753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-28T12:22:08.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 6953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-28T12:22:08.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 6961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-28T12:22:08.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 6953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-28T12:22:08.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 6889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-28T12:22:08.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 6961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-28T12:22:08.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 6897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-28T12:22:08.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-28T12:22:08.653 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/ 2024-03-28T12:22:08.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-28T12:22:08.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-28T12:22:08.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-28T12:22:08.653 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-28T12:22:08.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-28T12:22:08.654 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/ 2024-03-28T12:22:08.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 82865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-28T12:22:08.654 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/ 2024-03-28T12:22:08.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 198809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-28T12:22:08.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-28T12:22:08.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-28T12:22:08.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 32241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-28T12:22:08.654 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/ 2024-03-28T12:22:08.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 667353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-28T12:22:08.654 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/ 2024-03-28T12:22:08.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 67753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-28T12:22:08.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 790545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-28T12:22:08.654 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ 2024-03-28T12:22:08.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-28T12:22:08.654 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-28T12:22:08.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-28T12:22:08.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-28T12:22:08.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-28T12:22:08.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-28T12:22:08.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-28T12:22:08.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-28T12:22:08.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-28T12:22:08.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-28T12:22:08.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-28T12:22:08.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-28T12:22:08.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-28T12:22:08.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-28T12:22:08.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-28T12:22:08.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-28T12:22:08.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-28T12:22:08.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-28T12:22:08.655 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-28T12:22:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-28T12:22:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 55937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-28T12:22:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-28T12:22:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-28T12:22:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/ 2024-03-28T12:22:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 1046689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-28T12:22:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/ 2024-03-28T12:22:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 125697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-28T12:22:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/ 2024-03-28T12:22:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 194441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-28T12:22:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-28T12:22:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 58737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-28T12:22:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 61393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-28T12:22:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/ 2024-03-28T12:22:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 390033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-28T12:22:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-28T12:22:08.656 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-28T12:22:08.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-28T12:22:08.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-28T12:22:08.657 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/hsr/ 2024-03-28T12:22:08.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 102033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/hsr/hsr.ko 2024-03-28T12:22:08.657 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ 2024-03-28T12:22:08.657 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ 2024-03-28T12:22:08.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 45481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-28T12:22:08.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 284665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-28T12:22:08.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 47873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-28T12:22:08.657 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ 2024-03-28T12:22:08.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-28T12:22:08.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-28T12:22:08.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 48233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-28T12:22:08.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-28T12:22:08.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 51209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-28T12:22:08.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 61129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-28T12:22:08.657 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 61505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-28T12:22:08.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-28T12:22:08.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-28T12:22:08.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-28T12:22:08.658 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ 2024-03-28T12:22:08.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 38001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-28T12:22:08.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-28T12:22:08.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-28T12:22:08.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 42049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ip_tables.ko 2024-03-28T12:22:08.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-28T12:22:08.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-03-28T12:22:08.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-28T12:22:08.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-28T12:22:08.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-28T12:22:08.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-03-28T12:22:08.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-28T12:22:08.658 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-28T12:22:08.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-28T12:22:08.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-28T12:22:08.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-28T12:22:08.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-28T12:22:08.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-28T12:22:08.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-28T12:22:08.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-28T12:22:08.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-03-28T12:22:08.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-28T12:22:08.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-28T12:22:08.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-28T12:22:08.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-28T12:22:08.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-28T12:22:08.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-28T12:22:08.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-28T12:22:08.659 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 45041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-28T12:22:08.660 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-28T12:22:08.661 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 79921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_gre.ko 2024-03-28T12:22:08.661 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 94161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-28T12:22:08.661 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-28T12:22:08.661 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 54265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-28T12:22:08.661 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-28T12:22:08.661 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/mip6.ko 2024-03-28T12:22:08.661 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ 2024-03-28T12:22:08.661 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 42545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-28T12:22:08.661 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-03-28T12:22:08.661 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-28T12:22:08.661 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-28T12:22:08.661 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-28T12:22:08.661 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-28T12:22:08.661 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-28T12:22:08.661 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-28T12:22:08.661 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-28T12:22:08.662 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-28T12:22:08.662 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-28T12:22:08.662 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-28T12:22:08.662 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-28T12:22:08.662 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-28T12:22:08.662 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-28T12:22:08.662 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-28T12:22:08.662 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-28T12:22:08.662 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-28T12:22:08.662 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-28T12:22:08.662 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-28T12:22:08.662 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-28T12:22:08.662 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-28T12:22:08.662 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-28T12:22:08.662 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-28T12:22:08.662 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-28T12:22:08.663 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 74873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-28T12:22:08.663 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-28T12:22:08.663 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-28T12:22:08.663 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/ 2024-03-28T12:22:08.663 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 84393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-28T12:22:08.663 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/ 2024-03-28T12:22:08.663 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 125201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-28T12:22:08.663 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-28T12:22:08.663 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 25809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-28T12:22:08.663 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-28T12:22:08.663 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 37369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-28T12:22:08.663 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-28T12:22:08.663 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 53225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-28T12:22:08.663 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/lapb/ 2024-03-28T12:22:08.663 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 48097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/lapb/lapb.ko 2024-03-28T12:22:08.663 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/ 2024-03-28T12:22:08.664 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-28T12:22:08.664 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 268449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc2.ko 2024-03-28T12:22:08.664 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/ 2024-03-28T12:22:08.664 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 309361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-28T12:22:08.664 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/ 2024-03-28T12:22:08.664 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-28T12:22:08.664 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ 2024-03-28T12:22:08.664 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ 2024-03-28T12:22:08.664 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 119689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-28T12:22:08.664 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-28T12:22:08.664 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-28T12:22:08.664 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-28T12:22:08.664 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 99985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-28T12:22:08.664 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 100273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-28T12:22:08.664 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 102545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-28T12:22:08.664 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 102337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-28T12:22:08.664 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 111665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-28T12:22:08.665 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 59185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-28T12:22:08.665 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 108337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-28T12:22:08.665 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 112137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-28T12:22:08.665 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 112401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-28T12:22:08.665 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 110329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-28T12:22:08.665 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 113281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-28T12:22:08.665 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-28T12:22:08.665 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ 2024-03-28T12:22:08.665 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 412433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-28T12:22:08.665 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-28T12:22:08.665 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-28T12:22:08.665 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-28T12:22:08.665 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-28T12:22:08.665 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-28T12:22:08.665 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-28T12:22:08.665 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-28T12:22:08.665 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-28T12:22:08.666 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-28T12:22:08.666 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-28T12:22:08.666 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-28T12:22:08.666 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-28T12:22:08.666 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-28T12:22:08.666 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 49161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-28T12:22:08.666 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 411665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-28T12:22:08.666 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-28T12:22:08.666 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-28T12:22:08.666 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-28T12:22:08.666 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 118145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-28T12:22:08.666 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-28T12:22:08.666 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-28T12:22:08.666 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 108305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-28T12:22:08.666 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-28T12:22:08.666 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-28T12:22:08.667 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 66529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-28T12:22:08.667 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-28T12:22:08.667 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-28T12:22:08.667 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-28T12:22:08.667 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 92217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-28T12:22:08.667 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-28T12:22:08.667 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 38073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-28T12:22:08.667 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 96489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-28T12:22:08.667 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-28T12:22:08.667 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-28T12:22:08.667 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-28T12:22:08.667 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-28T12:22:08.667 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-28T12:22:08.667 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 44129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-28T12:22:08.667 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 623337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-28T12:22:08.668 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 42505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-28T12:22:08.668 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-28T12:22:08.668 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-03-28T12:22:08.668 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-28T12:22:08.668 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 22929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-28T12:22:08.668 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 49641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-28T12:22:08.668 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-28T12:22:08.668 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-28T12:22:08.668 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 40801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-28T12:22:08.668 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-28T12:22:08.668 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-28T12:22:08.668 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-28T12:22:08.668 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-28T12:22:08.668 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-28T12:22:08.668 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-28T12:22:08.668 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-28T12:22:08.668 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_osf.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_synproxy.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tproxy.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 89225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/x_tables.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 18073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-28T12:22:08.669 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-28T12:22:08.670 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 38769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-28T12:22:08.670 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-28T12:22:08.670 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-28T12:22:08.670 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-28T12:22:08.670 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-28T12:22:08.670 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-28T12:22:08.670 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-28T12:22:08.670 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-28T12:22:08.670 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-28T12:22:08.670 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-28T12:22:08.670 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-28T12:22:08.670 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-28T12:22:08.670 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-28T12:22:08.670 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-28T12:22:08.670 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-28T12:22:08.671 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-28T12:22:08.671 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-28T12:22:08.671 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-28T12:22:08.671 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-28T12:22:08.671 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-28T12:22:08.671 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-28T12:22:08.671 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-28T12:22:08.671 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-28T12:22:08.671 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-28T12:22:08.671 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-28T12:22:08.671 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-28T12:22:08.671 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-28T12:22:08.671 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-28T12:22:08.671 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-28T12:22:08.671 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-28T12:22:08.671 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-28T12:22:08.671 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 43193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-28T12:22:08.672 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-28T12:22:08.672 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-28T12:22:08.672 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-28T12:22:08.672 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-28T12:22:08.672 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-28T12:22:08.672 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-28T12:22:08.672 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-28T12:22:08.672 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-28T12:22:08.672 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-28T12:22:08.672 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-28T12:22:08.672 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-28T12:22:08.672 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-28T12:22:08.672 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-28T12:22:08.672 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-28T12:22:08.672 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-28T12:22:08.672 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-28T12:22:08.672 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-28T12:22:08.673 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-28T12:22:08.673 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-28T12:22:08.673 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-28T12:22:08.673 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-28T12:22:08.673 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-28T12:22:08.673 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-28T12:22:08.673 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 29993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-28T12:22:08.673 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 16809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-28T12:22:08.673 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-28T12:22:08.673 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-28T12:22:08.673 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-28T12:22:08.673 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 8449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-28T12:22:08.673 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpudp.ko 2024-03-28T12:22:08.673 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-28T12:22:08.673 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-28T12:22:08.673 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/ 2024-03-28T12:22:08.673 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 14433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-28T12:22:08.674 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/ 2024-03-28T12:22:08.674 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 12329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-28T12:22:08.674 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/ 2024-03-28T12:22:08.674 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 384137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-28T12:22:08.674 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-28T12:22:08.674 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-28T12:22:08.674 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-28T12:22:08.674 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/ 2024-03-28T12:22:08.674 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-28T12:22:08.674 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/phonet/ 2024-03-28T12:22:08.674 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 112521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/phonet/phonet.ko 2024-03-28T12:22:08.674 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 55041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/phonet/pn_pep.ko 2024-03-28T12:22:08.674 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/ 2024-03-28T12:22:08.674 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 253881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-28T12:22:08.674 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 165049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-28T12:22:08.674 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 68065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-28T12:22:08.675 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rxrpc/ 2024-03-28T12:22:08.675 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 828145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rxrpc/rxrpc.ko 2024-03-28T12:22:08.675 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/ 2024-03-28T12:22:08.675 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 32145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-28T12:22:08.675 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-28T12:22:08.675 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 37081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-28T12:22:08.675 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-28T12:22:08.675 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 43345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-28T12:22:08.675 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-28T12:22:08.675 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-28T12:22:08.675 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 35193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-28T12:22:08.675 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-28T12:22:08.675 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-28T12:22:08.675 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-28T12:22:08.675 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 19177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_cgroup.ko 2024-03-28T12:22:08.676 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-28T12:22:08.676 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-28T12:22:08.676 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 39513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-28T12:22:08.676 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 62649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-28T12:22:08.676 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-28T12:22:08.676 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 13313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-28T12:22:08.676 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 33417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-28T12:22:08.676 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-28T12:22:08.676 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-28T12:22:08.676 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-28T12:22:08.676 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-28T12:22:08.676 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-28T12:22:08.676 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 34585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-28T12:22:08.676 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 35785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-28T12:22:08.676 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq_codel.ko 2024-03-28T12:22:08.676 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 35449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-28T12:22:08.677 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 49841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-28T12:22:08.677 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 21969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-28T12:22:08.677 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 66441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-28T12:22:08.677 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-28T12:22:08.677 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 30217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-28T12:22:08.677 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-28T12:22:08.677 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-28T12:22:08.677 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 36145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-28T12:22:08.677 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 27401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-28T12:22:08.677 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-28T12:22:08.677 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 24769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-28T12:22:08.677 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 48529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-28T12:22:08.677 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 32809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-28T12:22:08.677 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 26785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-28T12:22:08.677 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 31313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-28T12:22:08.677 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-28T12:22:08.677 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 28265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-28T12:22:08.678 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/ 2024-03-28T12:22:08.678 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 932785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-28T12:22:08.678 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-28T12:22:08.678 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/ 2024-03-28T12:22:08.678 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/ 2024-03-28T12:22:08.678 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 336969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-28T12:22:08.678 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 55009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-28T12:22:08.678 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 1513769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-28T12:22:08.678 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/ 2024-03-28T12:22:08.678 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 704697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-28T12:22:08.678 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/ 2024-03-28T12:22:08.678 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 10393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-28T12:22:08.678 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 867121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-28T12:22:08.678 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/ 2024-03-28T12:22:08.678 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-28T12:22:08.678 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/ 2024-03-28T12:22:08.678 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 87737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-28T12:22:08.679 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 67937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-28T12:22:08.679 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 98089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-28T12:22:08.679 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 11073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-28T12:22:08.679 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 17809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-28T12:22:08.679 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/x25/ 2024-03-28T12:22:08.679 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 131209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/x25/x25.ko 2024-03-28T12:22:08.679 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/ 2024-03-28T12:22:08.679 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_algo.ko 2024-03-28T12:22:08.679 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 20545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-28T12:22:08.679 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 105209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_user.ko 2024-03-28T12:22:08.679 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/ 2024-03-28T12:22:08.679 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/ 2024-03-28T12:22:08.679 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 15433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-28T12:22:08.679 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 642383 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-28T12:22:08.679 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 625850 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-28T12:22:08.679 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 7677 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-28T12:22:08.680 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 23498 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-28T12:22:08.680 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 9916 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-28T12:22:08.680 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 70732 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-28T12:22:08.680 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 147214 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-28T12:22:08.680 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 233213 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-28T12:22:08.680 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 210 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-28T12:22:08.680 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 72614 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-28T12:22:08.680 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 879 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-28T12:22:08.680 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 257955 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-28T12:22:08.680 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 312782 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-28T12:22:08.680 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./usr/ 2024-03-28T12:22:08.680 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./usr/share/ 2024-03-28T12:22:08.680 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./usr/share/doc/ 2024-03-28T12:22:08.680 INFO:teuthology.orchestra.run.smithi076.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./usr/share/doc/linux-image-6.8.0-g1df0c7e8a235/ 2024-03-28T12:22:08.680 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 169 2024-03-25 03:29 ./usr/share/doc/linux-image-6.8.0-g1df0c7e8a235/changelog.Debian.gz 2024-03-28T12:22:08.680 INFO:teuthology.orchestra.run.smithi076.stdout:-rw-r--r-- root/root 691 2024-03-25 03:29 ./usr/share/doc/linux-image-6.8.0-g1df0c7e8a235/copyright 2024-03-28T12:22:08.684 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-28T12:22:08.684 INFO:teuthology.task.kernel:searching for kernel 6.8.0-g1df0c7e8a235 2024-03-28T12:22:08.685 DEBUG:teuthology.orchestra.run.smithi076:> egrep '(submenu|menuentry.*6.8.0-g1df0c7e8a235).*{' /boot/grub/grub.cfg 2024-03-28T12:22:08.692 INFO:teuthology.orchestra.run.smithi076.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-28T12:22:08.692 INFO:teuthology.orchestra.run.smithi076.stdout: menuentry 'Ubuntu, with Linux 6.8.0-g1df0c7e8a235' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-g1df0c7e8a235-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-28T12:22:08.692 INFO:teuthology.orchestra.run.smithi076.stdout: menuentry 'Ubuntu, with Linux 6.8.0-g1df0c7e8a235 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-g1df0c7e8a235-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-03-28T12:22:08.693 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-03-28T12:22:08.693 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.8.0-g1df0c7e8a235 2024-03-28T12:22:08.693 DEBUG:teuthology.orchestra.run.smithi076:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-03-28T12:22:08.736 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi076.front.sepia.ceph.com to complete... 2024-03-28T12:22:09.149 INFO:teuthology.orchestra.run.smithi076.stderr:Sourcing file `/etc/default/grub' 2024-03-28T12:22:09.150 INFO:teuthology.orchestra.run.smithi076.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-28T12:22:09.176 INFO:teuthology.orchestra.run.smithi076.stderr:Generating grub configuration file ... 2024-03-28T12:22:09.346 INFO:teuthology.orchestra.run.smithi076.stderr:Found linux image: /boot/vmlinuz-6.8.0-g1df0c7e8a235 2024-03-28T12:22:09.352 INFO:teuthology.orchestra.run.smithi076.stderr:Found initrd image: /boot/initrd.img-6.8.0-g1df0c7e8a235 2024-03-28T12:22:09.589 INFO:teuthology.orchestra.run.smithi076.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-28T12:22:09.594 INFO:teuthology.orchestra.run.smithi076.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-28T12:22:09.634 INFO:teuthology.orchestra.run.smithi076.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-28T12:22:09.639 INFO:teuthology.orchestra.run.smithi076.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-28T12:22:09.756 INFO:teuthology.orchestra.run.smithi076.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-28T12:22:09.757 INFO:teuthology.orchestra.run.smithi076.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-28T12:22:09.757 INFO:teuthology.orchestra.run.smithi076.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-28T12:22:09.776 INFO:teuthology.orchestra.run.smithi076.stderr:done 2024-03-28T12:22:40.888 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-28T12:22:40.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-03-28T12:22:40.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T12:23:15.486 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-03-28T12:23:24.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-03-28T12:23:24.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T12:24:24.490 DEBUG:teuthology.orchestra.remote:timed out 2024-03-28T12:24:36.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-03-28T12:24:36.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T12:24:36.773 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-03-28T12:24:37.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-03-28T12:24:37.490 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-g1df0c7e8a235"... 2024-03-28T12:24:37.490 DEBUG:teuthology.orchestra.run.smithi076:> uname -r 2024-03-28T12:24:37.537 INFO:teuthology.orchestra.run.smithi076.stdout:6.8.0-g1df0c7e8a235 2024-03-28T12:24:37.538 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-28T12:24:37.538 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-28T12:24:37.538 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-28T12:24:38.539 DEBUG:teuthology.parallel:result is None 2024-03-28T12:24:38.539 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-28T12:24:38.548 INFO:teuthology.task.internal:Creating test directory... 2024-03-28T12:24:38.548 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-28T12:24:38.551 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-28T12:24:38.557 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-28T12:24:38.564 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-28T12:24:38.570 INFO:teuthology.task.internal:Creating archive directory... 2024-03-28T12:24:38.570 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-28T12:24:38.601 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-28T12:24:38.624 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-28T12:24:38.636 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-28T12:24:38.636 DEBUG:teuthology.orchestra.run.smithi111:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-28T12:24:38.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T12:24:38.653 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-28T12:24:38.665 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-28T12:24:38.721 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-28T12:24:38.733 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-28T12:24:38.752 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-28T12:24:38.773 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-28T12:24:38.776 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-28T12:24:38.783 INFO:teuthology.task.internal:Configuring sudo... 2024-03-28T12:24:38.783 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-28T12:24:38.787 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-28T12:24:38.804 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-28T12:24:38.824 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-28T12:24:38.824 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-28T12:24:38.853 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-28T12:24:38.859 DEBUG:teuthology.orchestra.run.smithi076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-28T12:24:38.910 DEBUG:teuthology.orchestra.run.smithi076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-28T12:24:38.962 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:24:38.963 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-28T12:24:39.045 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-28T12:24:39.051 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-28T12:24:39.097 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:24:39.097 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-28T12:24:39.159 DEBUG:teuthology.orchestra.run.smithi076:> sudo service rsyslog restart 2024-03-28T12:24:39.162 DEBUG:teuthology.orchestra.run.smithi111:> sudo service rsyslog restart 2024-03-28T12:24:39.268 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-28T12:24:39.275 INFO:teuthology.task.internal:Starting timer... 2024-03-28T12:24:39.276 INFO:teuthology.run_tasks:Running task pcp... 2024-03-28T12:24:39.308 INFO:teuthology.run_tasks:Running task selinux... 2024-03-28T12:24:39.318 DEBUG:teuthology.task.selinux:Excluding smithi076: OS 'ubuntu' does not support SELinux 2024-03-28T12:24:39.318 DEBUG:teuthology.task.selinux:Excluding smithi111: OS 'ubuntu' does not support SELinux 2024-03-28T12:24:39.318 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-28T12:24:39.318 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-03-28T12:24:39.318 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-28T12:24:39.318 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-28T12:24:39.327 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-28T12:24:39.332 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-28T12:24:39.452 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-28T12:24:39.468 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-28T12:24:39.469 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi076.front.sepia.ceph.com,smithi111.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-28T12:32:08.472 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi076.front.sepia.ceph.com'), Remote(name='ubuntu@smithi111.front.sepia.ceph.com')] 2024-03-28T12:32:08.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-03-28T12:32:08.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T12:32:08.552 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-03-28T12:32:08.673 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-03-28T12:32:08.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-03-28T12:32:08.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-28T12:32:08.750 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-03-28T12:32:08.862 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-03-28T12:32:08.862 INFO:teuthology.run_tasks:Running task clock... 2024-03-28T12:32:08.874 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-28T12:32:08.874 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-28T12:32:08.875 DEBUG:teuthology.orchestra.run.smithi076:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-28T12:32:08.878 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-28T12:32:08.878 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-28T12:32:08.913 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-28T12:32:08.913 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: Command line: ntpd -gq 2024-03-28T12:32:08.913 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: ---------------------------------------------------- 2024-03-28T12:32:08.913 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: ntp-4 is maintained by Network Time Foundation, 2024-03-28T12:32:08.914 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-28T12:32:08.914 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: corporation. Support and training for ntp-4 are 2024-03-28T12:32:08.914 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: available at https://www.nwtime.org/support 2024-03-28T12:32:08.914 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: ---------------------------------------------------- 2024-03-28T12:32:08.914 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: proto: precision = 0.041 usec (-24) 2024-03-28T12:32:08.914 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: basedate set to 2022-02-04 2024-03-28T12:32:08.915 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: gps base set to 2022-02-06 (week 2196) 2024-03-28T12:32:08.915 INFO:teuthology.orchestra.run.smithi076.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-28T12:32:08.915 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-28T12:32:08.915 INFO:teuthology.orchestra.run.smithi076.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-28T12:32:08.916 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: restrict ::: KOD does nothing without LIMITED. 2024-03-28T12:32:08.917 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: Listen and drop on 0 v6wildcard [::]:123 2024-03-28T12:32:08.917 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-28T12:32:08.917 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: Listen normally on 2 lo 127.0.0.1:123 2024-03-28T12:32:08.917 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: Listen normally on 3 enp3s0f1 172.21.15.76:123 2024-03-28T12:32:08.917 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: Listen normally on 4 lo [::1]:123 2024-03-28T12:32:08.917 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:47e1%5]:123 2024-03-28T12:32:08.917 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:08 ntpd[17170]: Listening on routing socket on fd #22 for interface updates 2024-03-28T12:32:08.930 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-28T12:32:08.930 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: Command line: ntpd -gq 2024-03-28T12:32:08.930 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: ---------------------------------------------------- 2024-03-28T12:32:08.930 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: ntp-4 is maintained by Network Time Foundation, 2024-03-28T12:32:08.930 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-28T12:32:08.930 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: corporation. Support and training for ntp-4 are 2024-03-28T12:32:08.930 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: available at https://www.nwtime.org/support 2024-03-28T12:32:08.930 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: ---------------------------------------------------- 2024-03-28T12:32:08.931 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: proto: precision = 0.044 usec (-24) 2024-03-28T12:32:08.931 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: basedate set to 2022-02-04 2024-03-28T12:32:08.931 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: gps base set to 2022-02-06 (week 2196) 2024-03-28T12:32:08.931 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-28T12:32:08.931 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: restrict ::: KOD does nothing without LIMITED. 2024-03-28T12:32:08.932 INFO:teuthology.orchestra.run.smithi111.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-28T12:32:08.932 INFO:teuthology.orchestra.run.smithi111.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-28T12:32:08.933 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: Listen and drop on 0 v6wildcard [::]:123 2024-03-28T12:32:08.933 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-28T12:32:08.933 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: Listen normally on 2 lo 127.0.0.1:123 2024-03-28T12:32:08.933 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: Listen normally on 3 enp3s0f1 172.21.15.111:123 2024-03-28T12:32:08.933 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: Listen normally on 4 lo [::1]:123 2024-03-28T12:32:08.933 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc2f%5]:123 2024-03-28T12:32:08.933 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:08 ntpd[17622]: Listening on routing socket on fd #22 for interface updates 2024-03-28T12:32:09.914 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:09 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:09.914 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:09 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:09.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:09 ntpd[17622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:09.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:09 ntpd[17622]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:09.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:09 ntpd[17622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:09.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:09 ntpd[17622]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:09.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:09 ntpd[17622]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-28T12:32:09.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:09 ntpd[17622]: can't open /var/log/ntpstats/peerstats.20240328: Permission denied 2024-03-28T12:32:10.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:10 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:10.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:10 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:10.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:10 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:10.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:10 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:10.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:10 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-28T12:32:10.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:10 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240328: Permission denied 2024-03-28T12:32:10.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:10 ntpd[17622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:10.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:10 ntpd[17622]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:11.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:11 ntpd[17622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:11.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:11 ntpd[17622]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:11.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:11 ntpd[17622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:11.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:11 ntpd[17622]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:11.932 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:11 ntpd[17622]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-28T12:32:11.932 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:11 ntpd[17622]: can't open /var/log/ntpstats/peerstats.20240328: Permission denied 2024-03-28T12:32:12.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:12.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:12.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:12.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:12.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:12.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:12.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:12.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:12.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-28T12:32:12.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240328: Permission denied 2024-03-28T12:32:12.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:12.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:12.917 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-28T12:32:12.917 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240328: Permission denied 2024-03-28T12:32:12.917 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:12.917 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:12.917 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-28T12:32:12.917 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:12 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240328: Permission denied 2024-03-28T12:32:12.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:12 ntpd[17622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:12.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:12 ntpd[17622]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:12.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:12 ntpd[17622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:12.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:12 ntpd[17622]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:12.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:12 ntpd[17622]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-28T12:32:12.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:12 ntpd[17622]: can't open /var/log/ntpstats/peerstats.20240328: Permission denied 2024-03-28T12:32:13.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:13 ntpd[17622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:13.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:13 ntpd[17622]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:13.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:13 ntpd[17622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:13.932 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:13 ntpd[17622]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:13.932 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:13 ntpd[17622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:13.932 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:13 ntpd[17622]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:13.932 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:13 ntpd[17622]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-28T12:32:13.932 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:13 ntpd[17622]: can't open /var/log/ntpstats/peerstats.20240328: Permission denied 2024-03-28T12:32:13.932 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:13 ntpd[17622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:13.932 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:13 ntpd[17622]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:13.932 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:13 ntpd[17622]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-28T12:32:13.932 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:13 ntpd[17622]: can't open /var/log/ntpstats/peerstats.20240328: Permission denied 2024-03-28T12:32:14.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:14.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:14.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:14.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:14.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:14.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:14.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:14.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:14.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-28T12:32:14.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240328: Permission denied 2024-03-28T12:32:14.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:14.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:14.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-28T12:32:14.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240328: Permission denied 2024-03-28T12:32:14.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:14.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:14.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-28T12:32:14.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:14 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240328: Permission denied 2024-03-28T12:32:14.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:14 ntpd[17622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:14.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:14 ntpd[17622]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:14.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:14 ntpd[17622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:14.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:14 ntpd[17622]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:14.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:14 ntpd[17622]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-28T12:32:14.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:14 ntpd[17622]: can't open /var/log/ntpstats/peerstats.20240328: Permission denied 2024-03-28T12:32:15.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:15 ntpd[17622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:15.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:15 ntpd[17622]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:15.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:15 ntpd[17622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:15.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:15 ntpd[17622]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:15.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:15 ntpd[17622]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:15.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:15 ntpd[17622]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:15.931 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:15 ntpd[17622]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-28T12:32:15.932 INFO:teuthology.orchestra.run.smithi111.stdout:28 Mar 12:32:15 ntpd[17622]: ntpd: time slew -0.002276 s 2024-03-28T12:32:15.932 INFO:teuthology.orchestra.run.smithi111.stdout:ntpd: time slew -0.002276s 2024-03-28T12:32:15.932 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:15 ntpd[17622]: can't open /var/log/ntpstats/peerstats.20240328: Permission denied 2024-03-28T12:32:15.933 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:15 ntpd[17622]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-28T12:32:15.933 INFO:teuthology.orchestra.run.smithi111.stderr:28 Mar 12:32:15 ntpd[17622]: can't open /var/log/ntpstats/loopstats.20240328: Permission denied 2024-03-28T12:32:16.026 INFO:teuthology.orchestra.run.smithi111.stdout: remote refid st t when poll reach delay offset jitter 2024-03-28T12:32:16.026 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================== 2024-03-28T12:32:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-28T12:32:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-28T12:32:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-28T12:32:16.027 INFO:teuthology.orchestra.run.smithi111.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-28T12:32:16.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:16 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:16.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:16 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:16.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:16 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:16.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:16 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:16.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:16 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:16.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:16 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:16.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:16 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:16.915 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:16 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:16.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:16 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-28T12:32:16.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:16 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240328: Permission denied 2024-03-28T12:32:16.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:16 ntpd[17170]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-28T12:32:16.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:16 ntpd[17170]: can't open /var/log/ntpstats/rawstats.20240328: Permission denied 2024-03-28T12:32:16.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:16 ntpd[17170]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-28T12:32:16.916 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:16 ntpd[17170]: can't open /var/log/ntpstats/peerstats.20240328: Permission denied 2024-03-28T12:32:16.916 INFO:teuthology.orchestra.run.smithi076.stdout:28 Mar 12:32:16 ntpd[17170]: ntpd: time slew -0.000197 s 2024-03-28T12:32:16.916 INFO:teuthology.orchestra.run.smithi076.stdout:ntpd: time slew -0.000197s 2024-03-28T12:32:16.917 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:16 ntpd[17170]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-28T12:32:16.917 INFO:teuthology.orchestra.run.smithi076.stderr:28 Mar 12:32:16 ntpd[17170]: can't open /var/log/ntpstats/loopstats.20240328: Permission denied 2024-03-28T12:32:17.036 INFO:teuthology.orchestra.run.smithi076.stdout: remote refid st t when poll reach delay offset jitter 2024-03-28T12:32:17.036 INFO:teuthology.orchestra.run.smithi076.stdout:============================================================================== 2024-03-28T12:32:17.036 INFO:teuthology.orchestra.run.smithi076.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-28T12:32:17.036 INFO:teuthology.orchestra.run.smithi076.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-28T12:32:17.036 INFO:teuthology.orchestra.run.smithi076.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-28T12:32:17.037 INFO:teuthology.orchestra.run.smithi076.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-28T12:32:17.037 INFO:teuthology.run_tasks:Running task install... 2024-03-28T12:32:17.049 DEBUG:teuthology.task.install:project ceph 2024-03-28T12:32:17.049 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15'}} 2024-03-28T12:32:17.049 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15'} 2024-03-28T12:32:17.050 INFO:teuthology.task.install:Using flavor: default 2024-03-28T12:32:17.055 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-03-28T12:32:17.055 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-28T12:32:17.055 DEBUG:teuthology.orchestra.run.smithi076:> sudo apt-key list | grep Ceph 2024-03-28T12:32:17.055 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-key list | grep Ceph 2024-03-28T12:32:17.117 INFO:teuthology.orchestra.run.smithi111.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-28T12:32:17.147 INFO:teuthology.orchestra.run.smithi111.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-28T12:32:17.147 INFO:teuthology.orchestra.run.smithi111.stdout:uid [ unknown] Ceph.com (release key) 2024-03-28T12:32:17.148 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-03-28T12:32:17.148 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-03-28T12:32:17.148 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15 2024-03-28T12:32:17.183 INFO:teuthology.orchestra.run.smithi076.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-28T12:32:17.234 INFO:teuthology.orchestra.run.smithi076.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-28T12:32:17.234 INFO:teuthology.orchestra.run.smithi076.stdout:uid [ unknown] Ceph.com (release key) 2024-03-28T12:32:17.235 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-03-28T12:32:17.235 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-03-28T12:32:17.235 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15 2024-03-28T12:32:17.293 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default/ 2024-03-28T12:32:17.293 INFO:teuthology.task.install.deb:Package version is 19.0.0-2499-ge0e48ba6-1jammy 2024-03-28T12:32:17.403 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:32:17.403 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-28T12:32:17.417 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-03-28T12:32:17.459 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default/ 2024-03-28T12:32:17.459 INFO:teuthology.task.install.deb:Package version is 19.0.0-2499-ge0e48ba6-1jammy 2024-03-28T12:32:17.627 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:32:17.627 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-28T12:32:17.638 INFO:teuthology.orchestra.run.smithi111.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy InRelease 2024-03-28T12:32:17.646 DEBUG:teuthology.orchestra.run.smithi076:> sudo apt-get update 2024-03-28T12:32:17.660 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-28T12:32:17.683 INFO:teuthology.orchestra.run.smithi111.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-28T12:32:17.705 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-03-28T12:32:17.736 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-28T12:32:17.736 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-28T12:32:17.738 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-03-28T12:32:17.808 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-28T12:32:17.847 INFO:teuthology.orchestra.run.smithi076.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-28T12:32:17.859 INFO:teuthology.orchestra.run.smithi076.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-28T12:32:17.878 INFO:teuthology.orchestra.run.smithi076.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy InRelease 2024-03-28T12:32:17.890 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-28T12:32:17.893 INFO:teuthology.orchestra.run.smithi076.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-28T12:32:17.899 INFO:teuthology.orchestra.run.smithi076.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-28T12:32:17.922 INFO:teuthology.orchestra.run.smithi076.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-28T12:32:17.943 INFO:teuthology.orchestra.run.smithi076.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-03-28T12:32:17.954 INFO:teuthology.orchestra.run.smithi076.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-28T12:32:17.975 INFO:teuthology.orchestra.run.smithi076.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-03-28T12:32:18.109 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 29.1 kB in 1s (56.8 kB/s) 2024-03-28T12:32:18.432 INFO:teuthology.orchestra.run.smithi076.stdout:Fetched 29.1 kB in 1s (51.6 kB/s) 2024-03-28T12:32:19.062 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-03-28T12:32:19.079 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2499-ge0e48ba6-1jammy cephadm=19.0.0-2499-ge0e48ba6-1jammy ceph-mds=19.0.0-2499-ge0e48ba6-1jammy ceph-mgr=19.0.0-2499-ge0e48ba6-1jammy ceph-common=19.0.0-2499-ge0e48ba6-1jammy ceph-fuse=19.0.0-2499-ge0e48ba6-1jammy ceph-test=19.0.0-2499-ge0e48ba6-1jammy ceph-volume=19.0.0-2499-ge0e48ba6-1jammy radosgw=19.0.0-2499-ge0e48ba6-1jammy python3-rados=19.0.0-2499-ge0e48ba6-1jammy python3-rgw=19.0.0-2499-ge0e48ba6-1jammy python3-cephfs=19.0.0-2499-ge0e48ba6-1jammy python3-rbd=19.0.0-2499-ge0e48ba6-1jammy libcephfs2=19.0.0-2499-ge0e48ba6-1jammy libcephfs-dev=19.0.0-2499-ge0e48ba6-1jammy librados2=19.0.0-2499-ge0e48ba6-1jammy librbd1=19.0.0-2499-ge0e48ba6-1jammy rbd-fuse=19.0.0-2499-ge0e48ba6-1jammy ceph-common-dbg=19.0.0-2499-ge0e48ba6-1jammy ceph-fuse-dbg=19.0.0-2499-ge0e48ba6-1jammy ceph-mds-dbg=19.0.0-2499-ge0e48ba6-1jammy ceph-mgr-dbg=19.0.0-2499-ge0e48ba6-1jammy ceph-mon-dbg=19.0.0-2499-ge0e48ba6-1jammy ceph-osd-dbg=19.0.0-2499-ge0e48ba6-1jammy ceph-test-dbg=19.0.0-2499-ge0e48ba6-1jammy libcephfs2-dbg=19.0.0-2499-ge0e48ba6-1jammy librados2-dbg=19.0.0-2499-ge0e48ba6-1jammy libradosstriper1-dbg=19.0.0-2499-ge0e48ba6-1jammy librbd1-dbg=19.0.0-2499-ge0e48ba6-1jammy librgw2-dbg=19.0.0-2499-ge0e48ba6-1jammy radosgw-dbg=19.0.0-2499-ge0e48ba6-1jammy rbd-fuse-dbg=19.0.0-2499-ge0e48ba6-1jammy rbd-mirror-dbg=19.0.0-2499-ge0e48ba6-1jammy rbd-nbd-dbg=19.0.0-2499-ge0e48ba6-1jammy python3-cephfs=19.0.0-2499-ge0e48ba6-1jammy cephfs-shell=19.0.0-2499-ge0e48ba6-1jammy cephfs-top=19.0.0-2499-ge0e48ba6-1jammy cephfs-mirror=19.0.0-2499-ge0e48ba6-1jammy 2024-03-28T12:32:19.141 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-03-28T12:32:19.347 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-03-28T12:32:19.348 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-03-28T12:32:19.394 INFO:teuthology.orchestra.run.smithi076.stdout:Reading package lists... 2024-03-28T12:32:19.408 DEBUG:teuthology.orchestra.run.smithi076:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2499-ge0e48ba6-1jammy cephadm=19.0.0-2499-ge0e48ba6-1jammy ceph-mds=19.0.0-2499-ge0e48ba6-1jammy ceph-mgr=19.0.0-2499-ge0e48ba6-1jammy ceph-common=19.0.0-2499-ge0e48ba6-1jammy ceph-fuse=19.0.0-2499-ge0e48ba6-1jammy ceph-test=19.0.0-2499-ge0e48ba6-1jammy ceph-volume=19.0.0-2499-ge0e48ba6-1jammy radosgw=19.0.0-2499-ge0e48ba6-1jammy python3-rados=19.0.0-2499-ge0e48ba6-1jammy python3-rgw=19.0.0-2499-ge0e48ba6-1jammy python3-cephfs=19.0.0-2499-ge0e48ba6-1jammy python3-rbd=19.0.0-2499-ge0e48ba6-1jammy libcephfs2=19.0.0-2499-ge0e48ba6-1jammy libcephfs-dev=19.0.0-2499-ge0e48ba6-1jammy librados2=19.0.0-2499-ge0e48ba6-1jammy librbd1=19.0.0-2499-ge0e48ba6-1jammy rbd-fuse=19.0.0-2499-ge0e48ba6-1jammy ceph-common-dbg=19.0.0-2499-ge0e48ba6-1jammy ceph-fuse-dbg=19.0.0-2499-ge0e48ba6-1jammy ceph-mds-dbg=19.0.0-2499-ge0e48ba6-1jammy ceph-mgr-dbg=19.0.0-2499-ge0e48ba6-1jammy ceph-mon-dbg=19.0.0-2499-ge0e48ba6-1jammy ceph-osd-dbg=19.0.0-2499-ge0e48ba6-1jammy ceph-test-dbg=19.0.0-2499-ge0e48ba6-1jammy libcephfs2-dbg=19.0.0-2499-ge0e48ba6-1jammy librados2-dbg=19.0.0-2499-ge0e48ba6-1jammy libradosstriper1-dbg=19.0.0-2499-ge0e48ba6-1jammy librbd1-dbg=19.0.0-2499-ge0e48ba6-1jammy librgw2-dbg=19.0.0-2499-ge0e48ba6-1jammy radosgw-dbg=19.0.0-2499-ge0e48ba6-1jammy rbd-fuse-dbg=19.0.0-2499-ge0e48ba6-1jammy rbd-mirror-dbg=19.0.0-2499-ge0e48ba6-1jammy rbd-nbd-dbg=19.0.0-2499-ge0e48ba6-1jammy python3-cephfs=19.0.0-2499-ge0e48ba6-1jammy cephfs-shell=19.0.0-2499-ge0e48ba6-1jammy cephfs-top=19.0.0-2499-ge0e48ba6-1jammy cephfs-mirror=19.0.0-2499-ge0e48ba6-1jammy 2024-03-28T12:32:19.482 INFO:teuthology.orchestra.run.smithi076.stdout:Reading package lists... 2024-03-28T12:32:19.533 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-03-28T12:32:19.534 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-28T12:32:19.534 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-28T12:32:19.534 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-28T12:32:19.534 INFO:teuthology.orchestra.run.smithi111.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-03-28T12:32:19.535 INFO:teuthology.orchestra.run.smithi111.stdout: python2.7-minimal 2024-03-28T12:32:19.535 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-28T12:32:19.536 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-03-28T12:32:19.536 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-28T12:32:19.536 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-28T12:32:19.536 INFO:teuthology.orchestra.run.smithi111.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-28T12:32:19.536 INFO:teuthology.orchestra.run.smithi111.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-28T12:32:19.537 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-28T12:32:19.537 INFO:teuthology.orchestra.run.smithi111.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-28T12:32:19.537 INFO:teuthology.orchestra.run.smithi111.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-28T12:32:19.537 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-28T12:32:19.537 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-28T12:32:19.538 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-03-28T12:32:19.538 INFO:teuthology.orchestra.run.smithi111.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-03-28T12:32:19.538 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-03-28T12:32:19.538 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-03-28T12:32:19.538 INFO:teuthology.orchestra.run.smithi111.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-03-28T12:32:19.538 INFO:teuthology.orchestra.run.smithi111.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-03-28T12:32:19.538 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-03-28T12:32:19.538 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-03-28T12:32:19.538 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-03-28T12:32:19.538 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-03-28T12:32:19.538 INFO:teuthology.orchestra.run.smithi111.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-03-28T12:32:19.538 INFO:teuthology.orchestra.run.smithi111.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-03-28T12:32:19.538 INFO:teuthology.orchestra.run.smithi111.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-03-28T12:32:19.538 INFO:teuthology.orchestra.run.smithi111.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-03-28T12:32:19.538 INFO:teuthology.orchestra.run.smithi111.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-03-28T12:32:19.539 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-03-28T12:32:19.539 INFO:teuthology.orchestra.run.smithi111.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-28T12:32:19.539 INFO:teuthology.orchestra.run.smithi111.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-28T12:32:19.539 INFO:teuthology.orchestra.run.smithi111.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-28T12:32:19.539 INFO:teuthology.orchestra.run.smithi111.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-28T12:32:19.539 INFO:teuthology.orchestra.run.smithi111.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-28T12:32:19.539 INFO:teuthology.orchestra.run.smithi111.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-28T12:32:19.539 INFO:teuthology.orchestra.run.smithi111.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-28T12:32:19.539 INFO:teuthology.orchestra.run.smithi111.stdout:Recommended packages: 2024-03-28T12:32:19.539 INFO:teuthology.orchestra.run.smithi111.stdout: btrfs-tools 2024-03-28T12:32:19.653 INFO:teuthology.orchestra.run.smithi076.stdout:Building dependency tree... 2024-03-28T12:32:19.654 INFO:teuthology.orchestra.run.smithi076.stdout:Reading state information... 2024-03-28T12:32:19.670 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-03-28T12:32:19.670 INFO:teuthology.orchestra.run.smithi111.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-03-28T12:32:19.670 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-03-28T12:32:19.670 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-03-28T12:32:19.670 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-03-28T12:32:19.670 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-03-28T12:32:19.671 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-03-28T12:32:19.672 INFO:teuthology.orchestra.run.smithi111.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-03-28T12:32:19.672 INFO:teuthology.orchestra.run.smithi111.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-03-28T12:32:19.672 INFO:teuthology.orchestra.run.smithi111.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-03-28T12:32:19.672 INFO:teuthology.orchestra.run.smithi111.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-03-28T12:32:19.672 INFO:teuthology.orchestra.run.smithi111.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-03-28T12:32:19.672 INFO:teuthology.orchestra.run.smithi111.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-03-28T12:32:19.672 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-03-28T12:32:19.672 INFO:teuthology.orchestra.run.smithi111.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-03-28T12:32:19.672 INFO:teuthology.orchestra.run.smithi111.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-03-28T12:32:19.672 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-28T12:32:19.672 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-28T12:32:19.672 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-28T12:32:19.672 INFO:teuthology.orchestra.run.smithi111.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-28T12:32:19.672 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-28T12:32:19.672 INFO:teuthology.orchestra.run.smithi111.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-28T12:32:19.672 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-03-28T12:32:19.672 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-03-28T12:32:19.673 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-03-28T12:32:19.673 INFO:teuthology.orchestra.run.smithi111.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-28T12:32:19.673 INFO:teuthology.orchestra.run.smithi111.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-28T12:32:19.673 INFO:teuthology.orchestra.run.smithi111.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-28T12:32:19.673 INFO:teuthology.orchestra.run.smithi111.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-28T12:32:19.673 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-03-28T12:32:19.673 INFO:teuthology.orchestra.run.smithi111.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-03-28T12:32:19.673 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-03-28T12:32:19.814 INFO:teuthology.orchestra.run.smithi076.stdout:The following packages were automatically installed and are no longer required: 2024-03-28T12:32:19.815 INFO:teuthology.orchestra.run.smithi076.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-28T12:32:19.815 INFO:teuthology.orchestra.run.smithi076.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-28T12:32:19.815 INFO:teuthology.orchestra.run.smithi076.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-28T12:32:19.815 INFO:teuthology.orchestra.run.smithi076.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-28T12:32:19.815 INFO:teuthology.orchestra.run.smithi076.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-28T12:32:19.815 INFO:teuthology.orchestra.run.smithi076.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-28T12:32:19.816 INFO:teuthology.orchestra.run.smithi076.stdout:The following additional packages will be installed: 2024-03-28T12:32:19.816 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-28T12:32:19.816 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-28T12:32:19.816 INFO:teuthology.orchestra.run.smithi076.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-28T12:32:19.817 INFO:teuthology.orchestra.run.smithi076.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-28T12:32:19.818 INFO:teuthology.orchestra.run.smithi076.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-28T12:32:19.818 INFO:teuthology.orchestra.run.smithi076.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-28T12:32:19.818 INFO:teuthology.orchestra.run.smithi076.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-28T12:32:19.818 INFO:teuthology.orchestra.run.smithi076.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-28T12:32:19.818 INFO:teuthology.orchestra.run.smithi076.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-28T12:32:19.818 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-03-28T12:32:19.818 INFO:teuthology.orchestra.run.smithi076.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-03-28T12:32:19.818 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-03-28T12:32:19.818 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-03-28T12:32:19.818 INFO:teuthology.orchestra.run.smithi076.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-03-28T12:32:19.819 INFO:teuthology.orchestra.run.smithi076.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-03-28T12:32:19.819 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-03-28T12:32:19.819 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-03-28T12:32:19.819 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-03-28T12:32:19.819 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-03-28T12:32:19.819 INFO:teuthology.orchestra.run.smithi076.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-03-28T12:32:19.819 INFO:teuthology.orchestra.run.smithi076.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-03-28T12:32:19.819 INFO:teuthology.orchestra.run.smithi076.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-03-28T12:32:19.819 INFO:teuthology.orchestra.run.smithi076.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-03-28T12:32:19.819 INFO:teuthology.orchestra.run.smithi076.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-03-28T12:32:19.819 INFO:teuthology.orchestra.run.smithi076.stdout:Suggested packages: 2024-03-28T12:32:19.819 INFO:teuthology.orchestra.run.smithi076.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-28T12:32:19.819 INFO:teuthology.orchestra.run.smithi076.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-28T12:32:19.820 INFO:teuthology.orchestra.run.smithi076.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-28T12:32:19.820 INFO:teuthology.orchestra.run.smithi076.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-28T12:32:19.820 INFO:teuthology.orchestra.run.smithi076.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-28T12:32:19.820 INFO:teuthology.orchestra.run.smithi076.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-28T12:32:19.820 INFO:teuthology.orchestra.run.smithi076.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-28T12:32:19.820 INFO:teuthology.orchestra.run.smithi076.stdout:Recommended packages: 2024-03-28T12:32:19.820 INFO:teuthology.orchestra.run.smithi076.stdout: btrfs-tools 2024-03-28T12:32:19.860 INFO:teuthology.orchestra.run.smithi111.stdout:0 upgraded, 142 newly installed, 0 to remove and 301 not upgraded. 2024-03-28T12:32:19.860 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 3,822 MB of archives. 2024-03-28T12:32:19.860 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 4,717 MB of additional disk space will be used. 2024-03-28T12:32:19.860 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-03-28T12:32:19.909 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2499-ge0e48ba6-1jammy [3,553 kB] 2024-03-28T12:32:19.943 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-28T12:32:19.988 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-03-28T12:32:20.005 INFO:teuthology.orchestra.run.smithi076.stdout:The following NEW packages will be installed: 2024-03-28T12:32:20.005 INFO:teuthology.orchestra.run.smithi076.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-03-28T12:32:20.006 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-03-28T12:32:20.006 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-03-28T12:32:20.006 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-03-28T12:32:20.006 INFO:teuthology.orchestra.run.smithi076.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-03-28T12:32:20.006 INFO:teuthology.orchestra.run.smithi076.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-03-28T12:32:20.006 INFO:teuthology.orchestra.run.smithi076.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-03-28T12:32:20.006 INFO:teuthology.orchestra.run.smithi076.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-03-28T12:32:20.006 INFO:teuthology.orchestra.run.smithi076.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-03-28T12:32:20.007 INFO:teuthology.orchestra.run.smithi076.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-03-28T12:32:20.007 INFO:teuthology.orchestra.run.smithi076.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-03-28T12:32:20.007 INFO:teuthology.orchestra.run.smithi076.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-03-28T12:32:20.007 INFO:teuthology.orchestra.run.smithi076.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-03-28T12:32:20.007 INFO:teuthology.orchestra.run.smithi076.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-03-28T12:32:20.008 INFO:teuthology.orchestra.run.smithi076.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-03-28T12:32:20.008 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-28T12:32:20.008 INFO:teuthology.orchestra.run.smithi076.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-28T12:32:20.008 INFO:teuthology.orchestra.run.smithi076.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-28T12:32:20.008 INFO:teuthology.orchestra.run.smithi076.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-28T12:32:20.008 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-28T12:32:20.008 INFO:teuthology.orchestra.run.smithi076.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-28T12:32:20.008 INFO:teuthology.orchestra.run.smithi076.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-03-28T12:32:20.008 INFO:teuthology.orchestra.run.smithi076.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-03-28T12:32:20.008 INFO:teuthology.orchestra.run.smithi076.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-03-28T12:32:20.008 INFO:teuthology.orchestra.run.smithi076.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-28T12:32:20.008 INFO:teuthology.orchestra.run.smithi076.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-28T12:32:20.008 INFO:teuthology.orchestra.run.smithi076.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-28T12:32:20.008 INFO:teuthology.orchestra.run.smithi076.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-28T12:32:20.008 INFO:teuthology.orchestra.run.smithi076.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-03-28T12:32:20.008 INFO:teuthology.orchestra.run.smithi076.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-03-28T12:32:20.008 INFO:teuthology.orchestra.run.smithi076.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-03-28T12:32:20.085 INFO:teuthology.orchestra.run.smithi076.stdout:0 upgraded, 142 newly installed, 0 to remove and 301 not upgraded. 2024-03-28T12:32:20.085 INFO:teuthology.orchestra.run.smithi076.stdout:Need to get 3,822 MB of archives. 2024-03-28T12:32:20.086 INFO:teuthology.orchestra.run.smithi076.stdout:After this operation, 4,717 MB of additional disk space will be used. 2024-03-28T12:32:20.086 INFO:teuthology.orchestra.run.smithi076.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-03-28T12:32:20.106 INFO:teuthology.orchestra.run.smithi076.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-28T12:32:20.119 INFO:teuthology.orchestra.run.smithi076.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-03-28T12:32:20.167 INFO:teuthology.orchestra.run.smithi076.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-28T12:32:20.184 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-28T12:32:20.192 INFO:teuthology.orchestra.run.smithi076.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-28T12:32:20.195 INFO:teuthology.orchestra.run.smithi076.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-28T12:32:20.207 INFO:teuthology.orchestra.run.smithi076.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-28T12:32:20.232 INFO:teuthology.orchestra.run.smithi076.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2499-ge0e48ba6-1jammy [3,553 kB] 2024-03-28T12:32:20.258 INFO:teuthology.orchestra.run.smithi076.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-28T12:32:20.261 INFO:teuthology.orchestra.run.smithi076.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-28T12:32:20.272 INFO:teuthology.orchestra.run.smithi076.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-28T12:32:20.275 INFO:teuthology.orchestra.run.smithi076.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-28T12:32:20.276 INFO:teuthology.orchestra.run.smithi076.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-28T12:32:20.282 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-28T12:32:20.284 INFO:teuthology.orchestra.run.smithi076.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-28T12:32:20.287 INFO:teuthology.orchestra.run.smithi076.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-28T12:32:20.289 INFO:teuthology.orchestra.run.smithi076.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-28T12:32:20.290 INFO:teuthology.orchestra.run.smithi076.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-28T12:32:20.294 INFO:teuthology.orchestra.run.smithi076.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-28T12:32:20.295 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-28T12:32:20.312 INFO:teuthology.orchestra.run.smithi076.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-28T12:32:20.314 INFO:teuthology.orchestra.run.smithi076.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-28T12:32:20.316 INFO:teuthology.orchestra.run.smithi076.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-28T12:32:20.316 INFO:teuthology.orchestra.run.smithi076.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-28T12:32:20.317 INFO:teuthology.orchestra.run.smithi076.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-28T12:32:20.318 INFO:teuthology.orchestra.run.smithi076.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-28T12:32:20.318 INFO:teuthology.orchestra.run.smithi076.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-28T12:32:20.319 INFO:teuthology.orchestra.run.smithi076.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-28T12:32:20.319 INFO:teuthology.orchestra.run.smithi076.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-28T12:32:20.338 INFO:teuthology.orchestra.run.smithi076.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-28T12:32:20.339 INFO:teuthology.orchestra.run.smithi076.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-28T12:32:20.339 INFO:teuthology.orchestra.run.smithi076.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-28T12:32:20.342 INFO:teuthology.orchestra.run.smithi076.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-28T12:32:20.342 INFO:teuthology.orchestra.run.smithi076.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-28T12:32:20.343 INFO:teuthology.orchestra.run.smithi076.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-28T12:32:20.347 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-28T12:32:20.358 INFO:teuthology.orchestra.run.smithi076.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-28T12:32:20.360 INFO:teuthology.orchestra.run.smithi076.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-28T12:32:20.360 INFO:teuthology.orchestra.run.smithi076.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-28T12:32:20.360 INFO:teuthology.orchestra.run.smithi076.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-28T12:32:20.378 INFO:teuthology.orchestra.run.smithi076.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-28T12:32:20.379 INFO:teuthology.orchestra.run.smithi076.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-28T12:32:20.379 INFO:teuthology.orchestra.run.smithi076.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-28T12:32:20.386 INFO:teuthology.orchestra.run.smithi076.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-28T12:32:20.386 INFO:teuthology.orchestra.run.smithi076.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-28T12:32:20.386 INFO:teuthology.orchestra.run.smithi076.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-28T12:32:20.398 INFO:teuthology.orchestra.run.smithi076.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-28T12:32:20.399 INFO:teuthology.orchestra.run.smithi076.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-28T12:32:20.401 INFO:teuthology.orchestra.run.smithi076.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-28T12:32:20.402 INFO:teuthology.orchestra.run.smithi076.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-28T12:32:20.421 INFO:teuthology.orchestra.run.smithi076.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-28T12:32:20.421 INFO:teuthology.orchestra.run.smithi076.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-28T12:32:20.421 INFO:teuthology.orchestra.run.smithi076.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-28T12:32:20.422 INFO:teuthology.orchestra.run.smithi076.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-28T12:32:20.422 INFO:teuthology.orchestra.run.smithi076.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-28T12:32:20.424 INFO:teuthology.orchestra.run.smithi076.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-28T12:32:20.493 INFO:teuthology.orchestra.run.smithi076.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-28T12:32:20.494 INFO:teuthology.orchestra.run.smithi076.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-28T12:32:20.496 INFO:teuthology.orchestra.run.smithi076.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-28T12:32:20.496 INFO:teuthology.orchestra.run.smithi076.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-28T12:32:20.503 INFO:teuthology.orchestra.run.smithi076.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-28T12:32:20.523 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-28T12:32:20.527 INFO:teuthology.orchestra.run.smithi076.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-28T12:32:20.529 INFO:teuthology.orchestra.run.smithi076.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-28T12:32:20.529 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-28T12:32:20.529 INFO:teuthology.orchestra.run.smithi076.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-28T12:32:20.557 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-28T12:32:20.563 INFO:teuthology.orchestra.run.smithi076.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-28T12:32:20.563 INFO:teuthology.orchestra.run.smithi076.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-28T12:32:20.564 INFO:teuthology.orchestra.run.smithi076.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-28T12:32:20.564 INFO:teuthology.orchestra.run.smithi076.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-28T12:32:20.565 INFO:teuthology.orchestra.run.smithi076.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-28T12:32:20.565 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-28T12:32:20.565 INFO:teuthology.orchestra.run.smithi076.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-28T12:32:20.585 INFO:teuthology.orchestra.run.smithi076.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-28T12:32:20.585 INFO:teuthology.orchestra.run.smithi076.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-28T12:32:20.590 INFO:teuthology.orchestra.run.smithi076.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-28T12:32:20.608 INFO:teuthology.orchestra.run.smithi076.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-28T12:32:20.610 INFO:teuthology.orchestra.run.smithi076.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-28T12:32:20.611 INFO:teuthology.orchestra.run.smithi076.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-28T12:32:20.614 INFO:teuthology.orchestra.run.smithi076.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-28T12:32:20.617 INFO:teuthology.orchestra.run.smithi076.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-03-28T12:32:20.618 INFO:teuthology.orchestra.run.smithi076.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-28T12:32:20.619 INFO:teuthology.orchestra.run.smithi076.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-28T12:32:20.631 INFO:teuthology.orchestra.run.smithi076.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-28T12:32:20.636 INFO:teuthology.orchestra.run.smithi076.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-28T12:32:20.637 INFO:teuthology.orchestra.run.smithi076.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-28T12:32:20.653 INFO:teuthology.orchestra.run.smithi076.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-28T12:32:20.653 INFO:teuthology.orchestra.run.smithi076.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-28T12:32:20.654 INFO:teuthology.orchestra.run.smithi076.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-28T12:32:20.654 INFO:teuthology.orchestra.run.smithi076.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-28T12:32:20.656 INFO:teuthology.orchestra.run.smithi076.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-28T12:32:20.657 INFO:teuthology.orchestra.run.smithi076.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-28T12:32:20.666 INFO:teuthology.orchestra.run.smithi076.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-28T12:32:20.675 INFO:teuthology.orchestra.run.smithi076.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-28T12:32:20.675 INFO:teuthology.orchestra.run.smithi076.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-28T12:32:20.678 INFO:teuthology.orchestra.run.smithi076.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-28T12:32:20.695 INFO:teuthology.orchestra.run.smithi076.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-28T12:32:20.730 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-28T12:32:20.898 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2499-ge0e48ba6-1jammy [3,226 kB] 2024-03-28T12:32:21.615 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-28T12:32:21.635 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-28T12:32:21.657 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2499-ge0e48ba6-1jammy [712 kB] 2024-03-28T12:32:21.697 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-28T12:32:21.709 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-28T12:32:21.710 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-28T12:32:21.731 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-28T12:32:21.753 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-28T12:32:21.770 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-28T12:32:21.778 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-28T12:32:21.779 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-28T12:32:21.800 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2499-ge0e48ba6-1jammy [356 kB] 2024-03-28T12:32:21.846 INFO:teuthology.orchestra.run.smithi076.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2499-ge0e48ba6-1jammy [3,226 kB] 2024-03-28T12:32:21.878 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2499-ge0e48ba6-1jammy [32.8 kB] 2024-03-28T12:32:21.881 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2499-ge0e48ba6-1jammy [180 kB] 2024-03-28T12:32:21.903 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2499-ge0e48ba6-1jammy [66.6 kB] 2024-03-28T12:32:21.909 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2499-ge0e48ba6-1jammy [330 kB] 2024-03-28T12:32:21.949 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-28T12:32:21.978 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2499-ge0e48ba6-1jammy [6,660 kB] 2024-03-28T12:32:22.032 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-28T12:32:22.054 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-28T12:32:22.114 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-28T12:32:22.154 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-28T12:32:22.175 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-28T12:32:22.203 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-28T12:32:22.387 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-28T12:32:22.402 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-28T12:32:22.409 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-28T12:32:22.414 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-28T12:32:22.598 INFO:teuthology.orchestra.run.smithi111.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-28T12:32:22.682 INFO:teuthology.orchestra.run.smithi111.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-28T12:32:22.697 INFO:teuthology.orchestra.run.smithi111.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-28T12:32:22.713 INFO:teuthology.orchestra.run.smithi076.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2499-ge0e48ba6-1jammy [712 kB] 2024-03-28T12:32:22.816 INFO:teuthology.orchestra.run.smithi076.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2499-ge0e48ba6-1jammy [356 kB] 2024-03-28T12:32:22.857 INFO:teuthology.orchestra.run.smithi111.stdout:Get:46 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2499-ge0e48ba6-1jammy [112 kB] 2024-03-28T12:32:22.862 INFO:teuthology.orchestra.run.smithi111.stdout:Get:47 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2499-ge0e48ba6-1jammy [466 kB] 2024-03-28T12:32:22.882 INFO:teuthology.orchestra.run.smithi111.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-28T12:32:22.888 INFO:teuthology.orchestra.run.smithi076.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2499-ge0e48ba6-1jammy [32.8 kB] 2024-03-28T12:32:22.889 INFO:teuthology.orchestra.run.smithi076.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2499-ge0e48ba6-1jammy [180 kB] 2024-03-28T12:32:22.916 INFO:teuthology.orchestra.run.smithi111.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2499-ge0e48ba6-1jammy [25.3 MB] 2024-03-28T12:32:22.933 INFO:teuthology.orchestra.run.smithi111.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-28T12:32:22.938 INFO:teuthology.orchestra.run.smithi076.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2499-ge0e48ba6-1jammy [66.6 kB] 2024-03-28T12:32:22.947 INFO:teuthology.orchestra.run.smithi111.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-28T12:32:22.962 INFO:teuthology.orchestra.run.smithi076.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2499-ge0e48ba6-1jammy [330 kB] 2024-03-28T12:32:22.973 INFO:teuthology.orchestra.run.smithi076.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2499-ge0e48ba6-1jammy [6,660 kB] 2024-03-28T12:32:23.105 INFO:teuthology.orchestra.run.smithi111.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-28T12:32:23.106 INFO:teuthology.orchestra.run.smithi111.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-28T12:32:23.111 INFO:teuthology.orchestra.run.smithi111.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-28T12:32:23.115 INFO:teuthology.orchestra.run.smithi111.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-28T12:32:23.130 INFO:teuthology.orchestra.run.smithi111.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-28T12:32:23.315 INFO:teuthology.orchestra.run.smithi111.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-28T12:32:23.579 INFO:teuthology.orchestra.run.smithi111.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-28T12:32:23.695 INFO:teuthology.orchestra.run.smithi111.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-28T12:32:23.739 INFO:teuthology.orchestra.run.smithi111.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-28T12:32:23.821 INFO:teuthology.orchestra.run.smithi111.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-28T12:32:23.833 INFO:teuthology.orchestra.run.smithi111.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-28T12:32:23.846 INFO:teuthology.orchestra.run.smithi111.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-28T12:32:23.887 INFO:teuthology.orchestra.run.smithi111.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-28T12:32:24.149 INFO:teuthology.orchestra.run.smithi111.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-28T12:32:24.151 INFO:teuthology.orchestra.run.smithi111.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-28T12:32:24.154 INFO:teuthology.orchestra.run.smithi111.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-28T12:32:24.154 INFO:teuthology.orchestra.run.smithi076.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2499-ge0e48ba6-1jammy [112 kB] 2024-03-28T12:32:24.157 INFO:teuthology.orchestra.run.smithi076.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2499-ge0e48ba6-1jammy [466 kB] 2024-03-28T12:32:24.249 INFO:teuthology.orchestra.run.smithi076.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2499-ge0e48ba6-1jammy [25.3 MB] 2024-03-28T12:32:24.318 INFO:teuthology.orchestra.run.smithi111.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-28T12:32:24.656 INFO:teuthology.orchestra.run.smithi111.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-28T12:32:25.311 INFO:teuthology.orchestra.run.smithi111.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-28T12:32:25.327 INFO:teuthology.orchestra.run.smithi111.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-28T12:32:25.328 INFO:teuthology.orchestra.run.smithi111.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-28T12:32:25.415 INFO:teuthology.orchestra.run.smithi111.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-28T12:32:25.416 INFO:teuthology.orchestra.run.smithi111.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-28T12:32:25.418 INFO:teuthology.orchestra.run.smithi111.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-28T12:32:25.419 INFO:teuthology.orchestra.run.smithi111.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-28T12:32:25.420 INFO:teuthology.orchestra.run.smithi111.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-28T12:32:25.421 INFO:teuthology.orchestra.run.smithi111.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-28T12:32:25.586 INFO:teuthology.orchestra.run.smithi111.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-28T12:32:25.616 INFO:teuthology.orchestra.run.smithi111.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2499-ge0e48ba6-1jammy [5,086 kB] 2024-03-28T12:32:25.798 INFO:teuthology.orchestra.run.smithi111.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-28T12:32:26.113 INFO:teuthology.orchestra.run.smithi111.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-28T12:32:26.157 INFO:teuthology.orchestra.run.smithi111.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-28T12:32:26.179 INFO:teuthology.orchestra.run.smithi111.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2499-ge0e48ba6-1jammy [244 kB] 2024-03-28T12:32:26.184 INFO:teuthology.orchestra.run.smithi111.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-28T12:32:26.190 INFO:teuthology.orchestra.run.smithi111.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2499-ge0e48ba6-1jammy [124 kB] 2024-03-28T12:32:26.194 INFO:teuthology.orchestra.run.smithi111.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-28T12:32:26.239 INFO:teuthology.orchestra.run.smithi111.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2499-ge0e48ba6-1jammy [1,526 kB] 2024-03-28T12:32:26.240 INFO:teuthology.orchestra.run.smithi111.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-28T12:32:26.265 INFO:teuthology.orchestra.run.smithi111.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-03-28T12:32:26.267 INFO:teuthology.orchestra.run.smithi111.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-28T12:32:26.273 INFO:teuthology.orchestra.run.smithi111.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-28T12:32:26.277 INFO:teuthology.orchestra.run.smithi111.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-28T12:32:26.420 INFO:teuthology.orchestra.run.smithi111.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2499-ge0e48ba6-1jammy [6,259 kB] 2024-03-28T12:32:26.495 INFO:teuthology.orchestra.run.smithi111.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-28T12:32:26.755 INFO:teuthology.orchestra.run.smithi111.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-28T12:32:26.995 INFO:teuthology.orchestra.run.smithi111.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-28T12:32:26.997 INFO:teuthology.orchestra.run.smithi111.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-28T12:32:27.016 INFO:teuthology.orchestra.run.smithi111.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-28T12:32:27.022 INFO:teuthology.orchestra.run.smithi111.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-28T12:32:27.058 INFO:teuthology.orchestra.run.smithi111.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-28T12:32:27.071 INFO:teuthology.orchestra.run.smithi111.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-28T12:32:27.162 INFO:teuthology.orchestra.run.smithi111.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-28T12:32:27.164 INFO:teuthology.orchestra.run.smithi111.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-28T12:32:27.165 INFO:teuthology.orchestra.run.smithi111.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-28T12:32:27.182 INFO:teuthology.orchestra.run.smithi111.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2499-ge0e48ba6-1jammy [22.8 MB] 2024-03-28T12:32:27.344 INFO:teuthology.orchestra.run.smithi111.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-28T12:32:27.616 INFO:teuthology.orchestra.run.smithi111.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-28T12:32:28.076 INFO:teuthology.orchestra.run.smithi076.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2499-ge0e48ba6-1jammy [5,086 kB] 2024-03-28T12:32:28.837 INFO:teuthology.orchestra.run.smithi076.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2499-ge0e48ba6-1jammy [244 kB] 2024-03-28T12:32:28.849 INFO:teuthology.orchestra.run.smithi076.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2499-ge0e48ba6-1jammy [124 kB] 2024-03-28T12:32:28.915 INFO:teuthology.orchestra.run.smithi076.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2499-ge0e48ba6-1jammy [1,526 kB] 2024-03-28T12:32:29.115 INFO:teuthology.orchestra.run.smithi076.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2499-ge0e48ba6-1jammy [6,259 kB] 2024-03-28T12:32:29.985 INFO:teuthology.orchestra.run.smithi111.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2499-ge0e48ba6-1jammy [14.0 kB] 2024-03-28T12:32:30.015 INFO:teuthology.orchestra.run.smithi111.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2499-ge0e48ba6-1jammy [870 kB] 2024-03-28T12:32:30.053 INFO:teuthology.orchestra.run.smithi076.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2499-ge0e48ba6-1jammy [22.8 MB] 2024-03-28T12:32:30.067 INFO:teuthology.orchestra.run.smithi111.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2499-ge0e48ba6-1jammy [2,434 kB] 2024-03-28T12:32:30.366 INFO:teuthology.orchestra.run.smithi111.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2499-ge0e48ba6-1jammy [790 kB] 2024-03-28T12:32:30.506 INFO:teuthology.orchestra.run.smithi111.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2499-ge0e48ba6-1jammy [147 kB] 2024-03-28T12:32:30.528 INFO:teuthology.orchestra.run.smithi111.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2499-ge0e48ba6-1jammy [2,242 kB] 2024-03-28T12:32:30.869 INFO:teuthology.orchestra.run.smithi111.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2499-ge0e48ba6-1jammy [8,625 kB] 2024-03-28T12:32:32.090 INFO:teuthology.orchestra.run.smithi111.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2499-ge0e48ba6-1jammy [14.2 kB] 2024-03-28T12:32:32.091 INFO:teuthology.orchestra.run.smithi111.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2499-ge0e48ba6-1jammy [50.3 MB] 2024-03-28T12:32:33.314 INFO:teuthology.orchestra.run.smithi076.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2499-ge0e48ba6-1jammy [14.0 kB] 2024-03-28T12:32:33.314 INFO:teuthology.orchestra.run.smithi076.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2499-ge0e48ba6-1jammy [870 kB] 2024-03-28T12:32:33.429 INFO:teuthology.orchestra.run.smithi076.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2499-ge0e48ba6-1jammy [2,434 kB] 2024-03-28T12:32:33.787 INFO:teuthology.orchestra.run.smithi076.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2499-ge0e48ba6-1jammy [790 kB] 2024-03-28T12:32:33.869 INFO:teuthology.orchestra.run.smithi076.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2499-ge0e48ba6-1jammy [147 kB] 2024-03-28T12:32:33.889 INFO:teuthology.orchestra.run.smithi076.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2499-ge0e48ba6-1jammy [2,242 kB] 2024-03-28T12:32:34.095 INFO:teuthology.orchestra.run.smithi076.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2499-ge0e48ba6-1jammy [8,625 kB] 2024-03-28T12:32:34.949 INFO:teuthology.orchestra.run.smithi076.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2499-ge0e48ba6-1jammy [14.2 kB] 2024-03-28T12:32:34.950 INFO:teuthology.orchestra.run.smithi076.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2499-ge0e48ba6-1jammy [50.3 MB] 2024-03-28T12:32:37.562 INFO:teuthology.orchestra.run.smithi111.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2499-ge0e48ba6-1jammy [121 kB] 2024-03-28T12:32:37.564 INFO:teuthology.orchestra.run.smithi111.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2499-ge0e48ba6-1jammy [229 kB] 2024-03-28T12:32:37.569 INFO:teuthology.orchestra.run.smithi111.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2499-ge0e48ba6-1jammy [34.0 kB] 2024-03-28T12:32:37.570 INFO:teuthology.orchestra.run.smithi111.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2499-ge0e48ba6-1jammy [23.4 kB] 2024-03-28T12:32:37.571 INFO:teuthology.orchestra.run.smithi111.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2499-ge0e48ba6-1jammy [38.9 kB] 2024-03-28T12:32:37.572 INFO:teuthology.orchestra.run.smithi111.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2499-ge0e48ba6-1jammy [13.2 MB] 2024-03-28T12:32:38.880 INFO:teuthology.orchestra.run.smithi076.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2499-ge0e48ba6-1jammy [121 kB] 2024-03-28T12:32:38.881 INFO:teuthology.orchestra.run.smithi076.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2499-ge0e48ba6-1jammy [229 kB] 2024-03-28T12:32:38.888 INFO:teuthology.orchestra.run.smithi076.stdout:Get:120 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2499-ge0e48ba6-1jammy [34.0 kB] 2024-03-28T12:32:38.889 INFO:teuthology.orchestra.run.smithi076.stdout:Get:121 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2499-ge0e48ba6-1jammy [23.4 kB] 2024-03-28T12:32:38.890 INFO:teuthology.orchestra.run.smithi076.stdout:Get:122 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2499-ge0e48ba6-1jammy [38.9 kB] 2024-03-28T12:32:38.892 INFO:teuthology.orchestra.run.smithi076.stdout:Get:123 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2499-ge0e48ba6-1jammy [13.2 MB] 2024-03-28T12:32:38.995 INFO:teuthology.orchestra.run.smithi111.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2499-ge0e48ba6-1jammy [91.4 kB] 2024-03-28T12:32:38.997 INFO:teuthology.orchestra.run.smithi111.stdout:Get:125 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-2499-ge0e48ba6-1jammy [3,123 kB] 2024-03-28T12:32:39.206 INFO:teuthology.orchestra.run.smithi111.stdout:Get:126 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-2499-ge0e48ba6-1jammy [179 kB] 2024-03-28T12:32:39.261 INFO:teuthology.orchestra.run.smithi111.stdout:Get:127 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [763 MB] 2024-03-28T12:32:39.816 INFO:teuthology.orchestra.run.smithi076.stdout:Get:124 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2499-ge0e48ba6-1jammy [91.4 kB] 2024-03-28T12:32:39.817 INFO:teuthology.orchestra.run.smithi076.stdout:Get:125 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-2499-ge0e48ba6-1jammy [3,123 kB] 2024-03-28T12:32:40.034 INFO:teuthology.orchestra.run.smithi076.stdout:Get:126 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-2499-ge0e48ba6-1jammy [179 kB] 2024-03-28T12:32:40.039 INFO:teuthology.orchestra.run.smithi076.stdout:Get:127 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [763 MB] 2024-03-28T12:33:17.893 INFO:teuthology.orchestra.run.smithi076.stdout:Get:128 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [19.0 MB] 2024-03-28T12:33:19.115 INFO:teuthology.orchestra.run.smithi076.stdout:Get:129 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [86.7 MB] 2024-03-28T12:33:26.719 INFO:teuthology.orchestra.run.smithi076.stdout:Get:130 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [42.8 MB] 2024-03-28T12:33:29.937 INFO:teuthology.orchestra.run.smithi076.stdout:Get:131 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [159 MB] 2024-03-28T12:33:44.402 INFO:teuthology.orchestra.run.smithi111.stdout:Get:128 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [19.0 MB] 2024-03-28T12:33:44.447 INFO:teuthology.orchestra.run.smithi076.stdout:Get:132 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [542 MB] 2024-03-28T12:33:45.339 INFO:teuthology.orchestra.run.smithi111.stdout:Get:129 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [86.7 MB] 2024-03-28T12:33:49.558 INFO:teuthology.orchestra.run.smithi111.stdout:Get:130 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [42.8 MB] 2024-03-28T12:33:51.880 INFO:teuthology.orchestra.run.smithi111.stdout:Get:131 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [159 MB] 2024-03-28T12:34:00.686 INFO:teuthology.orchestra.run.smithi111.stdout:Get:132 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [542 MB] 2024-03-28T12:34:30.034 INFO:teuthology.orchestra.run.smithi076.stdout:Get:133 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [1,194 MB] 2024-03-28T12:34:34.392 INFO:teuthology.orchestra.run.smithi111.stdout:Get:133 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [1,194 MB] 2024-03-28T12:35:45.776 INFO:teuthology.orchestra.run.smithi076.stdout:Get:134 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [17.1 MB] 2024-03-28T12:35:46.575 INFO:teuthology.orchestra.run.smithi076.stdout:Get:135 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [83.3 MB] 2024-03-28T12:35:50.830 INFO:teuthology.orchestra.run.smithi076.stdout:Get:136 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [11.4 MB] 2024-03-28T12:35:51.257 INFO:teuthology.orchestra.run.smithi076.stdout:Get:137 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [104 MB] 2024-03-28T12:35:56.972 INFO:teuthology.orchestra.run.smithi076.stdout:Get:138 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [175 MB] 2024-03-28T12:36:06.322 INFO:teuthology.orchestra.run.smithi076.stdout:Get:139 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [339 MB] 2024-03-28T12:36:16.409 INFO:teuthology.orchestra.run.smithi111.stdout:Get:134 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [17.1 MB] 2024-03-28T12:36:18.182 INFO:teuthology.orchestra.run.smithi111.stdout:Get:135 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [83.3 MB] 2024-03-28T12:36:24.727 INFO:teuthology.orchestra.run.smithi076.stdout:Get:140 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [1,794 kB] 2024-03-28T12:36:24.741 INFO:teuthology.orchestra.run.smithi076.stdout:Get:141 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [97.7 MB] 2024-03-28T12:36:25.484 INFO:teuthology.orchestra.run.smithi111.stdout:Get:136 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [11.4 MB] 2024-03-28T12:36:26.358 INFO:teuthology.orchestra.run.smithi111.stdout:Get:137 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [104 MB] 2024-03-28T12:36:29.721 INFO:teuthology.orchestra.run.smithi076.stdout:Get:142 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [3,146 kB] 2024-03-28T12:36:30.506 INFO:teuthology.orchestra.run.smithi076.stdout:Fetched 3,822 MB in 4min 10s (15.3 MB/s) 2024-03-28T12:36:30.679 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pyperclip. 2024-03-28T12:36:30.746 INFO:teuthology.orchestra.run.smithi076.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132923 files and directories currently installed.) 2024-03-28T12:36:30.750 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-03-28T12:36:30.795 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-03-28T12:36:31.039 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-28T12:36:31.053 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-28T12:36:31.089 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-28T12:36:31.417 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-cmd2. 2024-03-28T12:36:31.432 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-03-28T12:36:31.476 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-03-28T12:36:31.813 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-28T12:36:31.827 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-28T12:36:31.946 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-28T12:36:32.300 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-28T12:36:32.315 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-28T12:36:32.359 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-28T12:36:32.712 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-28T12:36:32.727 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-28T12:36:32.770 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-28T12:36:33.157 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-28T12:36:33.172 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-28T12:36:33.215 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-28T12:36:33.370 INFO:teuthology.orchestra.run.smithi111.stdout:Get:138 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [175 MB] 2024-03-28T12:36:33.653 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-28T12:36:33.667 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-28T12:36:33.711 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-28T12:36:34.073 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-28T12:36:34.087 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-28T12:36:34.131 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-28T12:36:34.418 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-28T12:36:34.432 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-28T12:36:34.468 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-28T12:36:34.830 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package librados2. 2024-03-28T12:36:34.844 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../010-librados2_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:36:34.888 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking librados2 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:35.383 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package librbd1. 2024-03-28T12:36:35.397 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../011-librbd1_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:36:35.441 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking librbd1 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:35.845 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libcephfs2. 2024-03-28T12:36:35.859 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:36:35.894 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libcephfs2 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:36.189 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-rados. 2024-03-28T12:36:36.204 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:36:36.247 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-rados (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:36.584 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-28T12:36:36.598 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:36:36.642 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-ceph-argparse (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:36.870 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-cephfs. 2024-03-28T12:36:36.884 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:36:36.920 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-cephfs (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:37.223 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-28T12:36:37.238 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:36:37.282 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-ceph-common (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:37.635 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-prettytable. 2024-03-28T12:36:37.649 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-03-28T12:36:37.693 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-28T12:36:37.963 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-rbd. 2024-03-28T12:36:37.977 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:36:38.021 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-rbd (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:38.316 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-28T12:36:38.330 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-28T12:36:38.366 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-28T12:36:38.644 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-28T12:36:38.658 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-28T12:36:38.702 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-28T12:36:39.031 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-28T12:36:39.045 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-28T12:36:39.089 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-28T12:36:39.384 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package lua5.1. 2024-03-28T12:36:39.398 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-28T12:36:39.434 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-28T12:36:39.738 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package lua-any. 2024-03-28T12:36:39.752 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-03-28T12:36:39.796 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-28T12:36:40.041 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package zip. 2024-03-28T12:36:40.055 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-03-28T12:36:40.099 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking zip (3.0-12build2) ... 2024-03-28T12:36:40.386 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package unzip. 2024-03-28T12:36:40.400 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-28T12:36:40.436 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-28T12:36:40.849 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package luarocks. 2024-03-28T12:36:40.863 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-28T12:36:40.907 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-28T12:36:41.255 INFO:teuthology.orchestra.run.smithi111.stdout:Get:139 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [339 MB] 2024-03-28T12:36:41.299 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package librgw2. 2024-03-28T12:36:41.313 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../027-librgw2_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:36:41.358 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking librgw2 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:41.836 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-rgw. 2024-03-28T12:36:41.849 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:36:41.886 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-rgw (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:42.231 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-28T12:36:42.245 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-28T12:36:42.289 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-28T12:36:42.609 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libradosstriper1. 2024-03-28T12:36:42.624 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:36:42.667 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libradosstriper1 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:43.096 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-common. 2024-03-28T12:36:43.111 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:36:43.146 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-common (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:44.302 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-base. 2024-03-28T12:36:44.316 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:36:44.402 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-base (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:45.032 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-28T12:36:45.046 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-28T12:36:45.099 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-28T12:36:45.419 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-cheroot. 2024-03-28T12:36:45.433 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-28T12:36:45.477 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-28T12:36:45.872 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-28T12:36:45.887 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-28T12:36:45.939 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-28T12:36:46.317 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-28T12:36:46.332 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-28T12:36:46.384 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-28T12:36:46.704 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-28T12:36:46.718 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-28T12:36:46.762 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-28T12:36:47.066 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-tempora. 2024-03-28T12:36:47.080 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-03-28T12:36:47.141 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-28T12:36:47.402 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-portend. 2024-03-28T12:36:47.417 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-03-28T12:36:47.452 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-28T12:36:47.756 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-28T12:36:47.770 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-28T12:36:47.814 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-28T12:36:48.100 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-28T12:36:48.115 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-28T12:36:48.158 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-28T12:36:48.779 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-natsort. 2024-03-28T12:36:48.793 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-03-28T12:36:48.837 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-28T12:36:49.091 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-logutils. 2024-03-28T12:36:49.105 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-03-28T12:36:49.141 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-28T12:36:49.444 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-28T12:36:49.458 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-28T12:36:49.502 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-28T12:36:49.814 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-mako. 2024-03-28T12:36:49.829 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-28T12:36:49.872 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-28T12:36:50.185 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-28T12:36:50.199 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-28T12:36:50.234 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-28T12:36:50.504 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-28T12:36:50.519 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-28T12:36:50.563 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-28T12:36:50.874 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-webob. 2024-03-28T12:36:50.889 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-28T12:36:50.933 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-28T12:36:51.319 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-waitress. 2024-03-28T12:36:51.334 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-28T12:36:51.397 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-28T12:36:51.690 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-tempita. 2024-03-28T12:36:51.704 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-28T12:36:51.740 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-28T12:36:52.026 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-paste. 2024-03-28T12:36:52.041 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-28T12:36:52.084 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-28T12:36:52.396 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-28T12:36:52.428 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-28T12:36:52.446 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-28T12:36:52.741 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-28T12:36:52.756 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-28T12:36:52.799 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-28T12:36:53.103 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-webtest. 2024-03-28T12:36:53.117 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-03-28T12:36:53.161 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-28T12:36:53.464 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pecan. 2024-03-28T12:36:53.479 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-28T12:36:53.523 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-28T12:36:53.895 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-certifi. 2024-03-28T12:36:53.910 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-03-28T12:36:53.945 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-28T12:36:54.282 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-idna. 2024-03-28T12:36:54.296 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-03-28T12:36:54.340 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-28T12:36:54.660 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-urllib3. 2024-03-28T12:36:54.674 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-28T12:36:54.718 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-28T12:36:55.038 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-requests. 2024-03-28T12:36:55.053 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-28T12:36:55.097 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-28T12:36:55.225 INFO:teuthology.orchestra.run.smithi111.stdout:Get:140 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [1,794 kB] 2024-03-28T12:36:55.258 INFO:teuthology.orchestra.run.smithi111.stdout:Get:141 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [97.7 MB] 2024-03-28T12:36:55.400 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-28T12:36:55.415 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-28T12:36:55.492 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-28T12:36:55.803 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-28T12:36:55.817 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:36:55.861 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:56.217 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-28T12:36:56.231 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:36:56.267 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:56.595 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-28T12:36:56.610 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-28T12:36:56.654 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-28T12:36:57.007 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-openssl. 2024-03-28T12:36:57.022 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-03-28T12:36:57.065 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-28T12:36:57.344 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mgr. 2024-03-28T12:36:57.358 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:36:57.393 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mgr (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:57.780 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mon. 2024-03-28T12:36:57.795 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:36:57.838 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mon (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:58.386 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-osd. 2024-03-28T12:36:58.401 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:36:58.436 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-osd (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:59.096 INFO:teuthology.orchestra.run.smithi111.stdout:Get:142 https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240327.230800/e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-2499-ge0e48ba6-1jammy [3,146 kB] 2024-03-28T12:36:59.213 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph. 2024-03-28T12:36:59.228 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../068-ceph_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:36:59.271 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:59.616 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-fuse. 2024-03-28T12:36:59.630 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:36:59.674 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-fuse (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:36:59.765 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 3,822 MB in 4min 39s (13.7 MB/s) 2024-03-28T12:36:59.910 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyperclip. 2024-03-28T12:36:59.993 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-03-28T12:36:59.997 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-03-28T12:37:00.044 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mds. 2024-03-28T12:37:00.058 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:00.058 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-03-28T12:37:00.101 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mds (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:00.352 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-28T12:37:00.373 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-28T12:37:00.410 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-28T12:37:00.496 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package cephadm. 2024-03-28T12:37:00.510 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../071-cephadm_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:00.554 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking cephadm (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:00.721 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cmd2. 2024-03-28T12:37:00.742 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-03-28T12:37:00.780 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-03-28T12:37:00.857 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-28T12:37:00.871 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-28T12:37:00.915 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-28T12:37:01.116 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-28T12:37:01.136 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-28T12:37:01.225 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-28T12:37:01.268 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-28T12:37:01.282 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-28T12:37:01.326 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-28T12:37:01.553 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-28T12:37:01.574 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-28T12:37:01.611 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-28T12:37:01.964 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-28T12:37:01.985 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-28T12:37:02.022 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-28T12:37:02.247 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-babel. 2024-03-28T12:37:02.261 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-28T12:37:02.305 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-28T12:37:02.459 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-28T12:37:02.480 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-28T12:37:02.525 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-28T12:37:02.608 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-jinja2. 2024-03-28T12:37:02.622 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-28T12:37:02.658 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-28T12:37:02.912 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-28T12:37:02.933 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-28T12:37:02.970 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-28T12:37:02.986 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-28T12:37:03.000 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:37:03.036 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:03.315 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-28T12:37:03.336 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-28T12:37:03.380 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-28T12:37:03.382 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-28T12:37:03.394 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-03-28T12:37:03.439 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-28T12:37:03.700 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-routes. 2024-03-28T12:37:03.714 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-28T12:37:03.718 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-28T12:37:03.739 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-28T12:37:03.769 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-28T12:37:03.777 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-28T12:37:04.078 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-28T12:37:04.091 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:37:04.113 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librados2. 2024-03-28T12:37:04.133 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../010-librados2_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:04.135 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:04.171 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librados2 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:04.615 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librbd1. 2024-03-28T12:37:04.636 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../011-librbd1_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:04.690 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librbd1 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:05.110 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcephfs2. 2024-03-28T12:37:05.130 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:05.163 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcephfs2 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:05.391 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-28T12:37:05.405 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-28T12:37:05.440 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-28T12:37:05.696 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rados. 2024-03-28T12:37:05.707 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:05.745 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rados (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:05.935 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-joblib. 2024-03-28T12:37:05.949 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-28T12:37:05.993 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-28T12:37:06.065 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-28T12:37:06.085 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:37:06.123 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-ceph-argparse (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:06.355 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-28T12:37:06.369 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-28T12:37:06.376 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cephfs. 2024-03-28T12:37:06.396 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:06.434 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cephfs (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:06.519 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-28T12:37:06.728 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-28T12:37:06.749 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:37:06.778 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-ceph-common (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:06.785 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-sklearn. 2024-03-28T12:37:06.798 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-28T12:37:06.835 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-28T12:37:07.056 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-prettytable. 2024-03-28T12:37:07.076 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-03-28T12:37:07.114 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-28T12:37:07.359 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rbd. 2024-03-28T12:37:07.371 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:07.409 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rbd (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:07.501 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-28T12:37:07.515 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:37:07.551 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:07.778 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-28T12:37:07.799 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-28T12:37:07.836 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-28T12:37:08.105 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-28T12:37:08.117 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-28T12:37:08.155 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-28T12:37:08.425 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-28T12:37:08.437 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-28T12:37:08.475 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-28T12:37:08.555 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-cachetools. 2024-03-28T12:37:08.570 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-03-28T12:37:08.612 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-28T12:37:08.820 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua5.1. 2024-03-28T12:37:08.840 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-28T12:37:08.878 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-28T12:37:08.915 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-28T12:37:08.931 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-28T12:37:08.973 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-28T12:37:09.189 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-any. 2024-03-28T12:37:09.201 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-03-28T12:37:09.239 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-28T12:37:09.450 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package zip. 2024-03-28T12:37:09.462 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-03-28T12:37:09.492 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking zip (3.0-12build2) ... 2024-03-28T12:37:09.585 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-28T12:37:09.600 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-28T12:37:09.643 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-28T12:37:09.829 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package unzip. 2024-03-28T12:37:09.849 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-28T12:37:09.887 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-28T12:37:09.971 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-rsa. 2024-03-28T12:37:09.986 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-03-28T12:37:10.029 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-28T12:37:10.290 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package luarocks. 2024-03-28T12:37:10.311 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-28T12:37:10.332 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-google-auth. 2024-03-28T12:37:10.347 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-03-28T12:37:10.348 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-28T12:37:10.390 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-28T12:37:10.719 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-28T12:37:10.731 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librgw2. 2024-03-28T12:37:10.733 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-28T12:37:10.752 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../027-librgw2_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:10.777 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-28T12:37:10.789 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librgw2 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:11.071 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-websocket. 2024-03-28T12:37:11.086 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-03-28T12:37:11.121 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-28T12:37:11.317 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rgw. 2024-03-28T12:37:11.329 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:11.367 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rgw (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:11.424 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-28T12:37:11.439 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-28T12:37:11.482 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-28T12:37:11.736 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-28T12:37:11.757 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-28T12:37:11.794 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-28T12:37:12.081 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libradosstriper1. 2024-03-28T12:37:12.101 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:12.137 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-28T12:37:12.139 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libradosstriper1 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:12.151 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:37:12.214 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:12.532 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-28T12:37:12.534 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-common. 2024-03-28T12:37:12.545 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-28T12:37:12.555 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:12.581 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-28T12:37:12.592 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-common (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:12.934 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-28T12:37:12.948 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-28T12:37:13.001 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-28T12:37:13.270 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package jq. 2024-03-28T12:37:13.285 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-28T12:37:13.328 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-28T12:37:13.614 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package socat. 2024-03-28T12:37:13.629 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-28T12:37:13.664 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-28T12:37:13.864 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-base. 2024-03-28T12:37:13.884 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:13.931 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-base (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:13.934 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package xmlstarlet. 2024-03-28T12:37:13.948 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-28T12:37:13.992 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-28T12:37:14.338 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-test. 2024-03-28T12:37:14.352 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:14.396 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-test (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:14.518 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-28T12:37:14.539 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-28T12:37:14.577 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-28T12:37:14.829 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cheroot. 2024-03-28T12:37:14.850 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-28T12:37:14.887 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-28T12:37:15.174 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-28T12:37:15.194 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-28T12:37:15.232 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-28T12:37:15.562 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-28T12:37:15.582 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-28T12:37:15.620 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-28T12:37:15.914 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-28T12:37:15.936 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-28T12:37:15.973 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-28T12:37:16.259 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-tempora. 2024-03-28T12:37:16.280 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-03-28T12:37:16.317 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-28T12:37:16.458 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-volume. 2024-03-28T12:37:16.473 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:37:16.516 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-volume (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:16.570 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-portend. 2024-03-28T12:37:16.582 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-03-28T12:37:16.612 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-28T12:37:16.895 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package cephfs-mirror. 2024-03-28T12:37:16.910 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:16.923 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-28T12:37:16.943 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-28T12:37:16.953 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking cephfs-mirror (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:16.981 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-28T12:37:17.273 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-colorama. 2024-03-28T12:37:17.284 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-28T12:37:17.288 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-03-28T12:37:17.304 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-28T12:37:17.330 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-03-28T12:37:17.342 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-28T12:37:17.591 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package cephfs-shell. 2024-03-28T12:37:17.606 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:37:17.650 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking cephfs-shell (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:17.663 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-natsort. 2024-03-28T12:37:17.683 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-03-28T12:37:17.720 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-28T12:37:17.969 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package cephfs-top. 2024-03-28T12:37:17.985 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:37:18.027 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking cephfs-top (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:18.032 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-logutils. 2024-03-28T12:37:18.053 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-03-28T12:37:18.090 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-28T12:37:18.246 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-28T12:37:18.261 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:18.295 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libcephfs-dev (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:18.393 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-28T12:37:18.414 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-28T12:37:18.451 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-28T12:37:18.623 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-28T12:37:18.637 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-28T12:37:18.681 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-28T12:37:18.729 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-mako. 2024-03-28T12:37:18.741 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-28T12:37:18.771 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-28T12:37:19.044 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-28T12:37:19.049 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-28T12:37:19.058 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-03-28T12:37:19.070 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-28T12:37:19.102 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-28T12:37:19.107 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-28T12:37:19.393 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-28T12:37:19.405 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-28T12:37:19.435 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-28T12:37:19.514 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package nvme-cli. 2024-03-28T12:37:19.529 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-28T12:37:19.730 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-webob. 2024-03-28T12:37:19.751 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-28T12:37:19.781 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-28T12:37:19.788 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-28T12:37:20.150 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-waitress. 2024-03-28T12:37:20.171 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-28T12:37:20.185 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package pkg-config. 2024-03-28T12:37:20.200 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-28T12:37:20.211 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-28T12:37:20.243 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-28T12:37:20.505 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-28T12:37:20.519 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-tempita. 2024-03-28T12:37:20.520 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-28T12:37:20.540 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-28T12:37:20.563 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-28T12:37:20.577 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-28T12:37:20.830 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-paste. 2024-03-28T12:37:20.851 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-28T12:37:20.880 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-28T12:37:21.007 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-28T12:37:21.022 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-28T12:37:21.066 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-28T12:37:21.209 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-28T12:37:21.229 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-28T12:37:21.267 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-28T12:37:21.368 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pastescript. 2024-03-28T12:37:21.383 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-03-28T12:37:21.435 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-28T12:37:21.520 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-28T12:37:21.540 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-28T12:37:21.578 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-28T12:37:21.755 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pluggy. 2024-03-28T12:37:21.770 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-28T12:37:21.813 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-28T12:37:21.865 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-webtest. 2024-03-28T12:37:21.885 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-03-28T12:37:21.923 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-28T12:37:22.115 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-psutil. 2024-03-28T12:37:22.131 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-28T12:37:22.165 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-28T12:37:22.234 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pecan. 2024-03-28T12:37:22.254 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-28T12:37:22.292 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-28T12:37:22.501 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-py. 2024-03-28T12:37:22.517 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-03-28T12:37:22.551 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-28T12:37:22.639 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-certifi. 2024-03-28T12:37:22.660 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-03-28T12:37:22.697 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-28T12:37:22.846 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pygments. 2024-03-28T12:37:22.862 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-28T12:37:22.912 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-28T12:37:23.000 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-idna. 2024-03-28T12:37:23.020 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-03-28T12:37:23.058 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-28T12:37:23.344 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-urllib3. 2024-03-28T12:37:23.365 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-28T12:37:23.394 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-28T12:37:23.399 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-28T12:37:23.414 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-28T12:37:23.457 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-28T12:37:23.689 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-requests. 2024-03-28T12:37:23.710 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-28T12:37:23.747 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-28T12:37:23.769 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-toml. 2024-03-28T12:37:23.784 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-03-28T12:37:23.835 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-28T12:37:24.050 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-28T12:37:24.071 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-28T12:37:24.088 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-pytest. 2024-03-28T12:37:24.103 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-28T12:37:24.108 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-28T12:37:24.137 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-28T12:37:24.362 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-28T12:37:24.373 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:37:24.412 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:24.483 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package python3-simplejson. 2024-03-28T12:37:24.498 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-28T12:37:24.541 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-28T12:37:24.800 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-28T12:37:24.818 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-28T12:37:24.821 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:24.834 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-28T12:37:24.858 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:24.876 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-28T12:37:25.178 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-28T12:37:25.198 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-28T12:37:25.236 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-28T12:37:25.514 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-openssl. 2024-03-28T12:37:25.535 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-03-28T12:37:25.538 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package radosgw. 2024-03-28T12:37:25.553 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../122-radosgw_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:25.564 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-28T12:37:25.596 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking radosgw (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:25.917 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr. 2024-03-28T12:37:25.937 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:25.975 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:26.275 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package rbd-fuse. 2024-03-28T12:37:26.289 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:26.341 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking rbd-fuse (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:26.378 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mon. 2024-03-28T12:37:26.399 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:26.436 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mon (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:26.702 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package rbd-mirror. 2024-03-28T12:37:26.717 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:26.769 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking rbd-mirror (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:26.999 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-osd. 2024-03-28T12:37:27.019 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:27.048 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-osd (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:27.163 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package rbd-nbd. 2024-03-28T12:37:27.178 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:27.229 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking rbd-nbd (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:27.540 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-common-dbg. 2024-03-28T12:37:27.555 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:27.598 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-common-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:28.093 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph. 2024-03-28T12:37:28.114 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../068-ceph_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:28.143 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:28.463 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-fuse. 2024-03-28T12:37:28.483 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:28.521 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-fuse (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:28.899 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mds. 2024-03-28T12:37:28.920 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:28.957 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mds (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:29.377 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package cephadm. 2024-03-28T12:37:29.398 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../071-cephadm_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:29.435 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking cephadm (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:29.730 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-28T12:37:29.751 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-28T12:37:29.788 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-28T12:37:30.083 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-28T12:37:30.100 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-28T12:37:30.141 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-28T12:37:31.105 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-babel. 2024-03-28T12:37:31.126 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-28T12:37:31.171 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-28T12:37:31.524 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jinja2. 2024-03-28T12:37:31.545 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-28T12:37:31.582 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-28T12:37:31.919 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-28T12:37:31.940 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:37:31.977 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:32.314 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-28T12:37:32.335 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-03-28T12:37:32.380 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-28T12:37:32.659 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-routes. 2024-03-28T12:37:32.681 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-28T12:37:32.716 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-28T12:37:33.028 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-28T12:37:33.050 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:37:33.095 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:34.342 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-28T12:37:34.363 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-28T12:37:34.400 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-28T12:37:34.904 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-joblib. 2024-03-28T12:37:34.925 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-28T12:37:34.970 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-28T12:37:35.160 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-03-28T12:37:35.176 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:35.399 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-28T12:37:35.420 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-28T12:37:35.444 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-fuse-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:35.543 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-28T12:37:35.846 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-sklearn. 2024-03-28T12:37:35.866 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-28T12:37:35.896 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-03-28T12:37:35.911 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:35.912 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-28T12:37:35.954 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mds-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:36.905 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-28T12:37:36.927 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:37:36.971 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:37.098 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-03-28T12:37:37.113 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:37.147 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mgr-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:37.758 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-03-28T12:37:37.774 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:37.816 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-mon-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:37.966 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cachetools. 2024-03-28T12:37:37.990 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-03-28T12:37:38.032 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-28T12:37:38.294 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-28T12:37:38.315 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-28T12:37:38.360 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-28T12:37:38.655 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-28T12:37:38.677 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-28T12:37:38.714 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-28T12:37:39.025 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rsa. 2024-03-28T12:37:39.046 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-03-28T12:37:39.083 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-28T12:37:39.285 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-03-28T12:37:39.301 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:39.335 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-osd-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:39.370 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-google-auth. 2024-03-28T12:37:39.392 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-03-28T12:37:39.420 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-28T12:37:39.732 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-28T12:37:39.753 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-28T12:37:39.790 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-28T12:37:40.102 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-websocket. 2024-03-28T12:37:40.123 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-03-28T12:37:40.168 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-28T12:37:40.488 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-28T12:37:40.509 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-28T12:37:40.554 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-28T12:37:41.160 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-28T12:37:41.175 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:37:41.218 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:41.529 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-28T12:37:41.551 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-28T12:37:41.604 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-28T12:37:41.908 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-28T12:37:41.929 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-28T12:37:41.966 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-28T12:37:42.202 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package jq. 2024-03-28T12:37:42.214 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-28T12:37:42.252 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-28T12:37:42.513 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package socat. 2024-03-28T12:37:42.535 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-28T12:37:42.588 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-28T12:37:42.908 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package xmlstarlet. 2024-03-28T12:37:42.920 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-28T12:37:42.958 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-28T12:37:43.295 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-test. 2024-03-28T12:37:43.308 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:43.337 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-test (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:44.938 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ceph-test-dbg. 2024-03-28T12:37:44.953 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:44.987 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ceph-test-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:45.475 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-volume. 2024-03-28T12:37:45.496 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:37:45.541 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-volume (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:45.887 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package cephfs-mirror. 2024-03-28T12:37:45.909 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:45.954 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking cephfs-mirror (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:46.257 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-colorama. 2024-03-28T12:37:46.278 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-03-28T12:37:46.323 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-03-28T12:37:46.584 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package cephfs-shell. 2024-03-28T12:37:46.597 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:37:46.634 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking cephfs-shell (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:46.912 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package cephfs-top. 2024-03-28T12:37:46.924 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2499-ge0e48ba6-1jammy_all.deb ... 2024-03-28T12:37:46.962 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking cephfs-top (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:47.231 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-28T12:37:47.243 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:47.281 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcephfs-dev (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:47.601 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-28T12:37:47.622 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-28T12:37:47.667 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-28T12:37:47.989 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-28T12:37:48.010 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-03-28T12:37:48.047 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-28T12:37:48.417 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package nvme-cli. 2024-03-28T12:37:48.441 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-28T12:37:48.484 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-28T12:37:48.898 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package pkg-config. 2024-03-28T12:37:48.919 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-28T12:37:48.964 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-28T12:37:49.192 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-28T12:37:49.214 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-28T12:37:49.258 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-28T12:37:49.679 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-28T12:37:49.700 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-28T12:37:49.745 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-28T12:37:50.057 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pastescript. 2024-03-28T12:37:50.078 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-03-28T12:37:50.114 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-28T12:37:50.435 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pluggy. 2024-03-28T12:37:50.456 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-28T12:37:50.518 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-28T12:37:50.829 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-psutil. 2024-03-28T12:37:50.851 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-28T12:37:50.895 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-28T12:37:51.224 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-py. 2024-03-28T12:37:51.246 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-03-28T12:37:51.290 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-28T12:37:51.577 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pygments. 2024-03-28T12:37:51.599 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-28T12:37:51.635 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-28T12:37:52.067 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-28T12:37:52.089 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-28T12:37:52.133 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-28T12:37:52.453 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-toml. 2024-03-28T12:37:52.475 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-03-28T12:37:52.519 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-28T12:37:52.814 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pytest. 2024-03-28T12:37:52.835 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-28T12:37:52.871 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-28T12:37:53.200 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-simplejson. 2024-03-28T12:37:53.223 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-28T12:37:53.267 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-28T12:37:53.544 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-28T12:37:53.557 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-28T12:37:53.594 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-28T12:37:54.347 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package radosgw. 2024-03-28T12:37:54.369 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../122-radosgw_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:54.406 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking radosgw (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:55.168 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package rbd-fuse. 2024-03-28T12:37:55.181 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:55.218 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking rbd-fuse (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:55.538 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package rbd-mirror. 2024-03-28T12:37:55.560 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:55.604 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking rbd-mirror (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:56.028 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-03-28T12:37:56.032 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package rbd-nbd. 2024-03-28T12:37:56.043 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:56.044 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:56.078 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libcephfs2-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:56.081 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking rbd-nbd (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:56.318 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-common-dbg. 2024-03-28T12:37:56.331 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:56.359 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-common-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:56.480 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package librados2-dbg. 2024-03-28T12:37:56.494 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:56.538 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking librados2-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:57.558 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-03-28T12:37:57.572 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:57.616 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libradosstriper1-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:58.018 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package librbd1-dbg. 2024-03-28T12:37:58.037 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:58.076 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking librbd1-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:37:59.412 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package librgw2-dbg. 2024-03-28T12:37:59.427 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:37:59.470 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking librgw2-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:01.614 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package radosgw-dbg. 2024-03-28T12:38:01.629 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:01.664 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking radosgw-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:03.921 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-03-28T12:38:03.934 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:03.971 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-fuse-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:04.424 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-03-28T12:38:04.437 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:04.474 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mds-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:04.975 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-03-28T12:38:04.990 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:05.033 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking rbd-fuse-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:05.310 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-03-28T12:38:05.325 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:05.368 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking rbd-mirror-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:05.493 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-03-28T12:38:05.506 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:05.542 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:06.229 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-03-28T12:38:06.242 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:06.278 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mon-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:06.629 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-03-28T12:38:06.642 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:06.686 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking rbd-nbd-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:07.030 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-28T12:38:07.300 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-28T12:38:07.409 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-28T12:38:07.644 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-28T12:38:07.964 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-03-28T12:38:07.977 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:08.014 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-osd-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:08.034 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-28T12:38:08.670 INFO:teuthology.orchestra.run.smithi076.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-28T12:38:08.683 INFO:teuthology.orchestra.run.smithi076.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-03-28T12:38:08.744 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up cephadm (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:09.339 INFO:teuthology.orchestra.run.smithi076.stdout:Adding system user cephadm....done 2024-03-28T12:38:09.468 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-28T12:38:10.128 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-28T12:38:10.370 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-28T12:38:10.518 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-28T12:38:10.781 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-28T12:38:11.057 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-28T12:38:11.183 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-28T12:38:11.484 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-28T12:38:11.844 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-28T12:38:12.121 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-03-28T12:38:12.397 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-28T12:38:12.673 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-28T12:38:13.051 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-28T12:38:13.311 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-28T12:38:13.391 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-test-dbg. 2024-03-28T12:38:13.405 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:13.442 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-test-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:13.587 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-28T12:38:13.846 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-ceph-argparse (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:14.114 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-28T12:38:14.240 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-28T12:38:14.366 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-03-28T12:38:14.661 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-28T12:38:14.768 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-28T12:38:15.019 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-28T12:38:15.422 INFO:teuthology.orchestra.run.smithi076.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-28T12:38:15.458 INFO:teuthology.orchestra.run.smithi076.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-28T12:38:15.514 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-28T12:38:15.640 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-28T12:38:16.034 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-28T12:38:16.152 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-28T12:38:16.428 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-28T12:38:16.695 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-28T12:38:17.013 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up zip (3.0-12build2) ... 2024-03-28T12:38:17.139 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-28T12:38:17.833 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-28T12:38:18.126 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-28T12:38:18.226 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-28T12:38:18.344 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-28T12:38:18.662 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-28T12:38:19.105 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-28T12:38:19.373 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-28T12:38:19.766 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-28T12:38:20.076 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-03-28T12:38:20.410 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-28T12:38:20.745 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-28T12:38:21.004 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-28T12:38:21.130 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-ceph-common (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:21.440 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-idna (3.3-1) ... 2024-03-28T12:38:21.807 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-28T12:38:23.047 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-28T12:38:23.290 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-28T12:38:23.425 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-28T12:38:23.684 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-28T12:38:23.785 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-28T12:38:23.928 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-28T12:38:24.229 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-28T12:38:24.522 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-28T12:38:24.790 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-28T12:38:24.808 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-03-28T12:38:24.821 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:24.858 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcephfs2-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:24.916 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-28T12:38:25.234 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-28T12:38:25.302 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librados2-dbg. 2024-03-28T12:38:25.315 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:25.351 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librados2-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:25.477 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-28T12:38:25.745 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-28T12:38:26.012 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-28T12:38:26.280 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-28T12:38:26.338 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-03-28T12:38:26.360 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:26.404 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libradosstriper1-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:26.556 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-28T12:38:26.782 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librbd1-dbg. 2024-03-28T12:38:26.794 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:26.831 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librbd1-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:27.056 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-28T12:38:27.350 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-28T12:38:27.468 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-28T12:38:27.760 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-28T12:38:28.053 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-28T12:38:28.101 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librgw2-dbg. 2024-03-28T12:38:28.113 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:28.150 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librgw2-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:28.321 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-28T12:38:28.472 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-28T12:38:28.598 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-28T12:38:28.686 INFO:teuthology.orchestra.run.smithi076.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-28T12:38:28.933 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-28T12:38:29.042 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-28T12:38:29.419 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-28T12:38:29.678 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-28T12:38:29.829 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-28T12:38:29.953 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package radosgw-dbg. 2024-03-28T12:38:29.966 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:30.002 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking radosgw-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:30.097 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-28T12:38:30.223 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-28T12:38:30.549 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-28T12:38:30.859 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-28T12:38:31.127 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-28T12:38:31.355 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-28T12:38:31.623 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-28T12:38:31.908 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-28T12:38:32.176 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-28T12:38:32.578 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-28T12:38:32.854 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-28T12:38:33.214 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-03-28T12:38:33.214 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-28T12:38:33.226 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:33.264 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking rbd-fuse-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:33.341 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up librados2 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:33.467 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:33.541 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-03-28T12:38:33.563 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:33.593 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-28T12:38:33.607 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking rbd-mirror-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:33.888 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libcephfs2 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:34.039 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libradosstriper1 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:34.165 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-28T12:38:34.466 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up librados2-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:34.601 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up librbd1 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:34.710 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libcephfs2-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:34.811 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mgr-modules-core (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:34.818 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-03-28T12:38:34.831 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-2499-ge0e48ba6-1jammy_amd64.deb ... 2024-03-28T12:38:34.868 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking rbd-nbd-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:34.920 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-fuse (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:35.130 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-28T12:38:35.130 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-28T12:38:35.205 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-28T12:38:35.457 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-28T12:38:35.583 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-28T12:38:35.755 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libradosstriper1-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:35.849 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-28T12:38:35.881 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libcephfs-dev (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:36.007 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-fuse-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:36.133 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-rados (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:36.190 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-28T12:38:36.234 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up librgw2 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:36.335 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up cephfs-top (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:36.453 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-28T12:38:36.690 INFO:teuthology.orchestra.run.smithi111.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-28T12:38:36.810 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up cephadm (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:37.310 INFO:teuthology.orchestra.run.smithi111.stdout:Adding system user cephadm....done 2024-03-28T12:38:37.467 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-28T12:38:37.731 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up librbd1-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:37.734 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-28T12:38:37.857 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-rbd (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:37.978 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-28T12:38:37.983 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up librgw2-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:38.095 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-28T12:38:38.126 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up rbd-fuse (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:38.235 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up rbd-nbd (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:38.347 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-28T12:38:38.361 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-rgw (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:38.504 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up python3-cephfs (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:38.598 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-28T12:38:38.630 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up rbd-nbd-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:38.756 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up cephfs-shell (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:38.882 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up rbd-fuse-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:38.999 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-28T12:38:39.008 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-common (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:39.301 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-28T12:38:39.536 INFO:teuthology.orchestra.run.smithi076.stdout:Adding group ceph....done 2024-03-28T12:38:39.636 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-28T12:38:39.896 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-03-28T12:38:39.937 INFO:teuthology.orchestra.run.smithi076.stdout:Adding system user ceph....done 2024-03-28T12:38:40.098 INFO:teuthology.orchestra.run.smithi076.stdout:Setting system user ceph properties....done 2024-03-28T12:38:40.114 INFO:teuthology.orchestra.run.smithi076.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-28T12:38:40.147 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-28T12:38:40.260 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-28T12:38:40.415 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-28T12:38:40.680 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-28T12:38:40.700 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-28T12:38:40.959 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-28T12:38:41.210 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-28T12:38:41.368 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up cephfs-mirror (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:41.461 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-ceph-argparse (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:41.569 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-28T12:38:41.569 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-28T12:38:41.729 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-28T12:38:41.855 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-28T12:38:41.981 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-03-28T12:38:42.211 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-test (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:42.241 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-28T12:38:42.363 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up radosgw (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:42.366 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-28T12:38:42.617 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-28T12:38:42.912 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-28T12:38:42.912 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-28T12:38:43.041 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-28T12:38:43.075 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-28T12:38:43.129 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-28T12:38:43.255 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-28T12:38:43.590 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-base (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:43.615 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-28T12:38:43.741 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-28T12:38:43.949 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-28T12:38:44.009 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-28T12:38:44.268 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-28T12:38:44.561 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up zip (3.0-12build2) ... 2024-03-28T12:38:44.616 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mds (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:44.687 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-28T12:38:44.856 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-28T12:38:44.856 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-28T12:38:45.389 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-28T12:38:45.518 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-common-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:45.628 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up rbd-mirror (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:45.648 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-28T12:38:45.775 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-28T12:38:45.838 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-03-28T12:38:45.838 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-03-28T12:38:45.901 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-28T12:38:46.193 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-28T12:38:46.462 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mgr (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:46.570 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-28T12:38:46.675 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-28T12:38:46.675 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-28T12:38:46.813 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-28T12:38:47.173 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-28T12:38:47.305 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mds-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:47.449 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-03-28T12:38:47.481 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up radosgw-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:47.608 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-test-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:47.750 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-28T12:38:47.759 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-osd (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:48.085 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-28T12:38:48.085 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-28T12:38:48.101 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-28T12:38:48.353 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-28T12:38:48.470 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-ceph-common (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:48.711 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mgr-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:48.763 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-idna (3.3-1) ... 2024-03-28T12:38:48.828 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-osd-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:48.954 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up rbd-mirror-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:49.081 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-28T12:38:49.113 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:49.239 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:49.390 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mon (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:49.605 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-28T12:38:49.605 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-28T12:38:50.250 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mgr-cephadm (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:50.287 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-28T12:38:50.376 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:50.527 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mgr-dashboard (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:50.530 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-28T12:38:50.665 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-28T12:38:50.670 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-mon-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:50.796 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ceph-volume (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:50.932 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-28T12:38:51.058 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-28T12:38:51.157 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-28T12:38:51.168 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-28T12:38:51.257 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-28T12:38:51.401 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-28T12:38:51.453 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-28T12:38:51.729 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-28T12:38:51.980 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-28T12:38:52.106 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-28T12:38:52.408 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-28T12:38:52.470 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-28T12:38:52.667 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-28T12:38:52.918 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-28T12:38:53.161 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-28T12:38:53.338 INFO:teuthology.orchestra.run.smithi076.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-28T12:38:53.342 DEBUG:teuthology.orchestra.run.smithi076:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-03-28T12:38:53.416 INFO:teuthology.orchestra.run.smithi076.stdout:Reading package lists... 2024-03-28T12:38:53.429 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-28T12:38:53.588 INFO:teuthology.orchestra.run.smithi076.stdout:Building dependency tree... 2024-03-28T12:38:53.588 INFO:teuthology.orchestra.run.smithi076.stdout:Reading state information... 2024-03-28T12:38:53.705 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-28T12:38:53.743 INFO:teuthology.orchestra.run.smithi076.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-03-28T12:38:53.744 INFO:teuthology.orchestra.run.smithi076.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-03-28T12:38:53.744 INFO:teuthology.orchestra.run.smithi076.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-03-28T12:38:53.744 INFO:teuthology.orchestra.run.smithi076.stdout:The following packages were automatically installed and are no longer required: 2024-03-28T12:38:53.744 INFO:teuthology.orchestra.run.smithi076.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-28T12:38:53.744 INFO:teuthology.orchestra.run.smithi076.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-28T12:38:53.744 INFO:teuthology.orchestra.run.smithi076.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-28T12:38:53.745 INFO:teuthology.orchestra.run.smithi076.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-28T12:38:53.745 INFO:teuthology.orchestra.run.smithi076.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-28T12:38:53.745 INFO:teuthology.orchestra.run.smithi076.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-28T12:38:53.745 INFO:teuthology.orchestra.run.smithi076.stdout:The following additional packages will be installed: 2024-03-28T12:38:53.745 INFO:teuthology.orchestra.run.smithi076.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-03-28T12:38:53.745 INFO:teuthology.orchestra.run.smithi076.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-03-28T12:38:53.746 INFO:teuthology.orchestra.run.smithi076.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-03-28T12:38:53.746 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-03-28T12:38:53.746 INFO:teuthology.orchestra.run.smithi076.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-28T12:38:53.747 INFO:teuthology.orchestra.run.smithi076.stdout:Suggested packages: 2024-03-28T12:38:53.747 INFO:teuthology.orchestra.run.smithi076.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-03-28T12:38:53.747 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-03-28T12:38:53.747 INFO:teuthology.orchestra.run.smithi076.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-03-28T12:38:53.802 INFO:teuthology.orchestra.run.smithi076.stdout:The following NEW packages will be installed: 2024-03-28T12:38:53.802 INFO:teuthology.orchestra.run.smithi076.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-03-28T12:38:53.802 INFO:teuthology.orchestra.run.smithi076.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-03-28T12:38:53.803 INFO:teuthology.orchestra.run.smithi076.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-03-28T12:38:53.803 INFO:teuthology.orchestra.run.smithi076.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-03-28T12:38:53.803 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-03-28T12:38:53.803 INFO:teuthology.orchestra.run.smithi076.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-03-28T12:38:53.803 INFO:teuthology.orchestra.run.smithi076.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-28T12:38:53.804 INFO:teuthology.orchestra.run.smithi076.stdout:The following packages will be upgraded: 2024-03-28T12:38:53.804 INFO:teuthology.orchestra.run.smithi076.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-03-28T12:38:53.831 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-28T12:38:53.901 INFO:teuthology.orchestra.run.smithi076.stdout:4 upgraded, 39 newly installed, 0 to remove and 297 not upgraded. 2024-03-28T12:38:53.901 INFO:teuthology.orchestra.run.smithi076.stdout:Need to get 55.7 MB of archives. 2024-03-28T12:38:53.901 INFO:teuthology.orchestra.run.smithi076.stdout:After this operation, 202 MB of additional disk space will be used. 2024-03-28T12:38:53.901 INFO:teuthology.orchestra.run.smithi076.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.3 [1,063 kB] 2024-03-28T12:38:54.108 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-28T12:38:54.112 INFO:teuthology.orchestra.run.smithi076.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-03-28T12:38:54.120 INFO:teuthology.orchestra.run.smithi076.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-03-28T12:38:54.178 INFO:teuthology.orchestra.run.smithi076.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.3 [33.1 kB] 2024-03-28T12:38:54.179 INFO:teuthology.orchestra.run.smithi076.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.3 [24.4 kB] 2024-03-28T12:38:54.179 INFO:teuthology.orchestra.run.smithi076.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-03-28T12:38:54.194 INFO:teuthology.orchestra.run.smithi076.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-03-28T12:38:54.195 INFO:teuthology.orchestra.run.smithi076.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-03-28T12:38:54.198 INFO:teuthology.orchestra.run.smithi076.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-03-28T12:38:54.199 INFO:teuthology.orchestra.run.smithi076.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-03-28T12:38:54.199 INFO:teuthology.orchestra.run.smithi076.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-03-28T12:38:54.201 INFO:teuthology.orchestra.run.smithi076.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-03-28T12:38:54.220 INFO:teuthology.orchestra.run.smithi076.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-03-28T12:38:54.220 INFO:teuthology.orchestra.run.smithi076.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-03-28T12:38:54.220 INFO:teuthology.orchestra.run.smithi076.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-03-28T12:38:54.233 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-28T12:38:54.250 INFO:teuthology.orchestra.run.smithi076.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-03-28T12:38:54.526 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-28T12:38:54.671 INFO:teuthology.orchestra.run.smithi076.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-03-28T12:38:54.672 INFO:teuthology.orchestra.run.smithi076.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-03-28T12:38:54.673 INFO:teuthology.orchestra.run.smithi076.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-03-28T12:38:54.681 INFO:teuthology.orchestra.run.smithi076.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-03-28T12:38:54.681 INFO:teuthology.orchestra.run.smithi076.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-03-28T12:38:54.686 INFO:teuthology.orchestra.run.smithi076.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-03-28T12:38:54.688 INFO:teuthology.orchestra.run.smithi076.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-03-28T12:38:54.696 INFO:teuthology.orchestra.run.smithi076.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-03-28T12:38:54.696 INFO:teuthology.orchestra.run.smithi076.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-03-28T12:38:54.742 INFO:teuthology.orchestra.run.smithi076.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-03-28T12:38:54.745 INFO:teuthology.orchestra.run.smithi076.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-03-28T12:38:54.757 INFO:teuthology.orchestra.run.smithi076.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-03-28T12:38:54.819 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-28T12:38:54.841 INFO:teuthology.orchestra.run.smithi076.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-03-28T12:38:54.844 INFO:teuthology.orchestra.run.smithi076.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-03-28T12:38:54.845 INFO:teuthology.orchestra.run.smithi076.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-03-28T12:38:54.846 INFO:teuthology.orchestra.run.smithi076.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-03-28T12:38:54.847 INFO:teuthology.orchestra.run.smithi076.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-03-28T12:38:54.858 INFO:teuthology.orchestra.run.smithi076.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-03-28T12:38:54.860 INFO:teuthology.orchestra.run.smithi076.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-03-28T12:38:55.070 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-28T12:38:55.146 INFO:teuthology.orchestra.run.smithi076.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-03-28T12:38:55.146 INFO:teuthology.orchestra.run.smithi076.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-03-28T12:38:55.146 INFO:teuthology.orchestra.run.smithi076.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-03-28T12:38:55.146 INFO:teuthology.orchestra.run.smithi076.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-03-28T12:38:55.147 INFO:teuthology.orchestra.run.smithi076.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-03-28T12:38:55.147 INFO:teuthology.orchestra.run.smithi076.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-03-28T12:38:55.162 INFO:teuthology.orchestra.run.smithi076.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-03-28T12:38:55.163 INFO:teuthology.orchestra.run.smithi076.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-03-28T12:38:55.196 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-28T12:38:55.322 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-28T12:38:55.411 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-28T12:38:55.542 INFO:teuthology.orchestra.run.smithi076.stdout:Preconfiguring packages ... 2024-03-28T12:38:55.649 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-28T12:38:55.694 INFO:teuthology.orchestra.run.smithi076.stdout:Fetched 55.7 MB in 1s (41.2 MB/s) 2024-03-28T12:38:55.792 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-28T12:38:55.992 INFO:teuthology.orchestra.run.smithi076.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141204 files and directories currently installed.) 2024-03-28T12:38:55.996 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.3_amd64.deb ... 2024-03-28T12:38:56.145 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking util-linux (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-03-28T12:38:56.168 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-28T12:38:56.412 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-28T12:38:56.512 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-28T12:38:56.764 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-28T12:38:56.779 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up util-linux (2.37.2-4ubuntu3.3) ... 2024-03-28T12:38:56.889 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-28T12:38:57.199 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-28T12:38:57.492 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-28T12:38:57.760 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-28T12:38:57.848 INFO:teuthology.orchestra.run.smithi076.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-03-28T12:38:57.980 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-28T12:38:58.247 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-28T12:38:58.284 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package flex. 2024-03-28T12:38:58.356 INFO:teuthology.orchestra.run.smithi076.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141204 files and directories currently installed.) 2024-03-28T12:38:58.359 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-03-28T12:38:58.399 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking flex (2.6.4-8build2) ... 2024-03-28T12:38:58.515 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-28T12:38:58.766 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-28T12:38:59.011 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-28T12:38:59.135 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-28T12:38:59.180 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-03-28T12:38:59.386 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-28T12:38:59.597 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-28T12:38:59.714 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-28T12:38:59.840 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librados2 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:38:59.966 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:00.092 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-28T12:39:00.178 INFO:teuthology.orchestra.run.smithi076.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141277 files and directories currently installed.) 2024-03-28T12:39:00.182 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.3_amd64.deb ... 2024-03-28T12:39:00.338 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-03-28T12:39:00.387 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcephfs2 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:00.513 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libradosstriper1 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:00.639 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-28T12:39:00.793 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.3_amd64.deb ... 2024-03-28T12:39:00.940 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librados2-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:00.945 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-03-28T12:39:01.066 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librbd1 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:01.193 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcephfs2-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:01.318 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-modules-core (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:01.326 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.3) ... 2024-03-28T12:39:01.436 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-fuse (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:01.632 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-28T12:39:01.632 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-28T12:39:01.754 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package bison. 2024-03-28T12:39:01.830 INFO:teuthology.orchestra.run.smithi076.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141277 files and directories currently installed.) 2024-03-28T12:39:01.834 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-03-28T12:39:01.890 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-03-28T12:39:02.171 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libradosstriper1-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:02.274 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-03-28T12:39:02.289 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-03-28T12:39:02.297 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcephfs-dev (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:02.332 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-03-28T12:39:02.423 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-fuse-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:02.549 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rados (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:02.678 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librgw2 (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:02.685 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package dump. 2024-03-28T12:39:02.701 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-03-28T12:39:02.744 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking dump (0.4b47-3) ... 2024-03-28T12:39:02.801 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up cephfs-top (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:02.902 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-28T12:39:03.082 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package indent. 2024-03-28T12:39:03.097 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-03-28T12:39:03.132 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-28T12:39:03.385 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-03-28T12:39:03.400 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-03-28T12:39:03.435 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-28T12:39:03.764 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-03-28T12:39:03.780 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-03-28T12:39:03.822 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-28T12:39:04.092 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-03-28T12:39:04.105 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librbd1-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:04.107 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-03-28T12:39:04.150 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-03-28T12:39:04.232 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rbd (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:04.358 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librgw2-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:04.484 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up rbd-fuse (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:04.522 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libfl2:amd64. 2024-03-28T12:39:04.538 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-03-28T12:39:04.581 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-03-28T12:39:04.610 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up rbd-nbd (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:04.736 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rgw (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:04.833 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-03-28T12:39:04.848 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-03-28T12:39:04.853 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cephfs (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:04.891 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-28T12:39:04.996 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up rbd-nbd-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:05.122 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up cephfs-shell (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:05.127 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libjson-perl. 2024-03-28T12:39:05.143 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-03-28T12:39:05.177 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-03-28T12:39:05.248 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up rbd-fuse-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:05.374 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-common (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:05.464 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libllvm14:amd64. 2024-03-28T12:39:05.479 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-03-28T12:39:05.522 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-28T12:39:05.926 INFO:teuthology.orchestra.run.smithi111.stdout:Adding group ceph....done 2024-03-28T12:39:06.278 INFO:teuthology.orchestra.run.smithi111.stdout:Adding system user ceph....done 2024-03-28T12:39:06.445 INFO:teuthology.orchestra.run.smithi111.stdout:Setting system user ceph properties....done 2024-03-28T12:39:06.458 INFO:teuthology.orchestra.run.smithi111.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-28T12:39:06.592 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-28T12:39:06.900 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-03-28T12:39:06.916 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-28T12:39:06.942 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-28T12:39:06.992 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-28T12:39:07.270 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libmbim-proxy. 2024-03-28T12:39:07.285 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-28T12:39:07.328 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-28T12:39:07.509 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up cephfs-mirror (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:07.598 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-03-28T12:39:07.613 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-28T12:39:07.656 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-28T12:39:07.721 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-28T12:39:07.721 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-03-28T12:39:08.009 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libndp0:amd64. 2024-03-28T12:39:08.024 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-03-28T12:39:08.067 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-28T12:39:08.261 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-test (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:08.387 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up radosgw (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:08.547 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libnm0:amd64. 2024-03-28T12:39:08.562 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-03-28T12:39:08.596 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-28T12:39:08.908 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-28T12:39:08.908 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-28T12:39:08.924 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libpq5:amd64. 2024-03-28T12:39:08.939 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-28T12:39:08.982 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-28T12:39:09.361 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-03-28T12:39:09.376 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-28T12:39:09.427 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-28T12:39:09.455 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-base (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:09.772 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libqmi-proxy. 2024-03-28T12:39:09.787 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-28T12:39:09.838 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-28T12:39:09.993 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-28T12:39:10.133 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-03-28T12:39:10.148 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-28T12:39:10.190 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-28T12:39:10.549 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mds (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:10.719 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-03-28T12:39:10.734 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-03-28T12:39:10.769 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-28T12:39:10.769 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-28T12:39:10.778 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-03-28T12:39:11.206 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package modemmanager. 2024-03-28T12:39:11.221 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-28T12:39:11.264 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-28T12:39:11.318 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-common-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:11.436 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up rbd-mirror (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:11.653 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-03-28T12:39:11.653 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-03-28T12:39:11.863 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package network-manager. 2024-03-28T12:39:11.878 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-03-28T12:39:11.921 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-03-28T12:39:12.204 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:12.417 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-28T12:39:12.418 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-28T12:39:12.562 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package ppp. 2024-03-28T12:39:12.577 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-03-28T12:39:12.909 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-03-28T12:39:12.955 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mds-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:13.081 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up radosgw-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:13.207 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-test-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:13.250 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package pptp-linux. 2024-03-28T12:39:13.264 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-03-28T12:39:13.309 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-03-28T12:39:13.325 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-osd (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:13.561 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package network-manager-pptp. 2024-03-28T12:39:13.575 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-03-28T12:39:13.619 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-03-28T12:39:13.621 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-28T12:39:13.621 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-28T12:39:13.939 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package postgresql-client-common. 2024-03-28T12:39:13.953 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-03-28T12:39:13.989 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking postgresql-client-common (238) ... 2024-03-28T12:39:14.143 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:14.270 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-osd-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:14.285 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package postgresql-client-14. 2024-03-28T12:39:14.299 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-28T12:39:14.343 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-28T12:39:14.395 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up rbd-mirror-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:14.522 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:14.648 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:14.799 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mon (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:14.848 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package postgresql-common. 2024-03-28T12:39:14.862 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-03-28T12:39:14.915 INFO:teuthology.orchestra.run.smithi076.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-03-28T12:39:14.946 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking postgresql-common (238) ... 2024-03-28T12:39:15.009 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-28T12:39:15.009 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-28T12:39:15.439 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package postgresql-14. 2024-03-28T12:39:15.453 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-28T12:39:15.499 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-28T12:39:15.534 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-cephadm (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:15.660 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:15.771 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-dashboard (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:15.922 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mon-dbg (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:16.048 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-volume (19.0.0-2499-ge0e48ba6-1jammy) ... 2024-03-28T12:39:16.401 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-28T12:39:16.535 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-28T12:39:16.558 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package postgresql. 2024-03-28T12:39:16.573 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-03-28T12:39:16.608 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking postgresql (14+238) ... 2024-03-28T12:39:16.688 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-28T12:39:16.835 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package postgresql-client. 2024-03-28T12:39:16.850 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-03-28T12:39:16.886 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking postgresql-client (14+238) ... 2024-03-28T12:39:17.129 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package postgresql-contrib. 2024-03-28T12:39:17.144 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-03-28T12:39:17.188 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking postgresql-contrib (14+238) ... 2024-03-28T12:39:17.490 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package tcl8.6. 2024-03-28T12:39:17.505 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-03-28T12:39:17.548 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-28T12:39:17.789 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-28T12:39:17.809 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package tcl. 2024-03-28T12:39:17.824 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-03-28T12:39:17.864 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-03-28T12:39:18.204 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package wpasupplicant. 2024-03-28T12:39:18.219 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-03-28T12:39:18.262 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-28T12:39:18.450 INFO:teuthology.orchestra.run.smithi111.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-28T12:39:18.453 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-03-28T12:39:18.511 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-03-28T12:39:18.642 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-03-28T12:39:18.656 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-03-28T12:39:18.700 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-03-28T12:39:18.709 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-03-28T12:39:18.710 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-03-28T12:39:18.886 INFO:teuthology.orchestra.run.smithi111.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-03-28T12:39:18.887 INFO:teuthology.orchestra.run.smithi111.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-03-28T12:39:18.887 INFO:teuthology.orchestra.run.smithi111.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-03-28T12:39:18.887 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-03-28T12:39:18.887 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-28T12:39:18.887 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-28T12:39:18.887 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-28T12:39:18.887 INFO:teuthology.orchestra.run.smithi111.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-03-28T12:39:18.887 INFO:teuthology.orchestra.run.smithi111.stdout: python2.7-minimal 2024-03-28T12:39:18.887 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-28T12:39:18.888 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-03-28T12:39:18.888 INFO:teuthology.orchestra.run.smithi111.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-03-28T12:39:18.889 INFO:teuthology.orchestra.run.smithi111.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-03-28T12:39:18.889 INFO:teuthology.orchestra.run.smithi111.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-03-28T12:39:18.889 INFO:teuthology.orchestra.run.smithi111.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-03-28T12:39:18.889 INFO:teuthology.orchestra.run.smithi111.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-28T12:39:18.889 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-03-28T12:39:18.889 INFO:teuthology.orchestra.run.smithi111.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-03-28T12:39:18.890 INFO:teuthology.orchestra.run.smithi111.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-03-28T12:39:18.890 INFO:teuthology.orchestra.run.smithi111.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-03-28T12:39:18.930 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-03-28T12:39:18.930 INFO:teuthology.orchestra.run.smithi111.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-03-28T12:39:18.930 INFO:teuthology.orchestra.run.smithi111.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-03-28T12:39:18.931 INFO:teuthology.orchestra.run.smithi111.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-03-28T12:39:18.931 INFO:teuthology.orchestra.run.smithi111.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-03-28T12:39:18.931 INFO:teuthology.orchestra.run.smithi111.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-03-28T12:39:18.931 INFO:teuthology.orchestra.run.smithi111.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-03-28T12:39:18.931 INFO:teuthology.orchestra.run.smithi111.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-03-28T12:39:18.933 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages will be upgraded: 2024-03-28T12:39:18.933 INFO:teuthology.orchestra.run.smithi111.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-03-28T12:39:18.995 INFO:teuthology.orchestra.run.smithi111.stdout:4 upgraded, 39 newly installed, 0 to remove and 297 not upgraded. 2024-03-28T12:39:18.995 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 55.7 MB of archives. 2024-03-28T12:39:18.995 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 202 MB of additional disk space will be used. 2024-03-28T12:39:18.995 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.3 [1,063 kB] 2024-03-28T12:39:19.086 INFO:teuthology.orchestra.run.smithi076.stdout:Selecting previously unselected package usb-modeswitch. 2024-03-28T12:39:19.101 INFO:teuthology.orchestra.run.smithi076.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-03-28T12:39:19.143 INFO:teuthology.orchestra.run.smithi076.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-28T12:39:19.190 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-03-28T12:39:19.199 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-03-28T12:39:19.273 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.3 [33.1 kB] 2024-03-28T12:39:19.273 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.3 [24.4 kB] 2024-03-28T12:39:19.274 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-03-28T12:39:19.293 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-03-28T12:39:19.294 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-03-28T12:39:19.297 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-03-28T12:39:19.298 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-03-28T12:39:19.299 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-03-28T12:39:19.301 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-03-28T12:39:19.302 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-03-28T12:39:19.324 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-03-28T12:39:19.324 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-03-28T12:39:19.326 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-03-28T12:39:19.461 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up postgresql-client-common (238) ... 2024-03-28T12:39:19.667 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up flex (2.6.4-8build2) ... 2024-03-28T12:39:19.794 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-28T12:39:19.831 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-03-28T12:39:19.834 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-03-28T12:39:19.834 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-03-28T12:39:19.838 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-03-28T12:39:19.838 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-03-28T12:39:19.845 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-03-28T12:39:19.848 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-03-28T12:39:19.859 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-03-28T12:39:19.859 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-03-28T12:39:19.891 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-03-28T12:39:19.892 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-03-28T12:39:19.917 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-03-28T12:39:19.919 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-28T12:39:19.965 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-03-28T12:39:19.971 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-03-28T12:39:19.971 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-03-28T12:39:19.972 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-03-28T12:39:19.973 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-03-28T12:39:19.999 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-03-28T12:39:20.002 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-03-28T12:39:20.029 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-03-28T12:39:20.130 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-28T12:39:20.240 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-28T12:39:20.356 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-03-28T12:39:20.376 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-03-28T12:39:20.376 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-03-28T12:39:20.377 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-03-28T12:39:20.377 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-03-28T12:39:20.380 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-03-28T12:39:20.397 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-03-28T12:39:20.398 INFO:teuthology.orchestra.run.smithi111.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-03-28T12:39:20.801 INFO:teuthology.orchestra.run.smithi111.stdout:Preconfiguring packages ... 2024-03-28T12:39:20.950 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 55.7 MB in 1s (38.2 MB/s) 2024-03-28T12:39:21.186 INFO:teuthology.orchestra.run.smithi076.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-03-28T12:39:21.237 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138785 files and directories currently installed.) 2024-03-28T12:39:21.242 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.3_amd64.deb ... 2024-03-28T12:39:21.287 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-28T12:39:21.397 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking util-linux (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-03-28T12:39:21.674 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-28T12:39:21.674 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-28T12:39:21.991 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up util-linux (2.37.2-4ubuntu3.3) ... 2024-03-28T12:39:22.357 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.3) ... 2024-03-28T12:39:22.482 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-03-28T12:39:22.609 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-28T12:39:22.735 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-03-28T12:39:22.860 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-03-28T12:39:22.986 INFO:teuthology.orchestra.run.smithi111.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-03-28T12:39:22.987 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-03-28T12:39:23.104 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-28T12:39:23.205 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-03-28T12:39:23.219 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package flex. 2024-03-28T12:39:23.269 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138785 files and directories currently installed.) 2024-03-28T12:39:23.273 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-03-28T12:39:23.318 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking flex (2.6.4-8build2) ... 2024-03-28T12:39:23.836 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-28T12:39:24.049 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-03-28T12:39:24.219 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-28T12:39:24.337 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up dump (0.4b47-3) ... 2024-03-28T12:39:24.432 INFO:teuthology.orchestra.run.smithi076.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-03-28T12:39:24.450 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-28T12:39:24.506 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-28T12:39:24.632 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-28T12:39:24.758 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up tcl (8.6.11+1build2) ... 2024-03-28T12:39:24.883 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libjson-perl (4.04000-1) ... 2024-03-28T12:39:24.992 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138858 files and directories currently installed.) 2024-03-28T12:39:24.997 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.3_amd64.deb ... 2024-03-28T12:39:25.026 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-03-28T12:39:25.107 INFO:teuthology.orchestra.run.smithi076.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-03-28T12:39:25.132 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-03-28T12:39:25.169 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-28T12:39:25.271 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-28T12:39:25.447 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-28T12:39:25.573 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-28T12:39:25.627 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.3_amd64.deb ... 2024-03-28T12:39:25.699 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-03-28T12:39:25.739 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-03-28T12:39:25.867 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up postgresql-client (14+238) ... 2024-03-28T12:39:25.993 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-03-28T12:39:26.071 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.3) ... 2024-03-28T12:39:26.423 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package bison. 2024-03-28T12:39:26.504 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138858 files and directories currently installed.) 2024-03-28T12:39:26.509 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-03-28T12:39:26.534 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:39:26.534 INFO:teuthology.orchestra.run.smithi076.stdout:The following network interfaces were found in /etc/network/interfaces 2024-03-28T12:39:26.534 INFO:teuthology.orchestra.run.smithi076.stdout:which means they are currently configured by ifupdown: 2024-03-28T12:39:26.534 INFO:teuthology.orchestra.run.smithi076.stdout:- enp3s0f1 2024-03-28T12:39:26.534 INFO:teuthology.orchestra.run.smithi076.stdout:If you want to manage those interfaces with NetworkManager instead 2024-03-28T12:39:26.534 INFO:teuthology.orchestra.run.smithi076.stdout:remove their configuration from /etc/network/interfaces. 2024-03-28T12:39:26.534 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:39:26.550 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-03-28T12:39:26.668 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-03-28T12:39:26.951 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-03-28T12:39:26.973 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-03-28T12:39:27.018 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-03-28T12:39:27.060 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-03-28T12:39:27.329 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package dump. 2024-03-28T12:39:27.351 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-03-28T12:39:27.396 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking dump (0.4b47-3) ... 2024-03-28T12:39:27.478 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-03-28T12:39:27.675 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package indent. 2024-03-28T12:39:27.688 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-03-28T12:39:27.725 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-28T12:39:27.986 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-03-28T12:39:28.008 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-03-28T12:39:28.052 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-28T12:39:28.237 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-28T12:39:28.388 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-28T12:39:28.415 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-03-28T12:39:28.437 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-03-28T12:39:28.482 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-28T12:39:28.515 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-03-28T12:39:28.718 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-03-28T12:39:28.731 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-03-28T12:39:28.767 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-03-28T12:39:29.066 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up postgresql-common (238) ... 2024-03-28T12:39:29.104 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libfl2:amd64. 2024-03-28T12:39:29.127 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-03-28T12:39:29.171 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-03-28T12:39:29.432 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-03-28T12:39:29.454 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-03-28T12:39:29.499 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-28T12:39:29.751 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libjson-perl. 2024-03-28T12:39:29.765 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-03-28T12:39:29.802 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-03-28T12:39:30.031 INFO:teuthology.orchestra.run.smithi076.stdout:Adding user postgres to group ssl-cert 2024-03-28T12:39:30.105 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libllvm14:amd64. 2024-03-28T12:39:30.128 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-03-28T12:39:30.171 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-28T12:39:30.290 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:39:30.290 INFO:teuthology.orchestra.run.smithi076.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-03-28T12:39:30.538 INFO:teuthology.orchestra.run.smithi076.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-03-28T12:39:30.539 INFO:teuthology.orchestra.run.smithi076.stdout:Removing obsolete dictionary files: 2024-03-28T12:39:31.232 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-03-28T12:39:31.692 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-28T12:39:31.834 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-03-28T12:39:31.856 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-28T12:39:31.900 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-28T12:39:32.034 INFO:teuthology.orchestra.run.smithi076.stdout:Creating new PostgreSQL cluster 14/main ... 2024-03-28T12:39:32.057 INFO:teuthology.orchestra.run.smithi076.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-03-28T12:39:32.104 INFO:teuthology.orchestra.run.smithi076.stdout:The files belonging to this database system will be owned by user "postgres". 2024-03-28T12:39:32.104 INFO:teuthology.orchestra.run.smithi076.stdout:This user must also own the server process. 2024-03-28T12:39:32.104 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:39:32.104 INFO:teuthology.orchestra.run.smithi076.stdout:The database cluster will be initialized with locale "en_US". 2024-03-28T12:39:32.104 INFO:teuthology.orchestra.run.smithi076.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-03-28T12:39:32.104 INFO:teuthology.orchestra.run.smithi076.stdout:The default text search configuration will be set to "english". 2024-03-28T12:39:32.104 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:39:32.104 INFO:teuthology.orchestra.run.smithi076.stdout:Data page checksums are disabled. 2024-03-28T12:39:32.104 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:39:32.105 INFO:teuthology.orchestra.run.smithi076.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-03-28T12:39:32.105 INFO:teuthology.orchestra.run.smithi076.stdout:creating subdirectories ... ok 2024-03-28T12:39:32.105 INFO:teuthology.orchestra.run.smithi076.stdout:selecting dynamic shared memory implementation ... posix 2024-03-28T12:39:32.128 INFO:teuthology.orchestra.run.smithi076.stdout:selecting default max_connections ... 100 2024-03-28T12:39:32.162 INFO:teuthology.orchestra.run.smithi076.stdout:selecting default shared_buffers ... 128MB 2024-03-28T12:39:32.176 INFO:teuthology.orchestra.run.smithi076.stdout:selecting default time zone ... Etc/UTC 2024-03-28T12:39:32.177 INFO:teuthology.orchestra.run.smithi076.stdout:creating configuration files ... ok 2024-03-28T12:39:32.187 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libmbim-proxy. 2024-03-28T12:39:32.208 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-03-28T12:39:32.253 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-28T12:39:32.339 INFO:teuthology.orchestra.run.smithi076.stdout:running bootstrap script ... ok 2024-03-28T12:39:32.565 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-03-28T12:39:32.586 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-28T12:39:32.623 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-28T12:39:32.968 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libndp0:amd64. 2024-03-28T12:39:32.989 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-03-28T12:39:32.998 INFO:teuthology.orchestra.run.smithi076.stdout:performing post-bootstrap initialization ... ok 2024-03-28T12:39:33.034 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-28T12:39:33.387 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libnm0:amd64. 2024-03-28T12:39:33.409 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-03-28T12:39:33.454 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-28T12:39:33.606 INFO:teuthology.orchestra.run.smithi076.stdout:syncing data to disk ... ok 2024-03-28T12:39:33.815 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libpq5:amd64. 2024-03-28T12:39:33.837 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-28T12:39:33.873 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-28T12:39:34.127 INFO:teuthology.orchestra.run.smithi076.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-03-28T12:39:34.202 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-03-28T12:39:34.223 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-28T12:39:34.268 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-28T12:39:34.563 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqmi-proxy. 2024-03-28T12:39:34.575 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-03-28T12:39:34.612 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-28T12:39:34.857 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-03-28T12:39:34.869 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-03-28T12:39:34.907 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-28T12:39:35.419 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-03-28T12:39:35.441 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-03-28T12:39:35.485 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-03-28T12:39:36.191 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package modemmanager. 2024-03-28T12:39:36.213 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-03-28T12:39:36.257 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-28T12:39:36.889 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package network-manager. 2024-03-28T12:39:36.912 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-03-28T12:39:36.963 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-03-28T12:39:37.149 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-28T12:39:37.275 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up postgresql-contrib (14+238) ... 2024-03-28T12:39:37.393 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up postgresql (14+238) ... 2024-03-28T12:39:37.494 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-28T12:39:37.628 INFO:teuthology.orchestra.run.smithi076.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-28T12:39:37.697 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ppp. 2024-03-28T12:39:37.719 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-03-28T12:39:37.886 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-03-28T12:39:37.886 INFO:teuthology.orchestra.run.smithi076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-03-28T12:39:38.037 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-03-28T12:39:38.327 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package pptp-linux. 2024-03-28T12:39:38.349 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-03-28T12:39:38.393 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-03-28T12:39:38.646 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package network-manager-pptp. 2024-03-28T12:39:38.659 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-03-28T12:39:38.664 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-28T12:39:38.696 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-03-28T12:39:38.756 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-03-28T12:39:38.999 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package postgresql-client-common. 2024-03-28T12:39:39.022 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-03-28T12:39:39.066 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking postgresql-client-common (238) ... 2024-03-28T12:39:39.092 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-28T12:39:39.243 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-28T12:39:39.370 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package postgresql-client-14. 2024-03-28T12:39:39.392 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-28T12:39:39.436 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-28T12:39:40.033 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package postgresql-common. 2024-03-28T12:39:40.055 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-03-28T12:39:40.126 INFO:teuthology.orchestra.run.smithi111.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-03-28T12:39:40.156 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking postgresql-common (238) ... 2024-03-28T12:39:40.616 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package postgresql-14. 2024-03-28T12:39:40.638 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-03-28T12:39:40.662 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-03-28T12:39:40.685 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-28T12:39:40.755 INFO:teuthology.orchestra.run.smithi076.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-28T12:39:41.276 INFO:teuthology.orchestra.run.smithi076.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-28T12:39:41.283 DEBUG:teuthology.parallel:result is None 2024-03-28T12:39:42.302 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package postgresql. 2024-03-28T12:39:42.315 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-03-28T12:39:42.351 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking postgresql (14+238) ... 2024-03-28T12:39:42.604 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package postgresql-client. 2024-03-28T12:39:42.617 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-03-28T12:39:42.670 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking postgresql-client (14+238) ... 2024-03-28T12:39:42.898 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package postgresql-contrib. 2024-03-28T12:39:42.911 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-03-28T12:39:42.956 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking postgresql-contrib (14+238) ... 2024-03-28T12:39:43.259 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package tcl8.6. 2024-03-28T12:39:43.282 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-03-28T12:39:43.325 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-28T12:39:43.603 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package tcl. 2024-03-28T12:39:43.626 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-03-28T12:39:43.674 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-03-28T12:39:44.023 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package wpasupplicant. 2024-03-28T12:39:44.045 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-03-28T12:39:44.089 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-28T12:39:44.452 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-03-28T12:39:44.465 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-03-28T12:39:44.502 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-03-28T12:39:44.880 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package usb-modeswitch. 2024-03-28T12:39:44.903 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-03-28T12:39:44.955 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-28T12:39:45.231 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up postgresql-client-common (238) ... 2024-03-28T12:39:45.436 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up flex (2.6.4-8build2) ... 2024-03-28T12:39:45.562 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-03-28T12:39:45.688 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-03-28T12:39:45.806 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-03-28T12:39:45.916 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-03-28T12:39:46.042 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-28T12:39:46.522 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-03-28T12:39:46.606 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-03-28T12:39:47.024 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-28T12:39:47.025 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-03-28T12:39:47.609 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.3) ... 2024-03-28T12:39:47.760 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-03-28T12:39:47.886 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-03-28T12:39:48.012 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-03-28T12:39:48.139 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-03-28T12:39:48.264 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-03-28T12:39:48.366 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-03-28T12:39:48.492 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-03-28T12:39:49.139 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-03-28T12:39:49.276 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up dump (0.4b47-3) ... 2024-03-28T12:39:49.359 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-03-28T12:39:49.425 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-03-28T12:39:49.551 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-03-28T12:39:49.677 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up tcl (8.6.11+1build2) ... 2024-03-28T12:39:49.803 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libjson-perl (4.04000-1) ... 2024-03-28T12:39:49.930 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-03-28T12:39:50.020 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-03-28T12:39:50.089 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-03-28T12:39:50.199 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-03-28T12:39:50.359 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-03-28T12:39:50.485 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-03-28T12:39:50.611 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-03-28T12:39:50.779 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up postgresql-client (14+238) ... 2024-03-28T12:39:50.905 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-03-28T12:39:51.412 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:39:51.412 INFO:teuthology.orchestra.run.smithi111.stdout:The following network interfaces were found in /etc/network/interfaces 2024-03-28T12:39:51.412 INFO:teuthology.orchestra.run.smithi111.stdout:which means they are currently configured by ifupdown: 2024-03-28T12:39:51.412 INFO:teuthology.orchestra.run.smithi111.stdout:- enp3s0f1 2024-03-28T12:39:51.412 INFO:teuthology.orchestra.run.smithi111.stdout:If you want to manage those interfaces with NetworkManager instead 2024-03-28T12:39:51.412 INFO:teuthology.orchestra.run.smithi111.stdout:remove their configuration from /etc/network/interfaces. 2024-03-28T12:39:51.412 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:39:51.528 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-03-28T12:39:51.868 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-03-28T12:39:52.291 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-03-28T12:39:52.887 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-03-28T12:39:53.068 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-03-28T12:39:53.194 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-03-28T12:39:53.320 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up postgresql-common (238) ... 2024-03-28T12:39:54.234 INFO:teuthology.orchestra.run.smithi111.stdout:Adding user postgres to group ssl-cert 2024-03-28T12:39:54.423 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:39:54.423 INFO:teuthology.orchestra.run.smithi111.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-03-28T12:39:54.646 INFO:teuthology.orchestra.run.smithi111.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-03-28T12:39:54.646 INFO:teuthology.orchestra.run.smithi111.stdout:Removing obsolete dictionary files: 2024-03-28T12:39:55.249 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-03-28T12:39:55.657 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-03-28T12:39:55.963 INFO:teuthology.orchestra.run.smithi111.stdout:Creating new PostgreSQL cluster 14/main ... 2024-03-28T12:39:55.978 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-03-28T12:39:56.022 INFO:teuthology.orchestra.run.smithi111.stdout:The files belonging to this database system will be owned by user "postgres". 2024-03-28T12:39:56.022 INFO:teuthology.orchestra.run.smithi111.stdout:This user must also own the server process. 2024-03-28T12:39:56.022 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:39:56.022 INFO:teuthology.orchestra.run.smithi111.stdout:The database cluster will be initialized with locale "en_US". 2024-03-28T12:39:56.022 INFO:teuthology.orchestra.run.smithi111.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-03-28T12:39:56.022 INFO:teuthology.orchestra.run.smithi111.stdout:The default text search configuration will be set to "english". 2024-03-28T12:39:56.022 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:39:56.022 INFO:teuthology.orchestra.run.smithi111.stdout:Data page checksums are disabled. 2024-03-28T12:39:56.022 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:39:56.022 INFO:teuthology.orchestra.run.smithi111.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-03-28T12:39:56.022 INFO:teuthology.orchestra.run.smithi111.stdout:creating subdirectories ... ok 2024-03-28T12:39:56.022 INFO:teuthology.orchestra.run.smithi111.stdout:selecting dynamic shared memory implementation ... posix 2024-03-28T12:39:56.038 INFO:teuthology.orchestra.run.smithi111.stdout:selecting default max_connections ... 100 2024-03-28T12:39:56.057 INFO:teuthology.orchestra.run.smithi111.stdout:selecting default shared_buffers ... 128MB 2024-03-28T12:39:56.067 INFO:teuthology.orchestra.run.smithi111.stdout:selecting default time zone ... Etc/UTC 2024-03-28T12:39:56.067 INFO:teuthology.orchestra.run.smithi111.stdout:creating configuration files ... ok 2024-03-28T12:39:56.180 INFO:teuthology.orchestra.run.smithi111.stdout:running bootstrap script ... ok 2024-03-28T12:39:56.827 INFO:teuthology.orchestra.run.smithi111.stdout:performing post-bootstrap initialization ... ok 2024-03-28T12:39:57.578 INFO:teuthology.orchestra.run.smithi111.stdout:syncing data to disk ... ok 2024-03-28T12:39:58.006 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-03-28T12:40:00.839 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-03-28T12:40:00.966 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up postgresql-contrib (14+238) ... 2024-03-28T12:40:01.092 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up postgresql (14+238) ... 2024-03-28T12:40:01.218 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-03-28T12:40:01.344 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-03-28T12:40:01.600 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-03-28T12:40:01.600 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-03-28T12:40:02.163 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-28T12:40:02.256 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-03-28T12:40:02.558 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-28T12:40:02.710 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-28T12:40:04.072 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-03-28T12:40:04.197 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-28T12:40:04.705 INFO:teuthology.orchestra.run.smithi111.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-28T12:40:04.710 DEBUG:teuthology.parallel:result is None 2024-03-28T12:40:04.710 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15 2024-03-28T12:40:04.851 DEBUG:teuthology.orchestra.run.smithi076:> dpkg-query -W -f '${Version}' ceph 2024-03-28T12:40:04.874 INFO:teuthology.orchestra.run.smithi076.stdout:19.0.0-2499-ge0e48ba6-1jammy 2024-03-28T12:40:04.874 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2499-ge0e48ba6-1jammy 2024-03-28T12:40:04.875 INFO:teuthology.task.install:The correct ceph version 19.0.0-2499-ge0e48ba6-1jammy is installed. 2024-03-28T12:40:04.876 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15 2024-03-28T12:40:05.012 DEBUG:teuthology.orchestra.run.smithi111:> dpkg-query -W -f '${Version}' ceph 2024-03-28T12:40:05.031 INFO:teuthology.orchestra.run.smithi111.stdout:19.0.0-2499-ge0e48ba6-1jammy 2024-03-28T12:40:05.031 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2499-ge0e48ba6-1jammy 2024-03-28T12:40:05.031 INFO:teuthology.task.install:The correct ceph version 19.0.0-2499-ge0e48ba6-1jammy is installed. 2024-03-28T12:40:05.032 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-28T12:40:05.033 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:05.033 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-28T12:40:05.054 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:40:05.054 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-28T12:40:05.087 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-28T12:40:05.087 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:05.088 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/daemon-helper 2024-03-28T12:40:05.116 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-28T12:40:05.176 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:40:05.176 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/daemon-helper 2024-03-28T12:40:05.190 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-28T12:40:05.245 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-28T12:40:05.246 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:05.246 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-28T12:40:05.266 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-28T12:40:05.332 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:40:05.332 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-28T12:40:05.345 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-28T12:40:05.397 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-28T12:40:05.397 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:05.397 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/usr/bin/stdin-killer 2024-03-28T12:40:05.416 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-28T12:40:05.475 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:40:05.475 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/stdin-killer 2024-03-28T12:40:05.487 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-28T12:40:05.541 INFO:teuthology.run_tasks:Running task ceph... 2024-03-28T12:40:05.620 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-28T12:40:05.621 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 777 /var/log/ceph 2024-03-28T12:40:05.624 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 777 /var/log/ceph 2024-03-28T12:40:05.640 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-28T12:40:05.640 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-28T12:40:05.684 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-28T12:40:05.700 INFO:tasks.ceph:Creating extra log directories... 2024-03-28T12:40:05.700 DEBUG:teuthology.orchestra.run.smithi076:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-28T12:40:05.743 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-28T12:40:05.766 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-28T12:40:05.766 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-28T12:40:05.767 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-28T12:40:05.767 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:05.767 DEBUG:teuthology.orchestra.run.smithi076:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-28T12:40:05.809 DEBUG:teuthology.orchestra.run.smithi076:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-28T12:40:05.898 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:40:05.899 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-28T12:40:05.904 DEBUG:teuthology.orchestra.run.smithi111:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-28T12:40:05.983 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-28T12:40:05.983 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-28T12:40:05.983 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627784', 'branch': 'wip-batrick-testing-20240327.230800', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/5 tasks/fsstress validater/valgrind}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7627784', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20240327.230800'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20240327.230800', 'sha1': 'e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 7752, 'sha1': 'e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15', 'sleep_before_teardown': 0, 'subset': '1/512', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20240327.230800', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi076.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKoVmuWtstY1F4pmLD7TPY+oHB/CloLT8YY5gHm7dEB8VWk/9iZCnaTXaYD2Tk8Wu046YyZSIUllyuA2kemHSA0=', 'smithi111.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBfQWoGPgePB57Hor7i65p0t39xO2uMXVtp++yXP/eOgqz74SrpH/MpsUTir+Z2ZyZ+H/9SR1yOA352WOHAbyNs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-28_07:14:07', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-28T12:40:05.983 DEBUG:teuthology.orchestra.run.smithi076:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-28T12:40:05.986 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-28T12:40:06.027 DEBUG:teuthology.orchestra.run.smithi076:> sudo install -d -m0777 -- /var/run/ceph 2024-03-28T12:40:06.035 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/run/ceph 2024-03-28T12:40:06.081 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:06.081 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/scratch_devs of=/dev/stdout 2024-03-28T12:40:06.100 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-28T12:40:06.101 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_1 2024-03-28T12:40:06.153 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-28T12:40:06.153 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T12:40:06.153 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-03-28T12:40:06.153 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T12:40:06.153 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-03-28 12:28:41.778295764 +0000 2024-03-28T12:40:06.153 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-03-28 12:28:41.506298193 +0000 2024-03-28T12:40:06.153 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-03-28 12:28:41.506298193 +0000 2024-03-28T12:40:06.154 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-03-28 12:28:41.506298193 +0000 2024-03-28T12:40:06.154 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-28T12:40:06.214 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-03-28T12:40:06.214 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-03-28T12:40:06.214 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000376604 s, 1.4 MB/s 2024-03-28T12:40:06.216 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-28T12:40:06.271 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_2 2024-03-28T12:40:06.321 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-28T12:40:06.321 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T12:40:06.321 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 5h/5d Inode: 896 Links: 1 2024-03-28T12:40:06.321 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T12:40:06.321 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-03-28 12:28:42.014293655 +0000 2024-03-28T12:40:06.321 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-03-28 12:28:42.010293690 +0000 2024-03-28T12:40:06.321 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-03-28 12:28:42.010293690 +0000 2024-03-28T12:40:06.322 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-03-28 12:28:42.010293690 +0000 2024-03-28T12:40:06.322 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-28T12:40:06.382 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-03-28T12:40:06.383 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-03-28T12:40:06.383 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000365753 s, 1.4 MB/s 2024-03-28T12:40:06.385 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-28T12:40:06.443 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_3 2024-03-28T12:40:06.493 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-28T12:40:06.493 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T12:40:06.493 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-03-28T12:40:06.493 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T12:40:06.493 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-03-28 12:28:42.782286794 +0000 2024-03-28T12:40:06.493 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-03-28 12:28:42.530289046 +0000 2024-03-28T12:40:06.493 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-03-28 12:28:42.530289046 +0000 2024-03-28T12:40:06.493 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-03-28 12:28:42.530289046 +0000 2024-03-28T12:40:06.494 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-28T12:40:06.554 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-03-28T12:40:06.554 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-03-28T12:40:06.555 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000372029 s, 1.4 MB/s 2024-03-28T12:40:06.556 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-28T12:40:06.607 DEBUG:teuthology.orchestra.run.smithi076:> stat /dev/vg_nvme/lv_4 2024-03-28T12:40:06.661 INFO:teuthology.orchestra.run.smithi076.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-28T12:40:06.661 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T12:40:06.661 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 5h/5d Inode: 932 Links: 1 2024-03-28T12:40:06.661 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T12:40:06.661 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 2024-03-28 12:28:43.286282294 +0000 2024-03-28T12:40:06.661 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-03-28 12:28:43.030284580 +0000 2024-03-28T12:40:06.661 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-03-28 12:28:43.030284580 +0000 2024-03-28T12:40:06.661 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-03-28 12:28:43.030284580 +0000 2024-03-28T12:40:06.662 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-28T12:40:06.723 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records in 2024-03-28T12:40:06.723 INFO:teuthology.orchestra.run.smithi076.stderr:1+0 records out 2024-03-28T12:40:06.723 INFO:teuthology.orchestra.run.smithi076.stderr:512 bytes copied, 0.000385253 s, 1.3 MB/s 2024-03-28T12:40:06.724 DEBUG:teuthology.orchestra.run.smithi076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-28T12:40:06.779 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-28T12:40:06.779 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:40:06.779 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/scratch_devs of=/dev/stdout 2024-03-28T12:40:06.785 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-28T12:40:06.785 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_1 2024-03-28T12:40:06.831 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-28T12:40:06.831 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T12:40:06.831 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 879 Links: 1 2024-03-28T12:40:06.831 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T12:40:06.831 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-03-28 12:28:24.073646640 +0000 2024-03-28T12:40:06.831 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-03-28 12:28:23.797649105 +0000 2024-03-28T12:40:06.831 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-03-28 12:28:23.797649105 +0000 2024-03-28T12:40:06.831 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-03-28T12:40:06.831 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-28T12:40:06.885 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-03-28T12:40:06.885 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-03-28T12:40:06.885 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000551274 s, 929 kB/s 2024-03-28T12:40:06.886 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-28T12:40:06.939 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_2 2024-03-28T12:40:06.986 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-28T12:40:07.055 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T12:40:07.055 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 902 Links: 1 2024-03-28T12:40:07.055 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T12:40:07.055 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-03-28 12:28:24.533642532 +0000 2024-03-28T12:40:07.055 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-03-28 12:28:24.297644638 +0000 2024-03-28T12:40:07.055 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-03-28 12:28:24.297644638 +0000 2024-03-28T12:40:07.055 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-03-28T12:40:07.055 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-28T12:40:07.068 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-03-28T12:40:07.069 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-03-28T12:40:07.069 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000509747 s, 1.0 MB/s 2024-03-28T12:40:07.070 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-28T12:40:07.124 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_3 2024-03-28T12:40:07.170 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-28T12:40:07.171 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T12:40:07.171 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-03-28T12:40:07.171 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T12:40:07.171 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-03-28 12:28:25.009638279 +0000 2024-03-28T12:40:07.171 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-03-28 12:28:24.765640458 +0000 2024-03-28T12:40:07.171 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-03-28 12:28:24.765640458 +0000 2024-03-28T12:40:07.171 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-03-28T12:40:07.171 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-28T12:40:07.225 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-03-28T12:40:07.225 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-03-28T12:40:07.225 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000577315 s, 887 kB/s 2024-03-28T12:40:07.227 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-28T12:40:07.276 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_4 2024-03-28T12:40:07.322 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-28T12:40:07.322 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-28T12:40:07.322 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 931 Links: 1 2024-03-28T12:40:07.322 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T12:40:07.322 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-03-28 12:28:25.249636135 +0000 2024-03-28T12:40:07.322 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-03-28 12:28:25.245636171 +0000 2024-03-28T12:40:07.322 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-03-28 12:28:25.245636171 +0000 2024-03-28T12:40:07.322 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-03-28T12:40:07.323 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-28T12:40:07.377 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-03-28T12:40:07.377 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-03-28T12:40:07.377 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000451932 s, 1.1 MB/s 2024-03-28T12:40:07.378 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-28T12:40:07.431 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-28T12:40:07.431 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi076.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-28T12:40:07.432 INFO:tasks.ceph:Generating config... 2024-03-28T12:40:07.433 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-28T12:40:07.433 INFO:tasks.ceph:[client] debug client = 20 2024-03-28T12:40:07.433 INFO:tasks.ceph:[client] debug ms = 1 2024-03-28T12:40:07.433 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-28T12:40:07.433 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-28T12:40:07.433 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-03-28T12:40:07.433 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-03-28T12:40:07.433 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-28T12:40:07.433 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-03-28T12:40:07.433 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-28T12:40:07.433 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-28T12:40:07.433 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-28T12:40:07.433 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-28T12:40:07.433 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-28T12:40:07.433 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-28T12:40:07.433 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-03-28T12:40:07.434 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-28T12:40:07.434 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-28T12:40:07.434 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-28T12:40:07.434 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-28T12:40:07.434 INFO:tasks.ceph:[mgr] debug client = 20 2024-03-28T12:40:07.434 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-28T12:40:07.434 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-28T12:40:07.434 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-28T12:40:07.434 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-28T12:40:07.434 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-28T12:40:07.434 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-03-28T12:40:07.434 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-28T12:40:07.434 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-03-28T12:40:07.434 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-28T12:40:07.434 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-03-28T12:40:07.434 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-28T12:40:07.435 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-03-28T12:40:07.435 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-03-28T12:40:07.435 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-28T12:40:07.435 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-28T12:40:07.435 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-03-28T12:40:07.435 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-28T12:40:07.435 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-28T12:40:07.435 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-28T12:40:07.435 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-28T12:40:07.435 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-03-28T12:40:07.435 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-28T12:40:07.435 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-28T12:40:07.435 INFO:tasks.ceph:Setting up mon.a... 2024-03-28T12:40:07.435 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-28T12:40:07.479 INFO:teuthology.orchestra.run.smithi076.stdout:creating /etc/ceph/ceph.keyring 2024-03-28T12:40:07.498 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-28T12:40:07.588 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-28T12:40:07.648 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.76'), ('mon.b', '172.21.15.111'), ('mon.c', '[v2:172.21.15.111:3301,v1:172.21.15.111:6790]')] 2024-03-28T12:40:07.648 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.76,172.21.15.111,[v2:172.21.15.111:3301,v1:172.21.15.111:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'ms die on skipped message': False, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-28T12:40:07.649 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:07.649 DEBUG:teuthology.orchestra.run.smithi076:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-28T12:40:07.700 DEBUG:teuthology.orchestra.run.smithi076:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.76 --add b 172.21.15.111 --addv c '[v2:172.21.15.111:3301,v1:172.21.15.111:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-28T12:40:07.787 INFO:teuthology.orchestra.run.smithi076.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-28T12:40:07.787 INFO:teuthology.orchestra.run.smithi076.stdout:monmaptool: generated fsid ed125c42-99c2-4574-a55f-ea7172f89d9c 2024-03-28T12:40:07.787 INFO:teuthology.orchestra.run.smithi076.stdout:setting min_mon_release = quincy 2024-03-28T12:40:07.787 INFO:teuthology.orchestra.run.smithi076.stdout:epoch 0 2024-03-28T12:40:07.788 INFO:teuthology.orchestra.run.smithi076.stdout:fsid ed125c42-99c2-4574-a55f-ea7172f89d9c 2024-03-28T12:40:07.788 INFO:teuthology.orchestra.run.smithi076.stdout:last_changed 2024-03-28T12:40:07.790876+0000 2024-03-28T12:40:07.788 INFO:teuthology.orchestra.run.smithi076.stdout:created 2024-03-28T12:40:07.790876+0000 2024-03-28T12:40:07.788 INFO:teuthology.orchestra.run.smithi076.stdout:min_mon_release 17 (quincy) 2024-03-28T12:40:07.788 INFO:teuthology.orchestra.run.smithi076.stdout:election_strategy: 1 2024-03-28T12:40:07.788 INFO:teuthology.orchestra.run.smithi076.stdout:0: [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] mon.a 2024-03-28T12:40:07.788 INFO:teuthology.orchestra.run.smithi076.stdout:1: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.b 2024-03-28T12:40:07.788 INFO:teuthology.orchestra.run.smithi076.stdout:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-03-28T12:40:07.788 INFO:teuthology.orchestra.run.smithi076.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-28T12:40:07.791 DEBUG:teuthology.orchestra.run.smithi076:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-28T12:40:07.798 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ed125c42-99c2-4574-a55f-ea7172f89d9c... 2024-03-28T12:40:07.799 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-28T12:40:07.843 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-28T12:40:07.872 INFO:teuthology.orchestra.run.smithi111.stdout:[global] 2024-03-28T12:40:07.873 INFO:teuthology.orchestra.run.smithi111.stdout: chdir = "" 2024-03-28T12:40:07.873 INFO:teuthology.orchestra.run.smithi111.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-28T12:40:07.873 INFO:teuthology.orchestra.run.smithi111.stdout: auth supported = cephx 2024-03-28T12:40:07.873 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.873 INFO:teuthology.orchestra.run.smithi111.stdout: filestore xattr use omap = true 2024-03-28T12:40:07.873 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.873 INFO:teuthology.orchestra.run.smithi111.stdout: mon clock drift allowed = 1.000 2024-03-28T12:40:07.873 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.873 INFO:teuthology.orchestra.run.smithi111.stdout: osd crush chooseleaf type = 0 2024-03-28T12:40:07.873 INFO:teuthology.orchestra.run.smithi111.stdout: auth debug = true 2024-03-28T12:40:07.873 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.873 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on old message = true 2024-03-28T12:40:07.873 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on bug = true 2024-03-28T12:40:07.873 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.873 INFO:teuthology.orchestra.run.smithi111.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-28T12:40:07.874 INFO:teuthology.orchestra.run.smithi111.stdout: mon pg warn max object skew = 0 2024-03-28T12:40:07.874 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.874 INFO:teuthology.orchestra.run.smithi111.stdout: # disable pg_autoscaler by default for new pools 2024-03-28T12:40:07.874 INFO:teuthology.orchestra.run.smithi111.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-28T12:40:07.874 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.874 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default size = 2 2024-03-28T12:40:07.874 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.874 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow primary affinity = true 2024-03-28T12:40:07.874 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow pg remap = true 2024-03-28T12:40:07.874 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on legacy crush tunables = false 2024-03-28T12:40:07.874 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on crush straw calc version zero = false 2024-03-28T12:40:07.874 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on no sortbitwise = false 2024-03-28T12:40:07.874 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on osd down out interval zero = false 2024-03-28T12:40:07.874 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on too few osds = false 2024-03-28T12:40:07.874 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-28T12:40:07.875 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-28T12:40:07.875 INFO:teuthology.orchestra.run.smithi111.stdout: mon_allow_pool_size_one = true 2024-03-28T12:40:07.875 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.875 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-28T12:40:07.875 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.875 INFO:teuthology.orchestra.run.smithi111.stdout: osd default data pool replay window = 5 2024-03-28T12:40:07.875 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.875 INFO:teuthology.orchestra.run.smithi111.stdout: mon allow pool delete = true 2024-03-28T12:40:07.875 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.875 INFO:teuthology.orchestra.run.smithi111.stdout: mon cluster log file level = debug 2024-03-28T12:40:07.875 INFO:teuthology.orchestra.run.smithi111.stdout: debug asserts on shutdown = true 2024-03-28T12:40:07.875 INFO:teuthology.orchestra.run.smithi111.stdout: mon health detail to clog = false 2024-03-28T12:40:07.875 INFO:teuthology.orchestra.run.smithi111.stdout: mon host = "172.21.15.76,172.21.15.111,[v2:172.21.15.111:3301,v1:172.21.15.111:6790]" 2024-03-28T12:40:07.875 INFO:teuthology.orchestra.run.smithi111.stdout: mds beacon grace = 60 2024-03-28T12:40:07.875 INFO:teuthology.orchestra.run.smithi111.stdout: mds heartbeat grace = 60 2024-03-28T12:40:07.875 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on skipped message = False 2024-03-28T12:40:07.875 INFO:teuthology.orchestra.run.smithi111.stdout: osd heartbeat grace = 60 2024-03-28T12:40:07.876 INFO:teuthology.orchestra.run.smithi111.stdout: fsid = ed125c42-99c2-4574-a55f-ea7172f89d9c 2024-03-28T12:40:07.876 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.876 INFO:teuthology.orchestra.run.smithi111.stdout:[osd] 2024-03-28T12:40:07.876 INFO:teuthology.orchestra.run.smithi111.stdout: osd journal size = 100 2024-03-28T12:40:07.876 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.876 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub load threshold = 5.0 2024-03-28T12:40:07.876 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub max interval = 600 2024-03-28T12:40:07.876 INFO:teuthology.orchestra.run.smithi111.stdout: osd mclock profile = high_recovery_ops 2024-03-28T12:40:07.876 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.876 INFO:teuthology.orchestra.run.smithi111.stdout: osd recover clone overlap = true 2024-03-28T12:40:07.876 INFO:teuthology.orchestra.run.smithi111.stdout: osd recovery max chunk = 1048576 2024-03-28T12:40:07.876 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.876 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug shutdown = true 2024-03-28T12:40:07.876 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug op order = true 2024-03-28T12:40:07.876 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug verify stray on activate = true 2024-03-28T12:40:07.876 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug trim objects = true 2024-03-28T12:40:07.876 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: osd open classes on start = true 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug pg log writeout = true 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: osd deep scrub update digest min age = 30 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: osd map max advance = 10 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: journal zero on create = true 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: filestore ondisk finisher threads = 3 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: filestore apply finisher threads = 3 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: bdev debug aio = true 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug misdirected ops = true 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore block size = 96636764160 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore compression mode = aggressive 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore fsck on mount = True 2024-03-28T12:40:07.877 INFO:teuthology.orchestra.run.smithi111.stdout: debug bluefs = 20 2024-03-28T12:40:07.878 INFO:teuthology.orchestra.run.smithi111.stdout: debug bluestore = 20 2024-03-28T12:40:07.878 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-03-28T12:40:07.878 INFO:teuthology.orchestra.run.smithi111.stdout: debug osd = 20 2024-03-28T12:40:07.878 INFO:teuthology.orchestra.run.smithi111.stdout: debug rocksdb = 10 2024-03-28T12:40:07.878 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd backfillfull_ratio = 0.85 2024-03-28T12:40:07.878 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd full ratio = 0.9 2024-03-28T12:40:07.878 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd nearfull ratio = 0.8 2024-03-28T12:40:07.878 INFO:teuthology.orchestra.run.smithi111.stdout: osd failsafe full ratio = 0.95 2024-03-28T12:40:07.878 INFO:teuthology.orchestra.run.smithi111.stdout: osd fast shutdown = False 2024-03-28T12:40:07.878 INFO:teuthology.orchestra.run.smithi111.stdout: osd objectstore = bluestore 2024-03-28T12:40:07.878 INFO:teuthology.orchestra.run.smithi111.stdout: osd op complaint time = 180 2024-03-28T12:40:07.878 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.878 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr] 2024-03-28T12:40:07.878 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-03-28T12:40:07.878 INFO:teuthology.orchestra.run.smithi111.stdout: debug mgr = 20 2024-03-28T12:40:07.878 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2024-03-28T12:40:07.879 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2024-03-28T12:40:07.879 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2024-03-28T12:40:07.879 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2024-03-28T12:40:07.879 INFO:teuthology.orchestra.run.smithi111.stdout: mgr/telemetry/nag = false 2024-03-28T12:40:07.879 INFO:teuthology.orchestra.run.smithi111.stdout: debug client = 20 2024-03-28T12:40:07.879 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.879 INFO:teuthology.orchestra.run.smithi111.stdout:[mon] 2024-03-28T12:40:07.879 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-03-28T12:40:07.879 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2024-03-28T12:40:07.879 INFO:teuthology.orchestra.run.smithi111.stdout: debug paxos = 20 2024-03-28T12:40:07.879 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2024-03-28T12:40:07.879 INFO:teuthology.orchestra.run.smithi111.stdout: mon data avail warn = 5 2024-03-28T12:40:07.879 INFO:teuthology.orchestra.run.smithi111.stdout: mon mgr mkfs grace = 240 2024-03-28T12:40:07.879 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2024-03-28T12:40:07.879 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd reporter subtree level = osd 2024-03-28T12:40:07.879 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd prime pg temp = true 2024-03-28T12:40:07.879 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2024-03-28T12:40:07.880 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.880 INFO:teuthology.orchestra.run.smithi111.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-28T12:40:07.880 INFO:teuthology.orchestra.run.smithi111.stdout: auth mon ticket ttl = 660 # 11m 2024-03-28T12:40:07.880 INFO:teuthology.orchestra.run.smithi111.stdout: auth service ticket ttl = 240 # 4m 2024-03-28T12:40:07.880 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.880 INFO:teuthology.orchestra.run.smithi111.stdout: # don't complain about insecure global_id in the test suite 2024-03-28T12:40:07.880 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-28T12:40:07.880 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-28T12:40:07.880 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.880 INFO:teuthology.orchestra.run.smithi111.stdout: # 1m isn't quite enough 2024-03-28T12:40:07.880 INFO:teuthology.orchestra.run.smithi111.stdout: mon_down_mkfs_grace = 2m 2024-03-28T12:40:07.880 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.880 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_filestore_osds = false 2024-03-28T12:40:07.880 INFO:teuthology.orchestra.run.smithi111.stdout: mon down mkfs grace = 300 2024-03-28T12:40:07.880 INFO:teuthology.orchestra.run.smithi111.stdout: mon op complaint time = 120 2024-03-28T12:40:07.880 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd crush smoke test = False 2024-03-28T12:40:07.880 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-03-28T12:40:07.881 INFO:teuthology.orchestra.run.smithi111.stdout:[client] 2024-03-28T12:40:07.881 INFO:teuthology.orchestra.run.smithi111.stdout: rgw cache enabled = true 2024-03-28T12:40:07.881 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable ops log = true 2024-03-28T12:40:07.881 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable usage log = true 2024-03-28T12:40:07.881 INFO:teuthology.orchestra.run.smithi111.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-28T12:40:07.881 INFO:teuthology.orchestra.run.smithi111.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-28T12:40:07.881 INFO:teuthology.orchestra.run.smithi111.stdout: client mount timeout = 600 2024-03-28T12:40:07.881 INFO:teuthology.orchestra.run.smithi111.stdout: debug client = 20 2024-03-28T12:40:07.881 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-03-28T12:40:07.881 INFO:teuthology.orchestra.run.smithi111.stdout: rados mon op timeout = 900 2024-03-28T12:40:07.881 INFO:teuthology.orchestra.run.smithi111.stdout: rados osd op timeout = 900 2024-03-28T12:40:07.881 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.a] 2024-03-28T12:40:07.881 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.b] 2024-03-28T12:40:07.881 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.c] 2024-03-28T12:40:07.881 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.a] 2024-03-28T12:40:07.881 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.c] 2024-03-28T12:40:07.881 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.e] 2024-03-28T12:40:07.882 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.b] 2024-03-28T12:40:07.882 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.d] 2024-03-28T12:40:07.882 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.f] 2024-03-28T12:40:07.882 INFO:teuthology.orchestra.run.smithi111.stdout:[mds] 2024-03-28T12:40:07.882 INFO:teuthology.orchestra.run.smithi111.stdout: debug mds = 20 2024-03-28T12:40:07.882 INFO:teuthology.orchestra.run.smithi111.stdout: debug mds balancer = 20 2024-03-28T12:40:07.882 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-03-28T12:40:07.882 INFO:teuthology.orchestra.run.smithi111.stdout: mds debug frag = True 2024-03-28T12:40:07.882 INFO:teuthology.orchestra.run.smithi111.stdout: mds debug scatterstat = True 2024-03-28T12:40:07.882 INFO:teuthology.orchestra.run.smithi111.stdout: mds op complaint time = 180 2024-03-28T12:40:07.882 INFO:teuthology.orchestra.run.smithi111.stdout: mds valgrind exit = True 2024-03-28T12:40:07.882 INFO:teuthology.orchestra.run.smithi111.stdout: mds verify scatter = True 2024-03-28T12:40:07.882 INFO:teuthology.orchestra.run.smithi111.stdout: osd op complaint time = 180 2024-03-28T12:40:07.882 INFO:teuthology.orchestra.run.smithi111.stdout: rados mon op timeout = 900 2024-03-28T12:40:07.882 INFO:teuthology.orchestra.run.smithi111.stdout: rados osd op timeout = 900 2024-03-28T12:40:07.883 INFO:teuthology.orchestra.run.smithi076.stdout:[global] 2024-03-28T12:40:07.883 INFO:teuthology.orchestra.run.smithi076.stdout: chdir = "" 2024-03-28T12:40:07.883 INFO:teuthology.orchestra.run.smithi076.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-28T12:40:07.883 INFO:teuthology.orchestra.run.smithi076.stdout: auth supported = cephx 2024-03-28T12:40:07.883 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.883 INFO:teuthology.orchestra.run.smithi076.stdout: filestore xattr use omap = true 2024-03-28T12:40:07.883 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.883 INFO:teuthology.orchestra.run.smithi076.stdout: mon clock drift allowed = 1.000 2024-03-28T12:40:07.884 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.884 INFO:teuthology.orchestra.run.smithi076.stdout: osd crush chooseleaf type = 0 2024-03-28T12:40:07.884 INFO:teuthology.orchestra.run.smithi076.stdout: auth debug = true 2024-03-28T12:40:07.884 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.884 INFO:teuthology.orchestra.run.smithi076.stdout: ms die on old message = true 2024-03-28T12:40:07.884 INFO:teuthology.orchestra.run.smithi076.stdout: ms die on bug = true 2024-03-28T12:40:07.884 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.884 INFO:teuthology.orchestra.run.smithi076.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-28T12:40:07.884 INFO:teuthology.orchestra.run.smithi076.stdout: mon pg warn max object skew = 0 2024-03-28T12:40:07.884 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.884 INFO:teuthology.orchestra.run.smithi076.stdout: # disable pg_autoscaler by default for new pools 2024-03-28T12:40:07.884 INFO:teuthology.orchestra.run.smithi076.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-28T12:40:07.884 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.884 INFO:teuthology.orchestra.run.smithi076.stdout: osd pool default size = 2 2024-03-28T12:40:07.884 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.884 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd allow primary affinity = true 2024-03-28T12:40:07.885 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd allow pg remap = true 2024-03-28T12:40:07.885 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on legacy crush tunables = false 2024-03-28T12:40:07.885 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on crush straw calc version zero = false 2024-03-28T12:40:07.885 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on no sortbitwise = false 2024-03-28T12:40:07.885 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on osd down out interval zero = false 2024-03-28T12:40:07.885 INFO:teuthology.orchestra.run.smithi076.stdout: mon warn on too few osds = false 2024-03-28T12:40:07.885 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-28T12:40:07.885 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-28T12:40:07.885 INFO:teuthology.orchestra.run.smithi076.stdout: mon_allow_pool_size_one = true 2024-03-28T12:40:07.885 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.885 INFO:teuthology.orchestra.run.smithi076.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-28T12:40:07.885 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.885 INFO:teuthology.orchestra.run.smithi076.stdout: osd default data pool replay window = 5 2024-03-28T12:40:07.885 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.885 INFO:teuthology.orchestra.run.smithi076.stdout: mon allow pool delete = true 2024-03-28T12:40:07.886 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.886 INFO:teuthology.orchestra.run.smithi076.stdout: mon cluster log file level = debug 2024-03-28T12:40:07.886 INFO:teuthology.orchestra.run.smithi076.stdout: debug asserts on shutdown = true 2024-03-28T12:40:07.886 INFO:teuthology.orchestra.run.smithi076.stdout: mon health detail to clog = false 2024-03-28T12:40:07.886 INFO:teuthology.orchestra.run.smithi076.stdout: mon host = "172.21.15.76,172.21.15.111,[v2:172.21.15.111:3301,v1:172.21.15.111:6790]" 2024-03-28T12:40:07.886 INFO:teuthology.orchestra.run.smithi076.stdout: mds beacon grace = 60 2024-03-28T12:40:07.886 INFO:teuthology.orchestra.run.smithi076.stdout: mds heartbeat grace = 60 2024-03-28T12:40:07.886 INFO:teuthology.orchestra.run.smithi076.stdout: ms die on skipped message = False 2024-03-28T12:40:07.886 INFO:teuthology.orchestra.run.smithi076.stdout: osd heartbeat grace = 60 2024-03-28T12:40:07.886 INFO:teuthology.orchestra.run.smithi076.stdout: fsid = ed125c42-99c2-4574-a55f-ea7172f89d9c 2024-03-28T12:40:07.886 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.886 INFO:teuthology.orchestra.run.smithi076.stdout:[osd] 2024-03-28T12:40:07.886 INFO:teuthology.orchestra.run.smithi076.stdout: osd journal size = 100 2024-03-28T12:40:07.886 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.886 INFO:teuthology.orchestra.run.smithi076.stdout: osd scrub load threshold = 5.0 2024-03-28T12:40:07.886 INFO:teuthology.orchestra.run.smithi076.stdout: osd scrub max interval = 600 2024-03-28T12:40:07.887 INFO:teuthology.orchestra.run.smithi076.stdout: osd mclock profile = high_recovery_ops 2024-03-28T12:40:07.887 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.887 INFO:teuthology.orchestra.run.smithi076.stdout: osd recover clone overlap = true 2024-03-28T12:40:07.887 INFO:teuthology.orchestra.run.smithi076.stdout: osd recovery max chunk = 1048576 2024-03-28T12:40:07.887 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.887 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug shutdown = true 2024-03-28T12:40:07.887 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug op order = true 2024-03-28T12:40:07.887 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug verify stray on activate = true 2024-03-28T12:40:07.887 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug trim objects = true 2024-03-28T12:40:07.887 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.887 INFO:teuthology.orchestra.run.smithi076.stdout: osd open classes on start = true 2024-03-28T12:40:07.887 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug pg log writeout = true 2024-03-28T12:40:07.887 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.887 INFO:teuthology.orchestra.run.smithi076.stdout: osd deep scrub update digest min age = 30 2024-03-28T12:40:07.887 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.887 INFO:teuthology.orchestra.run.smithi076.stdout: osd map max advance = 10 2024-03-28T12:40:07.887 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.888 INFO:teuthology.orchestra.run.smithi076.stdout: journal zero on create = true 2024-03-28T12:40:07.888 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.888 INFO:teuthology.orchestra.run.smithi076.stdout: filestore ondisk finisher threads = 3 2024-03-28T12:40:07.888 INFO:teuthology.orchestra.run.smithi076.stdout: filestore apply finisher threads = 3 2024-03-28T12:40:07.888 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.888 INFO:teuthology.orchestra.run.smithi076.stdout: bdev debug aio = true 2024-03-28T12:40:07.888 INFO:teuthology.orchestra.run.smithi076.stdout: osd debug misdirected ops = true 2024-03-28T12:40:07.888 INFO:teuthology.orchestra.run.smithi076.stdout: bluestore block size = 96636764160 2024-03-28T12:40:07.888 INFO:teuthology.orchestra.run.smithi076.stdout: bluestore compression mode = aggressive 2024-03-28T12:40:07.888 INFO:teuthology.orchestra.run.smithi076.stdout: bluestore fsck on mount = True 2024-03-28T12:40:07.888 INFO:teuthology.orchestra.run.smithi076.stdout: debug bluefs = 20 2024-03-28T12:40:07.888 INFO:teuthology.orchestra.run.smithi076.stdout: debug bluestore = 20 2024-03-28T12:40:07.888 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2024-03-28T12:40:07.888 INFO:teuthology.orchestra.run.smithi076.stdout: debug osd = 20 2024-03-28T12:40:07.888 INFO:teuthology.orchestra.run.smithi076.stdout: debug rocksdb = 10 2024-03-28T12:40:07.888 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd backfillfull_ratio = 0.85 2024-03-28T12:40:07.888 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd full ratio = 0.9 2024-03-28T12:40:07.889 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd nearfull ratio = 0.8 2024-03-28T12:40:07.889 INFO:teuthology.orchestra.run.smithi076.stdout: osd failsafe full ratio = 0.95 2024-03-28T12:40:07.889 INFO:teuthology.orchestra.run.smithi076.stdout: osd fast shutdown = False 2024-03-28T12:40:07.889 INFO:teuthology.orchestra.run.smithi076.stdout: osd objectstore = bluestore 2024-03-28T12:40:07.889 INFO:teuthology.orchestra.run.smithi076.stdout: osd op complaint time = 180 2024-03-28T12:40:07.889 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.889 INFO:teuthology.orchestra.run.smithi076.stdout:[mgr] 2024-03-28T12:40:07.889 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2024-03-28T12:40:07.889 INFO:teuthology.orchestra.run.smithi076.stdout: debug mgr = 20 2024-03-28T12:40:07.889 INFO:teuthology.orchestra.run.smithi076.stdout: debug mon = 20 2024-03-28T12:40:07.889 INFO:teuthology.orchestra.run.smithi076.stdout: debug auth = 20 2024-03-28T12:40:07.889 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min pgs per osd = 4 2024-03-28T12:40:07.889 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min bytes per osd = 10 2024-03-28T12:40:07.889 INFO:teuthology.orchestra.run.smithi076.stdout: mgr/telemetry/nag = false 2024-03-28T12:40:07.889 INFO:teuthology.orchestra.run.smithi076.stdout: debug client = 20 2024-03-28T12:40:07.889 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.889 INFO:teuthology.orchestra.run.smithi076.stdout:[mon] 2024-03-28T12:40:07.890 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2024-03-28T12:40:07.890 INFO:teuthology.orchestra.run.smithi076.stdout: debug mon = 20 2024-03-28T12:40:07.890 INFO:teuthology.orchestra.run.smithi076.stdout: debug paxos = 20 2024-03-28T12:40:07.890 INFO:teuthology.orchestra.run.smithi076.stdout: debug auth = 20 2024-03-28T12:40:07.890 INFO:teuthology.orchestra.run.smithi076.stdout: mon data avail warn = 5 2024-03-28T12:40:07.890 INFO:teuthology.orchestra.run.smithi076.stdout: mon mgr mkfs grace = 240 2024-03-28T12:40:07.890 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min pgs per osd = 4 2024-03-28T12:40:07.890 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd reporter subtree level = osd 2024-03-28T12:40:07.890 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd prime pg temp = true 2024-03-28T12:40:07.890 INFO:teuthology.orchestra.run.smithi076.stdout: mon reweight min bytes per osd = 10 2024-03-28T12:40:07.890 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.890 INFO:teuthology.orchestra.run.smithi076.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-28T12:40:07.890 INFO:teuthology.orchestra.run.smithi076.stdout: auth mon ticket ttl = 660 # 11m 2024-03-28T12:40:07.890 INFO:teuthology.orchestra.run.smithi076.stdout: auth service ticket ttl = 240 # 4m 2024-03-28T12:40:07.890 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.890 INFO:teuthology.orchestra.run.smithi076.stdout: # don't complain about insecure global_id in the test suite 2024-03-28T12:40:07.891 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-28T12:40:07.891 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-28T12:40:07.891 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.891 INFO:teuthology.orchestra.run.smithi076.stdout: # 1m isn't quite enough 2024-03-28T12:40:07.891 INFO:teuthology.orchestra.run.smithi076.stdout: mon_down_mkfs_grace = 2m 2024-03-28T12:40:07.891 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.891 INFO:teuthology.orchestra.run.smithi076.stdout: mon_warn_on_filestore_osds = false 2024-03-28T12:40:07.891 INFO:teuthology.orchestra.run.smithi076.stdout: mon down mkfs grace = 300 2024-03-28T12:40:07.891 INFO:teuthology.orchestra.run.smithi076.stdout: mon op complaint time = 120 2024-03-28T12:40:07.891 INFO:teuthology.orchestra.run.smithi076.stdout: mon osd crush smoke test = False 2024-03-28T12:40:07.891 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:40:07.891 INFO:teuthology.orchestra.run.smithi076.stdout:[client] 2024-03-28T12:40:07.891 INFO:teuthology.orchestra.run.smithi076.stdout: rgw cache enabled = true 2024-03-28T12:40:07.891 INFO:teuthology.orchestra.run.smithi076.stdout: rgw enable ops log = true 2024-03-28T12:40:07.891 INFO:teuthology.orchestra.run.smithi076.stdout: rgw enable usage log = true 2024-03-28T12:40:07.891 INFO:teuthology.orchestra.run.smithi076.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-28T12:40:07.891 INFO:teuthology.orchestra.run.smithi076.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout: client mount timeout = 600 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout: debug client = 20 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout: rados mon op timeout = 900 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout: rados osd op timeout = 900 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout:[mon.a] 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout:[mon.b] 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout:[mon.c] 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.a] 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.c] 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.e] 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.b] 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.d] 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.f] 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout:[mds] 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout: debug mds = 20 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout: debug mds balancer = 20 2024-03-28T12:40:07.892 INFO:teuthology.orchestra.run.smithi076.stdout: debug ms = 1 2024-03-28T12:40:07.893 INFO:teuthology.orchestra.run.smithi076.stdout: mds debug frag = True 2024-03-28T12:40:07.893 INFO:teuthology.orchestra.run.smithi076.stdout: mds debug scatterstat = True 2024-03-28T12:40:07.893 INFO:teuthology.orchestra.run.smithi076.stdout: mds op complaint time = 180 2024-03-28T12:40:07.893 INFO:teuthology.orchestra.run.smithi076.stdout: mds valgrind exit = True 2024-03-28T12:40:07.893 INFO:teuthology.orchestra.run.smithi076.stdout: mds verify scatter = True 2024-03-28T12:40:07.893 INFO:teuthology.orchestra.run.smithi076.stdout: osd op complaint time = 180 2024-03-28T12:40:07.893 INFO:teuthology.orchestra.run.smithi076.stdout: rados mon op timeout = 900 2024-03-28T12:40:07.893 INFO:teuthology.orchestra.run.smithi076.stdout: rados osd op timeout = 900 2024-03-28T12:40:07.896 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-28T12:40:07.897 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-28T12:40:07.996 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-28T12:40:07.996 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:07.996 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-28T12:40:08.005 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:08.005 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-28T12:40:08.060 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi076.front.sepia.ceph.com 2024-03-28T12:40:08.061 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:08.061 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-28T12:40:08.061 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-28T12:40:08.131 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:08.131 DEBUG:teuthology.orchestra.run.smithi076:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-28T12:40:08.180 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi111.front.sepia.ceph.com 2024-03-28T12:40:08.180 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:40:08.180 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-28T12:40:08.180 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-28T12:40:08.205 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:40:08.205 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-28T12:40:08.250 INFO:tasks.ceph:Setting up mon nodes... 2024-03-28T12:40:08.250 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-28T12:40:08.250 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-28T12:40:08.304 INFO:teuthology.orchestra.run.smithi076.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-28T12:40:08.309 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-28T12:40:08.351 INFO:teuthology.orchestra.run.smithi111.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-28T12:40:08.361 INFO:tasks.ceph:Setting up mds nodes... 2024-03-28T12:40:08.361 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-28T12:40:08.414 INFO:teuthology.orchestra.run.smithi076.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-28T12:40:08.419 DEBUG:teuthology.orchestra.run.smithi076:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-28T12:40:08.438 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-28T12:40:08.532 INFO:teuthology.orchestra.run.smithi076.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-28T12:40:08.537 DEBUG:teuthology.orchestra.run.smithi076:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-28T12:40:08.556 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-03-28T12:40:08.649 INFO:teuthology.orchestra.run.smithi076.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-03-28T12:40:08.654 DEBUG:teuthology.orchestra.run.smithi076:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-03-28T12:40:08.673 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-28T12:40:08.718 INFO:teuthology.orchestra.run.smithi111.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-28T12:40:08.721 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-28T12:40:08.774 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-28T12:40:08.856 INFO:teuthology.orchestra.run.smithi111.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-28T12:40:08.859 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-28T12:40:08.917 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-03-28T12:40:09.003 INFO:teuthology.orchestra.run.smithi111.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-03-28T12:40:09.005 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-03-28T12:40:09.062 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-28T12:40:09.062 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-28T12:40:09.104 INFO:teuthology.orchestra.run.smithi076.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-28T12:40:09.121 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-28T12:40:09.121 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi076.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-28T12:40:09.121 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-28T12:40:09.187 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-28T12:40:09.187 INFO:tasks.ceph:role: osd.0 2024-03-28T12:40:09.187 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi076.front.sepia.ceph.com 2024-03-28T12:40:09.187 DEBUG:teuthology.orchestra.run.smithi076:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-28T12:40:09.254 INFO:teuthology.orchestra.run.smithi076.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-28T12:40:09.254 INFO:teuthology.orchestra.run.smithi076.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-28T12:40:09.254 INFO:teuthology.orchestra.run.smithi076.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-28T12:40:09.254 INFO:teuthology.orchestra.run.smithi076.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-28T12:40:09.255 INFO:teuthology.orchestra.run.smithi076.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-28T12:40:09.255 INFO:teuthology.orchestra.run.smithi076.stdout: = sunit=0 swidth=0 blks 2024-03-28T12:40:09.255 INFO:teuthology.orchestra.run.smithi076.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-28T12:40:09.255 INFO:teuthology.orchestra.run.smithi076.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-28T12:40:09.255 INFO:teuthology.orchestra.run.smithi076.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-28T12:40:09.255 INFO:teuthology.orchestra.run.smithi076.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-28T12:40:09.716 INFO:teuthology.orchestra.run.smithi076.stdout:Discarding blocks...Done. 2024-03-28T12:40:09.718 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi076.front.sepia.ceph.com -o noatime 2024-03-28T12:40:09.719 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-28T12:40:09.824 DEBUG:teuthology.orchestra.run.smithi076:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-28T12:40:09.840 INFO:teuthology.orchestra.run.smithi076.stderr:sudo: /sbin/restorecon: command not found 2024-03-28T12:40:09.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T12:40:09.841 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-28T12:40:09.907 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-28T12:40:09.907 INFO:tasks.ceph:role: osd.1 2024-03-28T12:40:09.907 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi076.front.sepia.ceph.com 2024-03-28T12:40:09.908 DEBUG:teuthology.orchestra.run.smithi076:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-28T12:40:09.979 INFO:teuthology.orchestra.run.smithi076.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-28T12:40:09.979 INFO:teuthology.orchestra.run.smithi076.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-28T12:40:09.979 INFO:teuthology.orchestra.run.smithi076.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-28T12:40:09.979 INFO:teuthology.orchestra.run.smithi076.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-28T12:40:09.979 INFO:teuthology.orchestra.run.smithi076.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-28T12:40:09.980 INFO:teuthology.orchestra.run.smithi076.stdout: = sunit=0 swidth=0 blks 2024-03-28T12:40:09.980 INFO:teuthology.orchestra.run.smithi076.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-28T12:40:09.980 INFO:teuthology.orchestra.run.smithi076.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-28T12:40:09.980 INFO:teuthology.orchestra.run.smithi076.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-28T12:40:09.980 INFO:teuthology.orchestra.run.smithi076.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-28T12:40:10.443 INFO:teuthology.orchestra.run.smithi076.stdout:Discarding blocks...Done. 2024-03-28T12:40:10.446 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi076.front.sepia.ceph.com -o noatime 2024-03-28T12:40:10.446 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-28T12:40:10.581 DEBUG:teuthology.orchestra.run.smithi076:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-28T12:40:10.598 INFO:teuthology.orchestra.run.smithi076.stderr:sudo: /sbin/restorecon: command not found 2024-03-28T12:40:10.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T12:40:10.599 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-28T12:40:10.661 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-28T12:40:10.661 INFO:tasks.ceph:role: osd.2 2024-03-28T12:40:10.661 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi076.front.sepia.ceph.com 2024-03-28T12:40:10.661 DEBUG:teuthology.orchestra.run.smithi076:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-28T12:40:10.731 INFO:teuthology.orchestra.run.smithi076.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-28T12:40:10.731 INFO:teuthology.orchestra.run.smithi076.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-28T12:40:10.731 INFO:teuthology.orchestra.run.smithi076.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-28T12:40:10.731 INFO:teuthology.orchestra.run.smithi076.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-28T12:40:10.731 INFO:teuthology.orchestra.run.smithi076.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-28T12:40:10.731 INFO:teuthology.orchestra.run.smithi076.stdout: = sunit=0 swidth=0 blks 2024-03-28T12:40:10.732 INFO:teuthology.orchestra.run.smithi076.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-28T12:40:10.732 INFO:teuthology.orchestra.run.smithi076.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-28T12:40:10.732 INFO:teuthology.orchestra.run.smithi076.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-28T12:40:10.732 INFO:teuthology.orchestra.run.smithi076.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-28T12:40:11.215 INFO:teuthology.orchestra.run.smithi076.stdout:Discarding blocks...Done. 2024-03-28T12:40:11.218 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi076.front.sepia.ceph.com -o noatime 2024-03-28T12:40:11.218 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-28T12:40:11.382 DEBUG:teuthology.orchestra.run.smithi076:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-28T12:40:11.398 INFO:teuthology.orchestra.run.smithi076.stderr:sudo: /sbin/restorecon: command not found 2024-03-28T12:40:11.399 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T12:40:11.399 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-28T12:40:11.460 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-28T12:40:11.460 INFO:tasks.ceph:role: osd.3 2024-03-28T12:40:11.460 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi076.front.sepia.ceph.com 2024-03-28T12:40:11.460 DEBUG:teuthology.orchestra.run.smithi076:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-28T12:40:11.528 INFO:teuthology.orchestra.run.smithi076.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-28T12:40:11.528 INFO:teuthology.orchestra.run.smithi076.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-28T12:40:11.528 INFO:teuthology.orchestra.run.smithi076.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-28T12:40:11.528 INFO:teuthology.orchestra.run.smithi076.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-28T12:40:11.528 INFO:teuthology.orchestra.run.smithi076.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-28T12:40:11.528 INFO:teuthology.orchestra.run.smithi076.stdout: = sunit=0 swidth=0 blks 2024-03-28T12:40:11.528 INFO:teuthology.orchestra.run.smithi076.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-28T12:40:11.529 INFO:teuthology.orchestra.run.smithi076.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-28T12:40:11.529 INFO:teuthology.orchestra.run.smithi076.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-28T12:40:11.529 INFO:teuthology.orchestra.run.smithi076.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-28T12:40:11.954 INFO:teuthology.orchestra.run.smithi076.stdout:Discarding blocks...Done. 2024-03-28T12:40:11.957 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi076.front.sepia.ceph.com -o noatime 2024-03-28T12:40:11.957 DEBUG:teuthology.orchestra.run.smithi076:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-28T12:40:12.071 DEBUG:teuthology.orchestra.run.smithi076:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-28T12:40:12.087 INFO:teuthology.orchestra.run.smithi076.stderr:sudo: /sbin/restorecon: command not found 2024-03-28T12:40:12.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T12:40:12.088 DEBUG:teuthology.orchestra.run.smithi076:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-28T12:40:12.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:12.216+0000 7fe83b22b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-28T12:40:12.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:12.216+0000 7fe83b22b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-28T12:40:12.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:12.216+0000 7fe83b22b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-28T12:40:12.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:12.216+0000 7fe83b22b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-28T12:40:12.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:12.216+0000 7fe83b22b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-28T12:40:12.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:12.220+0000 7fe83b22b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-28T12:40:15.199 DEBUG:teuthology.orchestra.run.smithi076:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-28T12:40:15.219 DEBUG:teuthology.orchestra.run.smithi076:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-28T12:40:15.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:15.316+0000 7fd7c007e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-28T12:40:15.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:15.316+0000 7fd7c007e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-28T12:40:15.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:15.316+0000 7fd7c007e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-28T12:40:15.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:15.316+0000 7fd7c007e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-28T12:40:15.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:15.316+0000 7fd7c007e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-28T12:40:15.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:15.316+0000 7fd7c007e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-28T12:40:18.288 DEBUG:teuthology.orchestra.run.smithi076:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-28T12:40:18.309 DEBUG:teuthology.orchestra.run.smithi076:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-28T12:40:18.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:18.404+0000 7f6361b0b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-28T12:40:18.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:18.408+0000 7f6361b0b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-28T12:40:18.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:18.408+0000 7f6361b0b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-28T12:40:18.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:18.408+0000 7f6361b0b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-28T12:40:18.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:18.408+0000 7f6361b0b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-28T12:40:18.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:18.408+0000 7f6361b0b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-28T12:40:21.387 DEBUG:teuthology.orchestra.run.smithi076:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-28T12:40:21.407 DEBUG:teuthology.orchestra.run.smithi076:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-28T12:40:21.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:21.500+0000 7fbcc24297c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-28T12:40:21.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:21.500+0000 7fbcc24297c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-28T12:40:21.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:21.500+0000 7fbcc24297c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-28T12:40:21.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:21.500+0000 7fbcc24297c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-28T12:40:21.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:21.500+0000 7fbcc24297c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-28T12:40:21.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:21.504+0000 7fbcc24297c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-28T12:40:24.470 DEBUG:teuthology.orchestra.run.smithi076:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-28T12:40:24.490 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-28T12:40:24.505 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-28T12:40:24.505 INFO:tasks.ceph:role: osd.4 2024-03-28T12:40:24.506 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com 2024-03-28T12:40:24.506 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-28T12:40:24.574 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-28T12:40:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-28T12:40:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-28T12:40:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-28T12:40:24.574 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-28T12:40:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-03-28T12:40:24.574 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-28T12:40:24.574 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-28T12:40:24.574 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-28T12:40:24.574 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-28T12:40:25.047 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-03-28T12:40:25.049 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-03-28T12:40:25.049 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-28T12:40:25.203 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-28T12:40:25.214 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-03-28T12:40:25.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T12:40:25.215 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-28T12:40:25.269 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-28T12:40:25.269 INFO:tasks.ceph:role: osd.5 2024-03-28T12:40:25.269 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi111.front.sepia.ceph.com 2024-03-28T12:40:25.270 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-28T12:40:25.334 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-28T12:40:25.334 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-28T12:40:25.334 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-28T12:40:25.334 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-28T12:40:25.334 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-28T12:40:25.334 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-03-28T12:40:25.334 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-28T12:40:25.334 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-28T12:40:25.334 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-28T12:40:25.334 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-28T12:40:25.780 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-03-28T12:40:25.782 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-03-28T12:40:25.782 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-28T12:40:25.874 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-28T12:40:25.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T12:40:25.884 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-03-28T12:40:25.884 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-28T12:40:25.935 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-28T12:40:25.935 INFO:tasks.ceph:role: osd.6 2024-03-28T12:40:25.935 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi111.front.sepia.ceph.com 2024-03-28T12:40:25.936 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-28T12:40:25.996 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-28T12:40:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-28T12:40:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-28T12:40:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-28T12:40:25.997 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-28T12:40:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-03-28T12:40:25.997 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-28T12:40:25.997 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-28T12:40:25.997 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-28T12:40:25.997 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-28T12:40:26.454 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-03-28T12:40:26.457 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-03-28T12:40:26.457 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-28T12:40:26.543 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-28T12:40:26.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T12:40:26.600 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-03-28T12:40:26.600 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-28T12:40:26.653 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-28T12:40:26.653 INFO:tasks.ceph:role: osd.7 2024-03-28T12:40:26.653 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi111.front.sepia.ceph.com 2024-03-28T12:40:26.653 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-28T12:40:26.717 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-28T12:40:26.717 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-28T12:40:26.717 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-28T12:40:26.717 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-28T12:40:26.717 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-28T12:40:26.717 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-03-28T12:40:26.717 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-28T12:40:26.717 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-28T12:40:26.717 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-28T12:40:26.718 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-28T12:40:27.204 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-03-28T12:40:27.206 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-03-28T12:40:27.206 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-28T12:40:27.334 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-28T12:40:27.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T12:40:27.344 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-03-28T12:40:27.344 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-28T12:40:27.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:27.449+0000 7f9d2684a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-28T12:40:27.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:27.453+0000 7f9d2684a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-28T12:40:27.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:27.453+0000 7f9d2684a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-28T12:40:27.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:27.453+0000 7f9d2684a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-28T12:40:27.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:27.453+0000 7f9d2684a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-28T12:40:27.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:27.457+0000 7f9d2684a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-28T12:40:30.442 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-28T12:40:30.455 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-28T12:40:30.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:30.533+0000 7f8ffeddb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-28T12:40:30.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:30.533+0000 7f8ffeddb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-28T12:40:30.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:30.533+0000 7f8ffeddb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-28T12:40:30.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:30.533+0000 7f8ffeddb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-28T12:40:30.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:30.533+0000 7f8ffeddb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-28T12:40:30.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:30.537+0000 7f8ffeddb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-28T12:40:33.550 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-28T12:40:33.606 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-28T12:40:33.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:33.681+0000 7f77307fc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-28T12:40:33.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:33.685+0000 7f77307fc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-28T12:40:33.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:33.685+0000 7f77307fc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-28T12:40:33.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:33.685+0000 7f77307fc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-28T12:40:33.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:33.685+0000 7f77307fc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-28T12:40:33.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:33.685+0000 7f77307fc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-28T12:40:35.984 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:40:35.989 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:40:36.664 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-28T12:40:36.675 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-28T12:40:36.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:36.749+0000 7fea864a67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-28T12:40:36.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:36.749+0000 7fea864a67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-28T12:40:36.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:36.749+0000 7fea864a67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-28T12:40:36.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:36.753+0000 7fea864a67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-28T12:40:36.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:36.753+0000 7fea864a67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-28T12:40:36.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:40:36.753+0000 7fea864a67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-28T12:40:39.733 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-28T12:40:39.786 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-28T12:40:39.786 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:39.787 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-28T12:40:39.808 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:39.808 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-28T12:40:39.873 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:39.873 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-28T12:40:39.937 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:39.937 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-03-28T12:40:39.997 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:39.997 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-28T12:40:40.061 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:40.061 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-28T12:40:40.128 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:40.128 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-28T12:40:40.192 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:40.192 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-28T12:40:40.252 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:40:40.253 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-28T12:40:40.267 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:40:40.267 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-28T12:40:40.320 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:40:40.321 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-28T12:40:40.373 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:40:40.373 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-03-28T12:40:40.428 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:40:40.428 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-28T12:40:40.481 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:40:40.481 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-28T12:40:40.538 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:40:40.538 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-28T12:40:40.593 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:40:40.593 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-28T12:40:40.650 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:40:40.650 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-28T12:40:40.659 INFO:tasks.ceph:Adding keys to all mons... 2024-03-28T12:40:40.659 DEBUG:teuthology.orchestra.run.smithi076:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-28T12:40:40.704 DEBUG:teuthology.orchestra.run.smithi111:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-28T12:40:40.714 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr.y] 2024-03-28T12:40:40.714 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAoZQVmWUBZEhAAJf1FPXvnN/LWAWkxh1S/XA== 2024-03-28T12:40:40.715 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.a] 2024-03-28T12:40:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAoZQVmjsnrGBAAA56YSf+PEXC1ifaXV76xxQ== 2024-03-28T12:40:40.715 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.c] 2024-03-28T12:40:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAoZQVmWF32HxAAlny90OvYGZp7WdCTUzPueg== 2024-03-28T12:40:40.715 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.e] 2024-03-28T12:40:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAoZQVm+DPrJhAATQTuGxB/AdUEh61zKTMFjA== 2024-03-28T12:40:40.715 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.0] 2024-03-28T12:40:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAsZQVmZlj3DBAAI9dr6weCpS0FGt5E7266Gw== 2024-03-28T12:40:40.715 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.1] 2024-03-28T12:40:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAvZQVmzl7mEhAALdGkFn9gNrXG3AwAOybF9A== 2024-03-28T12:40:40.715 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.2] 2024-03-28T12:40:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAyZQVm06RWGBAAIVqHIFW5WexqWT31ATWwCw== 2024-03-28T12:40:40.715 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.3] 2024-03-28T12:40:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQA1ZQVmawX6HRAAvGccJOfpqyK281iZcLmUUQ== 2024-03-28T12:40:40.715 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr.x] 2024-03-28T12:40:40.715 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAoZQVme6geFRAADUM3BobGBge7QPLknGmigA== 2024-03-28T12:40:40.716 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.b] 2024-03-28T12:40:40.716 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAoZQVmeSH1KhAAw0hPQZdagVZCeOR+y6qONQ== 2024-03-28T12:40:40.716 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.d] 2024-03-28T12:40:40.716 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAoZQVmZHAxMxAAp3Jd3huJQe/lJiPRq145MQ== 2024-03-28T12:40:40.716 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.f] 2024-03-28T12:40:40.716 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQApZQVmsaRRABAAdZhTZeuK3n9X20ziJ9EJvg== 2024-03-28T12:40:40.716 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.4] 2024-03-28T12:40:40.716 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQA7ZQVmVCQoGxAAOiC7OiOopnZ8dWA0TwdaGA== 2024-03-28T12:40:40.716 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.5] 2024-03-28T12:40:40.716 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQA+ZQVmjTkkIBAAPXVXsZ63oWS8Ti0EOspOuA== 2024-03-28T12:40:40.716 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.6] 2024-03-28T12:40:40.716 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQBBZQVmdrUBKRAA+OFXaCTqio5ly/6rOjALjA== 2024-03-28T12:40:40.716 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.7] 2024-03-28T12:40:40.716 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQBEZQVmVWcHLRAAIl4HogUPN6igojsTHi28KA== 2024-03-28T12:40:40.716 INFO:teuthology.orchestra.run.smithi111.stdout:[client.0] 2024-03-28T12:40:40.716 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQApZQVmBc9rBhAAcp3N7Kivn30K9W2bWk655g== 2024-03-28T12:40:40.719 INFO:teuthology.orchestra.run.smithi076.stdout:[mgr.y] 2024-03-28T12:40:40.719 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQAoZQVmWUBZEhAAJf1FPXvnN/LWAWkxh1S/XA== 2024-03-28T12:40:40.719 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.a] 2024-03-28T12:40:40.719 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQAoZQVmjsnrGBAAA56YSf+PEXC1ifaXV76xxQ== 2024-03-28T12:40:40.719 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.c] 2024-03-28T12:40:40.719 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQAoZQVmWF32HxAAlny90OvYGZp7WdCTUzPueg== 2024-03-28T12:40:40.719 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.e] 2024-03-28T12:40:40.719 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQAoZQVm+DPrJhAATQTuGxB/AdUEh61zKTMFjA== 2024-03-28T12:40:40.719 INFO:teuthology.orchestra.run.smithi076.stdout:[osd.0] 2024-03-28T12:40:40.719 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQAsZQVmZlj3DBAAI9dr6weCpS0FGt5E7266Gw== 2024-03-28T12:40:40.719 INFO:teuthology.orchestra.run.smithi076.stdout:[osd.1] 2024-03-28T12:40:40.719 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQAvZQVmzl7mEhAALdGkFn9gNrXG3AwAOybF9A== 2024-03-28T12:40:40.719 INFO:teuthology.orchestra.run.smithi076.stdout:[osd.2] 2024-03-28T12:40:40.720 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQAyZQVm06RWGBAAIVqHIFW5WexqWT31ATWwCw== 2024-03-28T12:40:40.720 INFO:teuthology.orchestra.run.smithi076.stdout:[osd.3] 2024-03-28T12:40:40.720 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQA1ZQVmawX6HRAAvGccJOfpqyK281iZcLmUUQ== 2024-03-28T12:40:40.720 INFO:teuthology.orchestra.run.smithi076.stdout:[mgr.x] 2024-03-28T12:40:40.720 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQAoZQVme6geFRAADUM3BobGBge7QPLknGmigA== 2024-03-28T12:40:40.720 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.b] 2024-03-28T12:40:40.720 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQAoZQVmeSH1KhAAw0hPQZdagVZCeOR+y6qONQ== 2024-03-28T12:40:40.720 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.d] 2024-03-28T12:40:40.720 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQAoZQVmZHAxMxAAp3Jd3huJQe/lJiPRq145MQ== 2024-03-28T12:40:40.720 INFO:teuthology.orchestra.run.smithi076.stdout:[mds.f] 2024-03-28T12:40:40.720 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQApZQVmsaRRABAAdZhTZeuK3n9X20ziJ9EJvg== 2024-03-28T12:40:40.720 INFO:teuthology.orchestra.run.smithi076.stdout:[osd.4] 2024-03-28T12:40:40.720 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQA7ZQVmVCQoGxAAOiC7OiOopnZ8dWA0TwdaGA== 2024-03-28T12:40:40.720 INFO:teuthology.orchestra.run.smithi076.stdout:[osd.5] 2024-03-28T12:40:40.720 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQA+ZQVmjTkkIBAAPXVXsZ63oWS8Ti0EOspOuA== 2024-03-28T12:40:40.720 INFO:teuthology.orchestra.run.smithi076.stdout:[osd.6] 2024-03-28T12:40:40.721 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQBBZQVmdrUBKRAA+OFXaCTqio5ly/6rOjALjA== 2024-03-28T12:40:40.721 INFO:teuthology.orchestra.run.smithi076.stdout:[osd.7] 2024-03-28T12:40:40.721 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQBEZQVmVWcHLRAAIl4HogUPN6igojsTHi28KA== 2024-03-28T12:40:40.721 INFO:teuthology.orchestra.run.smithi076.stdout:[client.0] 2024-03-28T12:40:40.721 INFO:teuthology.orchestra.run.smithi076.stdout: key = AQApZQVmBc9rBhAAcp3N7Kivn30K9W2bWk655g== 2024-03-28T12:40:40.722 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-28T12:40:40.767 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-28T12:40:40.819 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T12:40:40.822 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T12:40:40.897 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T12:40:40.900 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T12:40:40.988 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T12:40:40.992 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T12:40:41.077 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T12:40:41.080 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T12:40:41.165 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T12:40:41.168 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T12:40:41.253 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T12:40:41.256 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T12:40:41.340 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T12:40:41.343 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T12:40:41.423 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-28T12:40:41.426 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-28T12:40:41.506 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T12:40:41.510 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T12:40:41.591 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T12:40:41.594 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T12:40:41.673 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T12:40:41.676 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-28T12:40:41.758 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T12:40:41.762 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T12:40:41.845 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T12:40:41.848 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T12:40:41.934 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T12:40:41.937 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T12:40:42.020 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T12:40:42.023 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-28T12:40:42.105 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-28T12:40:42.108 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-28T12:40:42.198 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-28T12:40:42.198 DEBUG:teuthology.orchestra.run.smithi076:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-28T12:40:42.217 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-28T12:40:42.325 DEBUG:teuthology.orchestra.run.smithi076:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-28T12:40:42.344 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-28T12:40:42.359 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-28T12:40:42.452 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-28T12:40:42.463 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-28T12:40:42.520 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-28T12:40:42.611 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-28T12:40:42.621 DEBUG:teuthology.orchestra.run.smithi076:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-28T12:40:42.624 DEBUG:teuthology.orchestra.run.smithi111:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-28T12:40:42.669 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-28T12:40:42.669 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-03-28T12:40:42.669 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-28T12:40:42.670 DEBUG:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-03-28T12:40:42.672 INFO:tasks.ceph.mon.a:Started 2024-03-28T12:40:42.672 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-03-28T12:40:42.673 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-28T12:40:42.673 DEBUG:teuthology.orchestra.run.smithi111:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-03-28T12:40:42.715 INFO:tasks.ceph.mon.b:Started 2024-03-28T12:40:42.715 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-03-28T12:40:42.715 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-28T12:40:42.715 DEBUG:teuthology.orchestra.run.smithi111:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-03-28T12:40:42.717 INFO:tasks.ceph.mon.c:Started 2024-03-28T12:40:42.717 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-28T12:40:42.718 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-28T12:40:42.718 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-03-28T12:40:42.721 INFO:tasks.ceph.mgr.y:Started 2024-03-28T12:40:42.721 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-28T12:40:42.721 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-03-28T12:40:42.723 INFO:tasks.ceph.mgr.x:Started 2024-03-28T12:40:42.723 INFO:tasks.ceph:Setting crush tunables to default 2024-03-28T12:40:42.723 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --cluster ceph osd crush tunables default 2024-03-28T12:40:42.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:42.859+0000 7ff48d600640 1 Processor -- start 2024-03-28T12:40:42.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:42.859+0000 7ff48d600640 1 -- start start 2024-03-28T12:40:42.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:42.863+0000 7ff48d600640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff488072340 0x7ff4880c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:40:42.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:42.863+0000 7ff48d600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff488154400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:40:42.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:42.863+0000 7ff48d600640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4880cef50 con 0x7ff488071f60 2024-03-28T12:40:42.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:42.863+0000 7ff48d600640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7ff48806d7f0 con 0x7ff488072340 2024-03-28T12:40:42.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:42.863+0000 7ff48d600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff48806c750 con 0x7ff4880c8ae0 2024-03-28T12:40:42.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:42.863+0000 7ff486000640 1 -- >> v2:172.21.15.76:3300/0 conn(0x7ff488072340 msgr2=0x7ff4880c3550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.76:3300/0 2024-03-28T12:40:42.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:42.863+0000 7ff486a00640 1 -- >> v1:172.21.15.111:6789/0 conn(0x7ff488071f60 legacy=0x7ff48815b2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.111:6789/0 2024-03-28T12:40:42.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:42.863+0000 7ff486000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff488072340 0x7ff4880c3550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T12:40:42.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:42.863+0000 7ff487400640 1 -- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff488154400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.111:3301/0 2024-03-28T12:40:42.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:42.863+0000 7ff487400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff488154400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T12:40:43.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:43.067+0000 7ff486000640 1 -- >> v2:172.21.15.76:3300/0 conn(0x7ff488072340 msgr2=0x7ff4880c3550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.76:3300/0 2024-03-28T12:40:43.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:43.067+0000 7ff486000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff488072340 0x7ff4880c3550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T12:40:43.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:43.067+0000 7ff487400640 1 -- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff488154400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.111:3301/0 2024-03-28T12:40:43.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:43.067+0000 7ff487400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff488154400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T12:40:43.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:43.067+0000 7ff486a00640 1 -- >> v1:172.21.15.111:6789/0 conn(0x7ff488071f60 legacy=0x7ff48815b2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.111:6789/0 2024-03-28T12:40:43.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:43.471+0000 7ff486000640 1 -- >> v2:172.21.15.76:3300/0 conn(0x7ff488072340 msgr2=0x7ff4880c3550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.76:3300/0 2024-03-28T12:40:43.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:43.471+0000 7ff486000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff488072340 0x7ff4880c3550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-28T12:40:43.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:43.471+0000 7ff487400640 1 -- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff488154400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.111:3301/0 2024-03-28T12:40:43.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:43.471+0000 7ff486a00640 1 -- >> v1:172.21.15.111:6789/0 conn(0x7ff488071f60 legacy=0x7ff48815b2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.111:6789/0 2024-03-28T12:40:43.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:43.471+0000 7ff487400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff488154400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-28T12:40:44.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:44.275+0000 7ff486000640 1 -- >> v2:172.21.15.76:3300/0 conn(0x7ff488072340 msgr2=0x7ff4880c3550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.76:3300/0 2024-03-28T12:40:44.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:44.275+0000 7ff486000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff488072340 0x7ff4880c3550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-28T12:40:44.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:44.275+0000 7ff487400640 1 -- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff488154400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.111:3301/0 2024-03-28T12:40:44.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:44.275+0000 7ff486a00640 1 -- >> v1:172.21.15.111:6789/0 conn(0x7ff488071f60 legacy=0x7ff48815b2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.111:6789/0 2024-03-28T12:40:44.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:44.275+0000 7ff487400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff488154400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-28T12:40:45.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:45.863+0000 7ff47fe00640 1 -- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff488154400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T12:40:45.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:45.863+0000 7ff47fe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff488154400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:40:45.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:45.863+0000 7ff47fe00640 1 -- >> v2:172.21.15.76:3300/0 conn(0x7ff488072340 msgr2=0x7ff4880c3550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T12:40:45.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:45.863+0000 7ff47fe00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff488072340 0x7ff4880c3550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:40:45.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:45.863+0000 7ff47fe00640 1 -- >> v1:172.21.15.111:6789/0 conn(0x7ff488071f60 legacy=0x7ff48815b2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T12:40:45.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:45.863+0000 7ff47fe00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:40:45.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:45.863+0000 7ff47fe00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff48806ca30 con 0x7ff468003700 2024-03-28T12:40:45.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:45.863+0000 7ff47fe00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7ff48806d7f0 con 0x7ff468007440 2024-03-28T12:40:45.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:45.863+0000 7ff486a00640 1 -- >> v1:172.21.15.76:6789/0 conn(0x7ff468003700 legacy=0x7ff468005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.76:6789/0 2024-03-28T12:40:45.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:45.863+0000 7ff486000640 1 -- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.111:3300/0 2024-03-28T12:40:45.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:45.863+0000 7ff486000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T12:40:46.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:46.067+0000 7ff486a00640 1 -- >> v1:172.21.15.76:6789/0 conn(0x7ff468003700 legacy=0x7ff468005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.76:6789/0 2024-03-28T12:40:46.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:46.067+0000 7ff486000640 1 -- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.111:3300/0 2024-03-28T12:40:46.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:46.067+0000 7ff486000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T12:40:46.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:46.471+0000 7ff486a00640 1 -- >> v1:172.21.15.76:6789/0 conn(0x7ff468003700 legacy=0x7ff468005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.76:6789/0 2024-03-28T12:40:46.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:46.471+0000 7ff486000640 1 -- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.111:3300/0 2024-03-28T12:40:46.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:46.471+0000 7ff486000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-28T12:40:47.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:47.275+0000 7ff486a00640 1 -- >> v1:172.21.15.76:6789/0 conn(0x7ff468003700 legacy=0x7ff468005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.76:6789/0 2024-03-28T12:40:47.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:47.275+0000 7ff486000640 1 -- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.111:3300/0 2024-03-28T12:40:47.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:47.275+0000 7ff486000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-28T12:40:48.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:48.863+0000 7ff47fe00640 1 -- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T12:40:48.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:48.863+0000 7ff47fe00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:40:48.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:48.863+0000 7ff47fe00640 1 -- >> v1:172.21.15.76:6789/0 conn(0x7ff468003700 legacy=0x7ff468005b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T12:40:48.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:48.863+0000 7ff487400640 1 -- reap_dead start 2024-03-28T12:40:48.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:48.863+0000 7ff47fe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468009fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:40:48.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:48.863+0000 7ff47fe00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:40:48.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:48.863+0000 7ff47fe00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4880cef50 con 0x7ff468003700 2024-03-28T12:40:48.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:48.863+0000 7ff47fe00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7ff48806d7f0 con 0x7ff468007440 2024-03-28T12:40:48.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:48.863+0000 7ff47fe00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff48806c750 con 0x7ff4880c8ae0 2024-03-28T12:40:48.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:48.863+0000 7ff487400640 1 -- >> v1:172.21.15.76:6789/0 conn(0x7ff468003700 legacy=0x7ff468005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.76:6789/0 2024-03-28T12:40:48.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:48.863+0000 7ff486a00640 1 -- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff468009fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.111:3301/0 2024-03-28T12:40:48.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:48.863+0000 7ff486000640 1 -- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.111:3300/0 2024-03-28T12:40:48.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:48.863+0000 7ff486a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468009fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T12:40:48.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:48.863+0000 7ff486000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T12:40:49.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:49.067+0000 7ff487400640 1 -- >> v1:172.21.15.76:6789/0 conn(0x7ff468003700 legacy=0x7ff468005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.76:6789/0 2024-03-28T12:40:49.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:49.067+0000 7ff486000640 1 -- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.111:3300/0 2024-03-28T12:40:49.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:49.067+0000 7ff486000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T12:40:49.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:49.067+0000 7ff486a00640 1 -- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff468009fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.111:3301/0 2024-03-28T12:40:49.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:49.067+0000 7ff486a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468009fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T12:40:49.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:49.471+0000 7ff487400640 1 -- >> v1:172.21.15.76:6789/0 conn(0x7ff468003700 legacy=0x7ff468005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.76:6789/0 2024-03-28T12:40:49.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:49.471+0000 7ff486a00640 1 -- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff468009fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.111:3301/0 2024-03-28T12:40:49.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:49.471+0000 7ff486000640 1 -- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.111:3300/0 2024-03-28T12:40:49.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:49.471+0000 7ff486a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468009fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-28T12:40:49.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:49.471+0000 7ff486000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-28T12:40:50.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:50.275+0000 7ff487400640 1 -- >> v1:172.21.15.76:6789/0 conn(0x7ff468003700 legacy=0x7ff468005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.76:6789/0 2024-03-28T12:40:50.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:50.275+0000 7ff486a00640 1 -- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff468009fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.111:3301/0 2024-03-28T12:40:50.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:50.275+0000 7ff486000640 1 -- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.111:3300/0 2024-03-28T12:40:50.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:50.275+0000 7ff486000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-28T12:40:50.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:50.275+0000 7ff486a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468009fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-28T12:40:50.893 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:00:08.076 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T12:40:51.073 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:00:08.187 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T12:40:51.074 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:00:08.187 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T12:40:51.226 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:00:08.409 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T12:40:51.404 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:00:08.518 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T12:40:51.406 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:00:08.519 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T12:40:51.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:51.863+0000 7ff47fe00640 1 -- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff468009fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T12:40:51.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:51.863+0000 7ff47fe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468009fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:40:51.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:51.863+0000 7ff47fe00640 1 -- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T12:40:51.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:51.863+0000 7ff47fe00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:40:51.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:51.863+0000 7ff47fe00640 1 -- >> v1:172.21.15.76:6789/0 conn(0x7ff468003700 legacy=0x7ff468005b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T12:40:51.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:51.863+0000 7ff47fe00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:40:51.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:51.863+0000 7ff47fe00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff48806ca30 con 0x7ff46800a6b0 2024-03-28T12:40:51.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:51.863+0000 7ff47fe00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7ff48806d7f0 con 0x7ff46800aac0 2024-03-28T12:40:51.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:51.863+0000 7ff486000640 1 -- >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 msgr2=0x7ff468012890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.76:3300/0 2024-03-28T12:40:51.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:51.863+0000 7ff486000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T12:40:51.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:51.863+0000 7ff486a00640 1 -- >> v1:172.21.15.111:6789/0 conn(0x7ff46800a6b0 legacy=0x7ff46800f160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.111:6789/0 2024-03-28T12:40:52.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:52.067+0000 7ff486000640 1 -- >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 msgr2=0x7ff468012890 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.76:3300/0 2024-03-28T12:40:52.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:52.067+0000 7ff486000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T12:40:52.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:52.067+0000 7ff486a00640 1 -- >> v1:172.21.15.111:6789/0 conn(0x7ff46800a6b0 legacy=0x7ff46800f160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.111:6789/0 2024-03-28T12:40:52.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:52.471+0000 7ff486a00640 1 -- >> v1:172.21.15.111:6789/0 conn(0x7ff46800a6b0 legacy=0x7ff46800f160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.111:6789/0 2024-03-28T12:40:52.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:52.815+0000 7ff486000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:40:52.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:52.899+0000 7ff486000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:54328/0 (socket says 172.21.15.76:54328) 2024-03-28T12:40:52.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:52.903+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 learned_addr learned my addr 172.21.15.76:0/444052421 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:40:52.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:52.959+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 msgr2=0x7ff468012890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-28T12:40:52.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:52.959+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 msgr2=0x7ff468012890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:40:52.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:52.959+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:40:52.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:52.959+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-28T12:40:53.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:53.811+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:40:53.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:53.815+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 msgr2=0x7ff468012890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-28T12:40:53.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:53.815+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 msgr2=0x7ff468012890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:40:53.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:53.815+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:40:53.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:53.815+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-28T12:40:54.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 msgr2=0x7ff468012890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T12:40:54.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.863+0000 7ff47fe00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:40:54.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 >> v1:172.21.15.111:6789/0 conn(0x7ff46800a6b0 legacy=0x7ff46800f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:40:54.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.863+0000 7ff47fe00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:40:54.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.863+0000 7ff47fe00640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468012e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:40:54.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.863+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 reap_dead start 2024-03-28T12:40:54.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.863+0000 7ff47fe00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:40:54.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7ff48806d7f0 con 0x7ff46800aac0 2024-03-28T12:40:54.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7ff48806c750 con 0x7ff468007440 2024-03-28T12:40:54.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff46800a080 con 0x7ff4880c8ae0 2024-03-28T12:40:54.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.863+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:40:54.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.863+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 msgr2=0x7ff468012890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-28T12:40:54.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.863+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 msgr2=0x7ff468012890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:40:54.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.863+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:40:54.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.863+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T12:40:54.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.879+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468012e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:40:54.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.879+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff468012e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-28T12:40:54.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.879+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff468012e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:40:54.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.879+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468012e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:40:54.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.879+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468012e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T12:40:54.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.911+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:40:54.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.935+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-28T12:40:54.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.935+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:40:54.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.935+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:40:54.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:54.935+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T12:40:55.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.067+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:40:55.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.067+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 msgr2=0x7ff468012890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-28T12:40:55.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.067+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 msgr2=0x7ff468012890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:40:55.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.067+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:40:55.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.067+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T12:40:55.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.083+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468012e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:40:55.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.083+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff468012e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-28T12:40:55.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.083+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff468012e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:40:55.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.083+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468012e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:40:55.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.087+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468012e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T12:40:55.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.139+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:40:55.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.143+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-28T12:40:55.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.143+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:40:55.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.143+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:40:55.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.143+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T12:40:55.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.471+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:40:55.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.471+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 msgr2=0x7ff468012890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-28T12:40:55.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.471+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 msgr2=0x7ff468012890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:40:55.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.471+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:40:55.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.471+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-28T12:40:55.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.491+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468012e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:40:55.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.491+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff468012e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-28T12:40:55.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.491+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff468012e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:40:55.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.491+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468012e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:40:55.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.491+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468012e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-28T12:40:55.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.547+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:40:55.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.551+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-28T12:40:55.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.551+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:40:55.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.551+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:40:55.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:55.551+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-28T12:40:56.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:56.275+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:40:56.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:56.275+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 msgr2=0x7ff468012890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-28T12:40:56.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:56.275+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 msgr2=0x7ff468012890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:40:56.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:56.275+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:40:56.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:56.275+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-28T12:40:56.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:56.295+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468012e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:40:56.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:56.299+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff468012e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-28T12:40:56.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:56.299+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff468012e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:40:56.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:56.299+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468012e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:40:56.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:56.299+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468012e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-28T12:40:56.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:56.355+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:40:56.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:56.363+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-28T12:40:56.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:56.363+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:40:56.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:56.363+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:40:56.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:56.363+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-28T12:40:57.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:57.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 msgr2=0x7ff468012e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T12:40:57.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:57.863+0000 7ff47fe00640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff4880c8ae0 0x7ff468012e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:40:57.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:57.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff468009900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T12:40:57.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:57.863+0000 7ff47fe00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff468009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:40:57.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:57.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 msgr2=0x7ff468012890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T12:40:57.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:57.863+0000 7ff47fe00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff46800aac0 0x7ff468012890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:40:57.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:57.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4880cef50 con 0x7ff468013370 2024-03-28T12:40:57.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:40:57.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff468013b30 con 0x7ff468013750 2024-03-28T12:41:00.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 >> v1:172.21.15.111:6789/0 conn(0x7ff468013750 legacy=0x7ff46800f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:00.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 >> v1:172.21.15.76:6789/0 conn(0x7ff468013370 legacy=0x7ff468005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:00.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.863+0000 7ff47fe00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:00.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.863+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 reap_dead start 2024-03-28T12:41:00.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.863+0000 7ff47fe00640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 0x7ff468011370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:00.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff468015f60 con 0x7ff468012e30 2024-03-28T12:41:00.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7ff48806d7f0 con 0x7ff468007440 2024-03-28T12:41:00.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff48806c750 con 0x7ff468010f90 2024-03-28T12:41:00.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.899+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:00.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.903+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 0x7ff468011370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:00.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.987+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff4680078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-28T12:41:00.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.987+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff4680078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:41:00.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.987+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:41:00.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.987+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T12:41:00.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.999+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 msgr2=0x7ff468011370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-28T12:41:00.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.999+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 msgr2=0x7ff468011370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:41:00.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.999+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 0x7ff468011370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:41:00.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:00.999+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 0x7ff468011370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T12:41:01.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.191+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:01.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.195+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff4680078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-28T12:41:01.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.195+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff4680078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:41:01.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.195+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:41:01.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.195+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T12:41:01.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.203+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 0x7ff468011370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:01.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.207+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 msgr2=0x7ff468011370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-28T12:41:01.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.207+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 msgr2=0x7ff468011370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:41:01.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.207+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 0x7ff468011370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:41:01.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.207+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 0x7ff468011370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T12:41:01.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.599+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:01.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.603+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff4680078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-28T12:41:01.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.603+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff4680078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:41:01.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.603+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:41:01.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.603+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-28T12:41:01.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.611+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 0x7ff468011370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:01.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.611+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 msgr2=0x7ff468011370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-28T12:41:01.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.611+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 msgr2=0x7ff468011370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:41:01.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.611+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 0x7ff468011370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:41:01.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:01.611+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 0x7ff468011370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-28T12:41:02.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:02.407+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:02.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:02.411+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff4680078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-28T12:41:02.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:02.411+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff4680078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:41:02.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:02.411+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:41:02.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:02.411+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-28T12:41:02.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:02.415+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 0x7ff468011370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:02.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:02.419+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 msgr2=0x7ff468011370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-28T12:41:02.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:02.419+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 msgr2=0x7ff468011370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:41:02.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:02.419+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 0x7ff468011370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:41:02.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:02.419+0000 7ff487400640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 0x7ff468011370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-28T12:41:03.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:03.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 msgr2=0x7ff468011370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T12:41:03.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:03.863+0000 7ff47fe00640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468010f90 0x7ff468011370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:03.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:03.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff4680078f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T12:41:03.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:03.863+0000 7ff47fe00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:03.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:03.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 >> v1:172.21.15.76:6789/0 conn(0x7ff468012e30 legacy=0x7ff46800f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:03.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:03.863+0000 7ff47fe00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 0x7ff468006c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:03.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:03.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff468011980 con 0x7ff468006360 2024-03-28T12:41:03.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:03.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7ff48806d7f0 con 0x7ff468006810 2024-03-28T12:41:03.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:03.867+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 0x7ff468006c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:03.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:03.867+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 msgr2=0x7ff468006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-28T12:41:03.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:03.867+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 msgr2=0x7ff468006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:41:03.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:03.867+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 0x7ff468006c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:41:03.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:03.867+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 0x7ff468006c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T12:41:04.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:04.071+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 0x7ff468006c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:04.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:04.071+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 msgr2=0x7ff468006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-28T12:41:04.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:04.071+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 msgr2=0x7ff468006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:41:04.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:04.071+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 0x7ff468006c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:41:04.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:04.071+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 0x7ff468006c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T12:41:04.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:04.475+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 0x7ff468006c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:04.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:04.475+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 msgr2=0x7ff468006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-28T12:41:04.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:04.475+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 msgr2=0x7ff468006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:41:04.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:04.475+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 0x7ff468006c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:41:04.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:04.475+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 0x7ff468006c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-28T12:41:05.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:05.279+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 0x7ff468006c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:05.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:05.279+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 msgr2=0x7ff468006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-28T12:41:05.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:05.279+0000 7ff486000640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 msgr2=0x7ff468006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:41:05.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:05.279+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 0x7ff468006c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:41:05.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:05.279+0000 7ff486000640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 0x7ff468006c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-28T12:41:06.049 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:41:06.053 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:41:06.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:06.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 msgr2=0x7ff468006c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-28T12:41:06.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:06.863+0000 7ff47fe00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.76:3300/0 conn(0x7ff468006810 0x7ff468006c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:06.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:06.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 >> v1:172.21.15.111:6789/0 conn(0x7ff468006360 legacy=0x7ff46800f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:06.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:06.863+0000 7ff47fe00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:06.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:06.863+0000 7ff487400640 1 -- 172.21.15.76:0/444052421 reap_dead start 2024-03-28T12:41:06.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:06.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff468005b60 con 0x7ff468012e30 2024-03-28T12:41:06.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:06.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff468011370 con 0x7ff468005e30 2024-03-28T12:41:06.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:06.863+0000 7ff47fe00640 1 -- 172.21.15.76:0/444052421 --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7ff48806d7f0 con 0x7ff468007440 2024-03-28T12:41:07.025 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.027+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:07.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.031+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff4680078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-28T12:41:07.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.031+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff4680078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:41:07.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.031+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:41:07.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.031+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-28T12:41:07.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.211+0000 7ff485600640 1 -- 172.21.15.76:0/444052421 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 54885734 0 0) 0x7ff468005b60 con 0x7ff468012e30 2024-03-28T12:41:07.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.211+0000 7ff485600640 1 -- 172.21.15.76:0/444052421 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff46c003530 con 0x7ff468012e30 2024-03-28T12:41:07.268 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.271+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:07.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.311+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff4680078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-28T12:41:07.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.311+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 msgr2=0x7ff4680078f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-28T12:41:07.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.311+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-28T12:41:07.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.311+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-28T12:41:07.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.715+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> v2:172.21.15.111:3300/0 conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:07.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.807+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v1:172.21.15.111:6789/0 conn(0x7ff468005e30 legacy=0x7ff468018140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:07.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.807+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 >> v1:172.21.15.76:6789/0 conn(0x7ff468012e30 legacy=0x7ff46800f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:07.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.807+0000 7ff486a00640 1 -- 172.21.15.76:0/444052421 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff468011540 con 0x7ff468007440 2024-03-28T12:41:07.871 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:07.871+0000 7fea90628180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-28T12:41:07.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.903+0000 7ff486a00640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff468007440 0x7ff4680078f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff468003ae0 tx=0x7ff47801e1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57ac3eb8fbe42d01 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:07.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.995+0000 7ff485600640 1 -- 172.21.15.76:0/444052421 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4780b3070 con 0x7ff468007440 2024-03-28T12:41:07.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.995+0000 7ff485600640 1 -- 172.21.15.76:0/444052421 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4780a6cd0 con 0x7ff468007440 2024-03-28T12:41:07.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.995+0000 7ff485600640 1 -- 172.21.15.76:0/444052421 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4780ae640 con 0x7ff468007440 2024-03-28T12:41:07.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.999+0000 7ff48d600640 1 -- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff468007440 msgr2=0x7ff4680078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:07.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.999+0000 7ff48d600640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff468007440 0x7ff4680078f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff468003ae0 tx=0x7ff47801e1d0 comp rx=0 tx=0).stop 2024-03-28T12:41:07.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.999+0000 7ff48d600640 1 -- 172.21.15.76:0/444052421 shutdown_connections 2024-03-28T12:41:07.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.999+0000 7ff48d600640 1 --2- 172.21.15.76:0/444052421 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff468007440 0x7ff4680078f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:07.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.999+0000 7ff48d600640 1 -- 172.21.15.76:0/444052421 >> 172.21.15.76:0/444052421 conn(0x7ff488071540 msgr2=0x7ff488070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:07.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.999+0000 7ff48d600640 1 -- 172.21.15.76:0/444052421 shutdown_connections 2024-03-28T12:41:07.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.999+0000 7ff48d600640 1 -- 172.21.15.76:0/444052421 wait complete. 2024-03-28T12:41:07.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.999+0000 7ff48d600640 1 Processor -- start 2024-03-28T12:41:07.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.999+0000 7ff48d600640 1 -- start start 2024-03-28T12:41:08.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.999+0000 7ff48d600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468005e30 0x7ff488155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:08.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.999+0000 7ff48d600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff468007440 0x7ff488159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:08.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.999+0000 7ff48d600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff468012e30 0x7ff4880c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:08.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.999+0000 7ff48d600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff4880cea30 con 0x7ff468007440 2024-03-28T12:41:08.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.999+0000 7ff48d600640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff48806cff0 con 0x7ff468012e30 2024-03-28T12:41:08.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:07.999+0000 7ff48d600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff4880cebb0 con 0x7ff468005e30 2024-03-28T12:41:08.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.003+0000 7ff486000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff468007440 0x7ff488159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:08.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.003+0000 7ff486000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff468007440 0x7ff488159990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52324/0 (socket says 172.21.15.76:52324) 2024-03-28T12:41:08.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.003+0000 7ff486000640 1 -- 172.21.15.76:0/1901777633 learned_addr learned my addr 172.21.15.76:0/1901777633 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:08.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.007+0000 7ff486000640 1 -- 172.21.15.76:0/1901777633 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468005e30 msgr2=0x7ff488155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:08.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.007+0000 7ff486000640 1 --2- 172.21.15.76:0/1901777633 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468005e30 0x7ff488155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:08.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.007+0000 7ff486000640 1 -- 172.21.15.76:0/1901777633 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff468012e30 msgr2=0x7ff4880c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:08.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.007+0000 7ff486000640 1 --2- 172.21.15.76:0/1901777633 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff468012e30 0x7ff4880c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:08.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.007+0000 7ff486000640 1 -- 172.21.15.76:0/1901777633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4881558e0 con 0x7ff468007440 2024-03-28T12:41:08.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.011+0000 7ff486000640 1 --2- 172.21.15.76:0/1901777633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff468007440 0x7ff488159990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff474019e20 tx=0x7ff474017780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:08.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.019+0000 7ff47ea00640 1 -- 172.21.15.76:0/1901777633 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff474022400 con 0x7ff468007440 2024-03-28T12:41:08.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.019+0000 7ff47ea00640 1 -- 172.21.15.76:0/1901777633 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4740225a0 con 0x7ff468007440 2024-03-28T12:41:08.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.019+0000 7ff47ea00640 1 -- 172.21.15.76:0/1901777633 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff474022750 con 0x7ff468007440 2024-03-28T12:41:08.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.019+0000 7ff48d600640 1 -- 172.21.15.76:0/1901777633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4880b34c0 con 0x7ff468007440 2024-03-28T12:41:08.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.019+0000 7ff48d600640 1 -- 172.21.15.76:0/1901777633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4880c7530 con 0x7ff468007440 2024-03-28T12:41:08.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.019+0000 7ff48d600640 1 -- 172.21.15.76:0/1901777633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4880686e0 con 0x7ff468007440 2024-03-28T12:41:08.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.315+0000 7ff47ea00640 1 -- 172.21.15.76:0/1901777633 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff474015040 con 0x7ff468007440 2024-03-28T12:41:08.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.315+0000 7ff47ea00640 1 -- 172.21.15.76:0/1901777633 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff47402b920 con 0x7ff468007440 2024-03-28T12:41:08.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.315+0000 7ff47ea00640 1 -- 172.21.15.76:0/1901777633 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff4740050c0 con 0x7ff468007440 2024-03-28T12:41:08.379 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:08.379+0000 7fea90628180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-28T12:41:08.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.379+0000 7ff48d600640 1 -- 172.21.15.76:0/1901777633 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff488156190 con 0x7ff468007440 2024-03-28T12:41:08.518 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:08.517+0000 7f6d0c030180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-28T12:41:08.607 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:08.607+0000 7fea90628180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-28T12:41:08.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.627+0000 7ff47ea00640 1 -- 172.21.15.76:0/1901777633 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7ff47402bbc0 con 0x7ff468007440 2024-03-28T12:41:08.627 INFO:teuthology.orchestra.run.smithi076.stderr:adjusted tunables profile to default 2024-03-28T12:41:08.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.627+0000 7ff48d600640 1 -- 172.21.15.76:0/1901777633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff468007440 msgr2=0x7ff488159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:08.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.627+0000 7ff48d600640 1 --2- 172.21.15.76:0/1901777633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff468007440 0x7ff488159990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff474019e20 tx=0x7ff474017780 comp rx=0 tx=0).stop 2024-03-28T12:41:08.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.627+0000 7ff48d600640 1 -- 172.21.15.76:0/1901777633 shutdown_connections 2024-03-28T12:41:08.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.627+0000 7ff48d600640 1 --2- 172.21.15.76:0/1901777633 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff468012e30 0x7ff4880c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:08.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.627+0000 7ff48d600640 1 --2- 172.21.15.76:0/1901777633 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff468007440 0x7ff488159990 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:08.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.627+0000 7ff48d600640 1 --2- 172.21.15.76:0/1901777633 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff468005e30 0x7ff488155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:08.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.627+0000 7ff48d600640 1 -- 172.21.15.76:0/1901777633 >> 172.21.15.76:0/1901777633 conn(0x7ff488071540 msgr2=0x7ff488158dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:08.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.627+0000 7ff48d600640 1 -- 172.21.15.76:0/1901777633 shutdown_connections 2024-03-28T12:41:08.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:08.627+0000 7ff48d600640 1 -- 172.21.15.76:0/1901777633 wait complete. 2024-03-28T12:41:08.649 INFO:tasks.ceph:check_enable_crimson: False 2024-03-28T12:41:08.649 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-28T12:41:08.649 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:41:08.649 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-28T12:41:08.669 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:41:08.669 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-28T12:41:08.732 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:41:08.732 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-28T12:41:08.791 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:41:08.791 DEBUG:teuthology.orchestra.run.smithi076:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-28T12:41:08.851 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:41:08.851 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-28T12:41:08.865 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:41:08.865 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-28T12:41:08.917 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:41:08.917 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-28T12:41:08.977 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-03-28T12:41:08.977 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-28T12:41:09.016 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:09.013+0000 7f6d0c030180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-28T12:41:09.027 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new de27b51a-d060-4851-bd73-57aa86a82e7d 0 2024-03-28T12:41:09.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.197+0000 7fa24e470640 1 Processor -- start 2024-03-28T12:41:09.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.197+0000 7fa24e470640 1 -- start start 2024-03-28T12:41:09.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.197+0000 7fa24e470640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa248152920 0x7fa24815c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:09.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.197+0000 7fa24e470640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa248152d00 0x7fa248071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:09.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.197+0000 7fa24e470640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa248158ca0 con 0x7fa248158780 2024-03-28T12:41:09.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.197+0000 7fa24e470640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fa24815cc40 con 0x7fa248152d00 2024-03-28T12:41:09.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.197+0000 7fa24e470640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa2480c3130 con 0x7fa248152920 2024-03-28T12:41:09.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.201+0000 7fa247fff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa248152920 0x7fa24815c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:09.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.201+0000 7fa2477fe640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa248152d00 0x7fa248071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:09.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.201+0000 7fa247fff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa248152920 0x7fa24815c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:49294/0 (socket says 172.21.15.111:49294) 2024-03-28T12:41:09.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.201+0000 7fa247fff640 1 -- 172.21.15.111:0/373045490 learned_addr learned my addr 172.21.15.111:0/373045490 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-28T12:41:09.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.201+0000 7fa247fff640 1 -- 172.21.15.111:0/373045490 >> v2:172.21.15.111:3300/0 conn(0x7fa248152d00 msgr2=0x7fa248071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:09.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.201+0000 7fa247fff640 1 --2- 172.21.15.111:0/373045490 >> v2:172.21.15.111:3300/0 conn(0x7fa248152d00 0x7fa248071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:09.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.201+0000 7fa247fff640 1 -- 172.21.15.111:0/373045490 >> v1:172.21.15.76:6789/0 conn(0x7fa248158780 legacy=0x7fa2480c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:09.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.201+0000 7fa247fff640 1 -- 172.21.15.111:0/373045490 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa248158f80 con 0x7fa248152920 2024-03-28T12:41:09.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.205+0000 7fa247fff640 1 --2- 172.21.15.111:0/373045490 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa248152920 0x7fa24815c700 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa230009870 tx=0x7fa23001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e9f436719893c8c server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:09.235 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:09.233+0000 7f6d0c030180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-28T12:41:09.242 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:09.243+0000 7fea90628180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-28T12:41:09.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.245+0000 7fa246ffd640 1 -- 172.21.15.111:0/373045490 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2300a95f0 con 0x7fa248152920 2024-03-28T12:41:09.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.245+0000 7fa246ffd640 1 -- 172.21.15.111:0/373045490 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2300a9790 con 0x7fa248152920 2024-03-28T12:41:09.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.245+0000 7fa246ffd640 1 -- 172.21.15.111:0/373045490 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2300a9b60 con 0x7fa248152920 2024-03-28T12:41:09.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.245+0000 7fa24e470640 1 -- 172.21.15.111:0/373045490 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa248152920 msgr2=0x7fa24815c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:09.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.245+0000 7fa24e470640 1 --2- 172.21.15.111:0/373045490 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa248152920 0x7fa24815c700 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa230009870 tx=0x7fa23001c530 comp rx=0 tx=0).stop 2024-03-28T12:41:09.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.249+0000 7fa24e470640 1 -- 172.21.15.111:0/373045490 shutdown_connections 2024-03-28T12:41:09.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.249+0000 7fa24e470640 1 --2- 172.21.15.111:0/373045490 >> v2:172.21.15.111:3300/0 conn(0x7fa248152d00 0x7fa248071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:09.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.249+0000 7fa24e470640 1 --2- 172.21.15.111:0/373045490 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa248152920 0x7fa24815c700 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:09.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.249+0000 7fa24e470640 1 -- 172.21.15.111:0/373045490 >> 172.21.15.111:0/373045490 conn(0x7fa248071640 msgr2=0x7fa2480701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:09.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.249+0000 7fa24e470640 1 -- 172.21.15.111:0/373045490 shutdown_connections 2024-03-28T12:41:09.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.249+0000 7fa24e470640 1 -- 172.21.15.111:0/373045490 wait complete. 2024-03-28T12:41:09.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.249+0000 7fa24e470640 1 Processor -- start 2024-03-28T12:41:09.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.249+0000 7fa24e470640 1 -- start start 2024-03-28T12:41:09.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.249+0000 7fa24e470640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa248152920 0x7fa2481f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:09.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.249+0000 7fa24e470640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa248158780 0x7fa24815aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:09.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.249+0000 7fa24e470640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa248144e00 0x7fa2480ce540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:09.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.249+0000 7fa24e470640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa2480725e0 con 0x7fa248158780 2024-03-28T12:41:09.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.249+0000 7fa24e470640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa248072460 con 0x7fa248152920 2024-03-28T12:41:09.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.249+0000 7fa24e470640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa248072760 con 0x7fa248144e00 2024-03-28T12:41:09.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.253+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa248158780 0x7fa24815aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:09.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.253+0000 7fa247fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa248152920 0x7fa2481f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:09.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.253+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa248158780 0x7fa24815aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.111:37136/0 (socket says 172.21.15.111:37136) 2024-03-28T12:41:09.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.253+0000 7fa2477fe640 1 -- 172.21.15.111:0/281797354 learned_addr learned my addr 172.21.15.111:0/281797354 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-28T12:41:09.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.257+0000 7fa247fff640 1 -- 172.21.15.111:0/281797354 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa248144e00 msgr2=0x7fa2480ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:09.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.257+0000 7fa247fff640 1 --2- 172.21.15.111:0/281797354 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa248144e00 0x7fa2480ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:09.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.257+0000 7fa247fff640 1 -- 172.21.15.111:0/281797354 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa248158780 msgr2=0x7fa24815aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:09.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.257+0000 7fa247fff640 1 --2- 172.21.15.111:0/281797354 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa248158780 0x7fa24815aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:09.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.257+0000 7fa247fff640 1 -- 172.21.15.111:0/281797354 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa248146e30 con 0x7fa248152920 2024-03-28T12:41:09.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.257+0000 7fa247fff640 1 --2- 172.21.15.111:0/281797354 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa248152920 0x7fa2481f45a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa2300aa000 tx=0x7fa23001ad70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:09.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.261+0000 7fa244ff9640 1 -- 172.21.15.111:0/281797354 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2300b1800 con 0x7fa248152920 2024-03-28T12:41:09.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.261+0000 7fa244ff9640 1 -- 172.21.15.111:0/281797354 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2300b19a0 con 0x7fa248152920 2024-03-28T12:41:09.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.261+0000 7fa24e470640 1 -- 172.21.15.111:0/281797354 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa24806c7e0 con 0x7fa248152920 2024-03-28T12:41:09.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.261+0000 7fa244ff9640 1 -- 172.21.15.111:0/281797354 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2300b1d90 con 0x7fa248152920 2024-03-28T12:41:09.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.261+0000 7fa24e470640 1 -- 172.21.15.111:0/281797354 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa24806ca80 con 0x7fa248152920 2024-03-28T12:41:09.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.265+0000 7fa24e470640 1 -- 172.21.15.111:0/281797354 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa248068df0 con 0x7fa248152920 2024-03-28T12:41:09.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.269+0000 7fa244ff9640 1 -- 172.21.15.111:0/281797354 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa2300bc450 con 0x7fa248152920 2024-03-28T12:41:09.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.269+0000 7fa244ff9640 1 -- 172.21.15.111:0/281797354 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fa2300c58a0 con 0x7fa248152920 2024-03-28T12:41:09.305 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:09.307+0000 7fea90628180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-28T12:41:09.365 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:09.367+0000 7fea90628180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-28T12:41:09.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.449+0000 7fa244ff9640 1 -- 172.21.15.111:0/281797354 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa2300ad020 con 0x7fa248152920 2024-03-28T12:41:09.455 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:09.455+0000 7fea90628180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-28T12:41:09.516 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:09.515+0000 7fea90628180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-28T12:41:09.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.517+0000 7fa24e470640 1 -- 172.21.15.111:0/281797354 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd new", "uuid": "de27b51a-d060-4851-bd73-57aa86a82e7d", "id": 0} v 0) -- 0x7fa2480cada0 con 0x7fa248152920 2024-03-28T12:41:09.606 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:09.607+0000 7fea90628180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-28T12:41:09.671 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:09.671+0000 7fea90628180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-28T12:41:09.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.813+0000 7fa244ff9640 1 -- 172.21.15.111:0/281797354 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "de27b51a-d060-4851-bd73-57aa86a82e7d", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fa230016150 con 0x7fa248152920 2024-03-28T12:41:09.816 INFO:teuthology.orchestra.run.smithi111.stdout:0 2024-03-28T12:41:09.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.813+0000 7fa24e470640 1 -- 172.21.15.111:0/281797354 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa248152920 msgr2=0x7fa2481f45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:09.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.813+0000 7fa24e470640 1 --2- 172.21.15.111:0/281797354 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa248152920 0x7fa2481f45a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa2300aa000 tx=0x7fa23001ad70 comp rx=0 tx=0).stop 2024-03-28T12:41:09.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.813+0000 7fa24e470640 1 -- 172.21.15.111:0/281797354 shutdown_connections 2024-03-28T12:41:09.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.813+0000 7fa24e470640 1 --2- 172.21.15.111:0/281797354 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa248144e00 0x7fa2480ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:09.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.813+0000 7fa24e470640 1 --2- 172.21.15.111:0/281797354 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa248158780 0x7fa24815aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:09.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.813+0000 7fa24e470640 1 --2- 172.21.15.111:0/281797354 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa248152920 0x7fa2481f45a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:09.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.813+0000 7fa24e470640 1 -- 172.21.15.111:0/281797354 >> 172.21.15.111:0/281797354 conn(0x7fa248071640 msgr2=0x7fa248158020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:09.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.813+0000 7fa24e470640 1 -- 172.21.15.111:0/281797354 shutdown_connections 2024-03-28T12:41:09.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.813+0000 7fa24e470640 1 -- 172.21.15.111:0/281797354 wait complete. 2024-03-28T12:41:09.833 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new 344bf573-27c7-4ed4-82ed-23f41520eefe 1 2024-03-28T12:41:09.841 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:09.843+0000 7fea90628180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-28T12:41:09.869 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:09.865+0000 7f6d0c030180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-28T12:41:09.912 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:09.911+0000 7fea90628180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-28T12:41:09.924 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:09.921+0000 7f6d0c030180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-28T12:41:09.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.941+0000 7f0592f41640 1 Processor -- start 2024-03-28T12:41:09.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.941+0000 7f0592f41640 1 -- start start 2024-03-28T12:41:09.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.945+0000 7f0592f41640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f058c1514c0 0x7f058c06d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:09.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.945+0000 7f0592f41640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f058c158a70 0x7f058c0c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:09.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.945+0000 7f0592f41640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f058c06c6b0 con 0x7f058c0c7a50 2024-03-28T12:41:09.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.945+0000 7f0592f41640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f058c0c2070 con 0x7f058c158a70 2024-03-28T12:41:09.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.945+0000 7f0592f41640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f058c06c970 con 0x7f058c1514c0 2024-03-28T12:41:09.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.945+0000 7f0590cdd640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f058c1514c0 0x7f058c06d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:09.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.945+0000 7f0590cdd640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f058c1514c0 0x7f058c06d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:49318/0 (socket says 172.21.15.111:49318) 2024-03-28T12:41:09.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.945+0000 7f0590cdd640 1 -- 172.21.15.111:0/1685338503 learned_addr learned my addr 172.21.15.111:0/1685338503 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-28T12:41:09.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.945+0000 7f05914de640 1 --2- 172.21.15.111:0/1685338503 >> v2:172.21.15.76:3300/0 conn(0x7f058c158a70 0x7f058c0c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:09.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.945+0000 7f0590cdd640 1 -- 172.21.15.111:0/1685338503 >> v2:172.21.15.76:3300/0 conn(0x7f058c158a70 msgr2=0x7f058c0c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:09.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.945+0000 7f0590cdd640 1 --2- 172.21.15.111:0/1685338503 >> v2:172.21.15.76:3300/0 conn(0x7f058c158a70 0x7f058c0c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:09.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.945+0000 7f0590cdd640 1 -- 172.21.15.111:0/1685338503 >> v1:172.21.15.76:6789/0 conn(0x7f058c0c7a50 legacy=0x7f058c0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:09.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.945+0000 7f0590cdd640 1 -- 172.21.15.111:0/1685338503 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058c0c22c0 con 0x7f058c1514c0 2024-03-28T12:41:09.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.949+0000 7f0590cdd640 1 --2- 172.21.15.111:0/1685338503 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f058c1514c0 0x7f058c06d280 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0580009870 tx=0x7f058001ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35678d92ed61df92 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:09.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f058b7fe640 1 -- 172.21.15.111:0/1685338503 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05800b5070 con 0x7f058c1514c0 2024-03-28T12:41:09.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f058b7fe640 1 -- 172.21.15.111:0/1685338503 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05800a89d0 con 0x7f058c1514c0 2024-03-28T12:41:09.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f058b7fe640 1 -- 172.21.15.111:0/1685338503 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05800a8da0 con 0x7f058c1514c0 2024-03-28T12:41:09.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f0592f41640 1 -- 172.21.15.111:0/1685338503 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f058c1514c0 msgr2=0x7f058c06d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:09.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f0592f41640 1 --2- 172.21.15.111:0/1685338503 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f058c1514c0 0x7f058c06d280 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0580009870 tx=0x7f058001ed10 comp rx=0 tx=0).stop 2024-03-28T12:41:09.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f0592f41640 1 -- 172.21.15.111:0/1685338503 shutdown_connections 2024-03-28T12:41:09.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f0592f41640 1 --2- 172.21.15.111:0/1685338503 >> v2:172.21.15.76:3300/0 conn(0x7f058c158a70 0x7f058c0c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:09.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f0592f41640 1 --2- 172.21.15.111:0/1685338503 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f058c1514c0 0x7f058c06d280 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:09.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f0592f41640 1 -- 172.21.15.111:0/1685338503 >> 172.21.15.111:0/1685338503 conn(0x7f058c067a70 msgr2=0x7f058c073280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:09.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f0592f41640 1 -- 172.21.15.111:0/1685338503 shutdown_connections 2024-03-28T12:41:09.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f0592f41640 1 -- 172.21.15.111:0/1685338503 wait complete. 2024-03-28T12:41:09.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f0592f41640 1 Processor -- start 2024-03-28T12:41:09.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f0592f41640 1 -- start start 2024-03-28T12:41:09.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f0592f41640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f058c0c7a50 0x7f058c0ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:09.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f0592f41640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f058c1514c0 0x7f058c1ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:09.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f0592f41640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f058c158a70 0x7f058c1e2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:09.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f0592f41640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f058c0c25a0 con 0x7f058c0c7a50 2024-03-28T12:41:09.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f0592f41640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f058c1583f0 con 0x7f058c1514c0 2024-03-28T12:41:09.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.957+0000 7f0592f41640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f058c06cd50 con 0x7f058c158a70 2024-03-28T12:41:09.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.961+0000 7f05914de640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f058c158a70 0x7f058c1e2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:09.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.961+0000 7f0590cdd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f058c0c7a50 0x7f058c0ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:09.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.961+0000 7f058bfff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f058c1514c0 0x7f058c1ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:09.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.961+0000 7f05914de640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f058c158a70 0x7f058c1e2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:49330/0 (socket says 172.21.15.111:49330) 2024-03-28T12:41:09.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.961+0000 7f05914de640 1 -- 172.21.15.111:0/2171013095 learned_addr learned my addr 172.21.15.111:0/2171013095 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-28T12:41:09.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.961+0000 7f05914de640 1 -- 172.21.15.111:0/2171013095 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f058c1514c0 msgr2=0x7f058c1ef8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:09.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.961+0000 7f05914de640 1 --2- 172.21.15.111:0/2171013095 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f058c1514c0 0x7f058c1ef8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:09.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.961+0000 7f05914de640 1 -- 172.21.15.111:0/2171013095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f058c0c7a50 msgr2=0x7f058c0ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:09.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.961+0000 7f05914de640 1 --2- 172.21.15.111:0/2171013095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f058c0c7a50 0x7f058c0ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:09.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.961+0000 7f05914de640 1 -- 172.21.15.111:0/2171013095 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f058c0c6d20 con 0x7f058c158a70 2024-03-28T12:41:09.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.965+0000 7f05914de640 1 --2- 172.21.15.111:0/2171013095 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f058c158a70 0x7f058c1e2e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f058400bd30 tx=0x7f058400e490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:09.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.969+0000 7f05897fa640 1 -- 172.21.15.111:0/2171013095 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f058401a020 con 0x7f058c158a70 2024-03-28T12:41:09.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.969+0000 7f05897fa640 1 -- 172.21.15.111:0/2171013095 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0584016480 con 0x7f058c158a70 2024-03-28T12:41:09.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.969+0000 7f05897fa640 1 -- 172.21.15.111:0/2171013095 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0584016870 con 0x7f058c158a70 2024-03-28T12:41:09.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.969+0000 7f0592f41640 1 -- 172.21.15.111:0/2171013095 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f058c0c7000 con 0x7f058c158a70 2024-03-28T12:41:09.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.969+0000 7f0592f41640 1 -- 172.21.15.111:0/2171013095 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f058c0c9d90 con 0x7f058c158a70 2024-03-28T12:41:09.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:09.969+0000 7f0592f41640 1 -- 172.21.15.111:0/2171013095 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f058c068df0 con 0x7f058c158a70 2024-03-28T12:41:09.982 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:09.981+0000 7f6d0c030180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-28T12:41:10.060 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:10.057+0000 7f6d0c030180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-28T12:41:10.114 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:10.113+0000 7f6d0c030180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-28T12:41:10.191 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:10.189+0000 7f6d0c030180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-28T12:41:10.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.197+0000 7f05897fa640 1 -- 172.21.15.111:0/2171013095 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f058401d020 con 0x7f058c158a70 2024-03-28T12:41:10.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.197+0000 7f05897fa640 1 -- 172.21.15.111:0/2171013095 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f05840287a0 con 0x7f058c158a70 2024-03-28T12:41:10.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.197+0000 7f05897fa640 1 -- 172.21.15.111:0/2171013095 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0584024030 con 0x7f058c158a70 2024-03-28T12:41:10.247 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:10.245+0000 7f6d0c030180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-28T12:41:10.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.277+0000 7f0592f41640 1 -- 172.21.15.111:0/2171013095 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd new", "uuid": "344bf573-27c7-4ed4-82ed-23f41520eefe", "id": 1} v 0) -- 0x7f058c0cd7a0 con 0x7f058c158a70 2024-03-28T12:41:10.402 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:10.401+0000 7f6d0c030180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-28T12:41:10.467 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:10.465+0000 7f6d0c030180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-28T12:41:10.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.481+0000 7f05897fa640 1 -- 172.21.15.111:0/2171013095 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "344bf573-27c7-4ed4-82ed-23f41520eefe", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f0584012040 con 0x7f058c158a70 2024-03-28T12:41:10.484 INFO:teuthology.orchestra.run.smithi111.stdout:1 2024-03-28T12:41:10.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.485+0000 7f0592f41640 1 -- 172.21.15.111:0/2171013095 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f058c158a70 msgr2=0x7f058c1e2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:10.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.485+0000 7f0592f41640 1 --2- 172.21.15.111:0/2171013095 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f058c158a70 0x7f058c1e2e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f058400bd30 tx=0x7f058400e490 comp rx=0 tx=0).stop 2024-03-28T12:41:10.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.485+0000 7f0592f41640 1 -- 172.21.15.111:0/2171013095 shutdown_connections 2024-03-28T12:41:10.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.485+0000 7f0592f41640 1 --2- 172.21.15.111:0/2171013095 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f058c158a70 0x7f058c1e2e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:10.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.485+0000 7f0592f41640 1 --2- 172.21.15.111:0/2171013095 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f058c1514c0 0x7f058c1ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:10.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.485+0000 7f0592f41640 1 --2- 172.21.15.111:0/2171013095 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f058c0c7a50 0x7f058c0ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:10.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.485+0000 7f0592f41640 1 -- 172.21.15.111:0/2171013095 >> 172.21.15.111:0/2171013095 conn(0x7f058c067a70 msgr2=0x7f058c0c3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:10.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.485+0000 7f0592f41640 1 -- 172.21.15.111:0/2171013095 shutdown_connections 2024-03-28T12:41:10.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.485+0000 7f0592f41640 1 -- 172.21.15.111:0/2171013095 wait complete. 2024-03-28T12:41:10.502 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new 479e5f83-9f98-4dc4-964a-1d254a2eb578 2 2024-03-28T12:41:10.543 INFO:tasks.ceph.mgr.y.smithi076.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-03-28T12:41:10.543 INFO:tasks.ceph.mgr.y.smithi076.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-03-28T12:41:10.543 INFO:tasks.ceph.mgr.y.smithi076.stderr: from numpy import show_config as show_numpy_config 2024-03-28T12:41:10.606 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:10.607+0000 7fea90628180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-28T12:41:10.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.657+0000 7fd2580dd640 1 Processor -- start 2024-03-28T12:41:10.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.657+0000 7fd2580dd640 1 -- start start 2024-03-28T12:41:10.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.657+0000 7fd2580dd640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd250151160 0x7fd2500c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:10.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.657+0000 7fd2580dd640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fd2500c7030 0x7fd250156c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:10.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.657+0000 7fd2580dd640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2500cc990 0x7fd2500cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:10.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.657+0000 7fd2580dd640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fd2500c80d0 con 0x7fd2500c7030 2024-03-28T12:41:10.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.657+0000 7fd2580dd640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fd2500c8e20 con 0x7fd250151160 2024-03-28T12:41:10.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.657+0000 7fd2580dd640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd2500c3f00 con 0x7fd2500cc990 2024-03-28T12:41:10.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.661+0000 7fd25667a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2500cc990 0x7fd2500cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:10.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.661+0000 7fd255e79640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd250151160 0x7fd2500c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:10.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.661+0000 7fd255678640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fd2500c7030 0x7fd250156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:10.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.661+0000 7fd25667a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2500cc990 0x7fd2500cce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:49342/0 (socket says 172.21.15.111:49342) 2024-03-28T12:41:10.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.661+0000 7fd25667a640 1 -- 172.21.15.111:0/1937441422 learned_addr learned my addr 172.21.15.111:0/1937441422 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-28T12:41:10.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.661+0000 7fd255678640 1 -- 172.21.15.111:0/1937441422 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2500cc990 msgr2=0x7fd2500cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:10.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.661+0000 7fd255678640 1 --2- 172.21.15.111:0/1937441422 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2500cc990 0x7fd2500cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:10.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.661+0000 7fd255678640 1 -- 172.21.15.111:0/1937441422 >> v2:172.21.15.111:3300/0 conn(0x7fd250151160 msgr2=0x7fd2500c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:10.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.661+0000 7fd255678640 1 --2- 172.21.15.111:0/1937441422 >> v2:172.21.15.111:3300/0 conn(0x7fd250151160 0x7fd2500c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:10.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.661+0000 7fd255678640 1 -- 172.21.15.111:0/1937441422 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2500c41e0 con 0x7fd2500c7030 2024-03-28T12:41:10.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.661+0000 7fd25667a640 1 --2- 172.21.15.111:0/1937441422 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2500cc990 0x7fd2500cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T12:41:10.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.665+0000 7fd255678640 1 --2- 172.21.15.111:0/1937441422 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2500c7030 0x7fd250156c30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd25006bc10 tx=0x7fd24001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe098d50d2172321 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:10.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.669+0000 7fd254e77640 1 -- 172.21.15.111:0/1937441422 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2400b5070 con 0x7fd2500c7030 2024-03-28T12:41:10.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.669+0000 7fd254e77640 1 -- 172.21.15.111:0/1937441422 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2400a8930 con 0x7fd2500c7030 2024-03-28T12:41:10.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.669+0000 7fd254e77640 1 -- 172.21.15.111:0/1937441422 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2400a8d00 con 0x7fd2500c7030 2024-03-28T12:41:10.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd2580dd640 1 -- 172.21.15.111:0/1937441422 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2500c7030 msgr2=0x7fd250156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:10.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd2580dd640 1 --2- 172.21.15.111:0/1937441422 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2500c7030 0x7fd250156c30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd25006bc10 tx=0x7fd24001ec70 comp rx=0 tx=0).stop 2024-03-28T12:41:10.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd2580dd640 1 -- 172.21.15.111:0/1937441422 shutdown_connections 2024-03-28T12:41:10.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd2580dd640 1 --2- 172.21.15.111:0/1937441422 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2500cc990 0x7fd2500cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:10.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd2580dd640 1 --2- 172.21.15.111:0/1937441422 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2500c7030 0x7fd250156c30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:10.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd2580dd640 1 --2- 172.21.15.111:0/1937441422 >> v2:172.21.15.111:3300/0 conn(0x7fd250151160 0x7fd2500c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:10.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd2580dd640 1 -- 172.21.15.111:0/1937441422 >> 172.21.15.111:0/1937441422 conn(0x7fd2500707d0 msgr2=0x7fd250070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:10.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd2580dd640 1 -- 172.21.15.111:0/1937441422 shutdown_connections 2024-03-28T12:41:10.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd2580dd640 1 -- 172.21.15.111:0/1937441422 wait complete. 2024-03-28T12:41:10.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd2580dd640 1 Processor -- start 2024-03-28T12:41:10.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd2580dd640 1 -- start start 2024-03-28T12:41:10.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd2580dd640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2500c7030 0x7fd250154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:10.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd2580dd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2500cc990 0x7fd250154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:10.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd2580dd640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd250151160 0x7fd2501531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:10.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd2580dd640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd2500c44c0 con 0x7fd2500c7030 2024-03-28T12:41:10.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd2580dd640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd2500c7d60 con 0x7fd2500cc990 2024-03-28T12:41:10.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd2580dd640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd2500c8560 con 0x7fd250151160 2024-03-28T12:41:10.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd25667a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd250151160 0x7fd2501531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:10.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd255678640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2500cc990 0x7fd250154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:10.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd25667a640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd250151160 0x7fd2501531e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:49344/0 (socket says 172.21.15.111:49344) 2024-03-28T12:41:10.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.673+0000 7fd25667a640 1 -- 172.21.15.111:0/1320865837 learned_addr learned my addr 172.21.15.111:0/1320865837 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-28T12:41:10.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.677+0000 7fd255e79640 1 --2- 172.21.15.111:0/1320865837 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2500c7030 0x7fd250154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:10.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.677+0000 7fd25667a640 1 -- 172.21.15.111:0/1320865837 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2500cc990 msgr2=0x7fd250154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:10.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.677+0000 7fd25667a640 1 --2- 172.21.15.111:0/1320865837 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2500cc990 0x7fd250154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:10.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.677+0000 7fd25667a640 1 -- 172.21.15.111:0/1320865837 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2500c7030 msgr2=0x7fd250154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:10.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.677+0000 7fd25667a640 1 --2- 172.21.15.111:0/1320865837 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2500c7030 0x7fd250154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:10.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.677+0000 7fd25667a640 1 -- 172.21.15.111:0/1320865837 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2500c4dd0 con 0x7fd250151160 2024-03-28T12:41:10.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.681+0000 7fd25667a640 1 --2- 172.21.15.111:0/1320865837 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd250151160 0x7fd2501531e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd24800eed0 tx=0x7fd24800b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:10.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.685+0000 7fd2467fc640 1 -- 172.21.15.111:0/1320865837 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24800bb10 con 0x7fd250151160 2024-03-28T12:41:10.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.685+0000 7fd2467fc640 1 -- 172.21.15.111:0/1320865837 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24800bcb0 con 0x7fd250151160 2024-03-28T12:41:10.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.685+0000 7fd2467fc640 1 -- 172.21.15.111:0/1320865837 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24800be60 con 0x7fd250151160 2024-03-28T12:41:10.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.685+0000 7fd2580dd640 1 -- 172.21.15.111:0/1320865837 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd250151720 con 0x7fd250151160 2024-03-28T12:41:10.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.685+0000 7fd2580dd640 1 -- 172.21.15.111:0/1320865837 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd250155cb0 con 0x7fd250151160 2024-03-28T12:41:10.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.685+0000 7fd2580dd640 1 -- 172.21.15.111:0/1320865837 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd25006cfc0 con 0x7fd250151160 2024-03-28T12:41:10.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.685+0000 7fd2467fc640 1 -- 172.21.15.111:0/1320865837 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd24801b030 con 0x7fd250151160 2024-03-28T12:41:10.759 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:10.759+0000 7fea90628180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-28T12:41:10.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.769+0000 7fd2467fc640 1 -- 172.21.15.111:0/1320865837 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fd24801d830 con 0x7fd250151160 2024-03-28T12:41:10.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.821+0000 7fd2467fc640 1 -- 172.21.15.111:0/1320865837 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd248022020 con 0x7fd250151160 2024-03-28T12:41:10.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:10.913+0000 7fd2580dd640 1 -- 172.21.15.111:0/1320865837 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd new", "uuid": "479e5f83-9f98-4dc4-964a-1d254a2eb578", "id": 2} v 0) -- 0x7fd250068df0 con 0x7fd250151160 2024-03-28T12:41:10.946 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:10.943+0000 7fea90628180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-28T12:41:11.024 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:11.023+0000 7fea90628180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-28T12:41:11.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.061+0000 7fd2467fc640 1 -- 172.21.15.111:0/1320865837 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "479e5f83-9f98-4dc4-964a-1d254a2eb578", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fd24801d410 con 0x7fd250151160 2024-03-28T12:41:11.062 INFO:teuthology.orchestra.run.smithi111.stdout:2 2024-03-28T12:41:11.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.061+0000 7fd2580dd640 1 -- 172.21.15.111:0/1320865837 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd250151160 msgr2=0x7fd2501531e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:11.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.061+0000 7fd2580dd640 1 --2- 172.21.15.111:0/1320865837 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd250151160 0x7fd2501531e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd24800eed0 tx=0x7fd24800b480 comp rx=0 tx=0).stop 2024-03-28T12:41:11.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.061+0000 7fd2580dd640 1 -- 172.21.15.111:0/1320865837 shutdown_connections 2024-03-28T12:41:11.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.061+0000 7fd2580dd640 1 --2- 172.21.15.111:0/1320865837 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd250151160 0x7fd2501531e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.061+0000 7fd2580dd640 1 --2- 172.21.15.111:0/1320865837 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2500cc990 0x7fd250154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.061+0000 7fd2580dd640 1 --2- 172.21.15.111:0/1320865837 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2500c7030 0x7fd250154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.061+0000 7fd2580dd640 1 -- 172.21.15.111:0/1320865837 >> 172.21.15.111:0/1320865837 conn(0x7fd2500707d0 msgr2=0x7fd2500ca610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:11.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.061+0000 7fd2580dd640 1 -- 172.21.15.111:0/1320865837 shutdown_connections 2024-03-28T12:41:11.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.061+0000 7fd2580dd640 1 -- 172.21.15.111:0/1320865837 wait complete. 2024-03-28T12:41:11.085 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new 64fb6a90-7551-4929-b702-e3a82f4b3c51 3 2024-03-28T12:41:11.145 INFO:tasks.ceph.mgr.x.smithi111.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-03-28T12:41:11.145 INFO:tasks.ceph.mgr.x.smithi111.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-03-28T12:41:11.145 INFO:tasks.ceph.mgr.x.smithi111.stderr: from numpy import show_config as show_numpy_config 2024-03-28T12:41:11.176 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:11.175+0000 7fea90628180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-28T12:41:11.186 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:11.185+0000 7f6d0c030180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-28T12:41:11.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.213+0000 7f85771b3640 1 Processor -- start 2024-03-28T12:41:11.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.213+0000 7f85771b3640 1 -- start start 2024-03-28T12:41:11.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.213+0000 7f85771b3640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f8570154cf0 0x7f85700cc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:11.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.213+0000 7f85771b3640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85700c7700 0x7f857015a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:11.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.213+0000 7f85771b3640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f857015def0 con 0x7f857015ae20 2024-03-28T12:41:11.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.213+0000 7f85771b3640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f85701550d0 con 0x7f8570154cf0 2024-03-28T12:41:11.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.213+0000 7f85771b3640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f857015e7e0 con 0x7f85700c7700 2024-03-28T12:41:11.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.213+0000 7f856ffff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85700c7700 0x7f857015a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:11.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.213+0000 7f8575750640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f857015ae20 0x7f85700cadf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:51960/0 (socket says 172.21.15.111:51960) 2024-03-28T12:41:11.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.213+0000 7f8575750640 1 -- 172.21.15.111:0/606276872 learned_addr learned my addr 172.21.15.111:0/606276872 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-03-28T12:41:11.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.213+0000 7f8574f4f640 1 --2- 172.21.15.111:0/606276872 >> v2:172.21.15.76:3300/0 conn(0x7f8570154cf0 0x7f85700cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:11.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.217+0000 7f856ffff640 1 -- 172.21.15.111:0/606276872 >> v2:172.21.15.76:3300/0 conn(0x7f8570154cf0 msgr2=0x7f85700cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:11.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.217+0000 7f856ffff640 1 --2- 172.21.15.111:0/606276872 >> v2:172.21.15.76:3300/0 conn(0x7f8570154cf0 0x7f85700cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.217+0000 7f856ffff640 1 -- 172.21.15.111:0/606276872 >> v1:172.21.15.111:6789/0 conn(0x7f857015ae20 legacy=0x7f85700cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:11.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.217+0000 7f856ffff640 1 -- 172.21.15.111:0/606276872 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85700cbb70 con 0x7f85700c7700 2024-03-28T12:41:11.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.221+0000 7f856ffff640 1 --2- 172.21.15.111:0/606276872 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85700c7700 0x7f857015a8e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f855c0097c0 tx=0x7f855c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11adf9ca231ce62d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:11.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.225+0000 7f856f7fe640 1 -- 172.21.15.111:0/606276872 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c0b5070 con 0x7f85700c7700 2024-03-28T12:41:11.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.225+0000 7f856f7fe640 1 -- 172.21.15.111:0/606276872 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f855c0a8990 con 0x7f85700c7700 2024-03-28T12:41:11.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.225+0000 7f856f7fe640 1 -- 172.21.15.111:0/606276872 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c0a8d60 con 0x7f85700c7700 2024-03-28T12:41:11.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.225+0000 7f85771b3640 1 -- 172.21.15.111:0/606276872 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85700c7700 msgr2=0x7f857015a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:11.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.225+0000 7f85771b3640 1 --2- 172.21.15.111:0/606276872 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85700c7700 0x7f857015a8e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f855c0097c0 tx=0x7f855c01ec90 comp rx=0 tx=0).stop 2024-03-28T12:41:11.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.225+0000 7f85771b3640 1 -- 172.21.15.111:0/606276872 shutdown_connections 2024-03-28T12:41:11.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.225+0000 7f85771b3640 1 --2- 172.21.15.111:0/606276872 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85700c7700 0x7f857015a8e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.225+0000 7f85771b3640 1 --2- 172.21.15.111:0/606276872 >> v2:172.21.15.76:3300/0 conn(0x7f8570154cf0 0x7f85700cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.225+0000 7f85771b3640 1 -- 172.21.15.111:0/606276872 >> 172.21.15.111:0/606276872 conn(0x7f8570067330 msgr2=0x7f8570067740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:11.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.225+0000 7f85771b3640 1 -- 172.21.15.111:0/606276872 shutdown_connections 2024-03-28T12:41:11.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.225+0000 7f85771b3640 1 -- 172.21.15.111:0/606276872 wait complete. 2024-03-28T12:41:11.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.229+0000 7f85771b3640 1 Processor -- start 2024-03-28T12:41:11.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.229+0000 7f85771b3640 1 -- start start 2024-03-28T12:41:11.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.229+0000 7f85771b3640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85700c7700 0x7f85700c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:11.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.229+0000 7f85771b3640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8570154cf0 0x7f857014f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:11.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.229+0000 7f85771b3640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f857015ae20 0x7f85700c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:11.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.229+0000 7f85771b3640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f857015e470 con 0x7f8570154cf0 2024-03-28T12:41:11.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.229+0000 7f85771b3640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f857015e190 con 0x7f85700c7700 2024-03-28T12:41:11.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.229+0000 7f85771b3640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f85700cc110 con 0x7f857015ae20 2024-03-28T12:41:11.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.229+0000 7f8575750640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f857015ae20 0x7f85700c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:11.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.229+0000 7f856ffff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8570154cf0 0x7f857014f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:11.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.229+0000 7f8575750640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f857015ae20 0x7f85700c44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:49368/0 (socket says 172.21.15.111:49368) 2024-03-28T12:41:11.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.229+0000 7f8575750640 1 -- 172.21.15.111:0/1349655695 learned_addr learned my addr 172.21.15.111:0/1349655695 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-28T12:41:11.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.233+0000 7f856ffff640 1 -- 172.21.15.111:0/1349655695 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f857015ae20 msgr2=0x7f85700c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:11.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.233+0000 7f856ffff640 1 --2- 172.21.15.111:0/1349655695 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f857015ae20 0x7f85700c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.233+0000 7f856ffff640 1 -- 172.21.15.111:0/1349655695 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85700c7700 msgr2=0x7f85700c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:11.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.233+0000 7f856ffff640 1 --2- 172.21.15.111:0/1349655695 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85700c7700 0x7f85700c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.233+0000 7f856ffff640 1 -- 172.21.15.111:0/1349655695 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8570157210 con 0x7f8570154cf0 2024-03-28T12:41:11.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.241+0000 7f856ffff640 1 --2- 172.21.15.111:0/1349655695 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8570154cf0 0x7f857014f8c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f857015e960 tx=0x7f855c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:11.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.249+0000 7f856d7fa640 1 -- 172.21.15.111:0/1349655695 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c0bf070 con 0x7f8570154cf0 2024-03-28T12:41:11.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.249+0000 7f856d7fa640 1 -- 172.21.15.111:0/1349655695 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f855c0b0720 con 0x7f8570154cf0 2024-03-28T12:41:11.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.249+0000 7f856d7fa640 1 -- 172.21.15.111:0/1349655695 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c0b5040 con 0x7f8570154cf0 2024-03-28T12:41:11.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.249+0000 7f85771b3640 1 -- 172.21.15.111:0/1349655695 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85701574f0 con 0x7f8570154cf0 2024-03-28T12:41:11.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.249+0000 7f85771b3640 1 -- 172.21.15.111:0/1349655695 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8570157ab0 con 0x7f8570154cf0 2024-03-28T12:41:11.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.249+0000 7f85771b3640 1 -- 172.21.15.111:0/1349655695 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85700686e0 con 0x7f8570154cf0 2024-03-28T12:41:11.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.253+0000 7f856d7fa640 1 -- 172.21.15.111:0/1349655695 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f855c0c2070 con 0x7f8570154cf0 2024-03-28T12:41:11.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.285+0000 7f856d7fa640 1 -- 172.21.15.111:0/1349655695 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f855c0059a0 con 0x7f8570154cf0 2024-03-28T12:41:11.341 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:11.337+0000 7f6d0c030180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-28T12:41:11.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.389+0000 7f856d7fa640 1 -- 172.21.15.111:0/1349655695 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f855c0c9080 con 0x7f8570154cf0 2024-03-28T12:41:11.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.465+0000 7f85771b3640 1 -- 172.21.15.111:0/1349655695 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd new", "uuid": "64fb6a90-7551-4929-b702-e3a82f4b3c51", "id": 3} v 0) -- 0x7f85700cb950 con 0x7f8570154cf0 2024-03-28T12:41:11.499 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:11.497+0000 7f6d0c030180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-28T12:41:11.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.525+0000 7f856d7fa640 1 -- 172.21.15.111:0/1349655695 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "64fb6a90-7551-4929-b702-e3a82f4b3c51", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f855c0187f0 con 0x7f8570154cf0 2024-03-28T12:41:11.526 INFO:teuthology.orchestra.run.smithi111.stdout:3 2024-03-28T12:41:11.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.525+0000 7f85771b3640 1 -- 172.21.15.111:0/1349655695 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8570154cf0 msgr2=0x7f857014f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:11.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.525+0000 7f85771b3640 1 --2- 172.21.15.111:0/1349655695 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8570154cf0 0x7f857014f8c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f857015e960 tx=0x7f855c01ba30 comp rx=0 tx=0).stop 2024-03-28T12:41:11.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.525+0000 7f85771b3640 1 -- 172.21.15.111:0/1349655695 shutdown_connections 2024-03-28T12:41:11.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.525+0000 7f85771b3640 1 --2- 172.21.15.111:0/1349655695 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f857015ae20 0x7f85700c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.525+0000 7f85771b3640 1 --2- 172.21.15.111:0/1349655695 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8570154cf0 0x7f857014f8c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.525+0000 7f85771b3640 1 --2- 172.21.15.111:0/1349655695 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85700c7700 0x7f85700c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.525+0000 7f85771b3640 1 -- 172.21.15.111:0/1349655695 >> 172.21.15.111:0/1349655695 conn(0x7f8570067330 msgr2=0x7f85700c9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:11.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.525+0000 7f85771b3640 1 -- 172.21.15.111:0/1349655695 shutdown_connections 2024-03-28T12:41:11.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.525+0000 7f85771b3640 1 -- 172.21.15.111:0/1349655695 wait complete. 2024-03-28T12:41:11.549 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new 9b274d52-59b5-4434-aff3-0ded0c4e714b 4 2024-03-28T12:41:11.569 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:11.565+0000 7f6d0c030180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-28T12:41:11.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.665+0000 7f8382bc1640 1 Processor -- start 2024-03-28T12:41:11.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.665+0000 7f8382bc1640 1 -- start start 2024-03-28T12:41:11.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.665+0000 7f8382bc1640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f837c1514c0 0x7f837c06d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:11.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.665+0000 7f8382bc1640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f837c158a70 0x7f837c0c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:11.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.665+0000 7f8382bc1640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f837c06c6b0 con 0x7f837c0c7a50 2024-03-28T12:41:11.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.665+0000 7f8382bc1640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f837c0c2070 con 0x7f837c1514c0 2024-03-28T12:41:11.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.665+0000 7f8382bc1640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f837c06c970 con 0x7f837c158a70 2024-03-28T12:41:11.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.669+0000 7f838115e640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f837c158a70 0x7f837c0c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:11.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.669+0000 7f838115e640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f837c158a70 0x7f837c0c3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:49372/0 (socket says 172.21.15.111:49372) 2024-03-28T12:41:11.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.669+0000 7f838115e640 1 -- 172.21.15.111:0/3701778039 learned_addr learned my addr 172.21.15.111:0/3701778039 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-28T12:41:11.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.669+0000 7f838095d640 1 --2- 172.21.15.111:0/3701778039 >> v2:172.21.15.76:3300/0 conn(0x7f837c1514c0 0x7f837c06d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:11.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.669+0000 7f838115e640 1 -- 172.21.15.111:0/3701778039 >> v2:172.21.15.76:3300/0 conn(0x7f837c1514c0 msgr2=0x7f837c06d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:11.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.669+0000 7f838115e640 1 --2- 172.21.15.111:0/3701778039 >> v2:172.21.15.76:3300/0 conn(0x7f837c1514c0 0x7f837c06d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.669+0000 7f838115e640 1 -- 172.21.15.111:0/3701778039 >> v1:172.21.15.76:6789/0 conn(0x7f837c0c7a50 legacy=0x7f837c0ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:11.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.669+0000 7f838115e640 1 -- 172.21.15.111:0/3701778039 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837c0c22c0 con 0x7f837c158a70 2024-03-28T12:41:11.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.673+0000 7f838115e640 1 --2- 172.21.15.111:0/3701778039 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f837c158a70 0x7f837c0c3db0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f837400d150 tx=0x7f8374021420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acf6c414c5adea08 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:11.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.677+0000 7f837b7fe640 1 -- 172.21.15.111:0/3701778039 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83740b6070 con 0x7f837c158a70 2024-03-28T12:41:11.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.677+0000 7f837b7fe640 1 -- 172.21.15.111:0/3701778039 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f837400b2d0 con 0x7f837c158a70 2024-03-28T12:41:11.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.677+0000 7f837b7fe640 1 -- 172.21.15.111:0/3701778039 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837400b480 con 0x7f837c158a70 2024-03-28T12:41:11.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.677+0000 7f8382bc1640 1 -- 172.21.15.111:0/3701778039 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f837c158a70 msgr2=0x7f837c0c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:11.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.677+0000 7f8382bc1640 1 --2- 172.21.15.111:0/3701778039 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f837c158a70 0x7f837c0c3db0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f837400d150 tx=0x7f8374021420 comp rx=0 tx=0).stop 2024-03-28T12:41:11.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.677+0000 7f8382bc1640 1 -- 172.21.15.111:0/3701778039 shutdown_connections 2024-03-28T12:41:11.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.677+0000 7f8382bc1640 1 --2- 172.21.15.111:0/3701778039 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f837c158a70 0x7f837c0c3db0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.677+0000 7f8382bc1640 1 --2- 172.21.15.111:0/3701778039 >> v2:172.21.15.76:3300/0 conn(0x7f837c1514c0 0x7f837c06d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.677+0000 7f8382bc1640 1 -- 172.21.15.111:0/3701778039 >> 172.21.15.111:0/3701778039 conn(0x7f837c067a70 msgr2=0x7f837c073280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:11.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.677+0000 7f8382bc1640 1 -- 172.21.15.111:0/3701778039 shutdown_connections 2024-03-28T12:41:11.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.677+0000 7f8382bc1640 1 -- 172.21.15.111:0/3701778039 wait complete. 2024-03-28T12:41:11.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.681+0000 7f8382bc1640 1 Processor -- start 2024-03-28T12:41:11.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.681+0000 7f8382bc1640 1 -- start start 2024-03-28T12:41:11.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.681+0000 7f8382bc1640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f837c0c7a50 0x7f837c1f1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:11.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.681+0000 7f8382bc1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f837c1514c0 0x7f837c14c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:11.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.681+0000 7f8382bc1640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f837c158a70 0x7f837c1f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:11.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.681+0000 7f8382bc1640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f837c0c25a0 con 0x7f837c1514c0 2024-03-28T12:41:11.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.681+0000 7f8382bc1640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f837c1583f0 con 0x7f837c158a70 2024-03-28T12:41:11.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.681+0000 7f8382bc1640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f837c06cd50 con 0x7f837c0c7a50 2024-03-28T12:41:11.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.681+0000 7f838095d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f837c0c7a50 0x7f837c1f1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:11.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.681+0000 7f838115e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f837c158a70 0x7f837c1f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:11.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.681+0000 7f837bfff640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f837c1514c0 0x7f837c14c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:11.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.681+0000 7f838095d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f837c0c7a50 0x7f837c1f1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:49376/0 (socket says 172.21.15.111:49376) 2024-03-28T12:41:11.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.681+0000 7f838095d640 1 -- 172.21.15.111:0/2833521661 learned_addr learned my addr 172.21.15.111:0/2833521661 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-28T12:41:11.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.685+0000 7f837bfff640 1 -- 172.21.15.111:0/2833521661 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f837c0c7a50 msgr2=0x7f837c1f1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:11.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.685+0000 7f837bfff640 1 --2- 172.21.15.111:0/2833521661 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f837c0c7a50 0x7f837c1f1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.685+0000 7f837bfff640 1 -- 172.21.15.111:0/2833521661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f837c158a70 msgr2=0x7f837c1f45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:11.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.685+0000 7f837bfff640 1 --2- 172.21.15.111:0/2833521661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f837c158a70 0x7f837c1f45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.685+0000 7f837bfff640 1 -- 172.21.15.111:0/2833521661 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837c156be0 con 0x7f837c1514c0 2024-03-28T12:41:11.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.685+0000 7f837bfff640 1 --2- 172.21.15.111:0/2833521661 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f837c1514c0 0x7f837c14c5f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f837c0cab30 tx=0x7f836800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:11.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.689+0000 7f83797fa640 1 -- 172.21.15.111:0/2833521661 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368017070 con 0x7f837c1514c0 2024-03-28T12:41:11.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.689+0000 7f83797fa640 1 -- 172.21.15.111:0/2833521661 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83680052d0 con 0x7f837c1514c0 2024-03-28T12:41:11.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.689+0000 7f8382bc1640 1 -- 172.21.15.111:0/2833521661 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837c156e80 con 0x7f837c1514c0 2024-03-28T12:41:11.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.689+0000 7f83797fa640 1 -- 172.21.15.111:0/2833521661 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368003840 con 0x7f837c1514c0 2024-03-28T12:41:11.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.689+0000 7f8382bc1640 1 -- 172.21.15.111:0/2833521661 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f837c157440 con 0x7f837c1514c0 2024-03-28T12:41:11.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.693+0000 7f8382bc1640 1 -- 172.21.15.111:0/2833521661 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f837c06d7d0 con 0x7f837c1514c0 2024-03-28T12:41:11.710 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:11.709+0000 7f6d0c030180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-28T12:41:11.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.801+0000 7f83797fa640 1 -- 172.21.15.111:0/2833521661 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f836801a070 con 0x7f837c1514c0 2024-03-28T12:41:11.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.805+0000 7f83797fa640 1 -- 172.21.15.111:0/2833521661 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f8368011ba0 con 0x7f837c1514c0 2024-03-28T12:41:11.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.809+0000 7f83797fa640 1 -- 172.21.15.111:0/2833521661 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8368021020 con 0x7f837c1514c0 2024-03-28T12:41:11.908 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:11.907+0000 7fea90628180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-28T12:41:11.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.917+0000 7f8382bc1640 1 -- 172.21.15.111:0/2833521661 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9b274d52-59b5-4434-aff3-0ded0c4e714b", "id": 4} v 0) -- 0x7f837c068df0 con 0x7f837c1514c0 2024-03-28T12:41:11.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.957+0000 7f83797fa640 1 -- 172.21.15.111:0/2833521661 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9b274d52-59b5-4434-aff3-0ded0c4e714b", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f8368011da0 con 0x7f837c1514c0 2024-03-28T12:41:11.960 INFO:teuthology.orchestra.run.smithi111.stdout:4 2024-03-28T12:41:11.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.961+0000 7f8382bc1640 1 -- 172.21.15.111:0/2833521661 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f837c1514c0 msgr2=0x7f837c14c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:11.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.961+0000 7f8382bc1640 1 --2- 172.21.15.111:0/2833521661 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f837c1514c0 0x7f837c14c5f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f837c0cab30 tx=0x7f836800c820 comp rx=0 tx=0).stop 2024-03-28T12:41:11.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.961+0000 7f8382bc1640 1 -- 172.21.15.111:0/2833521661 shutdown_connections 2024-03-28T12:41:11.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.961+0000 7f8382bc1640 1 --2- 172.21.15.111:0/2833521661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f837c158a70 0x7f837c1f45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.961+0000 7f8382bc1640 1 --2- 172.21.15.111:0/2833521661 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f837c1514c0 0x7f837c14c5f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.961+0000 7f8382bc1640 1 --2- 172.21.15.111:0/2833521661 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f837c0c7a50 0x7f837c1f1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:11.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.961+0000 7f8382bc1640 1 -- 172.21.15.111:0/2833521661 >> 172.21.15.111:0/2833521661 conn(0x7f837c067a70 msgr2=0x7f837c14eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:11.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.961+0000 7f8382bc1640 1 -- 172.21.15.111:0/2833521661 shutdown_connections 2024-03-28T12:41:11.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:11.961+0000 7f8382bc1640 1 -- 172.21.15.111:0/2833521661 wait complete. 2024-03-28T12:41:11.984 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new 3d302c0a-5fc6-4892-a418-4ba3eaee0ea6 5 2024-03-28T12:41:12.017 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:12.019+0000 7fea90628180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-28T12:41:12.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.129+0000 7f625c005640 1 Processor -- start 2024-03-28T12:41:12.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.129+0000 7f625c005640 1 -- start start 2024-03-28T12:41:12.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.129+0000 7f625c005640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f62541524b0 0x7f62540c4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:12.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.129+0000 7f625c005640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f62540cdef0 0x7f62540ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:12.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.129+0000 7f625c005640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62540cebf0 con 0x7f62540c48a0 2024-03-28T12:41:12.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.129+0000 7f625c005640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f62540b1fc0 con 0x7f62541524b0 2024-03-28T12:41:12.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.129+0000 7f625c005640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f62540c32c0 con 0x7f62540cdef0 2024-03-28T12:41:12.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.133+0000 7f625a5a2640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f62540cdef0 0x7f62540ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:12.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.133+0000 7f6259da1640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f62541524b0 0x7f62540c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:12.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.133+0000 7f625a5a2640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f62540cdef0 0x7f62540ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:46698/0 (socket says 172.21.15.111:46698) 2024-03-28T12:41:12.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.133+0000 7f625a5a2640 1 -- 172.21.15.111:0/3283441857 learned_addr learned my addr 172.21.15.111:0/3283441857 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-28T12:41:12.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.133+0000 7f625a5a2640 1 -- 172.21.15.111:0/3283441857 >> v2:172.21.15.76:3300/0 conn(0x7f62541524b0 msgr2=0x7f62540c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:12.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.133+0000 7f625a5a2640 1 --2- 172.21.15.111:0/3283441857 >> v2:172.21.15.76:3300/0 conn(0x7f62541524b0 0x7f62540c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:12.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.133+0000 7f625a5a2640 1 -- 172.21.15.111:0/3283441857 >> v1:172.21.15.76:6789/0 conn(0x7f62540c48a0 legacy=0x7f62540c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:12.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.133+0000 7f625a5a2640 1 -- 172.21.15.111:0/3283441857 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62540c35a0 con 0x7f62540cdef0 2024-03-28T12:41:12.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.137+0000 7f625a5a2640 1 --2- 172.21.15.111:0/3283441857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62540cdef0 0x7f62540ce3a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f62540b1ee0 tx=0x7f624c01c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54d827f022ecb900 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:12.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.141+0000 7f6258d9f640 1 -- 172.21.15.111:0/3283441857 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c0a5880 con 0x7f62540cdef0 2024-03-28T12:41:12.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.141+0000 7f6258d9f640 1 -- 172.21.15.111:0/3283441857 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c0a5a20 con 0x7f62540cdef0 2024-03-28T12:41:12.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.141+0000 7f6258d9f640 1 -- 172.21.15.111:0/3283441857 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c0a5df0 con 0x7f62540cdef0 2024-03-28T12:41:12.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.141+0000 7f625c005640 1 -- 172.21.15.111:0/3283441857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62540cdef0 msgr2=0x7f62540ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:12.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.141+0000 7f625c005640 1 --2- 172.21.15.111:0/3283441857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62540cdef0 0x7f62540ce3a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f62540b1ee0 tx=0x7f624c01c9c0 comp rx=0 tx=0).stop 2024-03-28T12:41:12.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.141+0000 7f625c005640 1 -- 172.21.15.111:0/3283441857 shutdown_connections 2024-03-28T12:41:12.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.141+0000 7f625c005640 1 --2- 172.21.15.111:0/3283441857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62540cdef0 0x7f62540ce3a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:12.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.141+0000 7f625c005640 1 --2- 172.21.15.111:0/3283441857 >> v2:172.21.15.76:3300/0 conn(0x7f62541524b0 0x7f62540c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:12.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.141+0000 7f625c005640 1 -- 172.21.15.111:0/3283441857 >> 172.21.15.111:0/3283441857 conn(0x7f625406b5a0 msgr2=0x7f625406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:12.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.141+0000 7f625c005640 1 -- 172.21.15.111:0/3283441857 shutdown_connections 2024-03-28T12:41:12.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.141+0000 7f625c005640 1 -- 172.21.15.111:0/3283441857 wait complete. 2024-03-28T12:41:12.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.141+0000 7f625c005640 1 Processor -- start 2024-03-28T12:41:12.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.141+0000 7f625c005640 1 -- start start 2024-03-28T12:41:12.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.145+0000 7f625c005640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62540c48a0 0x7f62541562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:12.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.145+0000 7f625c005640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62540cdef0 0x7f6254143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:12.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.145+0000 7f625c005640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62541524b0 0x7f6254143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:12.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.145+0000 7f625c005640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6254152890 con 0x7f62540c48a0 2024-03-28T12:41:12.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.145+0000 7f625c005640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f62540ce8e0 con 0x7f62541524b0 2024-03-28T12:41:12.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.145+0000 7f625c005640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f62540c9390 con 0x7f62540cdef0 2024-03-28T12:41:12.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.145+0000 7f625a5a2640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62541524b0 0x7f6254143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:12.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.145+0000 7f62595a0640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62540cdef0 0x7f6254143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:12.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.145+0000 7f6259da1640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62540c48a0 0x7f62541562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:12.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.145+0000 7f62595a0640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62540cdef0 0x7f6254143820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:49388/0 (socket says 172.21.15.111:49388) 2024-03-28T12:41:12.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.145+0000 7f62595a0640 1 -- 172.21.15.111:0/4077280015 learned_addr learned my addr 172.21.15.111:0/4077280015 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-28T12:41:12.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.149+0000 7f6259da1640 1 -- 172.21.15.111:0/4077280015 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62540cdef0 msgr2=0x7f6254143820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:12.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.149+0000 7f6259da1640 1 --2- 172.21.15.111:0/4077280015 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62540cdef0 0x7f6254143820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:12.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.149+0000 7f6259da1640 1 -- 172.21.15.111:0/4077280015 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62541524b0 msgr2=0x7f6254143d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:12.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.149+0000 7f6259da1640 1 --2- 172.21.15.111:0/4077280015 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62541524b0 0x7f6254143d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:12.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.149+0000 7f6259da1640 1 -- 172.21.15.111:0/4077280015 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6254156800 con 0x7f62540c48a0 2024-03-28T12:41:12.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.149+0000 7f6259da1640 1 --2- 172.21.15.111:0/4077280015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62540c48a0 0x7f62541562c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f625000e870 tx=0x7f625000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:12.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.153+0000 7f624a7fc640 1 -- 172.21.15.111:0/4077280015 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6250017070 con 0x7f62540c48a0 2024-03-28T12:41:12.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.153+0000 7f624a7fc640 1 -- 172.21.15.111:0/4077280015 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f625000c940 con 0x7f62540c48a0 2024-03-28T12:41:12.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.153+0000 7f625c005640 1 -- 172.21.15.111:0/4077280015 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f625414e6b0 con 0x7f62540c48a0 2024-03-28T12:41:12.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.153+0000 7f624a7fc640 1 -- 172.21.15.111:0/4077280015 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625000ccf0 con 0x7f62540c48a0 2024-03-28T12:41:12.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.153+0000 7f625c005640 1 -- 172.21.15.111:0/4077280015 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f625414c9b0 con 0x7f62540c48a0 2024-03-28T12:41:12.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.153+0000 7f625c005640 1 -- 172.21.15.111:0/4077280015 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6254068df0 con 0x7f62540c48a0 2024-03-28T12:41:12.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.157+0000 7f624a7fc640 1 -- 172.21.15.111:0/4077280015 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f625001a070 con 0x7f62540c48a0 2024-03-28T12:41:12.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.157+0000 7f624a7fc640 1 -- 172.21.15.111:0/4077280015 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f62500065b0 con 0x7f62540c48a0 2024-03-28T12:41:12.222 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:12.223+0000 7fea90628180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-28T12:41:12.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.257+0000 7f624a7fc640 1 -- 172.21.15.111:0/4077280015 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6250006030 con 0x7f62540c48a0 2024-03-28T12:41:12.323 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:12.323+0000 7fea90628180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-28T12:41:12.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.329+0000 7f625c005640 1 -- 172.21.15.111:0/4077280015 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3d302c0a-5fc6-4892-a418-4ba3eaee0ea6", "id": 5} v 0) -- 0x7f6254162be0 con 0x7f62540c48a0 2024-03-28T12:41:12.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.369+0000 7f624a7fc640 1 -- 172.21.15.111:0/4077280015 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3d302c0a-5fc6-4892-a418-4ba3eaee0ea6", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f62500067b0 con 0x7f62540c48a0 2024-03-28T12:41:12.370 INFO:teuthology.orchestra.run.smithi111.stdout:5 2024-03-28T12:41:12.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.369+0000 7f625c005640 1 -- 172.21.15.111:0/4077280015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62540c48a0 msgr2=0x7f62541562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:12.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.369+0000 7f625c005640 1 --2- 172.21.15.111:0/4077280015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62540c48a0 0x7f62541562c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f625000e870 tx=0x7f625000ed30 comp rx=0 tx=0).stop 2024-03-28T12:41:12.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.369+0000 7f625c005640 1 -- 172.21.15.111:0/4077280015 shutdown_connections 2024-03-28T12:41:12.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.369+0000 7f625c005640 1 --2- 172.21.15.111:0/4077280015 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62541524b0 0x7f6254143d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:12.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.369+0000 7f625c005640 1 --2- 172.21.15.111:0/4077280015 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62540cdef0 0x7f6254143820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:12.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.369+0000 7f625c005640 1 --2- 172.21.15.111:0/4077280015 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62540c48a0 0x7f62541562c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:12.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.369+0000 7f625c005640 1 -- 172.21.15.111:0/4077280015 >> 172.21.15.111:0/4077280015 conn(0x7f625406b5a0 msgr2=0x7f62540caf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:12.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.369+0000 7f625c005640 1 -- 172.21.15.111:0/4077280015 shutdown_connections 2024-03-28T12:41:12.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.369+0000 7f625c005640 1 -- 172.21.15.111:0/4077280015 wait complete. 2024-03-28T12:41:12.389 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new 86e70c00-4b63-47bd-9232-d233b63427df 6 2024-03-28T12:41:12.459 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:12.457+0000 7f6d0c030180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-28T12:41:12.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.497+0000 7f7c6a679640 1 Processor -- start 2024-03-28T12:41:12.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.501+0000 7f7c6a679640 1 -- start start 2024-03-28T12:41:12.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.501+0000 7f7c6a679640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c6414e1c0 0x7f7c64157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:12.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.501+0000 7f7c6a679640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f7c640afbe0 0x7f7c640cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:12.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.501+0000 7f7c6a679640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c6406cf10 con 0x7f7c640c8030 2024-03-28T12:41:12.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.501+0000 7f7c6a679640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f7c6415ab10 con 0x7f7c640afbe0 2024-03-28T12:41:12.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.501+0000 7f7c6a679640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7c6406d1f0 con 0x7f7c6414e1c0 2024-03-28T12:41:12.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.501+0000 7f7c63fff640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c6414e1c0 0x7f7c64157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:12.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.501+0000 7f7c637fe640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f7c640c8030 0x7f7c6415b280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:51976/0 (socket says 172.21.15.111:51976) 2024-03-28T12:41:12.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.501+0000 7f7c637fe640 1 -- 172.21.15.111:0/1604116172 learned_addr learned my addr 172.21.15.111:0/1604116172 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-03-28T12:41:12.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.501+0000 7f7c68c16640 1 --2- 172.21.15.111:0/1604116172 >> v2:172.21.15.76:3300/0 conn(0x7f7c640afbe0 0x7f7c640cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:12.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.505+0000 7f7c63fff640 1 -- 172.21.15.111:0/1604116172 >> v2:172.21.15.76:3300/0 conn(0x7f7c640afbe0 msgr2=0x7f7c640cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:12.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.505+0000 7f7c63fff640 1 --2- 172.21.15.111:0/1604116172 >> v2:172.21.15.76:3300/0 conn(0x7f7c640afbe0 0x7f7c640cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:12.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.505+0000 7f7c63fff640 1 -- 172.21.15.111:0/1604116172 >> v1:172.21.15.111:6789/0 conn(0x7f7c640c8030 legacy=0x7f7c6415b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:12.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.505+0000 7f7c63fff640 1 -- 172.21.15.111:0/1604116172 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6406d4d0 con 0x7f7c6414e1c0 2024-03-28T12:41:12.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.505+0000 7f7c63fff640 1 --2- 172.21.15.111:0/1604116172 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c6414e1c0 0x7f7c64157fa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7c540097c0 tx=0x7f7c5401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c597a6a938220305 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:12.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.509+0000 7f7c62ffd640 1 -- 172.21.15.111:0/1604116172 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c540b5070 con 0x7f7c6414e1c0 2024-03-28T12:41:12.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.509+0000 7f7c62ffd640 1 -- 172.21.15.111:0/1604116172 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c540a8990 con 0x7f7c6414e1c0 2024-03-28T12:41:12.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.509+0000 7f7c62ffd640 1 -- 172.21.15.111:0/1604116172 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c540a8d60 con 0x7f7c6414e1c0 2024-03-28T12:41:12.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c6a679640 1 -- 172.21.15.111:0/1604116172 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c6414e1c0 msgr2=0x7f7c64157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:12.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c6a679640 1 --2- 172.21.15.111:0/1604116172 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c6414e1c0 0x7f7c64157fa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7c540097c0 tx=0x7f7c5401ec90 comp rx=0 tx=0).stop 2024-03-28T12:41:12.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c6a679640 1 -- 172.21.15.111:0/1604116172 shutdown_connections 2024-03-28T12:41:12.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c6a679640 1 --2- 172.21.15.111:0/1604116172 >> v2:172.21.15.76:3300/0 conn(0x7f7c640afbe0 0x7f7c640cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:12.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c6a679640 1 --2- 172.21.15.111:0/1604116172 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c6414e1c0 0x7f7c64157fa0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:12.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c6a679640 1 -- 172.21.15.111:0/1604116172 >> 172.21.15.111:0/1604116172 conn(0x7f7c6406f0a0 msgr2=0x7f7c6406f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:12.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c6a679640 1 -- 172.21.15.111:0/1604116172 shutdown_connections 2024-03-28T12:41:12.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c6a679640 1 -- 172.21.15.111:0/1604116172 wait complete. 2024-03-28T12:41:12.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c6a679640 1 Processor -- start 2024-03-28T12:41:12.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c6a679640 1 -- start start 2024-03-28T12:41:12.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c6a679640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c640afbe0 0x7f7c640ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:12.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c6a679640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c640c8030 0x7f7c6414b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:12.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c6a679640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c641e4670 0x7f7c64148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:12.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c6a679640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7c640c2280 con 0x7f7c641e4670 2024-03-28T12:41:12.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c6a679640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6415b990 con 0x7f7c640afbe0 2024-03-28T12:41:12.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c6a679640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7c640c8590 con 0x7f7c640c8030 2024-03-28T12:41:12.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c637fe640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c640c8030 0x7f7c6414b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:12.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c68c16640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c641e4670 0x7f7c64148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:12.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c63fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c640afbe0 0x7f7c640ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:12.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c637fe640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c640c8030 0x7f7c6414b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:49402/0 (socket says 172.21.15.111:49402) 2024-03-28T12:41:12.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.513+0000 7f7c637fe640 1 -- 172.21.15.111:0/3014742402 learned_addr learned my addr 172.21.15.111:0/3014742402 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-28T12:41:12.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.517+0000 7f7c68c16640 1 -- 172.21.15.111:0/3014742402 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c640c8030 msgr2=0x7f7c6414b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:12.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.517+0000 7f7c68c16640 1 --2- 172.21.15.111:0/3014742402 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c640c8030 0x7f7c6414b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:12.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.517+0000 7f7c68c16640 1 -- 172.21.15.111:0/3014742402 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c640afbe0 msgr2=0x7f7c640ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:12.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.517+0000 7f7c68c16640 1 --2- 172.21.15.111:0/3014742402 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c640afbe0 0x7f7c640ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:12.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.517+0000 7f7c68c16640 1 -- 172.21.15.111:0/3014742402 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c641f0a00 con 0x7f7c641e4670 2024-03-28T12:41:12.541 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:12.541+0000 7f6d0c030180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-28T12:41:12.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.597+0000 7f7c68c16640 1 --2- 172.21.15.111:0/3014742402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c641e4670 0x7f7c64148ac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009d90 tx=0x7f7c5c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:12.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.601+0000 7f7c60ff9640 1 -- 172.21.15.111:0/3014742402 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c018020 con 0x7f7c641e4670 2024-03-28T12:41:12.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.601+0000 7f7c60ff9640 1 -- 172.21.15.111:0/3014742402 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5c014480 con 0x7f7c641e4670 2024-03-28T12:41:12.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.601+0000 7f7c60ff9640 1 -- 172.21.15.111:0/3014742402 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c014870 con 0x7f7c641e4670 2024-03-28T12:41:12.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.601+0000 7f7c6a679640 1 -- 172.21.15.111:0/3014742402 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c641f0ce0 con 0x7f7c641e4670 2024-03-28T12:41:12.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.601+0000 7f7c6a679640 1 -- 172.21.15.111:0/3014742402 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c641f12a0 con 0x7f7c641e4670 2024-03-28T12:41:12.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.601+0000 7f7c6a679640 1 -- 172.21.15.111:0/3014742402 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c64068df0 con 0x7f7c641e4670 2024-03-28T12:41:12.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.605+0000 7f7c60ff9640 1 -- 172.21.15.111:0/3014742402 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7c5c01b020 con 0x7f7c641e4670 2024-03-28T12:41:12.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.605+0000 7f7c60ff9640 1 -- 172.21.15.111:0/3014742402 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f7c5c0139d0 con 0x7f7c641e4670 2024-03-28T12:41:12.692 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:12.691+0000 7fea90628180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-28T12:41:12.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.705+0000 7f7c60ff9640 1 -- 172.21.15.111:0/3014742402 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7c5c022030 con 0x7f7c641e4670 2024-03-28T12:41:12.724 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:12.721+0000 7f6d0c030180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-28T12:41:12.763 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:12.763+0000 7fea90628180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-28T12:41:12.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.781+0000 7f7c6a679640 1 -- 172.21.15.111:0/3014742402 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd new", "uuid": "86e70c00-4b63-47bd-9232-d233b63427df", "id": 6} v 0) -- 0x7f7c64151b50 con 0x7f7c641e4670 2024-03-28T12:41:12.797 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:12.793+0000 7f6d0c030180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-28T12:41:12.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:12.973+0000 7f7c60ff9640 1 -- 172.21.15.111:0/3014742402 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mgrmap(e 2) ==== 43943+0+0 (secure 0 0 0) 0x7f7c5c012050 con 0x7f7c641e4670 2024-03-28T12:41:13.094 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:13.093+0000 7f6d0c030180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-28T12:41:13.160 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-03-28T12:41:13.157+0000 7f6d0c030180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-28T12:41:13.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.349+0000 7f7c60ff9640 1 -- 172.21.15.111:0/3014742402 <== mon.0 v2:172.21.15.76:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86e70c00-4b63-47bd-9232-d233b63427df", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f7c5c010040 con 0x7f7c641e4670 2024-03-28T12:41:13.352 INFO:teuthology.orchestra.run.smithi111.stdout:6 2024-03-28T12:41:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.353+0000 7f7c6a679640 1 -- 172.21.15.111:0/3014742402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c641e4670 msgr2=0x7f7c64148ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.353+0000 7f7c6a679640 1 --2- 172.21.15.111:0/3014742402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c641e4670 0x7f7c64148ac0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009d90 tx=0x7f7c5c00c490 comp rx=0 tx=0).stop 2024-03-28T12:41:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.353+0000 7f7c6a679640 1 -- 172.21.15.111:0/3014742402 shutdown_connections 2024-03-28T12:41:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.353+0000 7f7c6a679640 1 --2- 172.21.15.111:0/3014742402 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c641e4670 0x7f7c64148ac0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.353+0000 7f7c6a679640 1 --2- 172.21.15.111:0/3014742402 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c640c8030 0x7f7c6414b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.353+0000 7f7c6a679640 1 --2- 172.21.15.111:0/3014742402 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c640afbe0 0x7f7c640ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.353+0000 7f7c6a679640 1 -- 172.21.15.111:0/3014742402 >> 172.21.15.111:0/3014742402 conn(0x7f7c6406f0a0 msgr2=0x7f7c640c94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.353+0000 7f7c6a679640 1 -- 172.21.15.111:0/3014742402 shutdown_connections 2024-03-28T12:41:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.353+0000 7f7c6a679640 1 -- 172.21.15.111:0/3014742402 wait complete. 2024-03-28T12:41:13.383 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new 57701a91-c7ae-435e-9172-09e848747718 7 2024-03-28T12:41:13.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.509+0000 7fa16016d640 1 Processor -- start 2024-03-28T12:41:13.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.509+0000 7fa16016d640 1 -- start start 2024-03-28T12:41:13.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.509+0000 7fa16016d640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa1580c7030 0x7fa158156c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:13.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.509+0000 7fa16016d640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fa1580cc990 0x7fa1580cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:13.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.509+0000 7fa16016d640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1580c3f00 con 0x7fa158151160 2024-03-28T12:41:13.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.509+0000 7fa16016d640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fa1580c80d0 con 0x7fa1580cc990 2024-03-28T12:41:13.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.509+0000 7fa16016d640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fa1580c41e0 con 0x7fa1580c7030 2024-03-28T12:41:13.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.513+0000 7fa15d708640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa1580c7030 0x7fa158156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:13.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.513+0000 7fa15d708640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa1580c7030 0x7fa158156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49078/0 (socket says 172.21.15.111:49078) 2024-03-28T12:41:13.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.513+0000 7fa15d708640 1 -- 172.21.15.111:0/865685059 learned_addr learned my addr 172.21.15.111:0/865685059 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-28T12:41:13.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.513+0000 7fa15d708640 1 -- 172.21.15.111:0/865685059 >> v2:172.21.15.76:3300/0 conn(0x7fa1580cc990 msgr2=0x7fa1580cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:13.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.513+0000 7fa15d708640 1 --2- 172.21.15.111:0/865685059 >> v2:172.21.15.76:3300/0 conn(0x7fa1580cc990 0x7fa1580cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:13.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.513+0000 7fa15d708640 1 -- 172.21.15.111:0/865685059 >> v1:172.21.15.111:6789/0 conn(0x7fa158151160 legacy=0x7fa1580c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:13.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.513+0000 7fa15d708640 1 -- 172.21.15.111:0/865685059 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1580c7a80 con 0x7fa1580c7030 2024-03-28T12:41:13.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.529+0000 7fa15d708640 1 --2- 172.21.15.111:0/865685059 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1580c7030 0x7fa158156c30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa1580c33d0 tx=0x7fa1480200e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8609af9a33aae58c server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:13.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.597+0000 7fa15cf07640 1 -- 172.21.15.111:0/865685059 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1480b6070 con 0x7fa1580c7030 2024-03-28T12:41:13.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.597+0000 7fa15cf07640 1 -- 172.21.15.111:0/865685059 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1480b1440 con 0x7fa1580c7030 2024-03-28T12:41:13.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.597+0000 7fa15cf07640 1 -- 172.21.15.111:0/865685059 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14800b040 con 0x7fa1580c7030 2024-03-28T12:41:13.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.597+0000 7fa16016d640 1 -- 172.21.15.111:0/865685059 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1580c7030 msgr2=0x7fa158156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:13.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.597+0000 7fa16016d640 1 --2- 172.21.15.111:0/865685059 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1580c7030 0x7fa158156c30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa1580c33d0 tx=0x7fa1480200e0 comp rx=0 tx=0).stop 2024-03-28T12:41:13.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.597+0000 7fa16016d640 1 -- 172.21.15.111:0/865685059 shutdown_connections 2024-03-28T12:41:13.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.597+0000 7fa16016d640 1 --2- 172.21.15.111:0/865685059 >> v2:172.21.15.76:3300/0 conn(0x7fa1580cc990 0x7fa1580cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:13.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.597+0000 7fa16016d640 1 --2- 172.21.15.111:0/865685059 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1580c7030 0x7fa158156c30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:13.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.597+0000 7fa16016d640 1 -- 172.21.15.111:0/865685059 >> 172.21.15.111:0/865685059 conn(0x7fa1580707d0 msgr2=0x7fa158070be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:13.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.597+0000 7fa16016d640 1 -- 172.21.15.111:0/865685059 shutdown_connections 2024-03-28T12:41:13.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.597+0000 7fa16016d640 1 -- 172.21.15.111:0/865685059 wait complete. 2024-03-28T12:41:13.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.601+0000 7fa16016d640 1 Processor -- start 2024-03-28T12:41:13.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.601+0000 7fa16016d640 1 -- start start 2024-03-28T12:41:13.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.601+0000 7fa16016d640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa1580c7030 0x7fa158141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:13.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.601+0000 7fa16016d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1580cc990 0x7fa1580cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:13.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.601+0000 7fa16016d640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa158151160 0x7fa158142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:13.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.601+0000 7fa16016d640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa1580c8560 con 0x7fa158151160 2024-03-28T12:41:13.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.601+0000 7fa16016d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa1580c44c0 con 0x7fa1580cc990 2024-03-28T12:41:13.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.601+0000 7fa16016d640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa1581f1900 con 0x7fa1580c7030 2024-03-28T12:41:13.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.601+0000 7fa15e70a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa158151160 0x7fa158142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:13.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.601+0000 7fa15e70a640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa158151160 0x7fa158142e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.111:47556/0 (socket says 172.21.15.111:47556) 2024-03-28T12:41:13.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.601+0000 7fa15e70a640 1 -- 172.21.15.111:0/2922536610 learned_addr learned my addr 172.21.15.111:0/2922536610 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-03-28T12:41:13.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.605+0000 7fa15df09640 1 --2- 172.21.15.111:0/2922536610 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa1580c7030 0x7fa158141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:13.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.605+0000 7fa15e70a640 1 -- 172.21.15.111:0/2922536610 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa1580c7030 msgr2=0x7fa158141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:13.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.605+0000 7fa15e70a640 1 --2- 172.21.15.111:0/2922536610 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa1580c7030 0x7fa158141e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:13.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.605+0000 7fa15e70a640 1 -- 172.21.15.111:0/2922536610 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1580cc990 msgr2=0x7fa1580cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:13.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.605+0000 7fa15e70a640 1 --2- 172.21.15.111:0/2922536610 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1580cc990 0x7fa1580cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:13.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.605+0000 7fa15e70a640 1 -- 172.21.15.111:0/2922536610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15814e310 con 0x7fa158151160 2024-03-28T12:41:13.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.609+0000 7fa15e70a640 1 --2- 172.21.15.111:0/2922536610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa158151160 0x7fa158142e10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa15000b9a0 tx=0x7fa15000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.613+0000 7fa14e7fc640 1 -- 172.21.15.111:0/2922536610 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150019070 con 0x7fa158151160 2024-03-28T12:41:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.613+0000 7fa14e7fc640 1 -- 172.21.15.111:0/2922536610 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa15000cb60 con 0x7fa158151160 2024-03-28T12:41:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.613+0000 7fa16016d640 1 -- 172.21.15.111:0/2922536610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1581424a0 con 0x7fa158151160 2024-03-28T12:41:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.613+0000 7fa14e7fc640 1 -- 172.21.15.111:0/2922536610 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150014440 con 0x7fa158151160 2024-03-28T12:41:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.613+0000 7fa16016d640 1 -- 172.21.15.111:0/2922536610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa158140aa0 con 0x7fa158151160 2024-03-28T12:41:13.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.613+0000 7fa16016d640 1 -- 172.21.15.111:0/2922536610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa15806cfa0 con 0x7fa158151160 2024-03-28T12:41:13.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.725+0000 7fa14e7fc640 1 -- 172.21.15.111:0/2922536610 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 2) ==== 43943+0+0 (secure 0 0 0) 0x7fa15001c070 con 0x7fa158151160 2024-03-28T12:41:13.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.725+0000 7fa14e7fc640 1 -- 172.21.15.111:0/2922536610 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fa15001dca0 con 0x7fa158151160 2024-03-28T12:41:13.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.729+0000 7fa14e7fc640 1 -- 172.21.15.111:0/2922536610 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa150023020 con 0x7fa158151160 2024-03-28T12:41:13.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:13.825+0000 7fa16016d640 1 -- 172.21.15.111:0/2922536610 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd new", "uuid": "57701a91-c7ae-435e-9172-09e848747718", "id": 7} v 0) -- 0x7fa158068df0 con 0x7fa158151160 2024-03-28T12:41:14.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:14.061+0000 7fa14e7fc640 1 -- 172.21.15.111:0/2922536610 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "57701a91-c7ae-435e-9172-09e848747718", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fa150012340 con 0x7fa158151160 2024-03-28T12:41:14.065 INFO:teuthology.orchestra.run.smithi111.stdout:7 2024-03-28T12:41:14.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:14.065+0000 7fa16016d640 1 -- 172.21.15.111:0/2922536610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa158151160 msgr2=0x7fa158142e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:14.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:14.065+0000 7fa16016d640 1 --2- 172.21.15.111:0/2922536610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa158151160 0x7fa158142e10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa15000b9a0 tx=0x7fa15000be60 comp rx=0 tx=0).stop 2024-03-28T12:41:14.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:14.065+0000 7fa16016d640 1 -- 172.21.15.111:0/2922536610 shutdown_connections 2024-03-28T12:41:14.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:14.065+0000 7fa16016d640 1 --2- 172.21.15.111:0/2922536610 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa158151160 0x7fa158142e10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:14.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:14.065+0000 7fa16016d640 1 --2- 172.21.15.111:0/2922536610 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1580cc990 0x7fa1580cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:14.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:14.065+0000 7fa16016d640 1 --2- 172.21.15.111:0/2922536610 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa1580c7030 0x7fa158141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:14.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:14.065+0000 7fa16016d640 1 -- 172.21.15.111:0/2922536610 >> 172.21.15.111:0/2922536610 conn(0x7fa1580707d0 msgr2=0x7fa158144fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:14.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:14.065+0000 7fa16016d640 1 -- 172.21.15.111:0/2922536610 shutdown_connections 2024-03-28T12:41:14.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-03-28T12:41:14.065+0000 7fa16016d640 1 -- 172.21.15.111:0/2922536610 wait complete. 2024-03-28T12:41:14.089 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-28T12:41:14.089 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-03-28T12:41:14.092 INFO:tasks.ceph.osd.0:Started 2024-03-28T12:41:14.092 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-28T12:41:14.092 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-03-28T12:41:14.095 INFO:tasks.ceph.osd.1:Started 2024-03-28T12:41:14.096 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-28T12:41:14.096 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-03-28T12:41:14.098 INFO:tasks.ceph.osd.2:Started 2024-03-28T12:41:14.099 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-28T12:41:14.099 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-03-28T12:41:14.103 INFO:tasks.ceph.osd.3:Started 2024-03-28T12:41:14.103 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-28T12:41:14.103 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-03-28T12:41:14.105 INFO:tasks.ceph.osd.4:Started 2024-03-28T12:41:14.105 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-28T12:41:14.105 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-03-28T12:41:14.107 INFO:tasks.ceph.osd.5:Started 2024-03-28T12:41:14.107 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-28T12:41:14.108 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-03-28T12:41:14.110 INFO:tasks.ceph.osd.6:Started 2024-03-28T12:41:14.110 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-28T12:41:14.110 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-03-28T12:41:14.112 INFO:tasks.ceph.osd.7:Started 2024-03-28T12:41:14.112 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T12:41:14.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.291+0000 7fe5da000640 1 Processor -- start 2024-03-28T12:41:14.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.291+0000 7fe5da000640 1 -- start start 2024-03-28T12:41:14.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.291+0000 7fe5da000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe5d4152650 0x7fe5d406e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:14.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.291+0000 7fe5da000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fe5d4152a30 0x7fe5d4072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:14.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.291+0000 7fe5da000640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5d406ecd0 con 0x7fe5d4072570 2024-03-28T12:41:14.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.291+0000 7fe5da000640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fe5d406dd40 con 0x7fe5d4152a30 2024-03-28T12:41:14.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.291+0000 7fe5da000640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fe5d406e300 con 0x7fe5d4152650 2024-03-28T12:41:14.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.291+0000 7fe5d8c00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe5d4152650 0x7fe5d406e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:14.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.291+0000 7fe5d8c00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe5d4152650 0x7fe5d406e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:36252/0 (socket says 172.21.15.76:36252) 2024-03-28T12:41:14.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.291+0000 7fe5d8c00640 1 -- 172.21.15.76:0/3423828462 learned_addr learned my addr 172.21.15.76:0/3423828462 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:14.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.295+0000 7fe5d8c00640 1 -- 172.21.15.76:0/3423828462 >> v2:172.21.15.76:3300/0 conn(0x7fe5d4152a30 msgr2=0x7fe5d4072030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:14.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.295+0000 7fe5d8c00640 1 --2- 172.21.15.76:0/3423828462 >> v2:172.21.15.76:3300/0 conn(0x7fe5d4152a30 0x7fe5d4072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:14.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.295+0000 7fe5d8c00640 1 -- 172.21.15.76:0/3423828462 >> v1:172.21.15.76:6789/0 conn(0x7fe5d4072570 legacy=0x7fe5d40c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:14.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.295+0000 7fe5d8c00640 1 -- 172.21.15.76:0/3423828462 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d4158a00 con 0x7fe5d4152650 2024-03-28T12:41:14.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.303+0000 7fe5d8c00640 1 --2- 172.21.15.76:0/3423828462 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5d4152650 0x7fe5d406e790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe5d406dec0 tx=0x7fe5c801c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e16e6bc4ab146dac server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:14.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.307+0000 7fe5d3400640 1 -- 172.21.15.76:0/3423828462 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c80aa610 con 0x7fe5d4152650 2024-03-28T12:41:14.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.307+0000 7fe5d3400640 1 -- 172.21.15.76:0/3423828462 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c80af070 con 0x7fe5d4152650 2024-03-28T12:41:14.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.307+0000 7fe5d3400640 1 -- 172.21.15.76:0/3423828462 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c80aa9d0 con 0x7fe5d4152650 2024-03-28T12:41:14.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.307+0000 7fe5da000640 1 -- 172.21.15.76:0/3423828462 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5d4152650 msgr2=0x7fe5d406e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:14.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.307+0000 7fe5da000640 1 --2- 172.21.15.76:0/3423828462 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5d4152650 0x7fe5d406e790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe5d406dec0 tx=0x7fe5c801c4b0 comp rx=0 tx=0).stop 2024-03-28T12:41:14.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.307+0000 7fe5da000640 1 -- 172.21.15.76:0/3423828462 shutdown_connections 2024-03-28T12:41:14.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.307+0000 7fe5da000640 1 --2- 172.21.15.76:0/3423828462 >> v2:172.21.15.76:3300/0 conn(0x7fe5d4152a30 0x7fe5d4072030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:14.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.307+0000 7fe5da000640 1 --2- 172.21.15.76:0/3423828462 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5d4152650 0x7fe5d406e790 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:14.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.307+0000 7fe5da000640 1 -- 172.21.15.76:0/3423828462 >> 172.21.15.76:0/3423828462 conn(0x7fe5d406fa90 msgr2=0x7fe5d406fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:14.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.307+0000 7fe5da000640 1 -- 172.21.15.76:0/3423828462 shutdown_connections 2024-03-28T12:41:14.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.307+0000 7fe5da000640 1 -- 172.21.15.76:0/3423828462 wait complete. 2024-03-28T12:41:14.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.311+0000 7fe5da000640 1 Processor -- start 2024-03-28T12:41:14.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.311+0000 7fe5da000640 1 -- start start 2024-03-28T12:41:14.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.311+0000 7fe5da000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe5d4072570 0x7fe5d40c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:14.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.311+0000 7fe5da000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5d4152650 0x7fe5d4151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:14.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.311+0000 7fe5da000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5d4152a30 0x7fe5d4146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:14.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.311+0000 7fe5da000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d40c9140 con 0x7fe5d4152650 2024-03-28T12:41:14.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.311+0000 7fe5da000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d406df90 con 0x7fe5d4152a30 2024-03-28T12:41:14.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.311+0000 7fe5da000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d40c92c0 con 0x7fe5d4072570 2024-03-28T12:41:14.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.311+0000 7fe5d8c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe5d4072570 0x7fe5d40c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:14.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.315+0000 7fe5d8c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe5d4072570 0x7fe5d40c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:39408/0 (socket says 172.21.15.76:39408) 2024-03-28T12:41:14.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.315+0000 7fe5d8c00640 1 -- 172.21.15.76:0/4087131935 learned_addr learned my addr 172.21.15.76:0/4087131935 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:14.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.315+0000 7fe5d9600640 1 --2- 172.21.15.76:0/4087131935 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5d4152a30 0x7fe5d4146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:14.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.323+0000 7fe5d8c00640 1 -- 172.21.15.76:0/4087131935 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5d4152a30 msgr2=0x7fe5d4146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:14.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.323+0000 7fe5d8c00640 1 --2- 172.21.15.76:0/4087131935 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5d4152a30 0x7fe5d4146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:14.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.327+0000 7fe5d8c00640 1 -- 172.21.15.76:0/4087131935 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5d4152650 msgr2=0x7fe5d4151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:14.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.327+0000 7fe5d8c00640 1 --2- 172.21.15.76:0/4087131935 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5d4152650 0x7fe5d4151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:14.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.327+0000 7fe5d8c00640 1 -- 172.21.15.76:0/4087131935 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d40c1450 con 0x7fe5d4072570 2024-03-28T12:41:14.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.331+0000 7fe5d8c00640 1 --2- 172.21.15.76:0/4087131935 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe5d4072570 0x7fe5d40c4d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80ac040 tx=0x7fe5c801acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:14.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.339+0000 7fe5d0c00640 1 -- 172.21.15.76:0/4087131935 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c80b3800 con 0x7fe5d4072570 2024-03-28T12:41:14.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.339+0000 7fe5d0c00640 1 -- 172.21.15.76:0/4087131935 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c80b39c0 con 0x7fe5d4072570 2024-03-28T12:41:14.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.339+0000 7fe5d0c00640 1 -- 172.21.15.76:0/4087131935 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c80b3db0 con 0x7fe5d4072570 2024-03-28T12:41:14.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.339+0000 7fe5da000640 1 -- 172.21.15.76:0/4087131935 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d40c1730 con 0x7fe5d4072570 2024-03-28T12:41:14.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.339+0000 7fe5da000640 1 -- 172.21.15.76:0/4087131935 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d4146560 con 0x7fe5d4072570 2024-03-28T12:41:14.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.343+0000 7fe5da000640 1 -- 172.21.15.76:0/4087131935 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d406c5b0 con 0x7fe5d4072570 2024-03-28T12:41:14.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.491+0000 7fe5d0c00640 1 -- 172.21.15.76:0/4087131935 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 2) ==== 43943+0+0 (secure 0 0 0) 0x7fe5c80bd3f0 con 0x7fe5d4072570 2024-03-28T12:41:14.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.491+0000 7fe5d0c00640 1 -- 172.21.15.76:0/4087131935 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fe5c80bc550 con 0x7fe5d4072570 2024-03-28T12:41:14.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.499+0000 7fe5d0c00640 1 -- 172.21.15.76:0/4087131935 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe5c80c3060 con 0x7fe5d4072570 2024-03-28T12:41:14.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.555+0000 7fe5da000640 1 -- 172.21.15.76:0/4087131935 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5d40686e0 con 0x7fe5d4072570 2024-03-28T12:41:14.762 INFO:tasks.ceph.osd.5.smithi111.stderr:2024-03-28T12:41:14.761+0000 7f228f9a87c0 -1 Falling back to public interface 2024-03-28T12:41:14.774 INFO:tasks.ceph.osd.4.smithi111.stderr:2024-03-28T12:41:14.773+0000 7ffba302f7c0 -1 Falling back to public interface 2024-03-28T12:41:14.774 INFO:tasks.ceph.osd.7.smithi111.stderr:2024-03-28T12:41:14.773+0000 7f4581c467c0 -1 Falling back to public interface 2024-03-28T12:41:14.790 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-03-28T12:41:14.789+0000 7f3d3fa9c7c0 -1 Falling back to public interface 2024-03-28T12:41:14.801 INFO:tasks.ceph.osd.2.smithi076.stderr:2024-03-28T12:41:14.803+0000 7f439a84f7c0 -1 Falling back to public interface 2024-03-28T12:41:14.805 INFO:tasks.ceph.osd.3.smithi076.stderr:2024-03-28T12:41:14.807+0000 7f02a73517c0 -1 Falling back to public interface 2024-03-28T12:41:14.814 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:14.815+0000 7fea36600640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-28T12:41:14.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.819+0000 7fe5d0c00640 1 -- 172.21.15.76:0/4087131935 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mgrmap(e 3) ==== 87641+0+0 (secure 0 0 0) 0x7fe5c80bd8d0 con 0x7fe5d4072570 2024-03-28T12:41:14.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.823+0000 7fe5d0c00640 1 --2- 172.21.15.76:0/4087131935 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe5b4068450 0x7fe5b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:14.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.823+0000 7fe5d3e00640 1 --2- 172.21.15.76:0/4087131935 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe5b4068450 0x7fe5b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:14.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:14.823+0000 7fe5d3e00640 1 --2- 172.21.15.76:0/4087131935 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe5b4068450 0x7fe5b406a840 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe5d414fd20 tx=0x7fe5c0006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:14.826 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-03-28T12:41:14.827+0000 7efe0e0247c0 -1 Falling back to public interface 2024-03-28T12:41:14.938 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T12:41:14.939+0000 7fea36600640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-28T12:41:15.006 INFO:tasks.ceph.osd.1.smithi076.stderr:2024-03-28T12:41:15.007+0000 7fb3497b67c0 -1 Falling back to public interface 2024-03-28T12:41:15.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:15.107+0000 7fe5d0c00640 1 -- 172.21.15.76:0/4087131935 <== mon.2 v2:172.21.15.111:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fe5c80a7070 con 0x7fe5d4072570 2024-03-28T12:41:15.106 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:41:15.106 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":10,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:41:13.906798+0000","last_up_change":"0.000000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:41:15.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:15.107+0000 7fe5da000640 1 -- 172.21.15.76:0/4087131935 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe5b4068450 msgr2=0x7fe5b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:15.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:15.107+0000 7fe5da000640 1 --2- 172.21.15.76:0/4087131935 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe5b4068450 0x7fe5b406a840 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe5d414fd20 tx=0x7fe5c0006ca0 comp rx=0 tx=0).stop 2024-03-28T12:41:15.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:15.107+0000 7fe5da000640 1 -- 172.21.15.76:0/4087131935 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe5d4072570 msgr2=0x7fe5d40c4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:15.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:15.107+0000 7fe5da000640 1 --2- 172.21.15.76:0/4087131935 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe5d4072570 0x7fe5d40c4d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80ac040 tx=0x7fe5c801acf0 comp rx=0 tx=0).stop 2024-03-28T12:41:15.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:15.107+0000 7fe5da000640 1 -- 172.21.15.76:0/4087131935 shutdown_connections 2024-03-28T12:41:15.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:15.107+0000 7fe5da000640 1 --2- 172.21.15.76:0/4087131935 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe5b4068450 0x7fe5b406a840 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:15.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:15.107+0000 7fe5da000640 1 --2- 172.21.15.76:0/4087131935 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe5d4152a30 0x7fe5d4146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:15.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:15.107+0000 7fe5da000640 1 --2- 172.21.15.76:0/4087131935 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe5d4152650 0x7fe5d4151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:15.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:15.107+0000 7fe5da000640 1 --2- 172.21.15.76:0/4087131935 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe5d4072570 0x7fe5d40c4d80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:15.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:15.107+0000 7fe5da000640 1 -- 172.21.15.76:0/4087131935 >> 172.21.15.76:0/4087131935 conn(0x7fe5d406fa90 msgr2=0x7fe5d40cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:15.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:15.107+0000 7fe5da000640 1 -- 172.21.15.76:0/4087131935 shutdown_connections 2024-03-28T12:41:15.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:15.107+0000 7fe5da000640 1 -- 172.21.15.76:0/4087131935 wait complete. 2024-03-28T12:41:15.125 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-28T12:41:15.125 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-28T12:41:15.931 DEBUG:teuthology.orchestra.run.smithi076:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-28T12:41:16.057 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.059+0000 7f29b6600640 1 Processor -- start 2024-03-28T12:41:16.057 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.059+0000 7f29b6600640 1 -- start start 2024-03-28T12:41:16.058 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.059+0000 7f29b6600640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f29b0154990 0x7f29b006cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:16.058 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.059+0000 7f29b6600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f29b006c950 0x7f29b01650f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:16.059 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.059+0000 7f29b6600640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b015b740 con 0x7f29b006d3e0 2024-03-28T12:41:16.059 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.059+0000 7f29b6600640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f29b00c90f0 con 0x7f29b0154990 2024-03-28T12:41:16.059 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.059+0000 7f29b6600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f29b015a980 con 0x7f29b006c950 2024-03-28T12:41:16.059 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.059+0000 7f29af400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f29b0154990 0x7f29b006cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:16.059 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.059+0000 7f29afe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f29b006c950 0x7f29b01650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:16.059 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.059+0000 7f29aea00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f29b006d3e0 0x7f29b00cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:51796/0 (socket says 172.21.15.76:51796) 2024-03-28T12:41:16.060 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.059+0000 7f29aea00640 1 -- 172.21.15.76:0/2660027173 learned_addr learned my addr 172.21.15.76:0/2660027173 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:41:16.062 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.063+0000 7f29af400640 1 -- 172.21.15.76:0/2660027173 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f29b006c950 msgr2=0x7f29b01650f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:16.062 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.063+0000 7f29af400640 1 --2- 172.21.15.76:0/2660027173 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f29b006c950 0x7f29b01650f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:16.062 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.063+0000 7f29af400640 1 -- 172.21.15.76:0/2660027173 >> v1:172.21.15.76:6789/0 conn(0x7f29b006d3e0 legacy=0x7f29b00cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:16.062 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.063+0000 7f29af400640 1 -- 172.21.15.76:0/2660027173 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b015ac60 con 0x7f29b0154990 2024-03-28T12:41:16.067 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.067+0000 7f29af400640 1 --2- 172.21.15.76:0/2660027173 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b0154990 0x7f29b006cea0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f29a00097c0 tx=0x7f29a001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7be2124c819d53 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:16.070 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.071+0000 7f29ae000640 1 -- 172.21.15.76:0/2660027173 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a00b5070 con 0x7f29b0154990 2024-03-28T12:41:16.070 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.071+0000 7f29ae000640 1 -- 172.21.15.76:0/2660027173 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a00a8990 con 0x7f29b0154990 2024-03-28T12:41:16.071 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.071+0000 7f29ae000640 1 -- 172.21.15.76:0/2660027173 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a00a8d60 con 0x7f29b0154990 2024-03-28T12:41:16.071 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.071+0000 7f29b6600640 1 -- 172.21.15.76:0/2660027173 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b0154990 msgr2=0x7f29b006cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:16.071 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.071+0000 7f29b6600640 1 --2- 172.21.15.76:0/2660027173 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b0154990 0x7f29b006cea0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f29a00097c0 tx=0x7f29a001ec90 comp rx=0 tx=0).stop 2024-03-28T12:41:16.071 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.071+0000 7f29b6600640 1 -- 172.21.15.76:0/2660027173 shutdown_connections 2024-03-28T12:41:16.072 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.071+0000 7f29b6600640 1 --2- 172.21.15.76:0/2660027173 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f29b006c950 0x7f29b01650f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:16.072 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.071+0000 7f29b6600640 1 --2- 172.21.15.76:0/2660027173 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b0154990 0x7f29b006cea0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:16.072 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.071+0000 7f29b6600640 1 -- 172.21.15.76:0/2660027173 >> 172.21.15.76:0/2660027173 conn(0x7f29b006b620 msgr2=0x7f29b006ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:16.072 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.071+0000 7f29b6600640 1 -- 172.21.15.76:0/2660027173 shutdown_connections 2024-03-28T12:41:16.072 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.071+0000 7f29b6600640 1 -- 172.21.15.76:0/2660027173 wait complete. 2024-03-28T12:41:16.073 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.075+0000 7f29b6600640 1 Processor -- start 2024-03-28T12:41:16.073 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.075+0000 7f29b6600640 1 -- start start 2024-03-28T12:41:16.074 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.075+0000 7f29b6600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b006c950 0x7f29b01f08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:16.074 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.075+0000 7f29b6600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29b006d3e0 0x7f29b00cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:16.074 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.075+0000 7f29b6600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f29b0154990 0x7f29b01e2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:16.074 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.075+0000 7f29b6600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f29b00c8d90 con 0x7f29b006c950 2024-03-28T12:41:16.075 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.075+0000 7f29b6600640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f29b015b220 con 0x7f29b006d3e0 2024-03-28T12:41:16.075 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.075+0000 7f29b6600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f29b0154d70 con 0x7f29b0154990 2024-03-28T12:41:16.075 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.075+0000 7f29af400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b006c950 0x7f29b01f08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:16.075 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.075+0000 7f29af400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b006c950 0x7f29b01f08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53544/0 (socket says 172.21.15.76:53544) 2024-03-28T12:41:16.075 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.075+0000 7f29af400640 1 -- 172.21.15.76:0/3025812557 learned_addr learned my addr 172.21.15.76:0/3025812557 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:16.075 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.075+0000 7f29afe00640 1 --2- 172.21.15.76:0/3025812557 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f29b0154990 0x7f29b01e2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:16.076 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.075+0000 7f29aea00640 1 --2- 172.21.15.76:0/3025812557 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29b006d3e0 0x7f29b00cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:16.078 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.079+0000 7f29af400640 1 -- 172.21.15.76:0/3025812557 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f29b0154990 msgr2=0x7f29b01e2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:16.078 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.079+0000 7f29af400640 1 --2- 172.21.15.76:0/3025812557 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f29b0154990 0x7f29b01e2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:16.079 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.079+0000 7f29af400640 1 -- 172.21.15.76:0/3025812557 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29b006d3e0 msgr2=0x7f29b00cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:16.079 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.079+0000 7f29af400640 1 --2- 172.21.15.76:0/3025812557 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29b006d3e0 0x7f29b00cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:16.079 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.079+0000 7f29af400640 1 -- 172.21.15.76:0/3025812557 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b01f4400 con 0x7f29b006c950 2024-03-28T12:41:16.081 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.083+0000 7f29af400640 1 --2- 172.21.15.76:0/3025812557 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b006c950 0x7f29b01f08e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f29a001b8a0 tx=0x7f29a001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:16.084 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.083+0000 7f29a7400640 1 -- 172.21.15.76:0/3025812557 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a00bf070 con 0x7f29b006c950 2024-03-28T12:41:16.084 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.083+0000 7f29a7400640 1 -- 172.21.15.76:0/3025812557 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a00b0700 con 0x7f29b006c950 2024-03-28T12:41:16.084 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.083+0000 7f29a7400640 1 -- 172.21.15.76:0/3025812557 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a00b5040 con 0x7f29b006c950 2024-03-28T12:41:16.084 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.083+0000 7f29b6600640 1 -- 172.21.15.76:0/3025812557 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b01f46e0 con 0x7f29b006c950 2024-03-28T12:41:16.084 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.083+0000 7f29b6600640 1 -- 172.21.15.76:0/3025812557 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b01f4ca0 con 0x7f29b006c950 2024-03-28T12:41:16.085 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.087+0000 7f29b6600640 1 -- 172.21.15.76:0/3025812557 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b00756f0 con 0x7f29b006c950 2024-03-28T12:41:16.102 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.103+0000 7f29a7400640 1 -- 172.21.15.76:0/3025812557 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 4) ==== 87747+0+0 (secure 0 0 0) 0x7f29a00b0ad0 con 0x7f29b006c950 2024-03-28T12:41:16.103 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.103+0000 7f29a7400640 1 --2- 172.21.15.76:0/3025812557 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2990067f80 0x7f299006a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:16.103 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.103+0000 7f29aea00640 1 --2- 172.21.15.76:0/3025812557 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2990067f80 0x7f299006a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:16.104 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.103+0000 7f29aea00640 1 --2- 172.21.15.76:0/3025812557 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2990067f80 0x7f299006a440 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f29b01e1df0 tx=0x7f299c007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:16.341 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.343+0000 7f29a7400640 1 -- 172.21.15.76:0/3025812557 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f29a00f1e70 con 0x7f29b006c950 2024-03-28T12:41:16.341 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.343+0000 7f29a7400640 1 -- 172.21.15.76:0/3025812557 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f29a00c8080 con 0x7f29b006c950 2024-03-28T12:41:16.500 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.499+0000 7f29b6600640 1 -- 172.21.15.76:0/3025812557 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29b00caa30 con 0x7f29b006c950 2024-03-28T12:41:16.543 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.543+0000 7f29a7400640 1 -- 172.21.15.76:0/3025812557 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f29a00187f0 con 0x7f29b006c950 2024-03-28T12:41:16.543 INFO:teuthology.misc.health.smithi076.stdout: 2024-03-28T12:41:16.543 INFO:teuthology.misc.health.smithi076.stdout:{"epoch":10,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:41:13.906798+0000","last_up_change":"0.000000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:41:16.545 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.547+0000 7f29b6600640 1 -- 172.21.15.76:0/3025812557 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2990067f80 msgr2=0x7f299006a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:16.545 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.547+0000 7f29b6600640 1 --2- 172.21.15.76:0/3025812557 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2990067f80 0x7f299006a440 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f29b01e1df0 tx=0x7f299c007e90 comp rx=0 tx=0).stop 2024-03-28T12:41:16.545 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.547+0000 7f29b6600640 1 -- 172.21.15.76:0/3025812557 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b006c950 msgr2=0x7f29b01f08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:16.545 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.547+0000 7f29b6600640 1 --2- 172.21.15.76:0/3025812557 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b006c950 0x7f29b01f08e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f29a001b8a0 tx=0x7f29a001ba30 comp rx=0 tx=0).stop 2024-03-28T12:41:16.546 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.547+0000 7f29b6600640 1 -- 172.21.15.76:0/3025812557 shutdown_connections 2024-03-28T12:41:16.546 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.547+0000 7f29b6600640 1 --2- 172.21.15.76:0/3025812557 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2990067f80 0x7f299006a440 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:16.546 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.547+0000 7f29b6600640 1 --2- 172.21.15.76:0/3025812557 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f29b0154990 0x7f29b01e2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:16.546 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.547+0000 7f29b6600640 1 --2- 172.21.15.76:0/3025812557 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f29b006d3e0 0x7f29b00cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:16.546 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.547+0000 7f29b6600640 1 --2- 172.21.15.76:0/3025812557 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f29b006c950 0x7f29b01f08e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:16.546 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.547+0000 7f29b6600640 1 -- 172.21.15.76:0/3025812557 >> 172.21.15.76:0/3025812557 conn(0x7f29b006b620 msgr2=0x7f29b014ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:16.546 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.547+0000 7f29b6600640 1 -- 172.21.15.76:0/3025812557 shutdown_connections 2024-03-28T12:41:16.546 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:16.547+0000 7f29b6600640 1 -- 172.21.15.76:0/3025812557 wait complete. 2024-03-28T12:41:16.562 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-28T12:41:18.525 INFO:tasks.ceph.osd.5.smithi111.stderr:2024-03-28T12:41:18.521+0000 7f228f9a87c0 -1 osd.5 0 log_to_monitors true 2024-03-28T12:41:18.613 INFO:tasks.ceph.osd.3.smithi076.stderr:2024-03-28T12:41:18.615+0000 7f02a73517c0 -1 osd.3 0 log_to_monitors true 2024-03-28T12:41:18.642 INFO:tasks.ceph.osd.7.smithi111.stderr:2024-03-28T12:41:18.641+0000 7f4581c467c0 -1 osd.7 0 log_to_monitors true 2024-03-28T12:41:18.687 INFO:tasks.ceph.osd.2.smithi076.stderr:2024-03-28T12:41:18.687+0000 7f439a84f7c0 -1 osd.2 0 log_to_monitors true 2024-03-28T12:41:18.726 INFO:tasks.ceph.osd.4.smithi111.stderr:2024-03-28T12:41:18.725+0000 7ffba302f7c0 -1 osd.4 0 log_to_monitors true 2024-03-28T12:41:18.750 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-03-28T12:41:18.751+0000 7efe0e0247c0 -1 osd.0 0 log_to_monitors true 2024-03-28T12:41:18.760 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-03-28T12:41:18.757+0000 7f3d3fa9c7c0 -1 osd.6 0 log_to_monitors true 2024-03-28T12:41:18.837 INFO:tasks.ceph.osd.1.smithi076.stderr:2024-03-28T12:41:18.839+0000 7fb3497b67c0 -1 osd.1 0 log_to_monitors true 2024-03-28T12:41:20.501 INFO:tasks.ceph.osd.5.smithi111.stderr:2024-03-28T12:41:20.497+0000 7f228b951640 -1 osd.5 0 waiting for initial osdmap 2024-03-28T12:41:20.579 INFO:tasks.ceph.osd.5.smithi111.stderr:2024-03-28T12:41:20.577+0000 7f2283785640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T12:41:20.599 INFO:tasks.ceph.osd.3.smithi076.stderr:2024-03-28T12:41:20.599+0000 7f02a2200640 -1 osd.3 0 waiting for initial osdmap 2024-03-28T12:41:20.722 INFO:tasks.ceph.osd.3.smithi076.stderr:2024-03-28T12:41:20.723+0000 7f0298200640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T12:41:22.113 INFO:tasks.ceph.osd.7.smithi111.stderr:2024-03-28T12:41:22.113+0000 7f457e401640 -1 osd.7 0 waiting for initial osdmap 2024-03-28T12:41:22.143 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-03-28T12:41:22.141+0000 7f3d3ba45640 -1 osd.6 0 waiting for initial osdmap 2024-03-28T12:41:22.174 INFO:tasks.ceph.osd.4.smithi111.stderr:2024-03-28T12:41:22.173+0000 7ffb9efd8640 -1 osd.4 0 waiting for initial osdmap 2024-03-28T12:41:22.182 INFO:tasks.ceph.osd.7.smithi111.stderr:2024-03-28T12:41:22.181+0000 7f4575a23640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T12:41:22.190 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-03-28T12:41:22.189+0000 7f3d33879640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T12:41:22.222 INFO:tasks.ceph.osd.4.smithi111.stderr:2024-03-28T12:41:22.221+0000 7ffb96e0c640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T12:41:22.338 INFO:tasks.ceph.osd.2.smithi076.stderr:2024-03-28T12:41:22.339+0000 7f4396200640 -1 osd.2 0 waiting for initial osdmap 2024-03-28T12:41:22.352 INFO:tasks.ceph.osd.1.smithi076.stderr:2024-03-28T12:41:22.355+0000 7fb344600640 -1 osd.1 0 waiting for initial osdmap 2024-03-28T12:41:22.456 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-03-28T12:41:22.455+0000 7efe09800640 -1 osd.0 0 waiting for initial osdmap 2024-03-28T12:41:22.461 INFO:tasks.ceph.osd.2.smithi076.stderr:2024-03-28T12:41:22.463+0000 7f438b800640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T12:41:22.477 INFO:tasks.ceph.osd.1.smithi076.stderr:2024-03-28T12:41:22.479+0000 7fb33a600640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T12:41:22.533 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-03-28T12:41:22.535+0000 7efdfee00640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-28T12:41:23.368 DEBUG:teuthology.orchestra.run.smithi076:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-28T12:41:23.506 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.507+0000 7f20ba200640 1 Processor -- start 2024-03-28T12:41:23.506 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.507+0000 7f20ba200640 1 -- start start 2024-03-28T12:41:23.507 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.507+0000 7f20ba200640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f20b406f8e0 0x7f20b40c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:23.507 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.507+0000 7f20ba200640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20b415be80 con 0x7f20b4152b00 2024-03-28T12:41:23.507 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.507+0000 7f20ba200640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20b415c160 con 0x7f20b4152720 2024-03-28T12:41:23.507 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.507+0000 7f20ba200640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f20b415c440 con 0x7f20b406f8e0 2024-03-28T12:41:23.508 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.507+0000 7f20b9800640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f20b406f8e0 0x7f20b40c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:23.508 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.511+0000 7f20b9800640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f20b406f8e0 0x7f20b40c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:48280/0 (socket says 172.21.15.76:48280) 2024-03-28T12:41:23.508 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.511+0000 7f20b9800640 1 -- 172.21.15.76:0/533117039 learned_addr learned my addr 172.21.15.76:0/533117039 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:23.511 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.511+0000 7f20b9800640 1 -- 172.21.15.76:0/533117039 >> v1:172.21.15.111:6789/0 conn(0x7f20b4152720 legacy=0x7f20b40c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:23.511 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.511+0000 7f20b9800640 1 -- 172.21.15.76:0/533117039 >> v1:172.21.15.76:6789/0 conn(0x7f20b4152b00 legacy=0x7f20b40c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:23.511 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.511+0000 7f20b9800640 1 -- 172.21.15.76:0/533117039 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b415c720 con 0x7f20b406f8e0 2024-03-28T12:41:23.518 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.519+0000 7f20b9800640 1 --2- 172.21.15.76:0/533117039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b406f8e0 0x7f20b40c8c20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f20ac009e50 tx=0x7f20ac01f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10e5cbf379cae1df server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:23.526 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.527+0000 7f20b3400640 1 -- 172.21.15.76:0/533117039 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0b4070 con 0x7f20b406f8e0 2024-03-28T12:41:23.526 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.527+0000 7f20b3400640 1 -- 172.21.15.76:0/533117039 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ac0af400 con 0x7f20b406f8e0 2024-03-28T12:41:23.527 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.527+0000 7f20b3400640 1 -- 172.21.15.76:0/533117039 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0af7d0 con 0x7f20b406f8e0 2024-03-28T12:41:23.527 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.527+0000 7f20ba200640 1 -- 172.21.15.76:0/533117039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b406f8e0 msgr2=0x7f20b40c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:23.527 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.527+0000 7f20ba200640 1 --2- 172.21.15.76:0/533117039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b406f8e0 0x7f20b40c8c20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f20ac009e50 tx=0x7f20ac01f1e0 comp rx=0 tx=0).stop 2024-03-28T12:41:23.528 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.527+0000 7f20ba200640 1 -- 172.21.15.76:0/533117039 shutdown_connections 2024-03-28T12:41:23.528 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.527+0000 7f20ba200640 1 --2- 172.21.15.76:0/533117039 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b406f8e0 0x7f20b40c8c20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:23.528 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.527+0000 7f20ba200640 1 -- 172.21.15.76:0/533117039 >> 172.21.15.76:0/533117039 conn(0x7f20b4070b70 msgr2=0x7f20b4070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:23.528 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.527+0000 7f20ba200640 1 -- 172.21.15.76:0/533117039 shutdown_connections 2024-03-28T12:41:23.528 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.527+0000 7f20ba200640 1 -- 172.21.15.76:0/533117039 wait complete. 2024-03-28T12:41:23.529 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.531+0000 7f20ba200640 1 Processor -- start 2024-03-28T12:41:23.529 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.531+0000 7f20ba200640 1 -- start start 2024-03-28T12:41:23.530 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.531+0000 7f20ba200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20b406f8e0 0x7f20b414fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:23.530 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.531+0000 7f20ba200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b4152720 0x7f20b4151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:23.531 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.531+0000 7f20ba200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b4152b00 0x7f20b41f3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:23.531 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.531+0000 7f20ba200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f20b415bb40 con 0x7f20b406f8e0 2024-03-28T12:41:23.531 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.531+0000 7f20ba200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f20b40c8700 con 0x7f20b4152720 2024-03-28T12:41:23.531 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.531+0000 7f20ba200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f20b40c9f60 con 0x7f20b4152b00 2024-03-28T12:41:23.532 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.531+0000 7f20b3e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b4152720 0x7f20b4151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:23.532 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.531+0000 7f20b9800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b4152b00 0x7f20b41f3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:23.533 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.531+0000 7f20b3e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b4152720 0x7f20b4151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:48286/0 (socket says 172.21.15.76:48286) 2024-03-28T12:41:23.533 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.531+0000 7f20b3e00640 1 -- 172.21.15.76:0/3146501368 learned_addr learned my addr 172.21.15.76:0/3146501368 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:23.538 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.539+0000 7f20b9800640 1 -- 172.21.15.76:0/3146501368 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b4152720 msgr2=0x7f20b4151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:23.538 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.539+0000 7f20b9800640 1 --2- 172.21.15.76:0/3146501368 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b4152720 0x7f20b4151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:23.538 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.539+0000 7f20b9800640 1 -- 172.21.15.76:0/3146501368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20b406f8e0 msgr2=0x7f20b414fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:23.538 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.539+0000 7f20b9800640 1 --2- 172.21.15.76:0/3146501368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20b406f8e0 0x7f20b414fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:23.538 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.539+0000 7f20b9800640 1 -- 172.21.15.76:0/3146501368 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b4150200 con 0x7f20b4152b00 2024-03-28T12:41:23.542 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.543+0000 7f20b9800640 1 --2- 172.21.15.76:0/3146501368 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b4152b00 0x7f20b41f3a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0ae000 tx=0x7f20ac01bf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:23.565 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.563+0000 7f20b0c00640 1 -- 172.21.15.76:0/3146501368 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0b4040 con 0x7f20b4152b00 2024-03-28T12:41:23.565 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.563+0000 7f20b0c00640 1 -- 172.21.15.76:0/3146501368 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ac0afd30 con 0x7f20b4152b00 2024-03-28T12:41:23.565 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.563+0000 7f20b0c00640 1 -- 172.21.15.76:0/3146501368 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0ba470 con 0x7f20b4152b00 2024-03-28T12:41:23.565 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.567+0000 7f20ba200640 1 -- 172.21.15.76:0/3146501368 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b40c2990 con 0x7f20b4152b00 2024-03-28T12:41:23.565 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.567+0000 7f20ba200640 1 -- 172.21.15.76:0/3146501368 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b414ef00 con 0x7f20b4152b00 2024-03-28T12:41:23.565 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.567+0000 7f20ba200640 1 -- 172.21.15.76:0/3146501368 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20b40756f0 con 0x7f20b4152b00 2024-03-28T12:41:23.979 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.979+0000 7f20b0c00640 1 -- 172.21.15.76:0/3146501368 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 4) ==== 87747+0+0 (secure 0 0 0) 0x7f20ac0c3030 con 0x7f20b4152b00 2024-03-28T12:41:23.980 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.979+0000 7f20b0c00640 1 --2- 172.21.15.76:0/3146501368 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2094067f80 0x7f209406a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:23.980 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.983+0000 7f20b8e00640 1 --2- 172.21.15.76:0/3146501368 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2094067f80 0x7f209406a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:23.981 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.983+0000 7f20b8e00640 1 --2- 172.21.15.76:0/3146501368 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2094067f80 0x7f209406a440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f20a8000f70 tx=0x7f20a80079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:23.996 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:23.999+0000 7f20b0c00640 1 -- 172.21.15.76:0/3146501368 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(15..15 src has 1..15) ==== 4471+0+0 (secure 0 0 0) 0x7f20ac002020 con 0x7f20b4152b00 2024-03-28T12:41:24.029 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:24.027+0000 7f20b0c00640 1 -- 172.21.15.76:0/3146501368 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f20ac0ca060 con 0x7f20b4152b00 2024-03-28T12:41:24.209 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:24.211+0000 7f20ba200640 1 -- 172.21.15.76:0/3146501368 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20b40ca2e0 con 0x7f20b4152b00 2024-03-28T12:41:24.258 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:24.259+0000 7f20b0c00640 1 -- 172.21.15.76:0/3146501368 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+10955 (secure 0 0 0) 0x7f20ac018d40 con 0x7f20b4152b00 2024-03-28T12:41:24.258 INFO:teuthology.misc.health.smithi076.stdout: 2024-03-28T12:41:24.258 INFO:teuthology.misc.health.smithi076.stdout:{"epoch":15,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:41:23.027601+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:41:24.260 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:24.259+0000 7f20ba200640 1 -- 172.21.15.76:0/3146501368 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2094067f80 msgr2=0x7f209406a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:24.260 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:24.259+0000 7f20ba200640 1 --2- 172.21.15.76:0/3146501368 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2094067f80 0x7f209406a440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f20a8000f70 tx=0x7f20a80079c0 comp rx=0 tx=0).stop 2024-03-28T12:41:24.260 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:24.259+0000 7f20ba200640 1 -- 172.21.15.76:0/3146501368 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b4152b00 msgr2=0x7f20b41f3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:24.260 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:24.259+0000 7f20ba200640 1 --2- 172.21.15.76:0/3146501368 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b4152b00 0x7f20b41f3a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f20ac0ae000 tx=0x7f20ac01bf80 comp rx=0 tx=0).stop 2024-03-28T12:41:24.260 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:24.259+0000 7f20ba200640 1 -- 172.21.15.76:0/3146501368 shutdown_connections 2024-03-28T12:41:24.260 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:24.259+0000 7f20ba200640 1 --2- 172.21.15.76:0/3146501368 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2094067f80 0x7f209406a440 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:24.261 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:24.259+0000 7f20ba200640 1 --2- 172.21.15.76:0/3146501368 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b4152b00 0x7f20b41f3a00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:24.261 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:24.259+0000 7f20ba200640 1 --2- 172.21.15.76:0/3146501368 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b4152720 0x7f20b4151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:24.261 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:24.259+0000 7f20ba200640 1 --2- 172.21.15.76:0/3146501368 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f20b406f8e0 0x7f20b414fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:24.261 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:24.259+0000 7f20ba200640 1 -- 172.21.15.76:0/3146501368 >> 172.21.15.76:0/3146501368 conn(0x7f20b4070b70 msgr2=0x7f20b406cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:24.261 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:24.259+0000 7f20ba200640 1 -- 172.21.15.76:0/3146501368 shutdown_connections 2024-03-28T12:41:24.261 INFO:teuthology.misc.health.smithi076.stderr:2024-03-28T12:41:24.259+0000 7f20ba200640 1 -- 172.21.15.76:0/3146501368 wait complete. 2024-03-28T12:41:24.278 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-28T12:41:24.278 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-28T12:41:24.278 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-03-28T12:41:24.278 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-28T12:41:24.279 DEBUG:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-03-28T12:41:24.282 INFO:tasks.ceph.mds.a:Started 2024-03-28T12:41:24.282 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-03-28T12:41:24.282 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-28T12:41:24.282 DEBUG:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-03-28T12:41:24.285 INFO:tasks.ceph.mds.c:Started 2024-03-28T12:41:24.285 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-03-28T12:41:24.285 INFO:tasks.ceph.mds.e:Restarting daemon 2024-03-28T12:41:24.285 DEBUG:teuthology.orchestra.run.smithi076:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-03-28T12:41:24.288 INFO:tasks.ceph.mds.e:Started 2024-03-28T12:41:24.288 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-03-28T12:41:24.288 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-28T12:41:24.289 DEBUG:teuthology.orchestra.run.smithi111:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-03-28T12:41:24.291 INFO:tasks.ceph.mds.b:Started 2024-03-28T12:41:24.291 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-03-28T12:41:24.291 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-28T12:41:24.291 DEBUG:teuthology.orchestra.run.smithi111:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-03-28T12:41:24.294 INFO:tasks.ceph.mds.d:Started 2024-03-28T12:41:24.294 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-03-28T12:41:24.294 INFO:tasks.ceph.mds.f:Restarting daemon 2024-03-28T12:41:24.294 DEBUG:teuthology.orchestra.run.smithi111:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-03-28T12:41:24.296 INFO:tasks.ceph.mds.f:Started 2024-03-28T12:41:24.296 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-28T12:41:24.297 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T12:41:24.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.491+0000 7ff116800640 1 Processor -- start 2024-03-28T12:41:24.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.491+0000 7ff116800640 1 -- start start 2024-03-28T12:41:24.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.491+0000 7ff116800640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff1101516e0 0x7ff110157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:24.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.491+0000 7ff116800640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1100c3eb0 con 0x7ff1100c2070 2024-03-28T12:41:24.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.495+0000 7ff116800640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1100c4190 con 0x7ff1100ccfa0 2024-03-28T12:41:24.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.495+0000 7ff116800640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7ff110158400 con 0x7ff1101516e0 2024-03-28T12:41:24.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.535+0000 7ff10ea00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7ff1100c2070 0x7ff1100700b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:35524/0 (socket says 172.21.15.76:35524) 2024-03-28T12:41:24.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.535+0000 7ff10ea00640 1 -- 172.21.15.76:0/3229868857 learned_addr learned my addr 172.21.15.76:0/3229868857 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:41:24.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.571+0000 7ff10f400640 1 --2- 172.21.15.76:0/3229868857 >> v2:172.21.15.76:3300/0 conn(0x7ff1101516e0 0x7ff110157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:24.579 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.579+0000 7ff10e000640 1 -- 172.21.15.76:0/3229868857 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1554809917 0 0) 0x7ff1100c3eb0 con 0x7ff1100c2070 2024-03-28T12:41:24.579 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.579+0000 7ff10e000640 1 -- 172.21.15.76:0/3229868857 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0f4003530 con 0x7ff1100c2070 2024-03-28T12:41:24.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.583+0000 7ff10f400640 1 -- 172.21.15.76:0/3229868857 >> v1:172.21.15.111:6789/0 conn(0x7ff1100ccfa0 legacy=0x7ff110161d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:24.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.583+0000 7ff10f400640 1 -- 172.21.15.76:0/3229868857 >> v1:172.21.15.76:6789/0 conn(0x7ff1100c2070 legacy=0x7ff1100700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:24.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.583+0000 7ff10f400640 1 -- 172.21.15.76:0/3229868857 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11006f2f0 con 0x7ff1101516e0 2024-03-28T12:41:24.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.615+0000 7ff10f400640 1 --2- 172.21.15.76:0/3229868857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff1101516e0 0x7ff110157ec0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff1000097c0 tx=0x7ff10001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8357daffee2bce server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:24.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.619+0000 7ff10e000640 1 -- 172.21.15.76:0/3229868857 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1000b5070 con 0x7ff1101516e0 2024-03-28T12:41:24.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.619+0000 7ff10e000640 1 -- 172.21.15.76:0/3229868857 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1000a8950 con 0x7ff1101516e0 2024-03-28T12:41:24.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.619+0000 7ff10e000640 1 -- 172.21.15.76:0/3229868857 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1000a8d20 con 0x7ff1101516e0 2024-03-28T12:41:24.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.619+0000 7ff116800640 1 -- 172.21.15.76:0/3229868857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff1101516e0 msgr2=0x7ff110157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:24.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.619+0000 7ff116800640 1 --2- 172.21.15.76:0/3229868857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff1101516e0 0x7ff110157ec0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff1000097c0 tx=0x7ff10001ec50 comp rx=0 tx=0).stop 2024-03-28T12:41:24.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.619+0000 7ff116800640 1 -- 172.21.15.76:0/3229868857 shutdown_connections 2024-03-28T12:41:24.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.619+0000 7ff116800640 1 --2- 172.21.15.76:0/3229868857 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff1101516e0 0x7ff110157ec0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:24.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.619+0000 7ff116800640 1 -- 172.21.15.76:0/3229868857 >> 172.21.15.76:0/3229868857 conn(0x7ff11006c6b0 msgr2=0x7ff11006cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:24.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.619+0000 7ff116800640 1 -- 172.21.15.76:0/3229868857 shutdown_connections 2024-03-28T12:41:24.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.619+0000 7ff116800640 1 -- 172.21.15.76:0/3229868857 wait complete. 2024-03-28T12:41:24.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.623+0000 7ff116800640 1 Processor -- start 2024-03-28T12:41:24.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.623+0000 7ff116800640 1 -- start start 2024-03-28T12:41:24.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.623+0000 7ff116800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff1100c2070 0x7ff1101edf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:24.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.623+0000 7ff116800640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1100ccfa0 0x7ff1101e4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:24.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.623+0000 7ff116800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff1101516e0 0x7ff110142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:24.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.623+0000 7ff116800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff11006fb90 con 0x7ff1101516e0 2024-03-28T12:41:24.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.623+0000 7ff116800640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff11006f8b0 con 0x7ff1100ccfa0 2024-03-28T12:41:24.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.623+0000 7ff116800640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff110151ac0 con 0x7ff1100c2070 2024-03-28T12:41:24.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.623+0000 7ff10fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff1101516e0 0x7ff110142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:24.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.627+0000 7ff10fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff1101516e0 0x7ff110142870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44972/0 (socket says 172.21.15.76:44972) 2024-03-28T12:41:24.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.627+0000 7ff10fe00640 1 -- 172.21.15.76:0/1686065608 learned_addr learned my addr 172.21.15.76:0/1686065608 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:24.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.627+0000 7ff10fe00640 1 -- 172.21.15.76:0/1686065608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff1100c2070 msgr2=0x7ff1101edf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:24.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.627+0000 7ff10fe00640 1 --2- 172.21.15.76:0/1686065608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff1100c2070 0x7ff1101edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:24.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.627+0000 7ff10fe00640 1 -- 172.21.15.76:0/1686065608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1100ccfa0 msgr2=0x7ff1101e4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:24.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.627+0000 7ff10fe00640 1 --2- 172.21.15.76:0/1686065608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1100ccfa0 0x7ff1101e4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:24.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.627+0000 7ff10fe00640 1 -- 172.21.15.76:0/1686065608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1100c6560 con 0x7ff1101516e0 2024-03-28T12:41:24.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.631+0000 7ff10fe00640 1 --2- 172.21.15.76:0/1686065608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff1101516e0 0x7ff110142870 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff10800c7b0 tx=0x7ff10800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:24.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.635+0000 7ff107400640 1 -- 172.21.15.76:0/1686065608 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff108017070 con 0x7ff1101516e0 2024-03-28T12:41:24.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.635+0000 7ff107400640 1 -- 172.21.15.76:0/1686065608 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff108003db0 con 0x7ff1101516e0 2024-03-28T12:41:24.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.635+0000 7ff116800640 1 -- 172.21.15.76:0/1686065608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff110148ac0 con 0x7ff1101516e0 2024-03-28T12:41:24.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.635+0000 7ff107400640 1 -- 172.21.15.76:0/1686065608 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1080052b0 con 0x7ff1101516e0 2024-03-28T12:41:24.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.635+0000 7ff116800640 1 -- 172.21.15.76:0/1686065608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1100c6280 con 0x7ff1101516e0 2024-03-28T12:41:24.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.639+0000 7ff116800640 1 -- 172.21.15.76:0/1686065608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff11006d640 con 0x7ff1101516e0 2024-03-28T12:41:24.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.659+0000 7ff107400640 1 -- 172.21.15.76:0/1686065608 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 4) ==== 87747+0+0 (secure 0 0 0) 0x7ff10801a070 con 0x7ff1101516e0 2024-03-28T12:41:24.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.659+0000 7ff107400640 1 --2- 172.21.15.76:0/1686065608 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff0f0067fb0 0x7ff0f006a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:24.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.659+0000 7ff10f400640 1 --2- 172.21.15.76:0/1686065608 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff0f0067fb0 0x7ff0f006a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:24.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.659+0000 7ff10f400640 1 --2- 172.21.15.76:0/1686065608 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff0f0067fb0 0x7ff0f006a470 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff1000b2000 tx=0x7ff100004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:24.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.911+0000 7ff107400640 1 -- 172.21.15.76:0/1686065608 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4846+0+0 (secure 0 0 0) 0x7ff108054080 con 0x7ff1101516e0 2024-03-28T12:41:24.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:24.911+0000 7ff107400640 1 -- 172.21.15.76:0/1686065608 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ff108021020 con 0x7ff1101516e0 2024-03-28T12:41:25.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.155+0000 7ff116800640 1 -- 172.21.15.76:0/1686065608 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff11006c200 con 0x7ff1101516e0 2024-03-28T12:41:25.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.243+0000 7ff107400640 1 -- 172.21.15.76:0/1686065608 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12888 (secure 0 0 0) 0x7ff1080566e0 con 0x7ff1101516e0 2024-03-28T12:41:25.242 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:41:25.243 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":16,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:41:24.290713+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:41:25.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.247+0000 7ff116800640 1 -- 172.21.15.76:0/1686065608 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff0f0067fb0 msgr2=0x7ff0f006a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:25.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.247+0000 7ff116800640 1 --2- 172.21.15.76:0/1686065608 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff0f0067fb0 0x7ff0f006a470 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff1000b2000 tx=0x7ff100004740 comp rx=0 tx=0).stop 2024-03-28T12:41:25.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.247+0000 7ff116800640 1 -- 172.21.15.76:0/1686065608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff1101516e0 msgr2=0x7ff110142870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:25.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.247+0000 7ff116800640 1 --2- 172.21.15.76:0/1686065608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff1101516e0 0x7ff110142870 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff10800c7b0 tx=0x7ff10800cc70 comp rx=0 tx=0).stop 2024-03-28T12:41:25.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.247+0000 7ff116800640 1 -- 172.21.15.76:0/1686065608 shutdown_connections 2024-03-28T12:41:25.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.247+0000 7ff116800640 1 --2- 172.21.15.76:0/1686065608 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff0f0067fb0 0x7ff0f006a470 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:25.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.247+0000 7ff116800640 1 --2- 172.21.15.76:0/1686065608 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff1101516e0 0x7ff110142870 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:25.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.247+0000 7ff116800640 1 --2- 172.21.15.76:0/1686065608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff1100ccfa0 0x7ff1101e4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:25.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.247+0000 7ff116800640 1 --2- 172.21.15.76:0/1686065608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff1100c2070 0x7ff1101edf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:25.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.247+0000 7ff116800640 1 -- 172.21.15.76:0/1686065608 >> 172.21.15.76:0/1686065608 conn(0x7ff11006c6b0 msgr2=0x7ff1100c2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:25.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.247+0000 7ff116800640 1 -- 172.21.15.76:0/1686065608 shutdown_connections 2024-03-28T12:41:25.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.247+0000 7ff116800640 1 -- 172.21.15.76:0/1686065608 wait complete. 2024-03-28T12:41:25.272 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T12:41:23.389090+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T12:41:25.273 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T12:41:25.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.423+0000 7fde57c00640 1 Processor -- start 2024-03-28T12:41:25.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.423+0000 7fde57c00640 1 -- start start 2024-03-28T12:41:25.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.423+0000 7fde57c00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fde500cea30 0x7fde50071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:25.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.423+0000 7fde57c00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fde50072240 0x7fde500cab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:25.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.427+0000 7fde57c00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde50158680 con 0x7fde50152800 2024-03-28T12:41:25.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.427+0000 7fde57c00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fde50159550 con 0x7fde50072240 2024-03-28T12:41:25.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.427+0000 7fde57c00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fde500cee60 con 0x7fde500cea30 2024-03-28T12:41:25.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.427+0000 7fde4fe00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fde500cea30 0x7fde50071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:25.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.427+0000 7fde55200640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fde50152800 0x7fde500c97e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:57592/0 (socket says 172.21.15.76:57592) 2024-03-28T12:41:25.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.427+0000 7fde55200640 1 -- 172.21.15.76:0/2258338454 learned_addr learned my addr 172.21.15.76:0/2258338454 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:41:25.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.439+0000 7fde4fe00640 1 -- 172.21.15.76:0/2258338454 >> v2:172.21.15.76:3300/0 conn(0x7fde50072240 msgr2=0x7fde500cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:25.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.439+0000 7fde4fe00640 1 --2- 172.21.15.76:0/2258338454 >> v2:172.21.15.76:3300/0 conn(0x7fde50072240 0x7fde500cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:25.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.439+0000 7fde4fe00640 1 -- 172.21.15.76:0/2258338454 >> v1:172.21.15.111:6789/0 conn(0x7fde50152800 legacy=0x7fde500c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:25.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.439+0000 7fde4fe00640 1 -- 172.21.15.76:0/2258338454 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde50158940 con 0x7fde500cea30 2024-03-28T12:41:25.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.447+0000 7fde4fe00640 1 --2- 172.21.15.76:0/2258338454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde500cea30 0x7fde50071d00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fde500c9030 tx=0x7fde3c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5086521c030bac7 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:25.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.455+0000 7fde4f400640 1 -- 172.21.15.76:0/2258338454 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0b1070 con 0x7fde500cea30 2024-03-28T12:41:25.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.455+0000 7fde4f400640 1 -- 172.21.15.76:0/2258338454 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde3c0ac5f0 con 0x7fde500cea30 2024-03-28T12:41:25.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.455+0000 7fde4f400640 1 -- 172.21.15.76:0/2258338454 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0ac9c0 con 0x7fde500cea30 2024-03-28T12:41:25.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.455+0000 7fde57c00640 1 -- 172.21.15.76:0/2258338454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde500cea30 msgr2=0x7fde50071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:25.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.455+0000 7fde57c00640 1 --2- 172.21.15.76:0/2258338454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde500cea30 0x7fde50071d00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fde500c9030 tx=0x7fde3c01c480 comp rx=0 tx=0).stop 2024-03-28T12:41:25.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.455+0000 7fde57c00640 1 -- 172.21.15.76:0/2258338454 shutdown_connections 2024-03-28T12:41:25.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.455+0000 7fde57c00640 1 --2- 172.21.15.76:0/2258338454 >> v2:172.21.15.76:3300/0 conn(0x7fde50072240 0x7fde500cab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:25.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.455+0000 7fde57c00640 1 --2- 172.21.15.76:0/2258338454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde500cea30 0x7fde50071d00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:25.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.455+0000 7fde57c00640 1 -- 172.21.15.76:0/2258338454 >> 172.21.15.76:0/2258338454 conn(0x7fde50071540 msgr2=0x7fde50070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:25.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.455+0000 7fde57c00640 1 -- 172.21.15.76:0/2258338454 shutdown_connections 2024-03-28T12:41:25.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.455+0000 7fde57c00640 1 -- 172.21.15.76:0/2258338454 wait complete. 2024-03-28T12:41:25.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.459+0000 7fde57c00640 1 Processor -- start 2024-03-28T12:41:25.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.459+0000 7fde57c00640 1 -- start start 2024-03-28T12:41:25.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.459+0000 7fde57c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fde50072240 0x7fde500c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:25.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.459+0000 7fde57c00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde500cea30 0x7fde500c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:25.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.459+0000 7fde57c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde50152800 0x7fde50154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:25.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.459+0000 7fde57c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fde500c8d00 con 0x7fde50152800 2024-03-28T12:41:25.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.459+0000 7fde57c00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fde500cb4d0 con 0x7fde500cea30 2024-03-28T12:41:25.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.459+0000 7fde57c00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fde50152be0 con 0x7fde50072240 2024-03-28T12:41:25.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.463+0000 7fde55c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde50152800 0x7fde50154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:25.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.463+0000 7fde55c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde50152800 0x7fde50154e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44984/0 (socket says 172.21.15.76:44984) 2024-03-28T12:41:25.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.463+0000 7fde55c00640 1 -- 172.21.15.76:0/3969504731 learned_addr learned my addr 172.21.15.76:0/3969504731 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:25.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.463+0000 7fde4fe00640 1 --2- 172.21.15.76:0/3969504731 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde500cea30 0x7fde500c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:25.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.463+0000 7fde55200640 1 --2- 172.21.15.76:0/3969504731 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fde50072240 0x7fde500c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:25.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.467+0000 7fde55c00640 1 -- 172.21.15.76:0/3969504731 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fde50072240 msgr2=0x7fde500c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:25.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.467+0000 7fde55c00640 1 --2- 172.21.15.76:0/3969504731 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fde50072240 0x7fde500c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:25.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.467+0000 7fde55c00640 1 -- 172.21.15.76:0/3969504731 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde500cea30 msgr2=0x7fde500c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:25.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.467+0000 7fde55c00640 1 --2- 172.21.15.76:0/3969504731 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde500cea30 0x7fde500c76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:25.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.467+0000 7fde55c00640 1 -- 172.21.15.76:0/3969504731 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde500c7ce0 con 0x7fde50152800 2024-03-28T12:41:25.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.467+0000 7fde55c00640 1 --2- 172.21.15.76:0/3969504731 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde50152800 0x7fde50154e60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fde4800b970 tx=0x7fde4800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:25.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.475+0000 7fde4cc00640 1 -- 172.21.15.76:0/3969504731 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48019070 con 0x7fde50152800 2024-03-28T12:41:25.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.475+0000 7fde4cc00640 1 -- 172.21.15.76:0/3969504731 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde4800cb60 con 0x7fde50152800 2024-03-28T12:41:25.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.475+0000 7fde4cc00640 1 -- 172.21.15.76:0/3969504731 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48014440 con 0x7fde50152800 2024-03-28T12:41:25.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.475+0000 7fde57c00640 1 -- 172.21.15.76:0/3969504731 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde500c7fc0 con 0x7fde50152800 2024-03-28T12:41:25.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.475+0000 7fde57c00640 1 -- 172.21.15.76:0/3969504731 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde50154380 con 0x7fde50152800 2024-03-28T12:41:25.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.475+0000 7fde57c00640 1 -- 172.21.15.76:0/3969504731 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde500c4c60 con 0x7fde50152800 2024-03-28T12:41:25.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.739+0000 7fde4cc00640 1 -- 172.21.15.76:0/3969504731 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 4) ==== 87747+0+0 (secure 0 0 0) 0x7fde4801c070 con 0x7fde50152800 2024-03-28T12:41:25.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.739+0000 7fde4cc00640 1 --2- 172.21.15.76:0/3969504731 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fde30067f80 0x7fde3006a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:25.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.739+0000 7fde55200640 1 --2- 172.21.15.76:0/3969504731 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fde30067f80 0x7fde3006a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:25.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.743+0000 7fde55200640 1 --2- 172.21.15.76:0/3969504731 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fde30067f80 0x7fde3006a440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fde44000f70 tx=0x7fde44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:25.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.755+0000 7fde4cc00640 1 -- 172.21.15.76:0/3969504731 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4846+0+0 (secure 0 0 0) 0x7fde48054800 con 0x7fde50152800 2024-03-28T12:41:25.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.755+0000 7fde4cc00640 1 -- 172.21.15.76:0/3969504731 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fde48023020 con 0x7fde50152800 2024-03-28T12:41:25.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:25.995+0000 7fde57c00640 1 -- 172.21.15.76:0/3969504731 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fde5006eef0 con 0x7fde50152800 2024-03-28T12:41:26.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.095+0000 7fde4cc00640 1 -- 172.21.15.76:0/3969504731 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7fde48056e60 con 0x7fde50152800 2024-03-28T12:41:26.095 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-03-28T12:41:26.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.099+0000 7fde57c00640 1 -- 172.21.15.76:0/3969504731 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fde30067f80 msgr2=0x7fde3006a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:26.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.099+0000 7fde57c00640 1 --2- 172.21.15.76:0/3969504731 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fde30067f80 0x7fde3006a440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fde44000f70 tx=0x7fde44009040 comp rx=0 tx=0).stop 2024-03-28T12:41:26.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.099+0000 7fde57c00640 1 -- 172.21.15.76:0/3969504731 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde50152800 msgr2=0x7fde50154e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:26.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.099+0000 7fde57c00640 1 --2- 172.21.15.76:0/3969504731 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde50152800 0x7fde50154e60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fde4800b970 tx=0x7fde4800be30 comp rx=0 tx=0).stop 2024-03-28T12:41:26.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.099+0000 7fde57c00640 1 -- 172.21.15.76:0/3969504731 shutdown_connections 2024-03-28T12:41:26.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.099+0000 7fde57c00640 1 --2- 172.21.15.76:0/3969504731 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fde30067f80 0x7fde3006a440 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:26.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.099+0000 7fde57c00640 1 --2- 172.21.15.76:0/3969504731 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fde50152800 0x7fde50154e60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:26.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.099+0000 7fde57c00640 1 --2- 172.21.15.76:0/3969504731 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fde500cea30 0x7fde500c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:26.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.099+0000 7fde57c00640 1 --2- 172.21.15.76:0/3969504731 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fde50072240 0x7fde500c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:26.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.099+0000 7fde57c00640 1 -- 172.21.15.76:0/3969504731 >> 172.21.15.76:0/3969504731 conn(0x7fde50071540 msgr2=0x7fde500cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:26.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.099+0000 7fde57c00640 1 -- 172.21.15.76:0/3969504731 shutdown_connections 2024-03-28T12:41:26.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.099+0000 7fde57c00640 1 -- 172.21.15.76:0/3969504731 wait complete. 2024-03-28T12:41:26.125 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T12:41:26.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.347+0000 7f5cd3400640 1 Processor -- start 2024-03-28T12:41:26.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.347+0000 7f5cd3400640 1 -- start start 2024-03-28T12:41:26.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.351+0000 7f5cd3400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ccc072060 0x7f5ccc0ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:26.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.351+0000 7f5cd3400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f5ccc15e990 0x7f5ccc154450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:26.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.351+0000 7f5cd3400640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ccc15aac0 con 0x7f5ccc072440 2024-03-28T12:41:26.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.351+0000 7f5cd3400640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f5ccc15ada0 con 0x7f5ccc15e990 2024-03-28T12:41:26.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.351+0000 7f5cd3400640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5ccc15b080 con 0x7f5ccc072060 2024-03-28T12:41:26.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.351+0000 7f5cd1400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f5ccc15e990 0x7f5ccc154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:26.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.351+0000 7f5ccbe00640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f5ccc072440 0x7f5ccc15e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:57600/0 (socket says 172.21.15.76:57600) 2024-03-28T12:41:26.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.351+0000 7f5ccbe00640 1 -- 172.21.15.76:0/2022939023 learned_addr learned my addr 172.21.15.76:0/2022939023 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:41:26.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.351+0000 7f5cd0a00640 1 --2- 172.21.15.76:0/2022939023 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ccc072060 0x7f5ccc0ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:26.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.355+0000 7f5cd1400640 1 -- 172.21.15.76:0/2022939023 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ccc072060 msgr2=0x7f5ccc0ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:26.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.355+0000 7f5cd1400640 1 --2- 172.21.15.76:0/2022939023 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ccc072060 0x7f5ccc0ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:26.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.355+0000 7f5cd1400640 1 -- 172.21.15.76:0/2022939023 >> v1:172.21.15.111:6789/0 conn(0x7f5ccc072440 legacy=0x7f5ccc15e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:26.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.355+0000 7f5cd1400640 1 -- 172.21.15.76:0/2022939023 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ccc15b360 con 0x7f5ccc15e990 2024-03-28T12:41:26.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.359+0000 7f5cd1400640 1 --2- 172.21.15.76:0/2022939023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ccc15e990 0x7f5ccc154450 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009d90 tx=0x7f5cc401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce85818803ec25b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:26.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.363+0000 7f5ccb400640 1 -- 172.21.15.76:0/2022939023 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc40b4070 con 0x7f5ccc15e990 2024-03-28T12:41:26.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.363+0000 7f5ccb400640 1 -- 172.21.15.76:0/2022939023 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc40af600 con 0x7f5ccc15e990 2024-03-28T12:41:26.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.363+0000 7f5ccb400640 1 -- 172.21.15.76:0/2022939023 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc40af9d0 con 0x7f5ccc15e990 2024-03-28T12:41:26.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.367+0000 7f5cd3400640 1 -- 172.21.15.76:0/2022939023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ccc15e990 msgr2=0x7f5ccc154450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:26.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.367+0000 7f5cd3400640 1 --2- 172.21.15.76:0/2022939023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ccc15e990 0x7f5ccc154450 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009d90 tx=0x7f5cc401f150 comp rx=0 tx=0).stop 2024-03-28T12:41:26.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.367+0000 7f5cd3400640 1 -- 172.21.15.76:0/2022939023 shutdown_connections 2024-03-28T12:41:26.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.367+0000 7f5cd3400640 1 --2- 172.21.15.76:0/2022939023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ccc15e990 0x7f5ccc154450 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:26.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.367+0000 7f5cd3400640 1 --2- 172.21.15.76:0/2022939023 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ccc072060 0x7f5ccc0ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:26.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.367+0000 7f5cd3400640 1 -- 172.21.15.76:0/2022939023 >> 172.21.15.76:0/2022939023 conn(0x7f5ccc071520 msgr2=0x7f5ccc070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:26.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.367+0000 7f5cd3400640 1 -- 172.21.15.76:0/2022939023 shutdown_connections 2024-03-28T12:41:26.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.367+0000 7f5cd3400640 1 -- 172.21.15.76:0/2022939023 wait complete. 2024-03-28T12:41:26.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.367+0000 7f5cd3400640 1 Processor -- start 2024-03-28T12:41:26.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.367+0000 7f5cd3400640 1 -- start start 2024-03-28T12:41:26.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.371+0000 7f5cd3400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ccc072060 0x7f5ccc149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:26.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.371+0000 7f5cd3400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ccc072440 0x7f5ccc14fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:26.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.371+0000 7f5cd3400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ccc15e990 0x7f5ccc150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:26.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.371+0000 7f5cd3400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5ccc0c8fa0 con 0x7f5ccc072060 2024-03-28T12:41:26.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.371+0000 7f5cd3400640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5ccc0c8e20 con 0x7f5ccc072440 2024-03-28T12:41:26.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.371+0000 7f5cd3400640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5ccc0c7720 con 0x7f5ccc15e990 2024-03-28T12:41:26.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.371+0000 7f5cd0a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ccc072060 0x7f5ccc149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:26.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.371+0000 7f5cd0a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ccc072060 0x7f5ccc149d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45002/0 (socket says 172.21.15.76:45002) 2024-03-28T12:41:26.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.371+0000 7f5cd0a00640 1 -- 172.21.15.76:0/2073574732 learned_addr learned my addr 172.21.15.76:0/2073574732 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:26.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.371+0000 7f5cd1400640 1 --2- 172.21.15.76:0/2073574732 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ccc15e990 0x7f5ccc150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:26.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.371+0000 7f5ccbe00640 1 --2- 172.21.15.76:0/2073574732 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ccc072440 0x7f5ccc14fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:26.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.375+0000 7f5cd0a00640 1 -- 172.21.15.76:0/2073574732 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ccc15e990 msgr2=0x7f5ccc150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:26.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.375+0000 7f5cd0a00640 1 --2- 172.21.15.76:0/2073574732 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ccc15e990 0x7f5ccc150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:26.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.375+0000 7f5cd0a00640 1 -- 172.21.15.76:0/2073574732 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ccc072440 msgr2=0x7f5ccc14fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:26.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.375+0000 7f5cd0a00640 1 --2- 172.21.15.76:0/2073574732 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ccc072440 0x7f5ccc14fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:26.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.375+0000 7f5cd0a00640 1 -- 172.21.15.76:0/2073574732 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ccc14a250 con 0x7f5ccc072060 2024-03-28T12:41:26.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.375+0000 7f5cd0a00640 1 --2- 172.21.15.76:0/2073574732 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ccc072060 0x7f5ccc149d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5cc000e930 tx=0x7f5cc000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:26.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.383+0000 7f5cc8c00640 1 -- 172.21.15.76:0/2073574732 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0017070 con 0x7f5ccc072060 2024-03-28T12:41:26.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.383+0000 7f5cc8c00640 1 -- 172.21.15.76:0/2073574732 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc000ca00 con 0x7f5ccc072060 2024-03-28T12:41:26.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.383+0000 7f5cd3400640 1 -- 172.21.15.76:0/2073574732 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ccc0cecd0 con 0x7f5ccc072060 2024-03-28T12:41:26.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.383+0000 7f5cc8c00640 1 -- 172.21.15.76:0/2073574732 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc000cdb0 con 0x7f5ccc072060 2024-03-28T12:41:26.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.383+0000 7f5cd3400640 1 -- 172.21.15.76:0/2073574732 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ccc0c7950 con 0x7f5ccc072060 2024-03-28T12:41:26.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.383+0000 7f5cd3400640 1 -- 172.21.15.76:0/2073574732 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ccc0686e0 con 0x7f5ccc072060 2024-03-28T12:41:26.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.415+0000 7f5cc8c00640 1 -- 172.21.15.76:0/2073574732 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 4) ==== 87747+0+0 (secure 0 0 0) 0x7f5cc001a070 con 0x7f5ccc072060 2024-03-28T12:41:26.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.415+0000 7f5cc8c00640 1 --2- 172.21.15.76:0/2073574732 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5cac067f60 0x7f5cac06a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:26.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.415+0000 7f5ccbe00640 1 --2- 172.21.15.76:0/2073574732 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5cac067f60 0x7f5cac06a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:26.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.415+0000 7f5cc8c00640 1 -- 172.21.15.76:0/2073574732 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f5cc005d690 con 0x7f5ccc072060 2024-03-28T12:41:26.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.419+0000 7f5ccbe00640 1 --2- 172.21.15.76:0/2073574732 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5cac067f60 0x7f5cac06a420 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc153450 tx=0x7f5cb8007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:26.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:26.687+0000 7f5cc8c00640 1 -- 172.21.15.76:0/2073574732 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f5cc0056ea0 con 0x7f5ccc072060 2024-03-28T12:41:27.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:27.031+0000 7f5cd3400640 1 -- 172.21.15.76:0/2073574732 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ccc0ca6f0 con 0x7f5ccc072060 2024-03-28T12:41:27.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:27.119+0000 7f5cc8c00640 1 -- 172.21.15.76:0/2073574732 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f5cc005b1a0 con 0x7f5ccc072060 2024-03-28T12:41:27.120 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:41:27.120 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-03-28T12:41:27.120 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 1 2024-03-28T12:41:27.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:27.123+0000 7f5cd3400640 1 -- 172.21.15.76:0/2073574732 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5cac067f60 msgr2=0x7f5cac06a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:27.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:27.123+0000 7f5cd3400640 1 --2- 172.21.15.76:0/2073574732 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5cac067f60 0x7f5cac06a420 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc153450 tx=0x7f5cb8007e90 comp rx=0 tx=0).stop 2024-03-28T12:41:27.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:27.123+0000 7f5cd3400640 1 -- 172.21.15.76:0/2073574732 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ccc072060 msgr2=0x7f5ccc149d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:27.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:27.123+0000 7f5cd3400640 1 --2- 172.21.15.76:0/2073574732 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ccc072060 0x7f5ccc149d10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5cc000e930 tx=0x7f5cc000edf0 comp rx=0 tx=0).stop 2024-03-28T12:41:27.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:27.123+0000 7f5cd3400640 1 -- 172.21.15.76:0/2073574732 shutdown_connections 2024-03-28T12:41:27.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:27.123+0000 7f5cd3400640 1 --2- 172.21.15.76:0/2073574732 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5cac067f60 0x7f5cac06a420 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:27.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:27.123+0000 7f5cd3400640 1 --2- 172.21.15.76:0/2073574732 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ccc15e990 0x7f5ccc150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:27.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:27.123+0000 7f5cd3400640 1 --2- 172.21.15.76:0/2073574732 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ccc072440 0x7f5ccc14fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:27.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:27.123+0000 7f5cd3400640 1 --2- 172.21.15.76:0/2073574732 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ccc072060 0x7f5ccc149d10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:27.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:27.123+0000 7f5cd3400640 1 -- 172.21.15.76:0/2073574732 >> 172.21.15.76:0/2073574732 conn(0x7f5ccc071520 msgr2=0x7f5ccc154010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:27.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:27.123+0000 7f5cd3400640 1 -- 172.21.15.76:0/2073574732 shutdown_connections 2024-03-28T12:41:27.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:27.123+0000 7f5cd3400640 1 -- 172.21.15.76:0/2073574732 wait complete. 2024-03-28T12:41:29.145 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T12:41:29.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.383+0000 7f52c3000640 1 Processor -- start 2024-03-28T12:41:29.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.383+0000 7f52c3000640 1 -- start start 2024-03-28T12:41:29.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.383+0000 7f52c3000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f52bc072060 0x7f52bc0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:29.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.383+0000 7f52c3000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f52bc072440 0x7f52bc1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:29.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.383+0000 7f52c3000640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52bc15bf40 con 0x7f52bc1592a0 2024-03-28T12:41:29.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.383+0000 7f52c3000640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f52bc0c31e0 con 0x7f52bc072060 2024-03-28T12:41:29.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.383+0000 7f52c3000640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f52bc15c220 con 0x7f52bc072440 2024-03-28T12:41:29.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.383+0000 7f52b3e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f52bc072440 0x7f52bc1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:29.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.387+0000 7f52b3e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f52bc072440 0x7f52bc1524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:48374/0 (socket says 172.21.15.76:48374) 2024-03-28T12:41:29.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.387+0000 7f52b3e00640 1 -- 172.21.15.76:0/3576555561 learned_addr learned my addr 172.21.15.76:0/3576555561 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:29.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.387+0000 7f52b3e00640 1 -- 172.21.15.76:0/3576555561 >> v2:172.21.15.76:3300/0 conn(0x7f52bc072060 msgr2=0x7f52bc0cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:29.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.387+0000 7f52b3e00640 1 --2- 172.21.15.76:0/3576555561 >> v2:172.21.15.76:3300/0 conn(0x7f52bc072060 0x7f52bc0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:29.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.387+0000 7f52b3e00640 1 -- 172.21.15.76:0/3576555561 >> v1:172.21.15.111:6789/0 conn(0x7f52bc1592a0 legacy=0x7f52bc0c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:29.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.387+0000 7f52b3e00640 1 -- 172.21.15.76:0/3576555561 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52bc15c500 con 0x7f52bc072440 2024-03-28T12:41:29.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.395+0000 7f52b3e00640 1 --2- 172.21.15.76:0/3576555561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52bc072440 0x7f52bc1524b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009870 tx=0x7f52a401c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d99f9324106f641f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:29.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.403+0000 7f52bb400640 1 -- 172.21.15.76:0/3576555561 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a40b0070 con 0x7f52bc072440 2024-03-28T12:41:29.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.403+0000 7f52bb400640 1 -- 172.21.15.76:0/3576555561 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a40ab600 con 0x7f52bc072440 2024-03-28T12:41:29.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.403+0000 7f52bb400640 1 -- 172.21.15.76:0/3576555561 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a40ab9d0 con 0x7f52bc072440 2024-03-28T12:41:29.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.403+0000 7f52c3000640 1 -- 172.21.15.76:0/3576555561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52bc072440 msgr2=0x7f52bc1524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:29.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.403+0000 7f52c3000640 1 --2- 172.21.15.76:0/3576555561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52bc072440 0x7f52bc1524b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f52a4009870 tx=0x7f52a401c4e0 comp rx=0 tx=0).stop 2024-03-28T12:41:29.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.403+0000 7f52c3000640 1 -- 172.21.15.76:0/3576555561 shutdown_connections 2024-03-28T12:41:29.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.403+0000 7f52c3000640 1 --2- 172.21.15.76:0/3576555561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52bc072440 0x7f52bc1524b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:29.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.403+0000 7f52c3000640 1 --2- 172.21.15.76:0/3576555561 >> v2:172.21.15.76:3300/0 conn(0x7f52bc072060 0x7f52bc0cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:29.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.403+0000 7f52c3000640 1 -- 172.21.15.76:0/3576555561 >> 172.21.15.76:0/3576555561 conn(0x7f52bc071520 msgr2=0x7f52bc070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:29.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.403+0000 7f52c3000640 1 -- 172.21.15.76:0/3576555561 shutdown_connections 2024-03-28T12:41:29.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.403+0000 7f52c3000640 1 -- 172.21.15.76:0/3576555561 wait complete. 2024-03-28T12:41:29.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.407+0000 7f52c3000640 1 Processor -- start 2024-03-28T12:41:29.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.407+0000 7f52c3000640 1 -- start start 2024-03-28T12:41:29.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.407+0000 7f52c3000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f52bc072060 0x7f52bc146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:29.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.407+0000 7f52c3000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52bc072440 0x7f52bc1480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:29.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.411+0000 7f52c3000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52bc1592a0 0x7f52bc148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:29.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.411+0000 7f52c3000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc163850 con 0x7f52bc072060 2024-03-28T12:41:29.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.411+0000 7f52c3000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc1636d0 con 0x7f52bc072440 2024-03-28T12:41:29.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.411+0000 7f52c3000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f52bc1639d0 con 0x7f52bc1592a0 2024-03-28T12:41:29.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.411+0000 7f52b3e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52bc072440 0x7f52bc1480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:29.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.411+0000 7f52c1000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52bc1592a0 0x7f52bc148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:29.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.411+0000 7f52bbe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f52bc072060 0x7f52bc146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:29.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.411+0000 7f52b3e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52bc072440 0x7f52bc1480f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:48382/0 (socket says 172.21.15.76:48382) 2024-03-28T12:41:29.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.411+0000 7f52b3e00640 1 -- 172.21.15.76:0/2618942953 learned_addr learned my addr 172.21.15.76:0/2618942953 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:29.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.415+0000 7f52c1000640 1 -- 172.21.15.76:0/2618942953 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52bc072440 msgr2=0x7f52bc1480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:29.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.415+0000 7f52c1000640 1 --2- 172.21.15.76:0/2618942953 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52bc072440 0x7f52bc1480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.415+0000 7f52c1000640 1 -- 172.21.15.76:0/2618942953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f52bc072060 msgr2=0x7f52bc146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.415+0000 7f52c1000640 1 --2- 172.21.15.76:0/2618942953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f52bc072060 0x7f52bc146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.415+0000 7f52c1000640 1 -- 172.21.15.76:0/2618942953 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52bc1f7dd0 con 0x7f52bc1592a0 2024-03-28T12:41:29.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.419+0000 7f52c1000640 1 --2- 172.21.15.76:0/2618942953 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52bc1592a0 0x7f52bc148630 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f52b400be00 tx=0x7f52b400bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:29.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.427+0000 7f52b8c00640 1 -- 172.21.15.76:0/2618942953 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4003980 con 0x7f52bc1592a0 2024-03-28T12:41:29.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.427+0000 7f52b8c00640 1 -- 172.21.15.76:0/2618942953 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b4003b20 con 0x7f52bc1592a0 2024-03-28T12:41:29.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.427+0000 7f52b8c00640 1 -- 172.21.15.76:0/2618942953 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4004020 con 0x7f52bc1592a0 2024-03-28T12:41:29.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.427+0000 7f52c3000640 1 -- 172.21.15.76:0/2618942953 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52bc0cd7d0 con 0x7f52bc1592a0 2024-03-28T12:41:29.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.427+0000 7f52c3000640 1 -- 172.21.15.76:0/2618942953 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f52bc147340 con 0x7f52bc1592a0 2024-03-28T12:41:29.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.427+0000 7f52c3000640 1 -- 172.21.15.76:0/2618942953 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52bc0686e0 con 0x7f52bc1592a0 2024-03-28T12:41:29.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.719+0000 7f52b8c00640 1 -- 172.21.15.76:0/2618942953 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 4) ==== 87747+0+0 (secure 0 0 0) 0x7f52b4006d10 con 0x7f52bc1592a0 2024-03-28T12:41:29.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.719+0000 7f52b8c00640 1 --2- 172.21.15.76:0/2618942953 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5298067fb0 0x7f529806a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:29.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.719+0000 7f52bbe00640 1 --2- 172.21.15.76:0/2618942953 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5298067fb0 0x7f529806a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:29.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.723+0000 7f52bbe00640 1 --2- 172.21.15.76:0/2618942953 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5298067fb0 0x7f529806a470 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009990 tx=0x7f52ac009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:29.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.723+0000 7f52b8c00640 1 -- 172.21.15.76:0/2618942953 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f52b405d330 con 0x7f52bc1592a0 2024-03-28T12:41:29.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:29.743+0000 7f52b8c00640 1 -- 172.21.15.76:0/2618942953 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f52b4056b40 con 0x7f52bc1592a0 2024-03-28T12:41:30.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:30.163+0000 7f52c3000640 1 -- 172.21.15.76:0/2618942953 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52bc147a70 con 0x7f52bc1592a0 2024-03-28T12:41:30.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:30.195+0000 7f52b8c00640 1 -- 172.21.15.76:0/2618942953 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f52b405ae40 con 0x7f52bc1592a0 2024-03-28T12:41:30.193 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:41:30.193 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-03-28T12:41:30.193 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 1 2024-03-28T12:41:30.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:30.195+0000 7f52c3000640 1 -- 172.21.15.76:0/2618942953 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5298067fb0 msgr2=0x7f529806a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:30.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:30.195+0000 7f52c3000640 1 --2- 172.21.15.76:0/2618942953 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5298067fb0 0x7f529806a470 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009990 tx=0x7f52ac009110 comp rx=0 tx=0).stop 2024-03-28T12:41:30.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:30.195+0000 7f52c3000640 1 -- 172.21.15.76:0/2618942953 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52bc1592a0 msgr2=0x7f52bc148630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:30.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:30.195+0000 7f52c3000640 1 --2- 172.21.15.76:0/2618942953 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52bc1592a0 0x7f52bc148630 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f52b400be00 tx=0x7f52b400bef0 comp rx=0 tx=0).stop 2024-03-28T12:41:30.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:30.195+0000 7f52c3000640 1 -- 172.21.15.76:0/2618942953 shutdown_connections 2024-03-28T12:41:30.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:30.195+0000 7f52c3000640 1 --2- 172.21.15.76:0/2618942953 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5298067fb0 0x7f529806a470 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:30.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:30.195+0000 7f52c3000640 1 --2- 172.21.15.76:0/2618942953 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52bc1592a0 0x7f52bc148630 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:30.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:30.195+0000 7f52c3000640 1 --2- 172.21.15.76:0/2618942953 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52bc072440 0x7f52bc1480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:30.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:30.195+0000 7f52c3000640 1 --2- 172.21.15.76:0/2618942953 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f52bc072060 0x7f52bc146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:30.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:30.195+0000 7f52c3000640 1 -- 172.21.15.76:0/2618942953 >> 172.21.15.76:0/2618942953 conn(0x7f52bc071520 msgr2=0x7f52bc0c7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:30.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:30.195+0000 7f52c3000640 1 -- 172.21.15.76:0/2618942953 shutdown_connections 2024-03-28T12:41:30.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:30.195+0000 7f52c3000640 1 -- 172.21.15.76:0/2618942953 wait complete. 2024-03-28T12:41:32.221 INFO:tasks.ceph.mds.f.smithi111.stdout:starting mds.f at 2024-03-28T12:41:32.226 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T12:41:32.253 INFO:tasks.ceph.mds.c.smithi076.stdout:starting mds.c at 2024-03-28T12:41:32.272 INFO:tasks.ceph.mds.d.smithi111.stdout:starting mds.d at 2024-03-28T12:41:32.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.379+0000 7f9b0be00640 1 Processor -- start 2024-03-28T12:41:32.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.379+0000 7f9b0be00640 1 -- start start 2024-03-28T12:41:32.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.383+0000 7f9b0be00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9b0c072260 0x7f9b0c1582a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:32.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.383+0000 7f9b0be00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b0c15c090 0x7f9b0c152140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:32.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.383+0000 7f9b0be00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b0c1588c0 con 0x7f9b0c071e80 2024-03-28T12:41:32.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.383+0000 7f9b0be00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f9b0c15bc00 con 0x7f9b0c072260 2024-03-28T12:41:32.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.383+0000 7f9b0be00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0c0c8240 con 0x7f9b0c15c090 2024-03-28T12:41:32.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.383+0000 7f9b0aa00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f9b0c071e80 0x7f9b0c0cb0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:35546/0 (socket says 172.21.15.76:35546) 2024-03-28T12:41:32.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.383+0000 7f9b0aa00640 1 -- 172.21.15.76:0/604751580 learned_addr learned my addr 172.21.15.76:0/604751580 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:41:32.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.383+0000 7f9b0a000640 1 --2- 172.21.15.76:0/604751580 >> v2:172.21.15.111:3300/0 conn(0x7f9b0c072260 0x7f9b0c1582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:32.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.383+0000 7f9b0b400640 1 --2- 172.21.15.76:0/604751580 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b0c15c090 0x7f9b0c152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:32.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.387+0000 7f9b0b400640 1 -- 172.21.15.76:0/604751580 >> v2:172.21.15.111:3300/0 conn(0x7f9b0c072260 msgr2=0x7f9b0c1582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:32.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.387+0000 7f9b0b400640 1 --2- 172.21.15.76:0/604751580 >> v2:172.21.15.111:3300/0 conn(0x7f9b0c072260 0x7f9b0c1582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:32.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.387+0000 7f9b0b400640 1 -- 172.21.15.76:0/604751580 >> v1:172.21.15.76:6789/0 conn(0x7f9b0c071e80 legacy=0x7f9b0c0cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:32.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.387+0000 7f9b0b400640 1 -- 172.21.15.76:0/604751580 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c158ba0 con 0x7f9b0c15c090 2024-03-28T12:41:32.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.395+0000 7f9b0b400640 1 --2- 172.21.15.76:0/604751580 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b0c15c090 0x7f9b0c152140 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009d90 tx=0x7f9b0401f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c31e0fcfc8cb191c server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:32.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.399+0000 7f9b09600640 1 -- 172.21.15.76:0/604751580 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b040b4070 con 0x7f9b0c15c090 2024-03-28T12:41:32.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.399+0000 7f9b09600640 1 -- 172.21.15.76:0/604751580 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b040af600 con 0x7f9b0c15c090 2024-03-28T12:41:32.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.399+0000 7f9b09600640 1 -- 172.21.15.76:0/604751580 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b040af9d0 con 0x7f9b0c15c090 2024-03-28T12:41:32.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.399+0000 7f9b0be00640 1 -- 172.21.15.76:0/604751580 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b0c15c090 msgr2=0x7f9b0c152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:32.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.399+0000 7f9b0be00640 1 --2- 172.21.15.76:0/604751580 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b0c15c090 0x7f9b0c152140 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009d90 tx=0x7f9b0401f150 comp rx=0 tx=0).stop 2024-03-28T12:41:32.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.403+0000 7f9b0be00640 1 -- 172.21.15.76:0/604751580 shutdown_connections 2024-03-28T12:41:32.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.403+0000 7f9b0be00640 1 --2- 172.21.15.76:0/604751580 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b0c15c090 0x7f9b0c152140 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:32.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.403+0000 7f9b0be00640 1 --2- 172.21.15.76:0/604751580 >> v2:172.21.15.111:3300/0 conn(0x7f9b0c072260 0x7f9b0c1582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:32.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.403+0000 7f9b0be00640 1 -- 172.21.15.76:0/604751580 >> 172.21.15.76:0/604751580 conn(0x7f9b0c06b770 msgr2=0x7f9b0c070330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:32.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.403+0000 7f9b0be00640 1 -- 172.21.15.76:0/604751580 shutdown_connections 2024-03-28T12:41:32.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.403+0000 7f9b0be00640 1 -- 172.21.15.76:0/604751580 wait complete. 2024-03-28T12:41:32.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.403+0000 7f9b0be00640 1 Processor -- start 2024-03-28T12:41:32.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.403+0000 7f9b0be00640 1 -- start start 2024-03-28T12:41:32.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.403+0000 7f9b0be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b0c071e80 0x7f9b0c14bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:32.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.403+0000 7f9b0be00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b0c072260 0x7f9b0c149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:32.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.403+0000 7f9b0be00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b0c15c090 0x7f9b0c14a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:32.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.403+0000 7f9b0be00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c15b890 con 0x7f9b0c071e80 2024-03-28T12:41:32.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.403+0000 7f9b0be00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c159160 con 0x7f9b0c072260 2024-03-28T12:41:32.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.403+0000 7f9b0be00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0c0c2d30 con 0x7f9b0c15c090 2024-03-28T12:41:32.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.403+0000 7f9b0a000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b0c072260 0x7f9b0c149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:32.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.407+0000 7f9b0a000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b0c072260 0x7f9b0c149ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:48418/0 (socket says 172.21.15.76:48418) 2024-03-28T12:41:32.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.407+0000 7f9b0a000640 1 -- 172.21.15.76:0/2951982767 learned_addr learned my addr 172.21.15.76:0/2951982767 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:32.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.407+0000 7f9b0b400640 1 --2- 172.21.15.76:0/2951982767 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b0c15c090 0x7f9b0c14a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:32.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.407+0000 7f9b0aa00640 1 --2- 172.21.15.76:0/2951982767 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b0c071e80 0x7f9b0c14bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:32.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.411+0000 7f9b0b400640 1 -- 172.21.15.76:0/2951982767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b0c072260 msgr2=0x7f9b0c149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:32.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.411+0000 7f9b0b400640 1 --2- 172.21.15.76:0/2951982767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b0c072260 0x7f9b0c149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:32.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.411+0000 7f9b0b400640 1 -- 172.21.15.76:0/2951982767 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b0c071e80 msgr2=0x7f9b0c14bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:32.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.411+0000 7f9b0b400640 1 --2- 172.21.15.76:0/2951982767 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b0c071e80 0x7f9b0c14bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:32.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.411+0000 7f9b0b400640 1 -- 172.21.15.76:0/2951982767 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c1f46d0 con 0x7f9b0c15c090 2024-03-28T12:41:32.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.423+0000 7f9b0b400640 1 --2- 172.21.15.76:0/2951982767 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b0c15c090 0x7f9b0c14a000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c15bd80 tx=0x7f9b0401bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:32.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.427+0000 7f9b02a00640 1 -- 172.21.15.76:0/2951982767 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b040b4040 con 0x7f9b0c15c090 2024-03-28T12:41:32.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.431+0000 7f9b02a00640 1 -- 172.21.15.76:0/2951982767 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b040af400 con 0x7f9b0c15c090 2024-03-28T12:41:32.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.431+0000 7f9b02a00640 1 -- 172.21.15.76:0/2951982767 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b04009450 con 0x7f9b0c15c090 2024-03-28T12:41:32.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.431+0000 7f9b0be00640 1 -- 172.21.15.76:0/2951982767 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b0c1f3b50 con 0x7f9b0c15c090 2024-03-28T12:41:32.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.431+0000 7f9b0be00640 1 -- 172.21.15.76:0/2951982767 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b0c1f4110 con 0x7f9b0c15c090 2024-03-28T12:41:32.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.431+0000 7f9b0be00640 1 -- 172.21.15.76:0/2951982767 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b0c068df0 con 0x7f9b0c15c090 2024-03-28T12:41:32.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.455+0000 7f9b02a00640 1 -- 172.21.15.76:0/2951982767 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 4) ==== 87747+0+0 (secure 0 0 0) 0x7f9b040c3020 con 0x7f9b0c15c090 2024-03-28T12:41:32.453 INFO:tasks.ceph.mds.e.smithi076.stdout:starting mds.e at 2024-03-28T12:41:32.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.455+0000 7f9b02a00640 1 --2- 172.21.15.76:0/2951982767 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9aec067f60 0x7f9aec06a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:32.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.455+0000 7f9b0aa00640 1 --2- 172.21.15.76:0/2951982767 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9aec067f60 0x7f9aec06a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:32.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.455+0000 7f9b0aa00640 1 --2- 172.21.15.76:0/2951982767 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9aec067f60 0x7f9aec06a420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9afc000f70 tx=0x7f9afc007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:32.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.459+0000 7f9b02a00640 1 -- 172.21.15.76:0/2951982767 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f9b040af5b0 con 0x7f9b0c15c090 2024-03-28T12:41:32.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.755+0000 7f9b02a00640 1 -- 172.21.15.76:0/2951982767 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f9b040ca020 con 0x7f9b0c15c090 2024-03-28T12:41:32.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:32.947+0000 7f9b0be00640 1 -- 172.21.15.76:0/2951982767 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b0c0c70b0 con 0x7f9b0c15c090 2024-03-28T12:41:33.759 INFO:tasks.ceph.mds.a.smithi076.stdout:starting mds.a at 2024-03-28T12:41:33.808 INFO:tasks.ceph.mds.b.smithi111.stdout:starting mds.b at 2024-03-28T12:41:36.300 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:41:36.303 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:41:39.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:39.199+0000 7f9b02a00640 1 -- 172.21.15.76:0/2951982767 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f9b04018cb0 con 0x7f9b0c15c090 2024-03-28T12:41:39.200 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:41:39.200 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-03-28T12:41:39.200 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 1 2024-03-28T12:41:39.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:39.203+0000 7f9b0be00640 1 -- 172.21.15.76:0/2951982767 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9aec067f60 msgr2=0x7f9aec06a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:39.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:39.203+0000 7f9b0be00640 1 --2- 172.21.15.76:0/2951982767 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9aec067f60 0x7f9aec06a420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9afc000f70 tx=0x7f9afc007e90 comp rx=0 tx=0).stop 2024-03-28T12:41:39.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:39.203+0000 7f9b0be00640 1 -- 172.21.15.76:0/2951982767 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b0c15c090 msgr2=0x7f9b0c14a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:39.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:39.203+0000 7f9b0be00640 1 --2- 172.21.15.76:0/2951982767 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b0c15c090 0x7f9b0c14a000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c15bd80 tx=0x7f9b0401bef0 comp rx=0 tx=0).stop 2024-03-28T12:41:39.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:39.203+0000 7f9b0be00640 1 -- 172.21.15.76:0/2951982767 shutdown_connections 2024-03-28T12:41:39.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:39.203+0000 7f9b0be00640 1 --2- 172.21.15.76:0/2951982767 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9aec067f60 0x7f9aec06a420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:39.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:39.203+0000 7f9b0be00640 1 --2- 172.21.15.76:0/2951982767 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b0c15c090 0x7f9b0c14a000 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:39.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:39.203+0000 7f9b0be00640 1 --2- 172.21.15.76:0/2951982767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b0c072260 0x7f9b0c149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:39.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:39.203+0000 7f9b0be00640 1 --2- 172.21.15.76:0/2951982767 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9b0c071e80 0x7f9b0c14bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:39.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:39.203+0000 7f9b0be00640 1 -- 172.21.15.76:0/2951982767 >> 172.21.15.76:0/2951982767 conn(0x7f9b0c06b770 msgr2=0x7f9b0c0c2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:39.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:39.203+0000 7f9b0be00640 1 -- 172.21.15.76:0/2951982767 shutdown_connections 2024-03-28T12:41:39.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:39.203+0000 7f9b0be00640 1 -- 172.21.15.76:0/2951982767 wait complete. 2024-03-28T12:41:41.222 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T12:41:41.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.367+0000 7f8d71a00640 1 Processor -- start 2024-03-28T12:41:41.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.367+0000 7f8d71a00640 1 -- start start 2024-03-28T12:41:41.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.367+0000 7f8d71a00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8d6c15bb60 0x7f8d6c06dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:41.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.367+0000 7f8d71a00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f8d6c06e2c0 0x7f8d6c072140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:41.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.367+0000 7f8d71a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d6c072680 0x7f8d6c15bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:41.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.367+0000 7f8d71a00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f8d6c06f570 con 0x7f8d6c06e2c0 2024-03-28T12:41:41.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.367+0000 7f8d71a00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f8d6c06ea80 con 0x7f8d6c15bb60 2024-03-28T12:41:41.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.367+0000 7f8d71a00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6c06ed60 con 0x7f8d6c072680 2024-03-28T12:41:41.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.367+0000 7f8d62000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f8d6c06e2c0 0x7f8d6c072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:41.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.367+0000 7f8d62000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f8d6c06e2c0 0x7f8d6c072140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37948/0 (socket says 172.21.15.76:37948) 2024-03-28T12:41:41.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.367+0000 7f8d62000640 1 -- 172.21.15.76:0/2921711385 learned_addr learned my addr 172.21.15.76:0/2921711385 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:41.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.371+0000 7f8d6aa00640 1 --2- 172.21.15.76:0/2921711385 >> v2:172.21.15.111:3300/0 conn(0x7f8d6c15bb60 0x7f8d6c06dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:41.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.371+0000 7f8d6b400640 1 --2- 172.21.15.76:0/2921711385 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d6c072680 0x7f8d6c15bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:41.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.371+0000 7f8d62000640 1 -- 172.21.15.76:0/2921711385 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d6c072680 msgr2=0x7f8d6c15bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:41.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.371+0000 7f8d62000640 1 --2- 172.21.15.76:0/2921711385 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d6c072680 0x7f8d6c15bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:41.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.371+0000 7f8d62000640 1 -- 172.21.15.76:0/2921711385 >> v2:172.21.15.111:3300/0 conn(0x7f8d6c15bb60 msgr2=0x7f8d6c06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:41.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.371+0000 7f8d62000640 1 --2- 172.21.15.76:0/2921711385 >> v2:172.21.15.111:3300/0 conn(0x7f8d6c15bb60 0x7f8d6c06dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:41.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.371+0000 7f8d62000640 1 -- 172.21.15.76:0/2921711385 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c06f040 con 0x7f8d6c06e2c0 2024-03-28T12:41:41.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.375+0000 7f8d62000640 1 --2- 172.21.15.76:0/2921711385 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d6c06e2c0 0x7f8d6c072140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c071c90 tx=0x7f8d5401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158f778ba5a54897 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:41.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.379+0000 7f8d6a000640 1 -- 172.21.15.76:0/2921711385 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d540aa610 con 0x7f8d6c06e2c0 2024-03-28T12:41:41.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.379+0000 7f8d6a000640 1 -- 172.21.15.76:0/2921711385 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d540af070 con 0x7f8d6c06e2c0 2024-03-28T12:41:41.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.379+0000 7f8d6a000640 1 -- 172.21.15.76:0/2921711385 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d540aa9d0 con 0x7f8d6c06e2c0 2024-03-28T12:41:41.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.379+0000 7f8d71a00640 1 -- 172.21.15.76:0/2921711385 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d6c06e2c0 msgr2=0x7f8d6c072140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:41.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.379+0000 7f8d71a00640 1 --2- 172.21.15.76:0/2921711385 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d6c06e2c0 0x7f8d6c072140 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c071c90 tx=0x7f8d5401c4f0 comp rx=0 tx=0).stop 2024-03-28T12:41:41.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.379+0000 7f8d71a00640 1 -- 172.21.15.76:0/2921711385 shutdown_connections 2024-03-28T12:41:41.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.379+0000 7f8d71a00640 1 --2- 172.21.15.76:0/2921711385 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d6c072680 0x7f8d6c15bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:41.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.379+0000 7f8d71a00640 1 --2- 172.21.15.76:0/2921711385 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d6c06e2c0 0x7f8d6c072140 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:41.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.379+0000 7f8d71a00640 1 --2- 172.21.15.76:0/2921711385 >> v2:172.21.15.111:3300/0 conn(0x7f8d6c15bb60 0x7f8d6c06dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:41.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.379+0000 7f8d71a00640 1 -- 172.21.15.76:0/2921711385 >> 172.21.15.76:0/2921711385 conn(0x7f8d6c06fbe0 msgr2=0x7f8d6c06fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:41.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.379+0000 7f8d71a00640 1 -- 172.21.15.76:0/2921711385 shutdown_connections 2024-03-28T12:41:41.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.379+0000 7f8d71a00640 1 -- 172.21.15.76:0/2921711385 wait complete. 2024-03-28T12:41:41.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.383+0000 7f8d71a00640 1 Processor -- start 2024-03-28T12:41:41.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.383+0000 7f8d71a00640 1 -- start start 2024-03-28T12:41:41.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.383+0000 7f8d71a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d6c06e2c0 0x7f8d6c141d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:41.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.383+0000 7f8d71a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d6c072680 0x7f8d6c0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:41.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.383+0000 7f8d71a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d6c15bb60 0x7f8d6c0c1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:41.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.383+0000 7f8d71a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c0c8740 con 0x7f8d6c15bb60 2024-03-28T12:41:41.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.383+0000 7f8d71a00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c15c890 con 0x7f8d6c072680 2024-03-28T12:41:41.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.383+0000 7f8d71a00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6c0c88c0 con 0x7f8d6c06e2c0 2024-03-28T12:41:41.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.383+0000 7f8d6b400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d6c15bb60 0x7f8d6c0c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:41.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.383+0000 7f8d6b400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d6c15bb60 0x7f8d6c0c1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37958/0 (socket says 172.21.15.76:37958) 2024-03-28T12:41:41.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.383+0000 7f8d6b400640 1 -- 172.21.15.76:0/4011002421 learned_addr learned my addr 172.21.15.76:0/4011002421 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:41.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.383+0000 7f8d6aa00640 1 --2- 172.21.15.76:0/4011002421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d6c06e2c0 0x7f8d6c141d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:41.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.383+0000 7f8d62000640 1 --2- 172.21.15.76:0/4011002421 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d6c072680 0x7f8d6c0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:41.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.387+0000 7f8d6b400640 1 -- 172.21.15.76:0/4011002421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d6c06e2c0 msgr2=0x7f8d6c141d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:41.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.387+0000 7f8d6b400640 1 --2- 172.21.15.76:0/4011002421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d6c06e2c0 0x7f8d6c141d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:41.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.387+0000 7f8d6b400640 1 -- 172.21.15.76:0/4011002421 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d6c072680 msgr2=0x7f8d6c0ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:41.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.387+0000 7f8d6b400640 1 --2- 172.21.15.76:0/4011002421 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d6c072680 0x7f8d6c0ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:41.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.387+0000 7f8d6b400640 1 -- 172.21.15.76:0/4011002421 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c0cbc80 con 0x7f8d6c15bb60 2024-03-28T12:41:41.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.387+0000 7f8d6b400640 1 --2- 172.21.15.76:0/4011002421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d6c15bb60 0x7f8d6c0c1130 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8d64007db0 tx=0x7f8d6400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:41.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.391+0000 7f8d63400640 1 -- 172.21.15.76:0/4011002421 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d64014420 con 0x7f8d6c15bb60 2024-03-28T12:41:41.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.391+0000 7f8d63400640 1 -- 172.21.15.76:0/4011002421 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d64019070 con 0x7f8d6c15bb60 2024-03-28T12:41:41.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.391+0000 7f8d63400640 1 -- 172.21.15.76:0/4011002421 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d64014800 con 0x7f8d6c15bb60 2024-03-28T12:41:41.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.391+0000 7f8d71a00640 1 -- 172.21.15.76:0/4011002421 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6c13fa10 con 0x7f8d6c15bb60 2024-03-28T12:41:41.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.391+0000 7f8d71a00640 1 -- 172.21.15.76:0/4011002421 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d6c0c2480 con 0x7f8d6c15bb60 2024-03-28T12:41:41.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.395+0000 7f8d71a00640 1 -- 172.21.15.76:0/4011002421 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6c0686e0 con 0x7f8d6c15bb60 2024-03-28T12:41:41.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.411+0000 7f8d63400640 1 -- 172.21.15.76:0/4011002421 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 4) ==== 87747+0+0 (secure 0 0 0) 0x7f8d640149a0 con 0x7f8d6c15bb60 2024-03-28T12:41:41.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.415+0000 7f8d63400640 1 --2- 172.21.15.76:0/4011002421 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8d48067f80 0x7f8d4806a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:41.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.415+0000 7f8d6aa00640 1 --2- 172.21.15.76:0/4011002421 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8d48067f80 0x7f8d4806a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:41.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.415+0000 7f8d6aa00640 1 --2- 172.21.15.76:0/4011002421 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8d48067f80 0x7f8d4806a440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0079e0 tx=0x7f8d5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:41.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.415+0000 7f8d63400640 1 -- 172.21.15.76:0/4011002421 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f8d6405dfa0 con 0x7f8d6c15bb60 2024-03-28T12:41:41.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.655+0000 7f8d63400640 1 -- 172.21.15.76:0/4011002421 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f8d640577b0 con 0x7f8d6c15bb60 2024-03-28T12:41:41.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.843+0000 7f8d71a00640 1 -- 172.21.15.76:0/4011002421 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d6c0677e0 con 0x7f8d6c15bb60 2024-03-28T12:41:41.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.851+0000 7f8d63400640 1 -- 172.21.15.76:0/4011002421 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f8d6405bab0 con 0x7f8d6c15bb60 2024-03-28T12:41:41.848 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:41:41.849 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-03-28T12:41:41.849 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 1 2024-03-28T12:41:41.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.851+0000 7f8d71a00640 1 -- 172.21.15.76:0/4011002421 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8d48067f80 msgr2=0x7f8d4806a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:41.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.851+0000 7f8d71a00640 1 --2- 172.21.15.76:0/4011002421 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8d48067f80 0x7f8d4806a440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0079e0 tx=0x7f8d5c008040 comp rx=0 tx=0).stop 2024-03-28T12:41:41.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.851+0000 7f8d71a00640 1 -- 172.21.15.76:0/4011002421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d6c15bb60 msgr2=0x7f8d6c0c1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:41.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.851+0000 7f8d71a00640 1 --2- 172.21.15.76:0/4011002421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d6c15bb60 0x7f8d6c0c1130 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8d64007db0 tx=0x7f8d6400e4b0 comp rx=0 tx=0).stop 2024-03-28T12:41:41.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.851+0000 7f8d71a00640 1 -- 172.21.15.76:0/4011002421 shutdown_connections 2024-03-28T12:41:41.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.851+0000 7f8d71a00640 1 --2- 172.21.15.76:0/4011002421 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8d48067f80 0x7f8d4806a440 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:41.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.851+0000 7f8d71a00640 1 --2- 172.21.15.76:0/4011002421 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8d6c15bb60 0x7f8d6c0c1130 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:41.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.851+0000 7f8d71a00640 1 --2- 172.21.15.76:0/4011002421 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d6c072680 0x7f8d6c0ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:41.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.851+0000 7f8d71a00640 1 --2- 172.21.15.76:0/4011002421 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d6c06e2c0 0x7f8d6c141d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:41.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.851+0000 7f8d71a00640 1 -- 172.21.15.76:0/4011002421 >> 172.21.15.76:0/4011002421 conn(0x7f8d6c06fbe0 msgr2=0x7f8d6c147850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:41.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.851+0000 7f8d71a00640 1 -- 172.21.15.76:0/4011002421 shutdown_connections 2024-03-28T12:41:41.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:41.851+0000 7f8d71a00640 1 -- 172.21.15.76:0/4011002421 wait complete. 2024-03-28T12:41:43.870 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T12:41:44.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:44.015+0000 7fc1e7c00640 1 Processor -- start 2024-03-28T12:41:44.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:44.015+0000 7fc1e7c00640 1 -- start start 2024-03-28T12:41:44.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:44.015+0000 7fc1e7c00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc1e0072440 0x7fc1e00ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:44.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:44.015+0000 7fc1e7c00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fc1e015e990 0x7fc1e0154450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:44.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:44.015+0000 7fc1e7c00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1e015aac0 con 0x7fc1e0072060 2024-03-28T12:41:44.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:44.015+0000 7fc1e7c00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fc1e015ada0 con 0x7fc1e015e990 2024-03-28T12:41:44.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:44.015+0000 7fc1e7c00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fc1e015b080 con 0x7fc1e0072440 2024-03-28T12:41:44.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:44.019+0000 7fc1dfe00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc1e0072440 0x7fc1e00ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:44.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:44.023+0000 7fc1dfe00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc1e0072440 0x7fc1e00ca3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:38736/0 (socket says 172.21.15.76:38736) 2024-03-28T12:41:44.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:44.023+0000 7fc1dfe00640 1 -- 172.21.15.76:0/163789492 learned_addr learned my addr 172.21.15.76:0/163789492 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:44.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:44.031+0000 7fc1dfe00640 1 -- 172.21.15.76:0/163789492 >> v2:172.21.15.76:3300/0 conn(0x7fc1e015e990 msgr2=0x7fc1e0154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:44.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:44.031+0000 7fc1dfe00640 1 --2- 172.21.15.76:0/163789492 >> v2:172.21.15.76:3300/0 conn(0x7fc1e015e990 0x7fc1e0154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:44.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:44.031+0000 7fc1dfe00640 1 -- 172.21.15.76:0/163789492 >> v1:172.21.15.76:6789/0 conn(0x7fc1e0072060 legacy=0x7fc1e015e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:44.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:44.031+0000 7fc1dfe00640 1 -- 172.21.15.76:0/163789492 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e015b360 con 0x7fc1e0072440 2024-03-28T12:41:44.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:44.043+0000 7fc1dfe00640 1 --2- 172.21.15.76:0/163789492 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1e0072440 0x7fc1e00ca3d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0098a0 tx=0x7fc1cc01ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5dc7bd8851ef187 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:48.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.471+0000 7fc1df400640 1 -- 172.21.15.76:0/163789492 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0b5070 con 0x7fc1e0072440 2024-03-28T12:41:48.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.471+0000 7fc1df400640 1 -- 172.21.15.76:0/163789492 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1cc0a89d0 con 0x7fc1e0072440 2024-03-28T12:41:48.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.471+0000 7fc1df400640 1 -- 172.21.15.76:0/163789492 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0a8e00 con 0x7fc1e0072440 2024-03-28T12:41:48.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.471+0000 7fc1e7c00640 1 -- 172.21.15.76:0/163789492 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1e0072440 msgr2=0x7fc1e00ca3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:48.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.471+0000 7fc1e7c00640 1 --2- 172.21.15.76:0/163789492 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1e0072440 0x7fc1e00ca3d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0098a0 tx=0x7fc1cc01ecb0 comp rx=0 tx=0).stop 2024-03-28T12:41:48.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.471+0000 7fc1e7c00640 1 -- 172.21.15.76:0/163789492 shutdown_connections 2024-03-28T12:41:48.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.471+0000 7fc1e7c00640 1 --2- 172.21.15.76:0/163789492 >> v2:172.21.15.76:3300/0 conn(0x7fc1e015e990 0x7fc1e0154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:48.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.471+0000 7fc1e7c00640 1 --2- 172.21.15.76:0/163789492 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1e0072440 0x7fc1e00ca3d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:48.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.471+0000 7fc1e7c00640 1 -- 172.21.15.76:0/163789492 >> 172.21.15.76:0/163789492 conn(0x7fc1e0071520 msgr2=0x7fc1e0070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:48.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.471+0000 7fc1e7c00640 1 -- 172.21.15.76:0/163789492 shutdown_connections 2024-03-28T12:41:48.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.471+0000 7fc1e7c00640 1 -- 172.21.15.76:0/163789492 wait complete. 2024-03-28T12:41:48.472 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.475+0000 7fc1e7c00640 1 Processor -- start 2024-03-28T12:41:48.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.475+0000 7fc1e7c00640 1 -- start start 2024-03-28T12:41:48.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.475+0000 7fc1e7c00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1e0072060 0x7fc1e00c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:48.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.475+0000 7fc1e7c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc1e0072440 0x7fc1e00c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:48.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.475+0000 7fc1e7c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc1e015e990 0x7fc1e0155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:48.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.475+0000 7fc1e7c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e00c8fa0 con 0x7fc1e015e990 2024-03-28T12:41:48.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.475+0000 7fc1e7c00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e00c8e20 con 0x7fc1e0072060 2024-03-28T12:41:48.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.475+0000 7fc1e7c00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e01542d0 con 0x7fc1e0072440 2024-03-28T12:41:48.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.479+0000 7fc1dfe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc1e0072440 0x7fc1e00c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:48.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.479+0000 7fc1dfe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc1e0072440 0x7fc1e00c57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:55262/0 (socket says 172.21.15.76:55262) 2024-03-28T12:41:48.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.479+0000 7fc1dfe00640 1 -- 172.21.15.76:0/2307198281 learned_addr learned my addr 172.21.15.76:0/2307198281 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:48.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.491+0000 7fc1dfe00640 1 -- 172.21.15.76:0/2307198281 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1e0072060 msgr2=0x7fc1e00c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:48.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.491+0000 7fc1dfe00640 1 --2- 172.21.15.76:0/2307198281 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1e0072060 0x7fc1e00c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:48.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.491+0000 7fc1dfe00640 1 -- 172.21.15.76:0/2307198281 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc1e015e990 msgr2=0x7fc1e0155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:48.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.491+0000 7fc1dfe00640 1 --2- 172.21.15.76:0/2307198281 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc1e015e990 0x7fc1e0155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:48.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.491+0000 7fc1dfe00640 1 -- 172.21.15.76:0/2307198281 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e00c7a20 con 0x7fc1e0072440 2024-03-28T12:41:48.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:48.495+0000 7fc1dfe00640 1 --2- 172.21.15.76:0/2307198281 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc1e0072440 0x7fc1e00c57b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc01b8c0 tx=0x7fc1cc01ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:50.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:50.523+0000 7fc1dcc00640 1 -- 172.21.15.76:0/2307198281 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0b5050 con 0x7fc1e0072440 2024-03-28T12:41:50.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:50.523+0000 7fc1dcc00640 1 -- 172.21.15.76:0/2307198281 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1cc0c0070 con 0x7fc1e0072440 2024-03-28T12:41:50.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:50.523+0000 7fc1dcc00640 1 -- 172.21.15.76:0/2307198281 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc003a40 con 0x7fc1e0072440 2024-03-28T12:41:50.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:50.523+0000 7fc1e7c00640 1 -- 172.21.15.76:0/2307198281 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e0156ab0 con 0x7fc1e0072440 2024-03-28T12:41:50.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:50.523+0000 7fc1e7c00640 1 -- 172.21.15.76:0/2307198281 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e0157620 con 0x7fc1e0072440 2024-03-28T12:41:50.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:50.527+0000 7fc1e7c00640 1 -- 172.21.15.76:0/2307198281 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e00686e0 con 0x7fc1e0072440 2024-03-28T12:41:55.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.183+0000 7fc1dcc00640 1 -- 172.21.15.76:0/2307198281 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fc1cc003be0 con 0x7fc1e0072440 2024-03-28T12:41:55.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.183+0000 7fc1dcc00640 1 --2- 172.21.15.76:0/2307198281 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc1c0068010 0x7fc1c006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:55.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.183+0000 7fc1e5200640 1 --2- 172.21.15.76:0/2307198281 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc1c0068010 0x7fc1c006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:55.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.187+0000 7fc1e5200640 1 --2- 172.21.15.76:0/2307198281 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc1c0068010 0x7fc1c006a4d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4007fd0 tx=0x7fc1d40079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:55.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.199+0000 7fc1dcc00640 1 -- 172.21.15.76:0/2307198281 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fc1cc0fb5c0 con 0x7fc1e0072440 2024-03-28T12:41:55.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.235+0000 7fc1dcc00640 1 -- 172.21.15.76:0/2307198281 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fc1cc018810 con 0x7fc1e0072440 2024-03-28T12:41:55.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.435+0000 7fc1e7c00640 1 -- 172.21.15.76:0/2307198281 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1e00c4ad0 con 0x7fc1e0072440 2024-03-28T12:41:55.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.471+0000 7fc1dcc00640 1 -- 172.21.15.76:0/2307198281 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5515 (secure 0 0 0) 0x7fc1cc0f4dd0 con 0x7fc1e0072440 2024-03-28T12:41:55.471 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:41:55.471 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/335301918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":335301918},{"type":"v1","addr":"172.21.15.111:6835","nonce":335301918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1786218285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1786218285},{"type":"v1","addr":"172.21.15.76:6837","nonce":1786218285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/2729208421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":2729208421},{"type":"v1","addr":"172.21.15.76:6839","nonce":2729208421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6837/4176441330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":4176441330},{"type":"v1","addr":"172.21.15.111:6837","nonce":4176441330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/3175932821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":3175932821},{"type":"v1","addr":"172.21.15.111:6833","nonce":3175932821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6835/544947706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":544947706},{"type":"v1","addr":"172.21.15.76:6835","nonce":544947706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-28T12:41:55.471 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 3 2024-03-28T12:41:55.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.475+0000 7fc1e7c00640 1 -- 172.21.15.76:0/2307198281 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc1c0068010 msgr2=0x7fc1c006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:55.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.475+0000 7fc1e7c00640 1 --2- 172.21.15.76:0/2307198281 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc1c0068010 0x7fc1c006a4d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4007fd0 tx=0x7fc1d40079a0 comp rx=0 tx=0).stop 2024-03-28T12:41:55.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.475+0000 7fc1e7c00640 1 -- 172.21.15.76:0/2307198281 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc1e0072440 msgr2=0x7fc1e00c57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:55.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.475+0000 7fc1e7c00640 1 --2- 172.21.15.76:0/2307198281 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc1e0072440 0x7fc1e00c57b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc01b8c0 tx=0x7fc1cc01ba50 comp rx=0 tx=0).stop 2024-03-28T12:41:55.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.475+0000 7fc1e7c00640 1 -- 172.21.15.76:0/2307198281 shutdown_connections 2024-03-28T12:41:55.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.475+0000 7fc1e7c00640 1 --2- 172.21.15.76:0/2307198281 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc1c0068010 0x7fc1c006a4d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:55.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.475+0000 7fc1e7c00640 1 --2- 172.21.15.76:0/2307198281 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc1e015e990 0x7fc1e0155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:55.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.475+0000 7fc1e7c00640 1 --2- 172.21.15.76:0/2307198281 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc1e0072440 0x7fc1e00c57b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:55.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.475+0000 7fc1e7c00640 1 --2- 172.21.15.76:0/2307198281 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc1e0072060 0x7fc1e00c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:55.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.475+0000 7fc1e7c00640 1 -- 172.21.15.76:0/2307198281 >> 172.21.15.76:0/2307198281 conn(0x7fc1e0071520 msgr2=0x7fc1e00cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:55.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.475+0000 7fc1e7c00640 1 -- 172.21.15.76:0/2307198281 shutdown_connections 2024-03-28T12:41:55.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.475+0000 7fc1e7c00640 1 -- 172.21.15.76:0/2307198281 wait complete. 2024-03-28T12:41:55.493 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T12:41:55.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.631+0000 7fa7d0a00640 1 Processor -- start 2024-03-28T12:41:55.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.631+0000 7fa7d0a00640 1 -- start start 2024-03-28T12:41:55.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.631+0000 7fa7d0a00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fa7cc152640 0x7fa7cc15c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:55.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.631+0000 7fa7d0a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7cc0c7890 0x7fa7cc071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:55.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.631+0000 7fa7d0a00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa7cc06f920 0x7fa7cc06fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:55.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.631+0000 7fa7d0a00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fa7cc070cb0 con 0x7fa7cc152640 2024-03-28T12:41:55.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.631+0000 7fa7d0a00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fa7cc15c910 con 0x7fa7cc06f920 2024-03-28T12:41:55.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.631+0000 7fa7d0a00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa7cc070960 con 0x7fa7cc0c7890 2024-03-28T12:41:55.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.631+0000 7fa7ca800640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fa7cc152640 0x7fa7cc15c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:55.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.631+0000 7fa7ca800640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fa7cc152640 0x7fa7cc15c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47114/0 (socket says 172.21.15.76:47114) 2024-03-28T12:41:55.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.631+0000 7fa7ca800640 1 -- 172.21.15.76:0/245013053 learned_addr learned my addr 172.21.15.76:0/245013053 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:55.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.635+0000 7fa7c9e00640 1 --2- 172.21.15.76:0/245013053 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7cc0c7890 0x7fa7cc071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:55.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.635+0000 7fa7ca800640 1 -- 172.21.15.76:0/245013053 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7cc0c7890 msgr2=0x7fa7cc071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:55.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.635+0000 7fa7ca800640 1 --2- 172.21.15.76:0/245013053 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7cc0c7890 0x7fa7cc071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:55.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.635+0000 7fa7ca800640 1 -- 172.21.15.76:0/245013053 >> v2:172.21.15.111:3300/0 conn(0x7fa7cc06f920 msgr2=0x7fa7cc06fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:55.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.635+0000 7fa7ca800640 1 --2- 172.21.15.76:0/245013053 >> v2:172.21.15.111:3300/0 conn(0x7fa7cc06f920 0x7fa7cc06fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:55.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.635+0000 7fa7ca800640 1 -- 172.21.15.76:0/245013053 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7cc06b910 con 0x7fa7cc152640 2024-03-28T12:41:55.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.655+0000 7fa7ca800640 1 --2- 172.21.15.76:0/245013053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7cc152640 0x7fa7cc15c3d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc06f420 tx=0x7fa7bc01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7ca9c664eb0f6c server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:55.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.659+0000 7fa7c9400640 1 -- 172.21.15.76:0/245013053 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0b5070 con 0x7fa7cc152640 2024-03-28T12:41:55.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.659+0000 7fa7c9400640 1 -- 172.21.15.76:0/245013053 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7bc0a89d0 con 0x7fa7cc152640 2024-03-28T12:41:55.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.659+0000 7fa7c9400640 1 -- 172.21.15.76:0/245013053 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0a8da0 con 0x7fa7cc152640 2024-03-28T12:41:55.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.659+0000 7fa7d0a00640 1 -- 172.21.15.76:0/245013053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7cc152640 msgr2=0x7fa7cc15c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:55.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.659+0000 7fa7d0a00640 1 --2- 172.21.15.76:0/245013053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7cc152640 0x7fa7cc15c3d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc06f420 tx=0x7fa7bc01ed10 comp rx=0 tx=0).stop 2024-03-28T12:41:55.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.659+0000 7fa7d0a00640 1 -- 172.21.15.76:0/245013053 shutdown_connections 2024-03-28T12:41:55.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.659+0000 7fa7d0a00640 1 --2- 172.21.15.76:0/245013053 >> v2:172.21.15.111:3300/0 conn(0x7fa7cc06f920 0x7fa7cc06fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:55.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.659+0000 7fa7d0a00640 1 --2- 172.21.15.76:0/245013053 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7cc0c7890 0x7fa7cc071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:55.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.659+0000 7fa7d0a00640 1 --2- 172.21.15.76:0/245013053 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7cc152640 0x7fa7cc15c3d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:55.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.659+0000 7fa7d0a00640 1 -- 172.21.15.76:0/245013053 >> 172.21.15.76:0/245013053 conn(0x7fa7cc0cce90 msgr2=0x7fa7cc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:55.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.659+0000 7fa7d0a00640 1 -- 172.21.15.76:0/245013053 shutdown_connections 2024-03-28T12:41:55.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.659+0000 7fa7d0a00640 1 -- 172.21.15.76:0/245013053 wait complete. 2024-03-28T12:41:55.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.663+0000 7fa7d0a00640 1 Processor -- start 2024-03-28T12:41:55.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.663+0000 7fa7d0a00640 1 -- start start 2024-03-28T12:41:55.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.663+0000 7fa7d0a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7cc06f920 0x7fa7cc14d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:55.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.663+0000 7fa7d0a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7cc0c7890 0x7fa7cc14f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:55.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.663+0000 7fa7d0a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7cc152640 0x7fa7cc1ee300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:55.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.663+0000 7fa7d0a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc06c1b0 con 0x7fa7cc0c7890 2024-03-28T12:41:55.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.663+0000 7fa7d0a00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc06bed0 con 0x7fa7cc06f920 2024-03-28T12:41:55.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.663+0000 7fa7d0a00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa7cc0c8230 con 0x7fa7cc152640 2024-03-28T12:41:55.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.663+0000 7fa7c9e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7cc0c7890 0x7fa7cc14f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:55.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.663+0000 7fa7c9e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7cc0c7890 0x7fa7cc14f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47124/0 (socket says 172.21.15.76:47124) 2024-03-28T12:41:55.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.663+0000 7fa7c9e00640 1 -- 172.21.15.76:0/2835584271 learned_addr learned my addr 172.21.15.76:0/2835584271 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:55.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.663+0000 7fa7ca800640 1 --2- 172.21.15.76:0/2835584271 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7cc06f920 0x7fa7cc14d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:55.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.663+0000 7fa7cb200640 1 --2- 172.21.15.76:0/2835584271 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7cc152640 0x7fa7cc1ee300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:55.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.667+0000 7fa7c9e00640 1 -- 172.21.15.76:0/2835584271 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7cc152640 msgr2=0x7fa7cc1ee300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:55.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.667+0000 7fa7c9e00640 1 --2- 172.21.15.76:0/2835584271 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7cc152640 0x7fa7cc1ee300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:55.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.667+0000 7fa7c9e00640 1 -- 172.21.15.76:0/2835584271 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7cc06f920 msgr2=0x7fa7cc14d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:55.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.667+0000 7fa7c9e00640 1 --2- 172.21.15.76:0/2835584271 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7cc06f920 0x7fa7cc14d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:55.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.667+0000 7fa7c9e00640 1 -- 172.21.15.76:0/2835584271 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7cc14dd80 con 0x7fa7cc0c7890 2024-03-28T12:41:55.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.671+0000 7fa7c9e00640 1 --2- 172.21.15.76:0/2835584271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7cc0c7890 0x7fa7cc14f210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800d800 tx=0x7fa7b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:55.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.671+0000 7fa7c2a00640 1 -- 172.21.15.76:0/2835584271 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b800b6c0 con 0x7fa7cc0c7890 2024-03-28T12:41:55.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.671+0000 7fa7c2a00640 1 -- 172.21.15.76:0/2835584271 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b8019070 con 0x7fa7cc0c7890 2024-03-28T12:41:55.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.671+0000 7fa7c2a00640 1 -- 172.21.15.76:0/2835584271 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b800ba60 con 0x7fa7cc0c7890 2024-03-28T12:41:55.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.671+0000 7fa7d0a00640 1 -- 172.21.15.76:0/2835584271 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7cc1f1a10 con 0x7fa7cc0c7890 2024-03-28T12:41:55.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.671+0000 7fa7d0a00640 1 -- 172.21.15.76:0/2835584271 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7cc1f1fd0 con 0x7fa7cc0c7890 2024-03-28T12:41:55.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.675+0000 7fa7d0a00640 1 -- 172.21.15.76:0/2835584271 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7cc0686e0 con 0x7fa7cc0c7890 2024-03-28T12:41:55.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.691+0000 7fa7c2a00640 1 -- 172.21.15.76:0/2835584271 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fa7b800bc00 con 0x7fa7cc0c7890 2024-03-28T12:41:55.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.695+0000 7fa7c2a00640 1 --2- 172.21.15.76:0/2835584271 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7ac068010 0x7fa7ac06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:55.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.695+0000 7fa7ca800640 1 --2- 172.21.15.76:0/2835584271 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7ac068010 0x7fa7ac06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:55.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.695+0000 7fa7ca800640 1 --2- 172.21.15.76:0/2835584271 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7ac068010 0x7fa7ac06a4d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0b2000 tx=0x7fa7bc0aa070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:55.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.931+0000 7fa7c2a00640 1 -- 172.21.15.76:0/2835584271 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fa7b805dc70 con 0x7fa7cc0c7890 2024-03-28T12:41:55.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:55.931+0000 7fa7c2a00640 1 -- 172.21.15.76:0/2835584271 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fa7b8057480 con 0x7fa7cc0c7890 2024-03-28T12:41:56.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.091+0000 7fa7d0a00640 1 -- 172.21.15.76:0/2835584271 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7cc06c410 con 0x7fa7cc0c7890 2024-03-28T12:41:56.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.115+0000 7fa7c2a00640 1 -- 172.21.15.76:0/2835584271 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12884 (secure 0 0 0) 0x7fa7b8083270 con 0x7fa7cc0c7890 2024-03-28T12:41:56.114 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:41:56.114 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":18,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:41:27.133206+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:41:56.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.119+0000 7fa7d0a00640 1 -- 172.21.15.76:0/2835584271 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7ac068010 msgr2=0x7fa7ac06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:56.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.119+0000 7fa7d0a00640 1 --2- 172.21.15.76:0/2835584271 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7ac068010 0x7fa7ac06a4d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0b2000 tx=0x7fa7bc0aa070 comp rx=0 tx=0).stop 2024-03-28T12:41:56.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.119+0000 7fa7d0a00640 1 -- 172.21.15.76:0/2835584271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7cc0c7890 msgr2=0x7fa7cc14f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:56.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.119+0000 7fa7d0a00640 1 --2- 172.21.15.76:0/2835584271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7cc0c7890 0x7fa7cc14f210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800d800 tx=0x7fa7b800dcc0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.119+0000 7fa7d0a00640 1 -- 172.21.15.76:0/2835584271 shutdown_connections 2024-03-28T12:41:56.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.119+0000 7fa7d0a00640 1 --2- 172.21.15.76:0/2835584271 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7ac068010 0x7fa7ac06a4d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.119+0000 7fa7d0a00640 1 --2- 172.21.15.76:0/2835584271 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7cc152640 0x7fa7cc1ee300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.119+0000 7fa7d0a00640 1 --2- 172.21.15.76:0/2835584271 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7cc0c7890 0x7fa7cc14f210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.119+0000 7fa7d0a00640 1 --2- 172.21.15.76:0/2835584271 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7cc06f920 0x7fa7cc14d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.119+0000 7fa7d0a00640 1 -- 172.21.15.76:0/2835584271 >> 172.21.15.76:0/2835584271 conn(0x7fa7cc0cce90 msgr2=0x7fa7cc06edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:56.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.119+0000 7fa7d0a00640 1 -- 172.21.15.76:0/2835584271 shutdown_connections 2024-03-28T12:41:56.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.119+0000 7fa7d0a00640 1 -- 172.21.15.76:0/2835584271 wait complete. 2024-03-28T12:41:56.135 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T12:41:23.389090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-28T12:41:56.135 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T12:41:56.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.279+0000 7fbfd9e00640 1 Processor -- start 2024-03-28T12:41:56.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.279+0000 7fbfd9e00640 1 -- start start 2024-03-28T12:41:56.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.279+0000 7fbfd9e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbfd40cea30 0x7fbfd4071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:56.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.279+0000 7fbfd9e00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd4158680 con 0x7fbfd4072240 2024-03-28T12:41:56.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.279+0000 7fbfd9e00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfd4158940 con 0x7fbfd4152800 2024-03-28T12:41:56.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.279+0000 7fbfd9e00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fbfd4159550 con 0x7fbfd40cea30 2024-03-28T12:41:56.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.279+0000 7fbfd3400640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fbfd4072240 0x7fbfd40cab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:52208/0 (socket says 172.21.15.76:52208) 2024-03-28T12:41:56.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.279+0000 7fbfd3400640 1 -- 172.21.15.76:0/2536943167 learned_addr learned my addr 172.21.15.76:0/2536943167 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:41:56.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.283+0000 7fbfd2000640 1 -- 172.21.15.76:0/2536943167 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3611022148 0 0) 0x7fbfd4158680 con 0x7fbfd4072240 2024-03-28T12:41:56.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.283+0000 7fbfd2000640 1 -- 172.21.15.76:0/2536943167 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfb8003530 con 0x7fbfd4072240 2024-03-28T12:41:56.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.287+0000 7fbfd2000640 1 -- 172.21.15.76:0/2536943167 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3036391364 0 0) 0x7fbfb8003530 con 0x7fbfd4072240 2024-03-28T12:41:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.287+0000 7fbfd2000640 1 -- 172.21.15.76:0/2536943167 >> v2:172.21.15.111:3300/0 conn(0x7fbfd40cea30 msgr2=0x7fbfd4071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.287+0000 7fbfd2000640 1 --2- 172.21.15.76:0/2536943167 >> v2:172.21.15.111:3300/0 conn(0x7fbfd40cea30 0x7fbfd4071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.287+0000 7fbfd2000640 1 -- 172.21.15.76:0/2536943167 >> v1:172.21.15.111:6789/0 conn(0x7fbfd4152800 legacy=0x7fbfd40c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.287+0000 7fbfd2000640 1 -- 172.21.15.76:0/2536943167 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd4158c20 con 0x7fbfd4072240 2024-03-28T12:41:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.287+0000 7fbfd2000640 1 -- 172.21.15.76:0/2536943167 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7fbfcc001a00 con 0x7fbfd4072240 2024-03-28T12:41:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.287+0000 7fbfd2000640 1 -- 172.21.15.76:0/2536943167 >> v1:172.21.15.76:6789/0 conn(0x7fbfd4072240 legacy=0x7fbfd40cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.287+0000 7fbfd2000640 1 --2- 172.21.15.76:0/2536943167 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfb8003a80 0x7fbfb8003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.287+0000 7fbfd2000640 1 --2- 172.21.15.76:0/2536943167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfb8004810 0x7fbfb8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.287+0000 7fbfd2000640 1 --2- 172.21.15.76:0/2536943167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbfb80053d0 0x7fbfb800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.287+0000 7fbfd2000640 1 -- 172.21.15.76:0/2536943167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb800c260 con 0x7fbfb80053d0 2024-03-28T12:41:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.287+0000 7fbfd2000640 1 -- 172.21.15.76:0/2536943167 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb800c410 con 0x7fbfb8004810 2024-03-28T12:41:56.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.287+0000 7fbfd2000640 1 -- 172.21.15.76:0/2536943167 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb800c610 con 0x7fbfb8003a80 2024-03-28T12:41:56.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.291+0000 7fbfd3400640 1 --2- 172.21.15.76:0/2536943167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbfb80053d0 0x7fbfb800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:56.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.295+0000 7fbfd3400640 1 -- 172.21.15.76:0/2536943167 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfb8003a80 msgr2=0x7fbfb8003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:56.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.295+0000 7fbfd3400640 1 --2- 172.21.15.76:0/2536943167 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfb8003a80 0x7fbfb8003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.295+0000 7fbfd3400640 1 -- 172.21.15.76:0/2536943167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfb8004810 msgr2=0x7fbfb8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:56.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.295+0000 7fbfd3400640 1 --2- 172.21.15.76:0/2536943167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfb8004810 0x7fbfb8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.295+0000 7fbfd3400640 1 -- 172.21.15.76:0/2536943167 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb8003530 con 0x7fbfb80053d0 2024-03-28T12:41:56.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.295+0000 7fbfd3400640 1 -- 172.21.15.76:0/2536943167 reap_dead start 2024-03-28T12:41:56.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.299+0000 7fbfd3400640 1 --2- 172.21.15.76:0/2536943167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbfb80053d0 0x7fbfb800b9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00a7b0 tx=0x7fbfcc01d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6355fc7c37101dfb server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:56.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.299+0000 7fbfd2000640 1 -- 172.21.15.76:0/2536943167 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc00a3d0 con 0x7fbfb80053d0 2024-03-28T12:41:56.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.303+0000 7fbfd2000640 1 -- 172.21.15.76:0/2536943167 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc0ac660 con 0x7fbfb80053d0 2024-03-28T12:41:56.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.303+0000 7fbfd2000640 1 -- 172.21.15.76:0/2536943167 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0aca50 con 0x7fbfb80053d0 2024-03-28T12:41:56.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.303+0000 7fbfd9e00640 1 -- 172.21.15.76:0/2536943167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbfb80053d0 msgr2=0x7fbfb800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:56.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.303+0000 7fbfd9e00640 1 --2- 172.21.15.76:0/2536943167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbfb80053d0 0x7fbfb800b9d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00a7b0 tx=0x7fbfcc01d2e0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.303+0000 7fbfd9e00640 1 -- 172.21.15.76:0/2536943167 shutdown_connections 2024-03-28T12:41:56.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.303+0000 7fbfd9e00640 1 --2- 172.21.15.76:0/2536943167 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbfb80053d0 0x7fbfb800b9d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.303+0000 7fbfd9e00640 1 -- 172.21.15.76:0/2536943167 >> 172.21.15.76:0/2536943167 conn(0x7fbfd4071540 msgr2=0x7fbfd4070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:56.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.303+0000 7fbfd9e00640 1 -- 172.21.15.76:0/2536943167 shutdown_connections 2024-03-28T12:41:56.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.303+0000 7fbfd9e00640 1 -- 172.21.15.76:0/2536943167 wait complete. 2024-03-28T12:41:56.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.303+0000 7fbfd9e00640 1 Processor -- start 2024-03-28T12:41:56.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.303+0000 7fbfd9e00640 1 -- start start 2024-03-28T12:41:56.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.307+0000 7fbfd9e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfb80053d0 0x7fbfd40cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:56.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.307+0000 7fbfd9e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfd40adc50 0x7fbfd40b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:56.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.307+0000 7fbfd9e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbfd40cbf50 0x7fbfd41f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:56.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.307+0000 7fbfd9e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd40cee60 con 0x7fbfd40cbf50 2024-03-28T12:41:56.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.307+0000 7fbfd9e00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd41591e0 con 0x7fbfd40adc50 2024-03-28T12:41:56.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.307+0000 7fbfd9e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fbfd40c8d00 con 0x7fbfb80053d0 2024-03-28T12:41:56.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.307+0000 7fbfd3400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbfd40cbf50 0x7fbfd41f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:56.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.307+0000 7fbfd3400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbfd40cbf50 0x7fbfd41f38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47142/0 (socket says 172.21.15.76:47142) 2024-03-28T12:41:56.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.307+0000 7fbfd3400640 1 -- 172.21.15.76:0/1674746148 learned_addr learned my addr 172.21.15.76:0/1674746148 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:56.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.311+0000 7fbfd3400640 1 -- 172.21.15.76:0/1674746148 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfb80053d0 msgr2=0x7fbfd40cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:56.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.311+0000 7fbfd3400640 1 --2- 172.21.15.76:0/1674746148 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfb80053d0 0x7fbfd40cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.311+0000 7fbfd3400640 1 -- 172.21.15.76:0/1674746148 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfd40adc50 msgr2=0x7fbfd40b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:56.308 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.311+0000 7fbfd3400640 1 --2- 172.21.15.76:0/1674746148 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfd40adc50 0x7fbfd40b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.311+0000 7fbfd3400640 1 -- 172.21.15.76:0/1674746148 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd41f12d0 con 0x7fbfd40cbf50 2024-03-28T12:41:56.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.311+0000 7fbfd3400640 1 --2- 172.21.15.76:0/1674746148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbfd40cbf50 0x7fbfd41f38e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc01db80 tx=0x7fbfb8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:56.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.315+0000 7fbfcbe00640 1 -- 172.21.15.76:0/1674746148 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc00a3d0 con 0x7fbfd40cbf50 2024-03-28T12:41:56.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.315+0000 7fbfd9e00640 1 -- 172.21.15.76:0/1674746148 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd40cd9f0 con 0x7fbfd40cbf50 2024-03-28T12:41:56.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.315+0000 7fbfd9e00640 1 -- 172.21.15.76:0/1674746148 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd41f07f0 con 0x7fbfd40cbf50 2024-03-28T12:41:56.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.315+0000 7fbfcbe00640 1 -- 172.21.15.76:0/1674746148 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfcc001950 con 0x7fbfd40cbf50 2024-03-28T12:41:56.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.315+0000 7fbfcbe00640 1 -- 172.21.15.76:0/1674746148 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0ac820 con 0x7fbfd40cbf50 2024-03-28T12:41:56.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.315+0000 7fbfd9e00640 1 -- 172.21.15.76:0/1674746148 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfac0052a0 con 0x7fbfd40cbf50 2024-03-28T12:41:56.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.335+0000 7fbfcbe00640 1 -- 172.21.15.76:0/1674746148 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fbfcc0be060 con 0x7fbfd40cbf50 2024-03-28T12:41:56.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.335+0000 7fbfcbe00640 1 --2- 172.21.15.76:0/1674746148 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbfb0067fc0 0x7fbfb006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:56.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.335+0000 7fbfd2a00640 1 --2- 172.21.15.76:0/1674746148 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbfb0067fc0 0x7fbfb006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:56.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.339+0000 7fbfd2a00640 1 --2- 172.21.15.76:0/1674746148 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbfb0067fc0 0x7fbfb006a480 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4007fd0 tx=0x7fbfc40079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:56.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.339+0000 7fbfcbe00640 1 -- 172.21.15.76:0/1674746148 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fbfcc0b5e00 con 0x7fbfd40cbf50 2024-03-28T12:41:56.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.575+0000 7fbfcbe00640 1 -- 172.21.15.76:0/1674746148 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fbfcc0c6080 con 0x7fbfd40cbf50 2024-03-28T12:41:56.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.751+0000 7fbfd9e00640 1 -- 172.21.15.76:0/1674746148 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbfac005860 con 0x7fbfd40cbf50 2024-03-28T12:41:56.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.755+0000 7fbfcbe00640 1 -- 172.21.15.76:0/1674746148 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7fbfcc016ff0 con 0x7fbfd40cbf50 2024-03-28T12:41:56.754 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-03-28T12:41:56.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.759+0000 7fbfd9e00640 1 -- 172.21.15.76:0/1674746148 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbfb0067fc0 msgr2=0x7fbfb006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:56.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.759+0000 7fbfd9e00640 1 --2- 172.21.15.76:0/1674746148 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbfb0067fc0 0x7fbfb006a480 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4007fd0 tx=0x7fbfc40079a0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.759+0000 7fbfd9e00640 1 -- 172.21.15.76:0/1674746148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbfd40cbf50 msgr2=0x7fbfd41f38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:56.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.759+0000 7fbfd9e00640 1 --2- 172.21.15.76:0/1674746148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbfd40cbf50 0x7fbfd41f38e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc01db80 tx=0x7fbfb8005840 comp rx=0 tx=0).stop 2024-03-28T12:41:56.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.759+0000 7fbfd9e00640 1 -- 172.21.15.76:0/1674746148 shutdown_connections 2024-03-28T12:41:56.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.759+0000 7fbfd9e00640 1 --2- 172.21.15.76:0/1674746148 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbfb0067fc0 0x7fbfb006a480 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.759+0000 7fbfd9e00640 1 --2- 172.21.15.76:0/1674746148 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbfd40cbf50 0x7fbfd41f38e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.759+0000 7fbfd9e00640 1 --2- 172.21.15.76:0/1674746148 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfd40adc50 0x7fbfd40b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.759+0000 7fbfd9e00640 1 --2- 172.21.15.76:0/1674746148 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbfb80053d0 0x7fbfd40cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.759+0000 7fbfd9e00640 1 -- 172.21.15.76:0/1674746148 >> 172.21.15.76:0/1674746148 conn(0x7fbfd4071540 msgr2=0x7fbfd4150e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:56.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.759+0000 7fbfd9e00640 1 -- 172.21.15.76:0/1674746148 shutdown_connections 2024-03-28T12:41:56.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.759+0000 7fbfd9e00640 1 -- 172.21.15.76:0/1674746148 wait complete. 2024-03-28T12:41:56.776 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-28T12:41:56.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.911+0000 7f2dd8a00640 1 Processor -- start 2024-03-28T12:41:56.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.911+0000 7f2dd8a00640 1 -- start start 2024-03-28T12:41:56.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.915+0000 7f2dd8a00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2dd40c5d10 0x7f2dd41548d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:56.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.915+0000 7f2dd8a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2dd40c3da0 0x7f2dd4154e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:56.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.915+0000 7f2dd8a00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dd40c7b10 con 0x7f2dd40c5930 2024-03-28T12:41:56.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.915+0000 7f2dd8a00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f2dd40c8b40 con 0x7f2dd40c5d10 2024-03-28T12:41:56.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.915+0000 7f2dd8a00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd40c7790 con 0x7f2dd40c3da0 2024-03-28T12:41:56.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.915+0000 7f2dd1e00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f2dd40c5930 0x7f2dd40c8430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:52218/0 (socket says 172.21.15.76:52218) 2024-03-28T12:41:56.913 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.915+0000 7f2dd1e00640 1 -- 172.21.15.76:0/3534205778 learned_addr learned my addr 172.21.15.76:0/3534205778 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:41:56.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.915+0000 7f2dd2800640 1 --2- 172.21.15.76:0/3534205778 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2dd40c3da0 0x7f2dd4154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:56.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.915+0000 7f2dc9400640 1 --2- 172.21.15.76:0/3534205778 >> v2:172.21.15.111:3300/0 conn(0x7f2dd40c5d10 0x7f2dd41548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:56.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.919+0000 7f2dd1400640 1 -- 172.21.15.76:0/3534205778 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1957569077 0 0) 0x7f2dd40c7b10 con 0x7f2dd40c5930 2024-03-28T12:41:56.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.919+0000 7f2dd1400640 1 -- 172.21.15.76:0/3534205778 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2db8003530 con 0x7f2dd40c5930 2024-03-28T12:41:56.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.919+0000 7f2dd1400640 1 -- 172.21.15.76:0/3534205778 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 123246127 0 0) 0x7f2db8003530 con 0x7f2dd40c5930 2024-03-28T12:41:56.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.919+0000 7f2dd1400640 1 -- 172.21.15.76:0/3534205778 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2dd40c3da0 msgr2=0x7f2dd4154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:56.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.919+0000 7f2dd1400640 1 --2- 172.21.15.76:0/3534205778 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2dd40c3da0 0x7f2dd4154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.919+0000 7f2dd1400640 1 -- 172.21.15.76:0/3534205778 >> v2:172.21.15.111:3300/0 conn(0x7f2dd40c5d10 msgr2=0x7f2dd41548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:56.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.919+0000 7f2dd1400640 1 --2- 172.21.15.76:0/3534205778 >> v2:172.21.15.111:3300/0 conn(0x7f2dd40c5d10 0x7f2dd41548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.919+0000 7f2dd1400640 1 -- 172.21.15.76:0/3534205778 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd40c74b0 con 0x7f2dd40c5930 2024-03-28T12:41:56.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.919+0000 7f2dd1400640 1 -- 172.21.15.76:0/3534205778 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7f2dc4001680 con 0x7f2dd40c5930 2024-03-28T12:41:56.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.919+0000 7f2dd1400640 1 -- 172.21.15.76:0/3534205778 >> v1:172.21.15.76:6789/0 conn(0x7f2dd40c5930 legacy=0x7f2dd40c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:56.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.919+0000 7f2dd1400640 1 --2- 172.21.15.76:0/3534205778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2db80039c0 0x7f2db8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:56.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.919+0000 7f2dd1400640 1 --2- 172.21.15.76:0/3534205778 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2db8004810 0x7f2db8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:56.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.919+0000 7f2dd1400640 1 --2- 172.21.15.76:0/3534205778 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2dd40c3da0 0x7f2db80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:56.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.919+0000 7f2dd1400640 1 -- 172.21.15.76:0/3534205778 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd40c8b40 con 0x7f2db80039c0 2024-03-28T12:41:56.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.919+0000 7f2dd1400640 1 -- 172.21.15.76:0/3534205778 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd40c7790 con 0x7f2db8004810 2024-03-28T12:41:56.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.919+0000 7f2dd1400640 1 -- 172.21.15.76:0/3534205778 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2db800ba20 con 0x7f2dd40c3da0 2024-03-28T12:41:56.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.923+0000 7f2dd1e00640 1 --2- 172.21.15.76:0/3534205778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2db80039c0 0x7f2db8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:56.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.927+0000 7f2dd1e00640 1 -- 172.21.15.76:0/3534205778 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2dd40c3da0 msgr2=0x7f2db80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:56.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.927+0000 7f2dd1e00640 1 --2- 172.21.15.76:0/3534205778 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2dd40c3da0 0x7f2db80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.927+0000 7f2dd1e00640 1 -- 172.21.15.76:0/3534205778 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2db8004810 msgr2=0x7f2db8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:56.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.927+0000 7f2dd1e00640 1 --2- 172.21.15.76:0/3534205778 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2db8004810 0x7f2db8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.927+0000 7f2dd1e00640 1 -- 172.21.15.76:0/3534205778 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db8003530 con 0x7f2db80039c0 2024-03-28T12:41:56.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.931+0000 7f2dd1e00640 1 --2- 172.21.15.76:0/3534205778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2db80039c0 0x7f2db8003de0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400c190 tx=0x7f2dc401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8159398c0d3d35 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:56.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.935+0000 7f2dd1400640 1 -- 172.21.15.76:0/3534205778 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4007c90 con 0x7f2db80039c0 2024-03-28T12:41:56.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.935+0000 7f2dd1400640 1 -- 172.21.15.76:0/3534205778 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc40a9020 con 0x7f2db80039c0 2024-03-28T12:41:56.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.935+0000 7f2dd1400640 1 -- 172.21.15.76:0/3534205778 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4005ae0 con 0x7f2db80039c0 2024-03-28T12:41:56.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.935+0000 7f2dd8a00640 1 -- 172.21.15.76:0/3534205778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2db80039c0 msgr2=0x7f2db8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:56.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.935+0000 7f2dd8a00640 1 --2- 172.21.15.76:0/3534205778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2db80039c0 0x7f2db8003de0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400c190 tx=0x7f2dc401cbe0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.935+0000 7f2dd2800640 1 -- 172.21.15.76:0/3534205778 reap_dead start 2024-03-28T12:41:56.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.935+0000 7f2dd8a00640 1 -- 172.21.15.76:0/3534205778 shutdown_connections 2024-03-28T12:41:56.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.935+0000 7f2dd8a00640 1 -- 172.21.15.76:0/3534205778 >> 172.21.15.76:0/3534205778 conn(0x7f2dd40c93a0 msgr2=0x7f2dd40c97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:56.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.935+0000 7f2dd8a00640 1 -- 172.21.15.76:0/3534205778 shutdown_connections 2024-03-28T12:41:56.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.935+0000 7f2dd8a00640 1 -- 172.21.15.76:0/3534205778 wait complete. 2024-03-28T12:41:56.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.939+0000 7f2dd8a00640 1 Processor -- start 2024-03-28T12:41:56.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.939+0000 7f2dd8a00640 1 -- start start 2024-03-28T12:41:56.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.939+0000 7f2dd8a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2db80039c0 0x7f2dd41f48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:56.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.939+0000 7f2dd8a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2dd414db30 0x7f2dd414b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:56.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.939+0000 7f2dd8a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2dd414bd80 0x7f2dd414c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:56.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.939+0000 7f2dd8a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd40c8060 con 0x7f2dd414db30 2024-03-28T12:41:56.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.939+0000 7f2dd8a00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd40c7ee0 con 0x7f2dd414bd80 2024-03-28T12:41:56.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.939+0000 7f2dd8a00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd4165ac0 con 0x7f2db80039c0 2024-03-28T12:41:56.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.939+0000 7f2dc9400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2dd414db30 0x7f2dd414b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:56.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.939+0000 7f2dc9400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2dd414db30 0x7f2dd414b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47164/0 (socket says 172.21.15.76:47164) 2024-03-28T12:41:56.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.939+0000 7f2dc9400640 1 -- 172.21.15.76:0/4146246786 learned_addr learned my addr 172.21.15.76:0/4146246786 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:56.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.939+0000 7f2dd1e00640 1 --2- 172.21.15.76:0/4146246786 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2db80039c0 0x7f2dd41f48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:56.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.939+0000 7f2dd2800640 1 --2- 172.21.15.76:0/4146246786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2dd414bd80 0x7f2dd414c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:56.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.943+0000 7f2dc9400640 1 -- 172.21.15.76:0/4146246786 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2db80039c0 msgr2=0x7f2dd41f48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:56.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.943+0000 7f2dc9400640 1 --2- 172.21.15.76:0/4146246786 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2db80039c0 0x7f2dd41f48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.943+0000 7f2dc9400640 1 -- 172.21.15.76:0/4146246786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2dd414bd80 msgr2=0x7f2dd414c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:56.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.943+0000 7f2dc9400640 1 --2- 172.21.15.76:0/4146246786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2dd414bd80 0x7f2dd414c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:56.942 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.943+0000 7f2dc9400640 1 -- 172.21.15.76:0/4146246786 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd4155410 con 0x7f2dd414db30 2024-03-28T12:41:56.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.947+0000 7f2dc9400640 1 --2- 172.21.15.76:0/4146246786 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2dd414db30 0x7f2dd414b100 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009de0 tx=0x7f2dbc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:56.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.947+0000 7f2dcaa00640 1 -- 172.21.15.76:0/4146246786 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc018020 con 0x7f2dd414db30 2024-03-28T12:41:56.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.947+0000 7f2dcaa00640 1 -- 172.21.15.76:0/4146246786 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dbc014480 con 0x7f2dd414db30 2024-03-28T12:41:56.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.947+0000 7f2dcaa00640 1 -- 172.21.15.76:0/4146246786 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc014870 con 0x7f2dd414db30 2024-03-28T12:41:56.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.947+0000 7f2dd8a00640 1 -- 172.21.15.76:0/4146246786 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd41f4e20 con 0x7f2dd414db30 2024-03-28T12:41:56.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.947+0000 7f2dd8a00640 1 -- 172.21.15.76:0/4146246786 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd414f3d0 con 0x7f2dd414db30 2024-03-28T12:41:56.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.951+0000 7f2dd8a00640 1 -- 172.21.15.76:0/4146246786 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd40686e0 con 0x7f2dd414db30 2024-03-28T12:41:56.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.967+0000 7f2dcaa00640 1 -- 172.21.15.76:0/4146246786 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f2dbc01b020 con 0x7f2dd414db30 2024-03-28T12:41:56.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.971+0000 7f2dcaa00640 1 --2- 172.21.15.76:0/4146246786 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2db0068010 0x7f2db006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:56.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.971+0000 7f2dd1e00640 1 --2- 172.21.15.76:0/4146246786 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2db0068010 0x7f2db006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:56.969 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:56.971+0000 7f2dd1e00640 1 --2- 172.21.15.76:0/4146246786 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2db0068010 0x7f2db006a4d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40aa000 tx=0x7f2dc40b1040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:57.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.207+0000 7f2dcaa00640 1 -- 172.21.15.76:0/4146246786 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f2dbc05e160 con 0x7f2dd414db30 2024-03-28T12:41:57.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.207+0000 7f2dcaa00640 1 -- 172.21.15.76:0/4146246786 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f2dbc022030 con 0x7f2dd414db30 2024-03-28T12:41:57.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.367+0000 7f2dd8a00640 1 -- 172.21.15.76:0/4146246786 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2dd40c9180 con 0x7f2dd414db30 2024-03-28T12:41:57.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.375+0000 7f2dcaa00640 1 -- 172.21.15.76:0/4146246786 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f2dd4155410 con 0x7f2dd414db30 2024-03-28T12:41:57.373 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:41:57.373 INFO:teuthology.orchestra.run.smithi076.stdout:[ 2024-03-28T12:41:57.373 INFO:teuthology.orchestra.run.smithi076.stdout: { 2024-03-28T12:41:57.373 INFO:teuthology.orchestra.run.smithi076.stdout: "poolnum": 1, 2024-03-28T12:41:57.373 INFO:teuthology.orchestra.run.smithi076.stdout: "poolname": ".mgr" 2024-03-28T12:41:57.373 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-03-28T12:41:57.373 INFO:teuthology.orchestra.run.smithi076.stdout:] 2024-03-28T12:41:57.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.375+0000 7f2dd8a00640 1 -- 172.21.15.76:0/4146246786 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2db0068010 msgr2=0x7f2db006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:57.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.375+0000 7f2dd8a00640 1 --2- 172.21.15.76:0/4146246786 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2db0068010 0x7f2db006a4d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40aa000 tx=0x7f2dc40b1040 comp rx=0 tx=0).stop 2024-03-28T12:41:57.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.375+0000 7f2dd8a00640 1 -- 172.21.15.76:0/4146246786 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2dd414db30 msgr2=0x7f2dd414b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:57.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.375+0000 7f2dd8a00640 1 --2- 172.21.15.76:0/4146246786 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2dd414db30 0x7f2dd414b100 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009de0 tx=0x7f2dbc00c490 comp rx=0 tx=0).stop 2024-03-28T12:41:57.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.375+0000 7f2dd8a00640 1 -- 172.21.15.76:0/4146246786 shutdown_connections 2024-03-28T12:41:57.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.375+0000 7f2dd8a00640 1 --2- 172.21.15.76:0/4146246786 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2db0068010 0x7f2db006a4d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:57.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.375+0000 7f2dd8a00640 1 --2- 172.21.15.76:0/4146246786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2dd414bd80 0x7f2dd414c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:57.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.375+0000 7f2dd8a00640 1 --2- 172.21.15.76:0/4146246786 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2dd414db30 0x7f2dd414b100 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:57.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.375+0000 7f2dd8a00640 1 --2- 172.21.15.76:0/4146246786 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2db80039c0 0x7f2dd41f48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:57.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.375+0000 7f2dd8a00640 1 -- 172.21.15.76:0/4146246786 >> 172.21.15.76:0/4146246786 conn(0x7f2dd40c93a0 msgr2=0x7f2dd4070120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:57.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.375+0000 7f2dd8a00640 1 -- 172.21.15.76:0/4146246786 shutdown_connections 2024-03-28T12:41:57.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.375+0000 7f2dd8a00640 1 -- 172.21.15.76:0/4146246786 wait complete. 2024-03-28T12:41:57.394 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-28T12:41:57.394 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-28T12:41:57.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.535+0000 7fac1ac00640 1 Processor -- start 2024-03-28T12:41:57.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.535+0000 7fac1ac00640 1 -- start start 2024-03-28T12:41:57.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.535+0000 7fac1ac00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac1406c960 0x7fac140c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:57.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.535+0000 7fac1ac00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fac140c4a10 0x7fac1406cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:57.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.535+0000 7fac1ac00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1415a9d0 con 0x7fac141549f0 2024-03-28T12:41:57.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.535+0000 7fac1ac00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fac140c9340 con 0x7fac140c4a10 2024-03-28T12:41:57.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.535+0000 7fac1ac00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fac1415acb0 con 0x7fac1406c960 2024-03-28T12:41:57.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.539+0000 7fac13400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac1406c960 0x7fac140c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:57.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.539+0000 7fac18c00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fac140c4a10 0x7fac1406cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:57.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.539+0000 7fac13400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac1406c960 0x7fac140c8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:44740/0 (socket says 172.21.15.76:44740) 2024-03-28T12:41:57.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.539+0000 7fac13400640 1 -- 172.21.15.76:0/3949191049 learned_addr learned my addr 172.21.15.76:0/3949191049 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:57.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.539+0000 7fac18c00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fac140c4a10 0x7fac1406cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:60492/0 (socket says 172.21.15.76:60492) 2024-03-28T12:41:57.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.547+0000 7fac13400640 1 -- 172.21.15.76:0/3949191049 >> v2:172.21.15.111:3300/0 conn(0x7fac140c4a10 msgr2=0x7fac1406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:57.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.547+0000 7fac13400640 1 --2- 172.21.15.76:0/3949191049 >> v2:172.21.15.111:3300/0 conn(0x7fac140c4a10 0x7fac1406cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:57.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.547+0000 7fac13400640 1 -- 172.21.15.76:0/3949191049 >> v1:172.21.15.111:6789/0 conn(0x7fac141549f0 legacy=0x7fac140cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:57.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.547+0000 7fac13400640 1 -- 172.21.15.76:0/3949191049 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1415af90 con 0x7fac1406c960 2024-03-28T12:41:57.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.551+0000 7fac13400640 1 --2- 172.21.15.76:0/3949191049 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac1406c960 0x7fac140c8d60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fac00009870 tx=0x7fac0001ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68401c7071177d33 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:57.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.563+0000 7fac12a00640 1 -- 172.21.15.76:0/3949191049 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac000b5070 con 0x7fac1406c960 2024-03-28T12:41:57.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.563+0000 7fac12a00640 1 -- 172.21.15.76:0/3949191049 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac000a8a50 con 0x7fac1406c960 2024-03-28T12:41:57.560 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.563+0000 7fac12a00640 1 -- 172.21.15.76:0/3949191049 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac000a8e20 con 0x7fac1406c960 2024-03-28T12:41:57.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.563+0000 7fac1ac00640 1 -- 172.21.15.76:0/3949191049 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac1406c960 msgr2=0x7fac140c8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:57.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.563+0000 7fac1ac00640 1 --2- 172.21.15.76:0/3949191049 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac1406c960 0x7fac140c8d60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fac00009870 tx=0x7fac0001ed50 comp rx=0 tx=0).stop 2024-03-28T12:41:57.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.563+0000 7fac1ac00640 1 -- 172.21.15.76:0/3949191049 shutdown_connections 2024-03-28T12:41:57.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.563+0000 7fac1ac00640 1 --2- 172.21.15.76:0/3949191049 >> v2:172.21.15.111:3300/0 conn(0x7fac140c4a10 0x7fac1406cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:57.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.563+0000 7fac1ac00640 1 --2- 172.21.15.76:0/3949191049 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac1406c960 0x7fac140c8d60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:57.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.563+0000 7fac1ac00640 1 -- 172.21.15.76:0/3949191049 >> 172.21.15.76:0/3949191049 conn(0x7fac14067330 msgr2=0x7fac14067740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:57.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.563+0000 7fac1ac00640 1 -- 172.21.15.76:0/3949191049 shutdown_connections 2024-03-28T12:41:57.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.563+0000 7fac1ac00640 1 -- 172.21.15.76:0/3949191049 wait complete. 2024-03-28T12:41:57.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.563+0000 7fac1ac00640 1 Processor -- start 2024-03-28T12:41:57.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.563+0000 7fac1ac00640 1 -- start start 2024-03-28T12:41:57.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.563+0000 7fac1ac00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac1406c960 0x7fac140ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:57.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.563+0000 7fac1ac00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac140c4a10 0x7fac140cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:57.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.563+0000 7fac1ac00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac141549f0 0x7fac1414d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:57.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.563+0000 7fac1ac00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fac14154dd0 con 0x7fac1406c960 2024-03-28T12:41:57.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.567+0000 7fac1ac00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fac1415b550 con 0x7fac141549f0 2024-03-28T12:41:57.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.567+0000 7fac1ac00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fac14154f50 con 0x7fac140c4a10 2024-03-28T12:41:57.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.567+0000 7fac13e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac1406c960 0x7fac140ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:57.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.567+0000 7fac13e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac1406c960 0x7fac140ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47170/0 (socket says 172.21.15.76:47170) 2024-03-28T12:41:57.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.567+0000 7fac13e00640 1 -- 172.21.15.76:0/1551707885 learned_addr learned my addr 172.21.15.76:0/1551707885 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:57.565 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.567+0000 7fac18c00640 1 --2- 172.21.15.76:0/1551707885 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac141549f0 0x7fac1414d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:57.566 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.567+0000 7fac13400640 1 --2- 172.21.15.76:0/1551707885 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac140c4a10 0x7fac140cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:57.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.571+0000 7fac13e00640 1 -- 172.21.15.76:0/1551707885 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac140c4a10 msgr2=0x7fac140cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:57.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.571+0000 7fac13e00640 1 --2- 172.21.15.76:0/1551707885 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac140c4a10 0x7fac140cadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:57.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.571+0000 7fac13e00640 1 -- 172.21.15.76:0/1551707885 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac141549f0 msgr2=0x7fac1414d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:57.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.571+0000 7fac13e00640 1 --2- 172.21.15.76:0/1551707885 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac141549f0 0x7fac1414d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:57.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.571+0000 7fac13e00640 1 -- 172.21.15.76:0/1551707885 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac141f0b90 con 0x7fac1406c960 2024-03-28T12:41:57.571 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.571+0000 7fac13e00640 1 --2- 172.21.15.76:0/1551707885 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac1406c960 0x7fac140ca260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fac0400c370 tx=0x7fac0400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:57.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.575+0000 7fac0be00640 1 -- 172.21.15.76:0/1551707885 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac040052d0 con 0x7fac1406c960 2024-03-28T12:41:57.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.575+0000 7fac0be00640 1 -- 172.21.15.76:0/1551707885 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac04005470 con 0x7fac1406c960 2024-03-28T12:41:57.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.575+0000 7fac1ac00640 1 -- 172.21.15.76:0/1551707885 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac141f0e50 con 0x7fac1406c960 2024-03-28T12:41:57.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.575+0000 7fac0be00640 1 -- 172.21.15.76:0/1551707885 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac04007260 con 0x7fac1406c960 2024-03-28T12:41:57.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.579+0000 7fac1ac00640 1 -- 172.21.15.76:0/1551707885 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac141f1410 con 0x7fac1406c960 2024-03-28T12:41:57.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.579+0000 7fac1ac00640 1 -- 172.21.15.76:0/1551707885 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac14068860 con 0x7fac1406c960 2024-03-28T12:41:57.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.827+0000 7fac0be00640 1 -- 172.21.15.76:0/1551707885 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fac04007400 con 0x7fac1406c960 2024-03-28T12:41:57.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.827+0000 7fac0be00640 1 --2- 172.21.15.76:0/1551707885 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fabf4068010 0x7fabf406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:57.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.831+0000 7fac13400640 1 --2- 172.21.15.76:0/1551707885 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fabf4068010 0x7fabf406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:57.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.831+0000 7fac13400640 1 --2- 172.21.15.76:0/1551707885 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fabf4068010 0x7fabf406a4d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac000b2000 tx=0x7fac00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:57.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.839+0000 7fac0be00640 1 -- 172.21.15.76:0/1551707885 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fac0405c710 con 0x7fac1406c960 2024-03-28T12:41:57.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.839+0000 7fac0be00640 1 -- 172.21.15.76:0/1551707885 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fac04055f20 con 0x7fac1406c960 2024-03-28T12:41:57.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:57.999+0000 7fac1ac00640 1 -- 172.21.15.76:0/1551707885 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fac1406d600 con 0x7fac1406c960 2024-03-28T12:41:58.980 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:58.979+0000 7fac0be00640 1 -- 172.21.15.76:0/1551707885 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7fac0405a220 con 0x7fac1406c960 2024-03-28T12:41:58.980 INFO:teuthology.orchestra.run.smithi076.stderr:pool 'cephfs_metadata' created 2024-03-28T12:41:58.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:58.983+0000 7fac1ac00640 1 -- 172.21.15.76:0/1551707885 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fabf4068010 msgr2=0x7fabf406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:58.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:58.983+0000 7fac1ac00640 1 --2- 172.21.15.76:0/1551707885 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fabf4068010 0x7fabf406a4d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac000b2000 tx=0x7fac00009040 comp rx=0 tx=0).stop 2024-03-28T12:41:58.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:58.983+0000 7fac1ac00640 1 -- 172.21.15.76:0/1551707885 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac1406c960 msgr2=0x7fac140ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:58.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:58.983+0000 7fac1ac00640 1 --2- 172.21.15.76:0/1551707885 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac1406c960 0x7fac140ca260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fac0400c370 tx=0x7fac0400c830 comp rx=0 tx=0).stop 2024-03-28T12:41:58.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:58.983+0000 7fac1ac00640 1 -- 172.21.15.76:0/1551707885 shutdown_connections 2024-03-28T12:41:58.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:58.983+0000 7fac1ac00640 1 --2- 172.21.15.76:0/1551707885 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fabf4068010 0x7fabf406a4d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:58.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:58.983+0000 7fac1ac00640 1 --2- 172.21.15.76:0/1551707885 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac141549f0 0x7fac1414d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:58.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:58.983+0000 7fac1ac00640 1 --2- 172.21.15.76:0/1551707885 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fac140c4a10 0x7fac140cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:58.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:58.983+0000 7fac1ac00640 1 --2- 172.21.15.76:0/1551707885 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fac1406c960 0x7fac140ca260 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:58.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:58.983+0000 7fac1ac00640 1 -- 172.21.15.76:0/1551707885 >> 172.21.15.76:0/1551707885 conn(0x7fac14067330 msgr2=0x7fac141e62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:58.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:58.983+0000 7fac1ac00640 1 -- 172.21.15.76:0/1551707885 shutdown_connections 2024-03-28T12:41:58.983 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:58.983+0000 7fac1ac00640 1 -- 172.21.15.76:0/1551707885 wait complete. 2024-03-28T12:41:59.002 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-03-28T12:41:59.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.159+0000 7f6dbbe00640 1 Processor -- start 2024-03-28T12:41:59.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.159+0000 7f6dbbe00640 1 -- start start 2024-03-28T12:41:59.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.159+0000 7f6dbbe00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6db4154560 0x7f6db4154940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:59.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.159+0000 7f6dbbe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6db40c8b10 0x7f6db415b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:59.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.159+0000 7f6dbbe00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6db415df80 con 0x7f6db40cb560 2024-03-28T12:41:59.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.159+0000 7f6dbbe00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f6db415eb70 con 0x7f6db4154560 2024-03-28T12:41:59.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.159+0000 7f6dbbe00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6db415e240 con 0x7f6db40c8b10 2024-03-28T12:41:59.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.159+0000 7f6db9400640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6db4154560 0x7f6db4154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:59.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.159+0000 7f6db9400640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6db4154560 0x7f6db4154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:60508/0 (socket says 172.21.15.76:60508) 2024-03-28T12:41:59.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.159+0000 7f6db9400640 1 -- 172.21.15.76:0/1724427731 learned_addr learned my addr 172.21.15.76:0/1724427731 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:59.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.163+0000 7f6db9e00640 1 --2- 172.21.15.76:0/1724427731 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6db40c8b10 0x7f6db415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:59.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.163+0000 7f6db9400640 1 -- 172.21.15.76:0/1724427731 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6db40c8b10 msgr2=0x7f6db415b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:59.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.163+0000 7f6db9400640 1 --2- 172.21.15.76:0/1724427731 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6db40c8b10 0x7f6db415b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:59.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.163+0000 7f6db9400640 1 -- 172.21.15.76:0/1724427731 >> v1:172.21.15.111:6789/0 conn(0x7f6db40cb560 legacy=0x7f6db4071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:41:59.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.163+0000 7f6db9400640 1 -- 172.21.15.76:0/1724427731 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db415e520 con 0x7f6db4154560 2024-03-28T12:41:59.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.171+0000 7f6db9400640 1 --2- 172.21.15.76:0/1724427731 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6db4154560 0x7f6db4154940 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009e50 tx=0x7f6da801f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6f850af7514f0b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:59.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.243+0000 7f6db3e00640 1 -- 172.21.15.76:0/1724427731 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da80b4070 con 0x7f6db4154560 2024-03-28T12:41:59.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.243+0000 7f6db3e00640 1 -- 172.21.15.76:0/1724427731 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da80af400 con 0x7f6db4154560 2024-03-28T12:41:59.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.243+0000 7f6db3e00640 1 -- 172.21.15.76:0/1724427731 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da80af7d0 con 0x7f6db4154560 2024-03-28T12:41:59.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.243+0000 7f6dbbe00640 1 -- 172.21.15.76:0/1724427731 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6db4154560 msgr2=0x7f6db4154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:59.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.243+0000 7f6dbbe00640 1 --2- 172.21.15.76:0/1724427731 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6db4154560 0x7f6db4154940 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009e50 tx=0x7f6da801f1e0 comp rx=0 tx=0).stop 2024-03-28T12:41:59.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.243+0000 7f6dbbe00640 1 -- 172.21.15.76:0/1724427731 shutdown_connections 2024-03-28T12:41:59.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.243+0000 7f6dbbe00640 1 --2- 172.21.15.76:0/1724427731 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6db40c8b10 0x7f6db415b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:59.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.243+0000 7f6dbbe00640 1 --2- 172.21.15.76:0/1724427731 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6db4154560 0x7f6db4154940 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:59.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.243+0000 7f6dbbe00640 1 -- 172.21.15.76:0/1724427731 >> 172.21.15.76:0/1724427731 conn(0x7f6db4071640 msgr2=0x7f6db40701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:41:59.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.243+0000 7f6dbbe00640 1 -- 172.21.15.76:0/1724427731 shutdown_connections 2024-03-28T12:41:59.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.243+0000 7f6dbbe00640 1 -- 172.21.15.76:0/1724427731 wait complete. 2024-03-28T12:41:59.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.243+0000 7f6dbbe00640 1 Processor -- start 2024-03-28T12:41:59.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.243+0000 7f6dbbe00640 1 -- start start 2024-03-28T12:41:59.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.247+0000 7f6dbbe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6db40c8b10 0x7f6db41f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:59.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.247+0000 7f6dbbe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6db40cb560 0x7f6db4152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:59.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.247+0000 7f6dbbe00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6db4154560 0x7f6db40cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:59.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.247+0000 7f6dbbe00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6db4072670 con 0x7f6db40c8b10 2024-03-28T12:41:59.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.247+0000 7f6dbbe00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6db40cbaa0 con 0x7f6db4154560 2024-03-28T12:41:59.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.247+0000 7f6dbbe00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6db40727f0 con 0x7f6db40cb560 2024-03-28T12:41:59.245 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.247+0000 7f6db9400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6db40c8b10 0x7f6db41f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:59.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.247+0000 7f6db9400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6db40c8b10 0x7f6db41f4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47178/0 (socket says 172.21.15.76:47178) 2024-03-28T12:41:59.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.247+0000 7f6db9400640 1 -- 172.21.15.76:0/2136891908 learned_addr learned my addr 172.21.15.76:0/2136891908 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:41:59.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.251+0000 7f6db9400640 1 -- 172.21.15.76:0/2136891908 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6db40cb560 msgr2=0x7f6db4152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:59.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.251+0000 7f6db9400640 1 --2- 172.21.15.76:0/2136891908 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6db40cb560 0x7f6db4152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:59.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.251+0000 7f6db9400640 1 -- 172.21.15.76:0/2136891908 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6db4154560 msgr2=0x7f6db40cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:41:59.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.251+0000 7f6db9400640 1 --2- 172.21.15.76:0/2136891908 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6db4154560 0x7f6db40cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:41:59.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.251+0000 7f6db9400640 1 -- 172.21.15.76:0/2136891908 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db41f4950 con 0x7f6db40c8b10 2024-03-28T12:41:59.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.251+0000 7f6db9400640 1 --2- 172.21.15.76:0/2136891908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6db40c8b10 0x7f6db41f4410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6da801d890 tx=0x7f6da801bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:59.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.255+0000 7f6db1600640 1 -- 172.21.15.76:0/2136891908 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da80b4040 con 0x7f6db40c8b10 2024-03-28T12:41:59.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.255+0000 7f6db1600640 1 -- 172.21.15.76:0/2136891908 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6da80afd30 con 0x7f6db40c8b10 2024-03-28T12:41:59.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.255+0000 7f6db1600640 1 -- 172.21.15.76:0/2136891908 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da80b9410 con 0x7f6db40c8b10 2024-03-28T12:41:59.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.255+0000 7f6dbbe00640 1 -- 172.21.15.76:0/2136891908 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db415aa00 con 0x7f6db40c8b10 2024-03-28T12:41:59.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.255+0000 7f6dbbe00640 1 -- 172.21.15.76:0/2136891908 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db40cd460 con 0x7f6db40c8b10 2024-03-28T12:41:59.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.259+0000 7f6dbbe00640 1 -- 172.21.15.76:0/2136891908 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6db4154240 con 0x7f6db40c8b10 2024-03-28T12:41:59.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.511+0000 7f6db1600640 1 -- 172.21.15.76:0/2136891908 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f6da80c1030 con 0x7f6db40c8b10 2024-03-28T12:41:59.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.511+0000 7f6db1600640 1 --2- 172.21.15.76:0/2136891908 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6d94068010 0x7f6d9406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:41:59.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.511+0000 7f6db8a00640 1 --2- 172.21.15.76:0/2136891908 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6d94068010 0x7f6d9406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:41:59.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.511+0000 7f6db8a00640 1 --2- 172.21.15.76:0/2136891908 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6d94068010 0x7f6d9406a4d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6db4159f70 tx=0x7f6da00079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:41:59.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.527+0000 7f6db1600640 1 -- 172.21.15.76:0/2136891908 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f6da8002020 con 0x7f6db40c8b10 2024-03-28T12:41:59.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.527+0000 7f6db1600640 1 -- 172.21.15.76:0/2136891908 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f6da80c8060 con 0x7f6db40c8b10 2024-03-28T12:41:59.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.687+0000 7f6dbbe00640 1 -- 172.21.15.76:0/2136891908 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f6db4153f60 con 0x7f6db40c8b10 2024-03-28T12:41:59.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:41:59.999+0000 7f6db1600640 1 -- 172.21.15.76:0/2136891908 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) ==== 171+0+0 (secure 0 0 0) 0x7f6da80f9e20 con 0x7f6db40c8b10 2024-03-28T12:41:59.999 INFO:teuthology.orchestra.run.smithi076.stderr:pool 'cephfs_data' created 2024-03-28T12:42:00.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.003+0000 7f6dbbe00640 1 -- 172.21.15.76:0/2136891908 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6d94068010 msgr2=0x7f6d9406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:00.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.003+0000 7f6dbbe00640 1 --2- 172.21.15.76:0/2136891908 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6d94068010 0x7f6d9406a4d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6db4159f70 tx=0x7f6da00079c0 comp rx=0 tx=0).stop 2024-03-28T12:42:00.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.003+0000 7f6dbbe00640 1 -- 172.21.15.76:0/2136891908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6db40c8b10 msgr2=0x7f6db41f4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:00.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.003+0000 7f6dbbe00640 1 --2- 172.21.15.76:0/2136891908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6db40c8b10 0x7f6db41f4410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6da801d890 tx=0x7f6da801bf80 comp rx=0 tx=0).stop 2024-03-28T12:42:00.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.003+0000 7f6dbbe00640 1 -- 172.21.15.76:0/2136891908 shutdown_connections 2024-03-28T12:42:00.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.003+0000 7f6dbbe00640 1 --2- 172.21.15.76:0/2136891908 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6d94068010 0x7f6d9406a4d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:00.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.003+0000 7f6dbbe00640 1 --2- 172.21.15.76:0/2136891908 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6db4154560 0x7f6db40cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:00.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.003+0000 7f6dbbe00640 1 --2- 172.21.15.76:0/2136891908 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6db40cb560 0x7f6db4152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:00.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.003+0000 7f6dbbe00640 1 --2- 172.21.15.76:0/2136891908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6db40c8b10 0x7f6db41f4410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:00.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.003+0000 7f6dbbe00640 1 -- 172.21.15.76:0/2136891908 >> 172.21.15.76:0/2136891908 conn(0x7f6db4071640 msgr2=0x7f6db4074e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:00.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.003+0000 7f6dbbe00640 1 -- 172.21.15.76:0/2136891908 shutdown_connections 2024-03-28T12:42:00.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.003+0000 7f6dbbe00640 1 -- 172.21.15.76:0/2136891908 wait complete. 2024-03-28T12:42:00.030 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-28T12:42:00.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.195+0000 7fd2ed200640 1 Processor -- start 2024-03-28T12:42:00.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.195+0000 7fd2ed200640 1 -- start start 2024-03-28T12:42:00.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.199+0000 7fd2ed200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fd2e8152800 0x7fd2e80cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:00.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.199+0000 7fd2ed200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2e80cab80 0x7fd2e80cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:00.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.199+0000 7fd2ed200640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2e8158680 con 0x7fd2e80c97e0 2024-03-28T12:42:00.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.199+0000 7fd2ed200640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e8159550 con 0x7fd2e8152800 2024-03-28T12:42:00.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.199+0000 7fd2ed200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e80cb4f0 con 0x7fd2e80cab80 2024-03-28T12:42:00.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.199+0000 7fd2e5e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fd2e8152800 0x7fd2e80cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:00.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.199+0000 7fd2e5e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fd2e8152800 0x7fd2e80cea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47186/0 (socket says 172.21.15.76:47186) 2024-03-28T12:42:00.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.199+0000 7fd2e5e00640 1 -- 172.21.15.76:0/2488175642 learned_addr learned my addr 172.21.15.76:0/2488175642 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:00.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.203+0000 7fd2e5e00640 1 -- 172.21.15.76:0/2488175642 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2e80cab80 msgr2=0x7fd2e80cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:00.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.203+0000 7fd2e5e00640 1 --2- 172.21.15.76:0/2488175642 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2e80cab80 0x7fd2e80cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:00.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.203+0000 7fd2e5e00640 1 -- 172.21.15.76:0/2488175642 >> v1:172.21.15.111:6789/0 conn(0x7fd2e80c97e0 legacy=0x7fd2e8071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:00.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.203+0000 7fd2e5e00640 1 -- 172.21.15.76:0/2488175642 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e8158940 con 0x7fd2e8152800 2024-03-28T12:42:00.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.207+0000 7fd2e5e00640 1 --2- 172.21.15.76:0/2488175642 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2e8152800 0x7fd2e80cea30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80b0fe0 tx=0x7fd2d801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a076a3f4983433f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:00.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.211+0000 7fd2e4a00640 1 -- 172.21.15.76:0/2488175642 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d80aa5f0 con 0x7fd2e8152800 2024-03-28T12:42:00.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.211+0000 7fd2e4a00640 1 -- 172.21.15.76:0/2488175642 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d80af070 con 0x7fd2e8152800 2024-03-28T12:42:00.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.211+0000 7fd2e4a00640 1 -- 172.21.15.76:0/2488175642 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d80aa9b0 con 0x7fd2e8152800 2024-03-28T12:42:00.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.211+0000 7fd2ed200640 1 -- 172.21.15.76:0/2488175642 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2e8152800 msgr2=0x7fd2e80cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:00.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.211+0000 7fd2ed200640 1 --2- 172.21.15.76:0/2488175642 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2e8152800 0x7fd2e80cea30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80b0fe0 tx=0x7fd2d801c4d0 comp rx=0 tx=0).stop 2024-03-28T12:42:00.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.211+0000 7fd2ed200640 1 -- 172.21.15.76:0/2488175642 shutdown_connections 2024-03-28T12:42:00.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.211+0000 7fd2ed200640 1 --2- 172.21.15.76:0/2488175642 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2e80cab80 0x7fd2e80cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:00.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.211+0000 7fd2ed200640 1 --2- 172.21.15.76:0/2488175642 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2e8152800 0x7fd2e80cea30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:00.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.211+0000 7fd2ed200640 1 -- 172.21.15.76:0/2488175642 >> 172.21.15.76:0/2488175642 conn(0x7fd2e8071540 msgr2=0x7fd2e8070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:00.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.211+0000 7fd2ed200640 1 -- 172.21.15.76:0/2488175642 shutdown_connections 2024-03-28T12:42:00.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.211+0000 7fd2ed200640 1 -- 172.21.15.76:0/2488175642 wait complete. 2024-03-28T12:42:00.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.211+0000 7fd2ed200640 1 Processor -- start 2024-03-28T12:42:00.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.211+0000 7fd2ed200640 1 -- start start 2024-03-28T12:42:00.212 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.215+0000 7fd2ed200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2e80c97e0 0x7fd2e8148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:00.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.215+0000 7fd2ed200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2e80cab80 0x7fd2e81511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:00.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.215+0000 7fd2ed200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2e8152800 0x7fd2e81516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:00.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.215+0000 7fd2ed200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e80c9c30 con 0x7fd2e8152800 2024-03-28T12:42:00.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.215+0000 7fd2ed200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e80c8d00 con 0x7fd2e80c97e0 2024-03-28T12:42:00.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.215+0000 7fd2ed200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e8072410 con 0x7fd2e80cab80 2024-03-28T12:42:00.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.215+0000 7fd2e6800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2e8152800 0x7fd2e81516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:00.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.215+0000 7fd2e6800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2e8152800 0x7fd2e81516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:47194/0 (socket says 172.21.15.76:47194) 2024-03-28T12:42:00.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.215+0000 7fd2e6800640 1 -- 172.21.15.76:0/729253469 learned_addr learned my addr 172.21.15.76:0/729253469 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:00.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.219+0000 7fd2e5e00640 1 --2- 172.21.15.76:0/729253469 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2e80c97e0 0x7fd2e8148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:00.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.219+0000 7fd2e6800640 1 -- 172.21.15.76:0/729253469 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2e80cab80 msgr2=0x7fd2e81511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:00.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.219+0000 7fd2e6800640 1 --2- 172.21.15.76:0/729253469 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2e80cab80 0x7fd2e81511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:00.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.219+0000 7fd2e6800640 1 -- 172.21.15.76:0/729253469 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2e80c97e0 msgr2=0x7fd2e8148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:00.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.219+0000 7fd2e6800640 1 --2- 172.21.15.76:0/729253469 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2e80c97e0 0x7fd2e8148cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:00.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.219+0000 7fd2e6800640 1 -- 172.21.15.76:0/729253469 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e80b22d0 con 0x7fd2e8152800 2024-03-28T12:42:00.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.223+0000 7fd2e6800640 1 --2- 172.21.15.76:0/729253469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2e8152800 0x7fd2e81516f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000b970 tx=0x7fd2e000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:00.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.227+0000 7fd2de000640 1 -- 172.21.15.76:0/729253469 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0019070 con 0x7fd2e8152800 2024-03-28T12:42:00.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.227+0000 7fd2de000640 1 -- 172.21.15.76:0/729253469 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e000cb60 con 0x7fd2e8152800 2024-03-28T12:42:00.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.227+0000 7fd2ed200640 1 -- 172.21.15.76:0/729253469 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e80b2900 con 0x7fd2e8152800 2024-03-28T12:42:00.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.227+0000 7fd2de000640 1 -- 172.21.15.76:0/729253469 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0014440 con 0x7fd2e8152800 2024-03-28T12:42:00.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.227+0000 7fd2ed200640 1 -- 172.21.15.76:0/729253469 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e80b2ec0 con 0x7fd2e8152800 2024-03-28T12:42:00.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.231+0000 7fd2ed200640 1 -- 172.21.15.76:0/729253469 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e80686e0 con 0x7fd2e8152800 2024-03-28T12:42:00.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.523+0000 7fd2de000640 1 -- 172.21.15.76:0/729253469 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fd2e001c070 con 0x7fd2e8152800 2024-03-28T12:42:00.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.523+0000 7fd2de000640 1 --2- 172.21.15.76:0/729253469 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd2c8068010 0x7fd2c806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:00.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.523+0000 7fd2e5e00640 1 --2- 172.21.15.76:0/729253469 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd2c8068010 0x7fd2c806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:00.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.523+0000 7fd2e5e00640 1 --2- 172.21.15.76:0/729253469 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd2c8068010 0x7fd2c806a4d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80ae000 tx=0x7fd2d80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:00.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.535+0000 7fd2de000640 1 -- 172.21.15.76:0/729253469 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7fd2e0054880 con 0x7fd2e8152800 2024-03-28T12:42:00.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.535+0000 7fd2de000640 1 -- 172.21.15.76:0/729253469 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fd2e0023020 con 0x7fd2e8152800 2024-03-28T12:42:00.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:00.735+0000 7fd2ed200640 1 -- 172.21.15.76:0/729253469 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd2e80c91b0 con 0x7fd2e8152800 2024-03-28T12:42:02.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.071+0000 7fd2de000640 1 -- 172.21.15.76:0/729253469 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fd2e0056ee0 con 0x7fd2e8152800 2024-03-28T12:42:02.069 INFO:teuthology.orchestra.run.smithi076.stderr:new fs with metadata pool 2 and data pool 3 2024-03-28T12:42:02.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.071+0000 7fd2ed200640 1 -- 172.21.15.76:0/729253469 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd2c8068010 msgr2=0x7fd2c806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:02.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.071+0000 7fd2ed200640 1 --2- 172.21.15.76:0/729253469 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd2c8068010 0x7fd2c806a4d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80ae000 tx=0x7fd2d80a7000 comp rx=0 tx=0).stop 2024-03-28T12:42:02.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.071+0000 7fd2ed200640 1 -- 172.21.15.76:0/729253469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2e8152800 msgr2=0x7fd2e81516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:02.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.071+0000 7fd2ed200640 1 --2- 172.21.15.76:0/729253469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2e8152800 0x7fd2e81516f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000b970 tx=0x7fd2e000be30 comp rx=0 tx=0).stop 2024-03-28T12:42:02.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.071+0000 7fd2ed200640 1 -- 172.21.15.76:0/729253469 shutdown_connections 2024-03-28T12:42:02.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.071+0000 7fd2ed200640 1 --2- 172.21.15.76:0/729253469 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd2c8068010 0x7fd2c806a4d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:02.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.071+0000 7fd2ed200640 1 --2- 172.21.15.76:0/729253469 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2e8152800 0x7fd2e81516f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:02.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.071+0000 7fd2ed200640 1 --2- 172.21.15.76:0/729253469 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd2e80cab80 0x7fd2e81511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:02.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.071+0000 7fd2ed200640 1 --2- 172.21.15.76:0/729253469 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2e80c97e0 0x7fd2e8148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:02.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.071+0000 7fd2ed200640 1 -- 172.21.15.76:0/729253469 >> 172.21.15.76:0/729253469 conn(0x7fd2e8071540 msgr2=0x7fd2e814bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:02.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.071+0000 7fd2ed200640 1 -- 172.21.15.76:0/729253469 shutdown_connections 2024-03-28T12:42:02.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.071+0000 7fd2ed200640 1 -- 172.21.15.76:0/729253469 wait complete. 2024-03-28T12:42:02.090 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-03-28T12:42:02.090 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-03-28T12:42:02.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.263+0000 7efe1f600640 1 Processor -- start 2024-03-28T12:42:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.263+0000 7efe1f600640 1 -- start start 2024-03-28T12:42:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.267+0000 7efe1f600640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7efe181529d0 0x7efe180c4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:02.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.267+0000 7efe1f600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe18158660 0x7efe180cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.267+0000 7efe1f600640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe181595b0 con 0x7efe180c9ff0 2024-03-28T12:42:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.267+0000 7efe1f600640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7efe180c42a0 con 0x7efe181529d0 2024-03-28T12:42:02.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.267+0000 7efe1f600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7efe18152db0 con 0x7efe18158660 2024-03-28T12:42:02.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.267+0000 7efe1d600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe18158660 0x7efe180cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.267+0000 7efe1d600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe18158660 0x7efe180cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:44780/0 (socket says 172.21.15.76:44780) 2024-03-28T12:42:02.266 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.267+0000 7efe1d600640 1 -- 172.21.15.76:0/2966885953 learned_addr learned my addr 172.21.15.76:0/2966885953 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:02.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.275+0000 7efe1d600640 1 -- 172.21.15.76:0/2966885953 >> v2:172.21.15.76:3300/0 conn(0x7efe181529d0 msgr2=0x7efe180c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:02.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.275+0000 7efe1d600640 1 --2- 172.21.15.76:0/2966885953 >> v2:172.21.15.76:3300/0 conn(0x7efe181529d0 0x7efe180c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:02.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.275+0000 7efe1d600640 1 -- 172.21.15.76:0/2966885953 >> v1:172.21.15.76:6789/0 conn(0x7efe180c9ff0 legacy=0x7efe180c3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:02.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.275+0000 7efe1d600640 1 -- 172.21.15.76:0/2966885953 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe18158ff0 con 0x7efe18158660 2024-03-28T12:42:02.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.283+0000 7efe1d600640 1 --2- 172.21.15.76:0/2966885953 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe18158660 0x7efe180cdf60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe10009e50 tx=0x7efe1001c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3aed54647b033ea server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:02.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.291+0000 7efe17e00640 1 -- 172.21.15.76:0/2966885953 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe100a57b0 con 0x7efe18158660 2024-03-28T12:42:02.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.291+0000 7efe17e00640 1 -- 172.21.15.76:0/2966885953 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe100a5950 con 0x7efe18158660 2024-03-28T12:42:02.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.291+0000 7efe17e00640 1 -- 172.21.15.76:0/2966885953 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe100a5d20 con 0x7efe18158660 2024-03-28T12:42:02.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.291+0000 7efe1f600640 1 -- 172.21.15.76:0/2966885953 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe18158660 msgr2=0x7efe180cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:02.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.291+0000 7efe1f600640 1 --2- 172.21.15.76:0/2966885953 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe18158660 0x7efe180cdf60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe10009e50 tx=0x7efe1001c930 comp rx=0 tx=0).stop 2024-03-28T12:42:02.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.291+0000 7efe1f600640 1 -- 172.21.15.76:0/2966885953 shutdown_connections 2024-03-28T12:42:02.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.291+0000 7efe1f600640 1 --2- 172.21.15.76:0/2966885953 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe18158660 0x7efe180cdf60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:02.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.291+0000 7efe1f600640 1 --2- 172.21.15.76:0/2966885953 >> v2:172.21.15.76:3300/0 conn(0x7efe181529d0 0x7efe180c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:02.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.291+0000 7efe1f600640 1 -- 172.21.15.76:0/2966885953 >> 172.21.15.76:0/2966885953 conn(0x7efe18067330 msgr2=0x7efe18067740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:02.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.291+0000 7efe1f600640 1 -- 172.21.15.76:0/2966885953 shutdown_connections 2024-03-28T12:42:02.289 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.291+0000 7efe1f600640 1 -- 172.21.15.76:0/2966885953 wait complete. 2024-03-28T12:42:02.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.291+0000 7efe1f600640 1 Processor -- start 2024-03-28T12:42:02.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.295+0000 7efe1f600640 1 -- start start 2024-03-28T12:42:02.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.295+0000 7efe1f600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe180c9ff0 0x7efe18145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:02.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.295+0000 7efe1f600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe181529d0 0x7efe18148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:02.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.295+0000 7efe1f600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe18158660 0x7efe18148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:02.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.295+0000 7efe1f600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7efe181658a0 con 0x7efe180c9ff0 2024-03-28T12:42:02.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.295+0000 7efe1f600640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7efe18165720 con 0x7efe181529d0 2024-03-28T12:42:02.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.295+0000 7efe1f600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7efe18165a20 con 0x7efe18158660 2024-03-28T12:42:02.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.295+0000 7efe1d600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe18158660 0x7efe18148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:02.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.295+0000 7efe0fe00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe181529d0 0x7efe18148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:02.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.299+0000 7efe1d600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe18158660 0x7efe18148640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:44782/0 (socket says 172.21.15.76:44782) 2024-03-28T12:42:02.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.299+0000 7efe1d600640 1 -- 172.21.15.76:0/1944057623 learned_addr learned my addr 172.21.15.76:0/1944057623 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:02.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.307+0000 7efe1d600640 1 -- 172.21.15.76:0/1944057623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe181529d0 msgr2=0x7efe18148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:02.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.307+0000 7efe1d600640 1 --2- 172.21.15.76:0/1944057623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe181529d0 0x7efe18148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:02.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.307+0000 7efe1d600640 1 -- 172.21.15.76:0/1944057623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe180c9ff0 msgr2=0x7efe18145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:02.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.307+0000 7efe1d600640 1 --2- 172.21.15.76:0/1944057623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe180c9ff0 0x7efe18145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:02.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.307+0000 7efe1d600640 1 -- 172.21.15.76:0/1944057623 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1814a1b0 con 0x7efe18158660 2024-03-28T12:42:02.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.311+0000 7efe1d600640 1 --2- 172.21.15.76:0/1944057623 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe18158660 0x7efe18148640 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe1001afe0 tx=0x7efe100196d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:02.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.383+0000 7efe15600640 1 -- 172.21.15.76:0/1944057623 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe100bc070 con 0x7efe18158660 2024-03-28T12:42:02.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.383+0000 7efe15600640 1 -- 172.21.15.76:0/1944057623 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe100b8870 con 0x7efe18158660 2024-03-28T12:42:02.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.383+0000 7efe15600640 1 -- 172.21.15.76:0/1944057623 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe100b8c60 con 0x7efe18158660 2024-03-28T12:42:02.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.383+0000 7efe1f600640 1 -- 172.21.15.76:0/1944057623 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1814a450 con 0x7efe18158660 2024-03-28T12:42:02.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.383+0000 7efe1f600640 1 -- 172.21.15.76:0/1944057623 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1814aa10 con 0x7efe18158660 2024-03-28T12:42:02.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.383+0000 7efe1f600640 1 -- 172.21.15.76:0/1944057623 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe18068860 con 0x7efe18158660 2024-03-28T12:42:02.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.719+0000 7efe15600640 1 -- 172.21.15.76:0/1944057623 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7efe100bf070 con 0x7efe18158660 2024-03-28T12:42:02.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.723+0000 7efe15600640 1 --2- 172.21.15.76:0/1944057623 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efdf4068010 0x7efdf406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:02.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.723+0000 7efe1cc00640 1 --2- 172.21.15.76:0/1944057623 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efdf4068010 0x7efdf406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:02.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.723+0000 7efe1cc00640 1 --2- 172.21.15.76:0/1944057623 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efdf4068010 0x7efdf406a4d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe08009690 tx=0x7efe08006c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:02.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.727+0000 7efe15600640 1 -- 172.21.15.76:0/1944057623 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efe100efa80 con 0x7efe18158660 2024-03-28T12:42:02.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.755+0000 7efe15600640 1 -- 172.21.15.76:0/1944057623 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7efe100165e0 con 0x7efe18158660 2024-03-28T12:42:02.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:02.935+0000 7efe1f600640 1 -- 172.21.15.76:0/1944057623 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7efe180c5180 con 0x7efe18158660 2024-03-28T12:42:04.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.290+0000 7efe15600640 1 -- 172.21.15.76:0/1944057623 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) ==== 157+0+0 (secure 0 0 0) 0x7efe100f19e0 con 0x7efe18158660 2024-03-28T12:42:04.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.290+0000 7efe1f600640 1 -- 172.21.15.76:0/1944057623 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efdf4068010 msgr2=0x7efdf406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:04.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.290+0000 7efe1f600640 1 --2- 172.21.15.76:0/1944057623 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efdf4068010 0x7efdf406a4d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe08009690 tx=0x7efe08006c00 comp rx=0 tx=0).stop 2024-03-28T12:42:04.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.290+0000 7efe1f600640 1 -- 172.21.15.76:0/1944057623 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe18158660 msgr2=0x7efe18148640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:04.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.290+0000 7efe1f600640 1 --2- 172.21.15.76:0/1944057623 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe18158660 0x7efe18148640 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe1001afe0 tx=0x7efe100196d0 comp rx=0 tx=0).stop 2024-03-28T12:42:04.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.290+0000 7efe1f600640 1 -- 172.21.15.76:0/1944057623 shutdown_connections 2024-03-28T12:42:04.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.290+0000 7efe1f600640 1 --2- 172.21.15.76:0/1944057623 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efdf4068010 0x7efdf406a4d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:04.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.290+0000 7efe1f600640 1 --2- 172.21.15.76:0/1944057623 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe18158660 0x7efe18148640 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:04.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.290+0000 7efe1f600640 1 --2- 172.21.15.76:0/1944057623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe181529d0 0x7efe18148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:04.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.290+0000 7efe1f600640 1 --2- 172.21.15.76:0/1944057623 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efe180c9ff0 0x7efe18145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:04.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.290+0000 7efe1f600640 1 -- 172.21.15.76:0/1944057623 >> 172.21.15.76:0/1944057623 conn(0x7efe18067330 msgr2=0x7efe180c8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:04.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.290+0000 7efe1f600640 1 -- 172.21.15.76:0/1944057623 shutdown_connections 2024-03-28T12:42:04.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.290+0000 7efe1f600640 1 -- 172.21.15.76:0/1944057623 wait complete. 2024-03-28T12:42:04.318 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-03-28T12:42:04.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.466+0000 7fc1a2a00640 1 Processor -- start 2024-03-28T12:42:04.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.466+0000 7fc1a2a00640 1 -- start start 2024-03-28T12:42:04.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.466+0000 7fc1a2a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc19c1517f0 0x7fc19c0c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:04.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.466+0000 7fc1a2a00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc19c0c3560 0x7fc19c0c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:04.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.466+0000 7fc1a2a00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc19c157890 con 0x7fc19c151bd0 2024-03-28T12:42:04.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.466+0000 7fc1a2a00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fc19c157b70 con 0x7fc19c0c3560 2024-03-28T12:42:04.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.466+0000 7fc1a2a00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc19c157e50 con 0x7fc19c1517f0 2024-03-28T12:42:04.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.466+0000 7fc19b400640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fc19c151bd0 0x7fc19c15ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:42484/0 (socket says 172.21.15.76:42484) 2024-03-28T12:42:04.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.466+0000 7fc19b400640 1 -- 172.21.15.76:0/923607503 learned_addr learned my addr 172.21.15.76:0/923607503 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:04.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.470+0000 7fc19be00640 1 --2- 172.21.15.76:0/923607503 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc19c1517f0 0x7fc19c0c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:04.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.470+0000 7fc1a0a00640 1 --2- 172.21.15.76:0/923607503 >> v2:172.21.15.111:3300/0 conn(0x7fc19c0c3560 0x7fc19c0c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:04.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.470+0000 7fc19aa00640 1 -- 172.21.15.76:0/923607503 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 248165164 0 0) 0x7fc19c157890 con 0x7fc19c151bd0 2024-03-28T12:42:04.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.470+0000 7fc19aa00640 1 -- 172.21.15.76:0/923607503 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc180005740 con 0x7fc19c151bd0 2024-03-28T12:42:04.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.474+0000 7fc19aa00640 1 -- 172.21.15.76:0/923607503 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1059784001 0 0) 0x7fc180005740 con 0x7fc19c151bd0 2024-03-28T12:42:04.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.474+0000 7fc19aa00640 1 -- 172.21.15.76:0/923607503 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc19c1517f0 msgr2=0x7fc19c0c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:04.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.474+0000 7fc19aa00640 1 --2- 172.21.15.76:0/923607503 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc19c1517f0 0x7fc19c0c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:04.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.474+0000 7fc19aa00640 1 -- 172.21.15.76:0/923607503 >> v2:172.21.15.111:3300/0 conn(0x7fc19c0c3560 msgr2=0x7fc19c0c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:04.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.474+0000 7fc19aa00640 1 --2- 172.21.15.76:0/923607503 >> v2:172.21.15.111:3300/0 conn(0x7fc19c0c3560 0x7fc19c0c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:04.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.474+0000 7fc19aa00640 1 -- 172.21.15.76:0/923607503 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19c158130 con 0x7fc19c151bd0 2024-03-28T12:42:04.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.474+0000 7fc19aa00640 1 -- 172.21.15.76:0/923607503 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7fc188001680 con 0x7fc19c151bd0 2024-03-28T12:42:04.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.474+0000 7fc19aa00640 1 -- 172.21.15.76:0/923607503 >> v1:172.21.15.76:6789/0 conn(0x7fc19c151bd0 legacy=0x7fc19c15ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:04.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.474+0000 7fc19aa00640 1 --2- 172.21.15.76:0/923607503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc180005bd0 0x7fc180005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:04.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.474+0000 7fc19aa00640 1 --2- 172.21.15.76:0/923607503 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc19c1517f0 0x7fc180006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:04.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.474+0000 7fc19aa00640 1 --2- 172.21.15.76:0/923607503 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc180006f60 0x7fc1800073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:04.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.474+0000 7fc19aa00640 1 -- 172.21.15.76:0/923607503 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c157b70 con 0x7fc180005bd0 2024-03-28T12:42:04.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.474+0000 7fc19aa00640 1 -- 172.21.15.76:0/923607503 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c157e50 con 0x7fc180006f60 2024-03-28T12:42:04.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.474+0000 7fc19aa00640 1 -- 172.21.15.76:0/923607503 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc18000dc10 con 0x7fc19c1517f0 2024-03-28T12:42:04.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.478+0000 7fc19be00640 1 --2- 172.21.15.76:0/923607503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc180005bd0 0x7fc180005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:04.479 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.482+0000 7fc19be00640 1 -- 172.21.15.76:0/923607503 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc19c1517f0 msgr2=0x7fc180006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:04.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.482+0000 7fc19be00640 1 --2- 172.21.15.76:0/923607503 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc19c1517f0 0x7fc180006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:04.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.482+0000 7fc19be00640 1 -- 172.21.15.76:0/923607503 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc180006f60 msgr2=0x7fc1800073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:04.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.482+0000 7fc19be00640 1 --2- 172.21.15.76:0/923607503 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc180006f60 0x7fc1800073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:04.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.482+0000 7fc19be00640 1 -- 172.21.15.76:0/923607503 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc180005740 con 0x7fc180005bd0 2024-03-28T12:42:04.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.482+0000 7fc19be00640 1 --2- 172.21.15.76:0/923607503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc180005bd0 0x7fc180005ff0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009ae0 tx=0x7fc18c01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1578cc5205795d61 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:04.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.486+0000 7fc19aa00640 1 -- 172.21.15.76:0/923607503 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0b2070 con 0x7fc180005bd0 2024-03-28T12:42:04.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.486+0000 7fc19aa00640 1 -- 172.21.15.76:0/923607503 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc18c0a56a0 con 0x7fc180005bd0 2024-03-28T12:42:04.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.486+0000 7fc19aa00640 1 -- 172.21.15.76:0/923607503 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0096b0 con 0x7fc180005bd0 2024-03-28T12:42:04.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.486+0000 7fc1a2a00640 1 -- 172.21.15.76:0/923607503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc180005bd0 msgr2=0x7fc180005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:04.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.486+0000 7fc1a2a00640 1 --2- 172.21.15.76:0/923607503 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc180005bd0 0x7fc180005ff0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009ae0 tx=0x7fc18c01cab0 comp rx=0 tx=0).stop 2024-03-28T12:42:04.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.490+0000 7fc1a0a00640 1 -- 172.21.15.76:0/923607503 reap_dead start 2024-03-28T12:42:04.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.490+0000 7fc1a2a00640 1 -- 172.21.15.76:0/923607503 shutdown_connections 2024-03-28T12:42:04.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.490+0000 7fc1a2a00640 1 -- 172.21.15.76:0/923607503 >> 172.21.15.76:0/923607503 conn(0x7fc19c0cbfd0 msgr2=0x7fc19c0cc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:04.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.490+0000 7fc1a2a00640 1 -- 172.21.15.76:0/923607503 shutdown_connections 2024-03-28T12:42:04.488 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.490+0000 7fc1a2a00640 1 -- 172.21.15.76:0/923607503 wait complete. 2024-03-28T12:42:04.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.490+0000 7fc1a2a00640 1 Processor -- start 2024-03-28T12:42:04.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.490+0000 7fc1a2a00640 1 -- start start 2024-03-28T12:42:04.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.490+0000 7fc1a2a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc180005bd0 0x7fc19c0ade10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:04.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.490+0000 7fc1a2a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc19c1f4610 0x7fc19c1567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:04.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.490+0000 7fc1a2a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc19c0c6410 0x7fc19c0c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:04.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.490+0000 7fc1a2a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c15b600 con 0x7fc19c1f4610 2024-03-28T12:42:04.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.490+0000 7fc1a2a00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc19c15b480 con 0x7fc19c0c6410 2024-03-28T12:42:04.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.490+0000 7fc1a2a00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc19c1f1670 con 0x7fc180005bd0 2024-03-28T12:42:04.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.490+0000 7fc19b400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc19c1f4610 0x7fc19c1567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:04.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.490+0000 7fc19b400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc19c1f4610 0x7fc19c1567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36488/0 (socket says 172.21.15.76:36488) 2024-03-28T12:42:04.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.490+0000 7fc19b400640 1 -- 172.21.15.76:0/660545813 learned_addr learned my addr 172.21.15.76:0/660545813 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:04.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.494+0000 7fc1a0a00640 1 --2- 172.21.15.76:0/660545813 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc19c0c6410 0x7fc19c0c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:04.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.494+0000 7fc19be00640 1 --2- 172.21.15.76:0/660545813 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc180005bd0 0x7fc19c0ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:04.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.494+0000 7fc19b400640 1 -- 172.21.15.76:0/660545813 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc180005bd0 msgr2=0x7fc19c0ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:04.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.494+0000 7fc19b400640 1 --2- 172.21.15.76:0/660545813 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc180005bd0 0x7fc19c0ade10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:04.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.494+0000 7fc19b400640 1 -- 172.21.15.76:0/660545813 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc19c0c6410 msgr2=0x7fc19c0c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:04.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.494+0000 7fc19b400640 1 --2- 172.21.15.76:0/660545813 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc19c0c6410 0x7fc19c0c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:04.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.494+0000 7fc19b400640 1 -- 172.21.15.76:0/660545813 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc19c1f08f0 con 0x7fc19c1f4610 2024-03-28T12:42:04.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.498+0000 7fc19b400640 1 --2- 172.21.15.76:0/660545813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc19c1f4610 0x7fc19c1567c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc18800f560 tx=0x7fc18800f960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:04.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.502+0000 7fc193e00640 1 -- 172.21.15.76:0/660545813 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18801b070 con 0x7fc19c1f4610 2024-03-28T12:42:04.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.502+0000 7fc193e00640 1 -- 172.21.15.76:0/660545813 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc188007d20 con 0x7fc19c1f4610 2024-03-28T12:42:04.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.502+0000 7fc193e00640 1 -- 172.21.15.76:0/660545813 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc18800a310 con 0x7fc19c1f4610 2024-03-28T12:42:04.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.502+0000 7fc1a2a00640 1 -- 172.21.15.76:0/660545813 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19c0ae430 con 0x7fc19c1f4610 2024-03-28T12:42:04.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.502+0000 7fc1a2a00640 1 -- 172.21.15.76:0/660545813 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc19c1f0e70 con 0x7fc19c1f4610 2024-03-28T12:42:04.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.502+0000 7fc1a2a00640 1 -- 172.21.15.76:0/660545813 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc19c0687c0 con 0x7fc19c1f4610 2024-03-28T12:42:04.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.522+0000 7fc193e00640 1 -- 172.21.15.76:0/660545813 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fc18801e070 con 0x7fc19c1f4610 2024-03-28T12:42:04.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.522+0000 7fc193e00640 1 --2- 172.21.15.76:0/660545813 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc17c068010 0x7fc17c06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:04.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.522+0000 7fc19be00640 1 --2- 172.21.15.76:0/660545813 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc17c068010 0x7fc17c06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:04.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.522+0000 7fc19be00640 1 --2- 172.21.15.76:0/660545813 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc17c068010 0x7fc17c06a4d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009ae0 tx=0x7fc18c0046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:04.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.526+0000 7fc193e00640 1 -- 172.21.15.76:0/660545813 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6007+0+0 (secure 0 0 0) 0x7fc188056ef0 con 0x7fc19c1f4610 2024-03-28T12:42:04.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.770+0000 7fc193e00640 1 -- 172.21.15.76:0/660545813 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fc188025020 con 0x7fc19c1f4610 2024-03-28T12:42:04.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:04.926+0000 7fc1a2a00640 1 -- 172.21.15.76:0/660545813 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc19c072960 con 0x7fc19c1f4610 2024-03-28T12:42:06.346 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:42:06.350 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:42:06.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.470+0000 7fc193e00640 1 -- 172.21.15.76:0/660545813 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) ==== 228+0+0 (secure 0 0 0) 0x7fc188058e50 con 0x7fc19c1f4610 2024-03-28T12:42:06.469 INFO:teuthology.orchestra.run.smithi076.stderr:pool 'cephfs_data_ec' created 2024-03-28T12:42:06.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.474+0000 7fc1a2a00640 1 -- 172.21.15.76:0/660545813 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc17c068010 msgr2=0x7fc17c06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:06.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.474+0000 7fc1a2a00640 1 --2- 172.21.15.76:0/660545813 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc17c068010 0x7fc17c06a4d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc18c009ae0 tx=0x7fc18c0046d0 comp rx=0 tx=0).stop 2024-03-28T12:42:06.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.474+0000 7fc1a2a00640 1 -- 172.21.15.76:0/660545813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc19c1f4610 msgr2=0x7fc19c1567c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:06.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.474+0000 7fc1a2a00640 1 --2- 172.21.15.76:0/660545813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc19c1f4610 0x7fc19c1567c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc18800f560 tx=0x7fc18800f960 comp rx=0 tx=0).stop 2024-03-28T12:42:06.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.474+0000 7fc1a2a00640 1 -- 172.21.15.76:0/660545813 shutdown_connections 2024-03-28T12:42:06.473 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.474+0000 7fc1a2a00640 1 --2- 172.21.15.76:0/660545813 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc17c068010 0x7fc17c06a4d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:06.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.474+0000 7fc1a2a00640 1 --2- 172.21.15.76:0/660545813 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc19c0c6410 0x7fc19c0c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:06.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.474+0000 7fc1a2a00640 1 --2- 172.21.15.76:0/660545813 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc19c1f4610 0x7fc19c1567c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:06.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.474+0000 7fc1a2a00640 1 --2- 172.21.15.76:0/660545813 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc180005bd0 0x7fc19c0ade10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:06.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.474+0000 7fc1a2a00640 1 -- 172.21.15.76:0/660545813 >> 172.21.15.76:0/660545813 conn(0x7fc19c0cbfd0 msgr2=0x7fc19c14ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:06.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.474+0000 7fc1a2a00640 1 -- 172.21.15.76:0/660545813 shutdown_connections 2024-03-28T12:42:06.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.474+0000 7fc1a2a00640 1 -- 172.21.15.76:0/660545813 wait complete. 2024-03-28T12:42:06.502 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-03-28T12:42:06.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.658+0000 7fef69e00640 1 Processor -- start 2024-03-28T12:42:06.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.658+0000 7fef69e00640 1 -- start start 2024-03-28T12:42:06.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.658+0000 7fef69e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fef641528b0 0x7fef640c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:06.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.658+0000 7fef69e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fef6406eeb0 0x7fef64159330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:06.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.658+0000 7fef69e00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef64159870 con 0x7fef64072150 2024-03-28T12:42:06.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.658+0000 7fef69e00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fef640c7860 con 0x7fef641528b0 2024-03-28T12:42:06.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.658+0000 7fef69e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fef6406dbe0 con 0x7fef6406eeb0 2024-03-28T12:42:06.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.662+0000 7fef63400640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fef64072150 0x7fef6406e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:42488/0 (socket says 172.21.15.76:42488) 2024-03-28T12:42:06.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.662+0000 7fef63400640 1 -- 172.21.15.76:0/2350364234 learned_addr learned my addr 172.21.15.76:0/2350364234 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:06.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.662+0000 7fef5be00640 1 --2- 172.21.15.76:0/2350364234 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fef6406eeb0 0x7fef64159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:06.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.662+0000 7fef62a00640 1 --2- 172.21.15.76:0/2350364234 >> v2:172.21.15.111:3300/0 conn(0x7fef641528b0 0x7fef640c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:06.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.662+0000 7fef62000640 1 -- 172.21.15.76:0/2350364234 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2107425057 0 0) 0x7fef5c0014a0 con 0x7fef64072150 2024-03-28T12:42:06.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.662+0000 7fef62000640 1 -- 172.21.15.76:0/2350364234 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef48003530 con 0x7fef64072150 2024-03-28T12:42:06.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.666+0000 7fef62a00640 1 -- 172.21.15.76:0/2350364234 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fef6406eeb0 msgr2=0x7fef64159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:06.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.666+0000 7fef62a00640 1 --2- 172.21.15.76:0/2350364234 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fef6406eeb0 0x7fef64159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:06.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.666+0000 7fef62a00640 1 -- 172.21.15.76:0/2350364234 >> v1:172.21.15.76:6789/0 conn(0x7fef64072150 legacy=0x7fef6406e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:06.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.666+0000 7fef62a00640 1 -- 172.21.15.76:0/2350364234 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6406dea0 con 0x7fef641528b0 2024-03-28T12:42:06.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.670+0000 7fef62a00640 1 --2- 172.21.15.76:0/2350364234 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef641528b0 0x7fef640c7cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fef540097c0 tx=0x7fef5401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23ac6f5f0cd6765a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:06.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.674+0000 7fef62000640 1 -- 172.21.15.76:0/2350364234 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef540a7070 con 0x7fef641528b0 2024-03-28T12:42:06.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.678+0000 7fef62000640 1 -- 172.21.15.76:0/2350364234 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef540b0070 con 0x7fef641528b0 2024-03-28T12:42:06.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.678+0000 7fef62000640 1 -- 172.21.15.76:0/2350364234 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef540ab870 con 0x7fef641528b0 2024-03-28T12:42:06.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.678+0000 7fef69e00640 1 -- 172.21.15.76:0/2350364234 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef641528b0 msgr2=0x7fef640c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:06.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.678+0000 7fef69e00640 1 --2- 172.21.15.76:0/2350364234 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef641528b0 0x7fef640c7cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fef540097c0 tx=0x7fef5401c470 comp rx=0 tx=0).stop 2024-03-28T12:42:06.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.678+0000 7fef69e00640 1 -- 172.21.15.76:0/2350364234 shutdown_connections 2024-03-28T12:42:06.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.678+0000 7fef69e00640 1 --2- 172.21.15.76:0/2350364234 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fef6406eeb0 0x7fef64159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:06.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.678+0000 7fef69e00640 1 --2- 172.21.15.76:0/2350364234 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef641528b0 0x7fef640c7cf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:06.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.678+0000 7fef69e00640 1 -- 172.21.15.76:0/2350364234 >> 172.21.15.76:0/2350364234 conn(0x7fef640c8ad0 msgr2=0x7fef640c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:06.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.678+0000 7fef69e00640 1 -- 172.21.15.76:0/2350364234 shutdown_connections 2024-03-28T12:42:06.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.678+0000 7fef69e00640 1 -- 172.21.15.76:0/2350364234 wait complete. 2024-03-28T12:42:06.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.678+0000 7fef69e00640 1 Processor -- start 2024-03-28T12:42:06.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.678+0000 7fef69e00640 1 -- start start 2024-03-28T12:42:06.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.682+0000 7fef69e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fef6406eeb0 0x7fef640c2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:06.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.682+0000 7fef69e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fef64072150 0x7fef641f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:06.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.682+0000 7fef69e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef641528b0 0x7fef640cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:06.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.682+0000 7fef69e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fef6406d7c0 con 0x7fef6406eeb0 2024-03-28T12:42:06.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.682+0000 7fef69e00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fef64152c90 con 0x7fef641528b0 2024-03-28T12:42:06.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.682+0000 7fef69e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fef6406d940 con 0x7fef64072150 2024-03-28T12:42:06.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.682+0000 7fef62a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fef6406eeb0 0x7fef640c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:06.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.682+0000 7fef62a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fef6406eeb0 0x7fef640c2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36502/0 (socket says 172.21.15.76:36502) 2024-03-28T12:42:06.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.682+0000 7fef62a00640 1 -- 172.21.15.76:0/86836743 learned_addr learned my addr 172.21.15.76:0/86836743 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:06.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.682+0000 7fef5be00640 1 --2- 172.21.15.76:0/86836743 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fef64072150 0x7fef641f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:06.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.682+0000 7fef63400640 1 --2- 172.21.15.76:0/86836743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef641528b0 0x7fef640cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:06.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.686+0000 7fef62a00640 1 -- 172.21.15.76:0/86836743 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fef64072150 msgr2=0x7fef641f4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:06.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.686+0000 7fef62a00640 1 --2- 172.21.15.76:0/86836743 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fef64072150 0x7fef641f4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:06.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.686+0000 7fef62a00640 1 -- 172.21.15.76:0/86836743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef641528b0 msgr2=0x7fef640cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:06.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.686+0000 7fef62a00640 1 --2- 172.21.15.76:0/86836743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef641528b0 0x7fef640cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:06.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.686+0000 7fef62a00640 1 -- 172.21.15.76:0/86836743 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef64141cf0 con 0x7fef6406eeb0 2024-03-28T12:42:06.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.686+0000 7fef62a00640 1 --2- 172.21.15.76:0/86836743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fef6406eeb0 0x7fef640c2390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fef540ad040 tx=0x7fef54019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:06.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.690+0000 7fef5b400640 1 -- 172.21.15.76:0/86836743 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54003820 con 0x7fef6406eeb0 2024-03-28T12:42:06.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.690+0000 7fef5b400640 1 -- 172.21.15.76:0/86836743 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef540039c0 con 0x7fef6406eeb0 2024-03-28T12:42:06.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.690+0000 7fef69e00640 1 -- 172.21.15.76:0/86836743 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef640c9fe0 con 0x7fef6406eeb0 2024-03-28T12:42:06.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.690+0000 7fef5b400640 1 -- 172.21.15.76:0/86836743 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54003d90 con 0x7fef6406eeb0 2024-03-28T12:42:06.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.690+0000 7fef69e00640 1 -- 172.21.15.76:0/86836743 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef641f3a00 con 0x7fef6406eeb0 2024-03-28T12:42:06.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.690+0000 7fef69e00640 1 -- 172.21.15.76:0/86836743 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef64068860 con 0x7fef6406eeb0 2024-03-28T12:42:06.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.710+0000 7fef5b400640 1 -- 172.21.15.76:0/86836743 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fef540c3060 con 0x7fef6406eeb0 2024-03-28T12:42:06.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.710+0000 7fef5b400640 1 --2- 172.21.15.76:0/86836743 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fef40068010 0x7fef4006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:06.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.710+0000 7fef5be00640 1 --2- 172.21.15.76:0/86836743 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fef40068010 0x7fef4006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:06.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.710+0000 7fef5be00640 1 --2- 172.21.15.76:0/86836743 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fef40068010 0x7fef4006a4d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fef6415cf60 tx=0x7fef4c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:06.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.714+0000 7fef5b400640 1 -- 172.21.15.76:0/86836743 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7fef540ee440 con 0x7fef6406eeb0 2024-03-28T12:42:06.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:06.970+0000 7fef5b400640 1 -- 172.21.15.76:0/86836743 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fef54016090 con 0x7fef6406eeb0 2024-03-28T12:42:07.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.134+0000 7fef69e00640 1 -- 172.21.15.76:0/86836743 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fef640c6c40 con 0x7fef6406eeb0 2024-03-28T12:42:07.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.674+0000 7fef5b400640 1 -- 172.21.15.76:0/86836743 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) ==== 169+0+0 (secure 0 0 0) 0x7fef540f03a0 con 0x7fef6406eeb0 2024-03-28T12:42:07.675 INFO:teuthology.orchestra.run.smithi076.stderr:set pool 4 allow_ec_overwrites to true 2024-03-28T12:42:07.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.678+0000 7fef69e00640 1 -- 172.21.15.76:0/86836743 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fef40068010 msgr2=0x7fef4006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:07.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.678+0000 7fef69e00640 1 --2- 172.21.15.76:0/86836743 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fef40068010 0x7fef4006a4d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fef6415cf60 tx=0x7fef4c009190 comp rx=0 tx=0).stop 2024-03-28T12:42:07.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.678+0000 7fef69e00640 1 -- 172.21.15.76:0/86836743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fef6406eeb0 msgr2=0x7fef640c2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:07.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.678+0000 7fef69e00640 1 --2- 172.21.15.76:0/86836743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fef6406eeb0 0x7fef640c2390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fef540ad040 tx=0x7fef54019210 comp rx=0 tx=0).stop 2024-03-28T12:42:07.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.678+0000 7fef69e00640 1 -- 172.21.15.76:0/86836743 shutdown_connections 2024-03-28T12:42:07.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.678+0000 7fef69e00640 1 --2- 172.21.15.76:0/86836743 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fef40068010 0x7fef4006a4d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:07.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.678+0000 7fef69e00640 1 --2- 172.21.15.76:0/86836743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef641528b0 0x7fef640cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:07.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.678+0000 7fef69e00640 1 --2- 172.21.15.76:0/86836743 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fef64072150 0x7fef641f4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:07.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.678+0000 7fef69e00640 1 --2- 172.21.15.76:0/86836743 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fef6406eeb0 0x7fef640c2390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:07.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.678+0000 7fef69e00640 1 -- 172.21.15.76:0/86836743 >> 172.21.15.76:0/86836743 conn(0x7fef640c8ad0 msgr2=0x7fef64161a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:07.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.678+0000 7fef69e00640 1 -- 172.21.15.76:0/86836743 shutdown_connections 2024-03-28T12:42:07.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.678+0000 7fef69e00640 1 -- 172.21.15.76:0/86836743 wait complete. 2024-03-28T12:42:07.697 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-03-28T12:42:07.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.850+0000 7f9990e00640 1 Processor -- start 2024-03-28T12:42:07.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.850+0000 7f9990e00640 1 -- start start 2024-03-28T12:42:07.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.850+0000 7f9990e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f998c06f370 0x7f998c06f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:07.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.850+0000 7f9990e00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f998c06ef80 con 0x7f998c06feb0 2024-03-28T12:42:07.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.850+0000 7f9990e00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f998c0ca990 con 0x7f998c0c7d80 2024-03-28T12:42:07.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.850+0000 7f9990e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f998c06eca0 con 0x7f998c06f370 2024-03-28T12:42:07.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.850+0000 7f998a800640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f998c06feb0 0x7f998c162f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:42496/0 (socket says 172.21.15.76:42496) 2024-03-28T12:42:07.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.850+0000 7f998a800640 1 -- 172.21.15.76:0/3261642090 learned_addr learned my addr 172.21.15.76:0/3261642090 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:07.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.854+0000 7f9989400640 1 -- 172.21.15.76:0/3261642090 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2719883179 0 0) 0x7f998c06ef80 con 0x7f998c06feb0 2024-03-28T12:42:07.854 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.854+0000 7f9989400640 1 -- 172.21.15.76:0/3261642090 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9970003530 con 0x7f998c06feb0 2024-03-28T12:42:07.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.858+0000 7f9989400640 1 -- 172.21.15.76:0/3261642090 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3468644200 0 0) 0x7f9970003530 con 0x7f998c06feb0 2024-03-28T12:42:07.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.858+0000 7f9989400640 1 -- 172.21.15.76:0/3261642090 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f998c06f370 msgr2=0x7f998c06f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:07.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.858+0000 7f9989400640 1 --2- 172.21.15.76:0/3261642090 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f998c06f370 0x7f998c06f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:07.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.858+0000 7f9989400640 1 -- 172.21.15.76:0/3261642090 >> v1:172.21.15.111:6789/0 conn(0x7f998c0c7d80 legacy=0x7f998c15bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:07.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.858+0000 7f9989400640 1 -- 172.21.15.76:0/3261642090 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998c0c84e0 con 0x7f998c06feb0 2024-03-28T12:42:07.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.858+0000 7f9989400640 1 -- 172.21.15.76:0/3261642090 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7f9984001a00 con 0x7f998c06feb0 2024-03-28T12:42:07.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.858+0000 7f9989400640 1 -- 172.21.15.76:0/3261642090 >> v1:172.21.15.76:6789/0 conn(0x7f998c06feb0 legacy=0x7f998c162f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:07.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.858+0000 7f9989400640 1 --2- 172.21.15.76:0/3261642090 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9970003a60 0x7f9970003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:07.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.858+0000 7f9989400640 1 --2- 172.21.15.76:0/3261642090 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f998c06f370 0x7f9970004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:07.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.858+0000 7f9989400640 1 --2- 172.21.15.76:0/3261642090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9970004e70 0x7f997000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:07.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.858+0000 7f9989400640 1 -- 172.21.15.76:0/3261642090 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f998c06eca0 con 0x7f9970004e70 2024-03-28T12:42:07.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.858+0000 7f9989400640 1 -- 172.21.15.76:0/3261642090 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9970005620 con 0x7f9970003a60 2024-03-28T12:42:07.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.858+0000 7f9989400640 1 -- 172.21.15.76:0/3261642090 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f997000bf10 con 0x7f998c06f370 2024-03-28T12:42:07.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.862+0000 7f998a800640 1 --2- 172.21.15.76:0/3261642090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9970004e70 0x7f997000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:07.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.866+0000 7f998a800640 1 -- 172.21.15.76:0/3261642090 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f998c06f370 msgr2=0x7f9970004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:07.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.866+0000 7f998a800640 1 --2- 172.21.15.76:0/3261642090 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f998c06f370 0x7f9970004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:07.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.866+0000 7f998a800640 1 -- 172.21.15.76:0/3261642090 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9970003a60 msgr2=0x7f9970003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:07.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.866+0000 7f998a800640 1 --2- 172.21.15.76:0/3261642090 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9970003a60 0x7f9970003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:07.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.866+0000 7f998a800640 1 -- 172.21.15.76:0/3261642090 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9970003530 con 0x7f9970004e70 2024-03-28T12:42:07.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.870+0000 7f998a800640 1 --2- 172.21.15.76:0/3261642090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9970004e70 0x7f997000b9d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f998400a7b0 tx=0x7f998401d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4dc51ea059e38f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:07.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.870+0000 7f9989400640 1 -- 172.21.15.76:0/3261642090 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998400a3d0 con 0x7f9970004e70 2024-03-28T12:42:07.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.874+0000 7f9989400640 1 -- 172.21.15.76:0/3261642090 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99840ad630 con 0x7f9970004e70 2024-03-28T12:42:07.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.874+0000 7f9989400640 1 -- 172.21.15.76:0/3261642090 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99840ada20 con 0x7f9970004e70 2024-03-28T12:42:07.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.874+0000 7f9990e00640 1 -- 172.21.15.76:0/3261642090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9970004e70 msgr2=0x7f997000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:07.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.874+0000 7f9990e00640 1 --2- 172.21.15.76:0/3261642090 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9970004e70 0x7f997000b9d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f998400a7b0 tx=0x7f998401d2e0 comp rx=0 tx=0).stop 2024-03-28T12:42:07.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.874+0000 7f998a800640 1 -- 172.21.15.76:0/3261642090 reap_dead start 2024-03-28T12:42:07.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.874+0000 7f9990e00640 1 -- 172.21.15.76:0/3261642090 shutdown_connections 2024-03-28T12:42:07.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.874+0000 7f9990e00640 1 -- 172.21.15.76:0/3261642090 >> 172.21.15.76:0/3261642090 conn(0x7f998c070ca0 msgr2=0x7f998c0710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:07.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.874+0000 7f9990e00640 1 -- 172.21.15.76:0/3261642090 shutdown_connections 2024-03-28T12:42:07.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.874+0000 7f9990e00640 1 -- 172.21.15.76:0/3261642090 wait complete. 2024-03-28T12:42:07.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.878+0000 7f9990e00640 1 Processor -- start 2024-03-28T12:42:07.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.878+0000 7f9990e00640 1 -- start start 2024-03-28T12:42:07.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.878+0000 7f9990e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9970004e70 0x7f998c1ee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:07.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.878+0000 7f9990e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f998c156a50 0x7f998c14f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:07.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.878+0000 7f9990e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f998c1f1630 0x7f998c1501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:07.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.878+0000 7f9990e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f998c0c8d80 con 0x7f998c1f1630 2024-03-28T12:42:07.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.878+0000 7f9990e00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f998c0c8aa0 con 0x7f998c156a50 2024-03-28T12:42:07.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.878+0000 7f9990e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f998c06e990 con 0x7f9970004e70 2024-03-28T12:42:07.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.882+0000 7f9989e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9970004e70 0x7f998c1ee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:07.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.882+0000 7f9989e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9970004e70 0x7f998c1ee0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:49956/0 (socket says 172.21.15.76:49956) 2024-03-28T12:42:07.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.882+0000 7f9989e00640 1 -- 172.21.15.76:0/2841865957 learned_addr learned my addr 172.21.15.76:0/2841865957 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:07.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.890+0000 7f998a800640 1 --2- 172.21.15.76:0/2841865957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f998c1f1630 0x7f998c1501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:07.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.890+0000 7f9989e00640 1 -- 172.21.15.76:0/2841865957 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f998c156a50 msgr2=0x7f998c14f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:07.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.890+0000 7f9989e00640 1 --2- 172.21.15.76:0/2841865957 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f998c156a50 0x7f998c14f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:07.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.890+0000 7f9989e00640 1 -- 172.21.15.76:0/2841865957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f998c1f1630 msgr2=0x7f998c1501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:07.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.890+0000 7f9989e00640 1 --2- 172.21.15.76:0/2841865957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f998c1f1630 0x7f998c1501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:07.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.890+0000 7f9989e00640 1 -- 172.21.15.76:0/2841865957 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998c075660 con 0x7f9970004e70 2024-03-28T12:42:07.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.898+0000 7f9989e00640 1 --2- 172.21.15.76:0/2841865957 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9970004e70 0x7f998c1ee0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f997c00b480 tx=0x7f997c00b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:07.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.938+0000 7f9982000640 1 -- 172.21.15.76:0/2841865957 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c014070 con 0x7f9970004e70 2024-03-28T12:42:07.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.938+0000 7f9982000640 1 -- 172.21.15.76:0/2841865957 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f997c010870 con 0x7f9970004e70 2024-03-28T12:42:07.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.938+0000 7f9982000640 1 -- 172.21.15.76:0/2841865957 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997c010c60 con 0x7f9970004e70 2024-03-28T12:42:07.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.938+0000 7f9990e00640 1 -- 172.21.15.76:0/2841865957 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f998c155b40 con 0x7f9970004e70 2024-03-28T12:42:07.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.942+0000 7f9990e00640 1 -- 172.21.15.76:0/2841865957 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f998c1ee750 con 0x7f9970004e70 2024-03-28T12:42:07.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:07.942+0000 7f9990e00640 1 -- 172.21.15.76:0/2841865957 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f998c0686e0 con 0x7f9970004e70 2024-03-28T12:42:08.261 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:08.262+0000 7f9982000640 1 -- 172.21.15.76:0/2841865957 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f997c017070 con 0x7f9970004e70 2024-03-28T12:42:08.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:08.262+0000 7f9982000640 1 --2- 172.21.15.76:0/2841865957 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9968067ff0 0x7f996806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:08.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:08.262+0000 7f9983e00640 1 --2- 172.21.15.76:0/2841865957 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9968067ff0 0x7f996806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:08.263 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:08.266+0000 7f9983e00640 1 --2- 172.21.15.76:0/2841865957 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9968067ff0 0x7f996806a4b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9974007fd0 tx=0x7f99740079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:08.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:08.278+0000 7f9982000640 1 -- 172.21.15.76:0/2841865957 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6500+0+0 (secure 0 0 0) 0x7f997c054930 con 0x7f9970004e70 2024-03-28T12:42:08.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:08.314+0000 7f9982000640 1 -- 172.21.15.76:0/2841865957 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f997c084e20 con 0x7f9970004e70 2024-03-28T12:42:08.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:08.506+0000 7f9990e00640 1 -- 172.21.15.76:0/2841865957 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f998c0c9540 con 0x7f9970004e70 2024-03-28T12:42:09.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.022+0000 7f9982000640 1 -- 172.21.15.76:0/2841865957 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7f997c056f90 con 0x7f9970004e70 2024-03-28T12:42:09.021 INFO:teuthology.orchestra.run.smithi076.stderr:added data pool 4 to fsmap 2024-03-28T12:42:09.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.026+0000 7f9990e00640 1 -- 172.21.15.76:0/2841865957 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9968067ff0 msgr2=0x7f996806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:09.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.026+0000 7f9990e00640 1 --2- 172.21.15.76:0/2841865957 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9968067ff0 0x7f996806a4b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9974007fd0 tx=0x7f99740079a0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.026+0000 7f9990e00640 1 -- 172.21.15.76:0/2841865957 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9970004e70 msgr2=0x7f998c1ee0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:09.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.026+0000 7f9990e00640 1 --2- 172.21.15.76:0/2841865957 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9970004e70 0x7f998c1ee0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f997c00b480 tx=0x7f997c00b940 comp rx=0 tx=0).stop 2024-03-28T12:42:09.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.026+0000 7f9990e00640 1 -- 172.21.15.76:0/2841865957 shutdown_connections 2024-03-28T12:42:09.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.026+0000 7f9990e00640 1 --2- 172.21.15.76:0/2841865957 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9968067ff0 0x7f996806a4b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.026+0000 7f9990e00640 1 --2- 172.21.15.76:0/2841865957 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f998c1f1630 0x7f998c1501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.026+0000 7f9990e00640 1 --2- 172.21.15.76:0/2841865957 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f998c156a50 0x7f998c14f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.026+0000 7f9990e00640 1 --2- 172.21.15.76:0/2841865957 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9970004e70 0x7f998c1ee0c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.026+0000 7f9990e00640 1 -- 172.21.15.76:0/2841865957 >> 172.21.15.76:0/2841865957 conn(0x7f998c070ca0 msgr2=0x7f998c0c5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:09.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.026+0000 7f9990e00640 1 -- 172.21.15.76:0/2841865957 shutdown_connections 2024-03-28T12:42:09.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.026+0000 7f9990e00640 1 -- 172.21.15.76:0/2841865957 wait complete. 2024-03-28T12:42:09.043 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T12:42:09.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.182+0000 7f5260a00640 1 Processor -- start 2024-03-28T12:42:09.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.182+0000 7f5260a00640 1 -- start start 2024-03-28T12:42:09.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.182+0000 7f5260a00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f525c154940 0x7f525c06fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:09.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.182+0000 7f5260a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f525c06eb90 0x7f525c0c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:09.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.182+0000 7f5260a00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f525c154d20 con 0x7f525c06efb0 2024-03-28T12:42:09.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.182+0000 7f5260a00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f525c070610 con 0x7f525c154940 2024-03-28T12:42:09.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.182+0000 7f5260a00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f525c0c4140 con 0x7f525c06eb90 2024-03-28T12:42:09.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.186+0000 7f525be00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f525c06efb0 0x7f525c15a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:42506/0 (socket says 172.21.15.76:42506) 2024-03-28T12:42:09.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.186+0000 7f525be00640 1 -- 172.21.15.76:0/3092071070 learned_addr learned my addr 172.21.15.76:0/3092071070 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:09.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.186+0000 7f525aa00640 1 --2- 172.21.15.76:0/3092071070 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f525c06eb90 0x7f525c0c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:09.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.186+0000 7f525b400640 1 --2- 172.21.15.76:0/3092071070 >> v2:172.21.15.111:3300/0 conn(0x7f525c154940 0x7f525c06fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:09.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.186+0000 7f525a000640 1 -- 172.21.15.76:0/3092071070 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3487249824 0 0) 0x7f525c154d20 con 0x7f525c06efb0 2024-03-28T12:42:09.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.186+0000 7f525a000640 1 -- 172.21.15.76:0/3092071070 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5240003530 con 0x7f525c06efb0 2024-03-28T12:42:09.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.190+0000 7f525a000640 1 -- 172.21.15.76:0/3092071070 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1577418046 0 0) 0x7f5240003530 con 0x7f525c06efb0 2024-03-28T12:42:09.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.190+0000 7f525a000640 1 -- 172.21.15.76:0/3092071070 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f525c06eb90 msgr2=0x7f525c0c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:09.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.190+0000 7f525a000640 1 --2- 172.21.15.76:0/3092071070 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f525c06eb90 0x7f525c0c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.190+0000 7f525a000640 1 -- 172.21.15.76:0/3092071070 >> v2:172.21.15.111:3300/0 conn(0x7f525c154940 msgr2=0x7f525c06fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:09.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.190+0000 7f525a000640 1 --2- 172.21.15.76:0/3092071070 >> v2:172.21.15.111:3300/0 conn(0x7f525c154940 0x7f525c06fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.190+0000 7f525a000640 1 -- 172.21.15.76:0/3092071070 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c070380 con 0x7f525c06efb0 2024-03-28T12:42:09.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.190+0000 7f525a000640 1 -- 172.21.15.76:0/3092071070 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7f5254001a00 con 0x7f525c06efb0 2024-03-28T12:42:09.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.190+0000 7f525a000640 1 -- 172.21.15.76:0/3092071070 >> v1:172.21.15.76:6789/0 conn(0x7f525c06efb0 legacy=0x7f525c15a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:09.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.190+0000 7f525a000640 1 --2- 172.21.15.76:0/3092071070 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f525c06eb90 0x7f52400039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:09.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.190+0000 7f525a000640 1 --2- 172.21.15.76:0/3092071070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5240003f90 0x7f5240004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:09.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.190+0000 7f525a000640 1 --2- 172.21.15.76:0/3092071070 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5240004d50 0x7f52400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:09.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.190+0000 7f525a000640 1 -- 172.21.15.76:0/3092071070 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f525c070610 con 0x7f5240003f90 2024-03-28T12:42:09.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.190+0000 7f525a000640 1 -- 172.21.15.76:0/3092071070 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f525c0c4140 con 0x7f5240004d50 2024-03-28T12:42:09.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.190+0000 7f525a000640 1 -- 172.21.15.76:0/3092071070 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f524000ba80 con 0x7f525c06eb90 2024-03-28T12:42:09.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.194+0000 7f525aa00640 1 --2- 172.21.15.76:0/3092071070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5240003f90 0x7f5240004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:09.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.194+0000 7f525aa00640 1 -- 172.21.15.76:0/3092071070 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f525c06eb90 msgr2=0x7f52400039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:09.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.194+0000 7f525aa00640 1 --2- 172.21.15.76:0/3092071070 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f525c06eb90 0x7f52400039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.194+0000 7f525aa00640 1 -- 172.21.15.76:0/3092071070 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5240004d50 msgr2=0x7f52400051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:09.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.198+0000 7f525aa00640 1 --2- 172.21.15.76:0/3092071070 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5240004d50 0x7f52400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.198+0000 7f525aa00640 1 -- 172.21.15.76:0/3092071070 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5240003530 con 0x7f5240003f90 2024-03-28T12:42:09.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.202+0000 7f525aa00640 1 --2- 172.21.15.76:0/3092071070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5240003f90 0x7f5240004810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5248009ae0 tx=0x7f524801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c883715b390efc0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:09.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.206+0000 7f525a000640 1 -- 172.21.15.76:0/3092071070 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52480b2070 con 0x7f5240003f90 2024-03-28T12:42:09.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.206+0000 7f525a000640 1 -- 172.21.15.76:0/3092071070 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52480a5590 con 0x7f5240003f90 2024-03-28T12:42:09.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.206+0000 7f525a000640 1 -- 172.21.15.76:0/3092071070 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52480096b0 con 0x7f5240003f90 2024-03-28T12:42:09.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.206+0000 7f5260a00640 1 -- 172.21.15.76:0/3092071070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5240003f90 msgr2=0x7f5240004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:09.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.206+0000 7f5260a00640 1 --2- 172.21.15.76:0/3092071070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5240003f90 0x7f5240004810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5248009ae0 tx=0x7f524801cab0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.206+0000 7f525be00640 1 -- 172.21.15.76:0/3092071070 reap_dead start 2024-03-28T12:42:09.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.206+0000 7f5260a00640 1 -- 172.21.15.76:0/3092071070 shutdown_connections 2024-03-28T12:42:09.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.206+0000 7f5260a00640 1 -- 172.21.15.76:0/3092071070 >> 172.21.15.76:0/3092071070 conn(0x7f525c070c10 msgr2=0x7f525c071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:09.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.206+0000 7f5260a00640 1 -- 172.21.15.76:0/3092071070 shutdown_connections 2024-03-28T12:42:09.206 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.206+0000 7f5260a00640 1 -- 172.21.15.76:0/3092071070 wait complete. 2024-03-28T12:42:09.207 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.210+0000 7f5260a00640 1 Processor -- start 2024-03-28T12:42:09.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.210+0000 7f5260a00640 1 -- start start 2024-03-28T12:42:09.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.210+0000 7f5260a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5240003f90 0x7f525c163fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:09.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.210+0000 7f5260a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f525c147b90 0x7f525c1464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:09.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.210+0000 7f5260a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f525c0cca40 0x7f525c1469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:09.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.210+0000 7f5260a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f525c164ee0 con 0x7f525c147b90 2024-03-28T12:42:09.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.210+0000 7f5260a00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f525c0c3dd0 con 0x7f525c0cca40 2024-03-28T12:42:09.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.210+0000 7f5260a00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f525c165060 con 0x7f5240003f90 2024-03-28T12:42:09.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.210+0000 7f525b400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5240003f90 0x7f525c163fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:09.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.210+0000 7f525aa00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f525c147b90 0x7f525c1464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:09.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.210+0000 7f525be00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f525c0cca40 0x7f525c1469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:09.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.214+0000 7f525aa00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f525c147b90 0x7f525c1464b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36544/0 (socket says 172.21.15.76:36544) 2024-03-28T12:42:09.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.214+0000 7f525aa00640 1 -- 172.21.15.76:0/1638983802 learned_addr learned my addr 172.21.15.76:0/1638983802 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:09.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.214+0000 7f525aa00640 1 -- 172.21.15.76:0/1638983802 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5240003f90 msgr2=0x7f525c163fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:09.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.214+0000 7f525aa00640 1 --2- 172.21.15.76:0/1638983802 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5240003f90 0x7f525c163fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.214+0000 7f525aa00640 1 -- 172.21.15.76:0/1638983802 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f525c0cca40 msgr2=0x7f525c1469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:09.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.214+0000 7f525aa00640 1 --2- 172.21.15.76:0/1638983802 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f525c0cca40 0x7f525c1469f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.214+0000 7f525aa00640 1 -- 172.21.15.76:0/1638983802 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c0cb1b0 con 0x7f525c147b90 2024-03-28T12:42:09.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.218+0000 7f525aa00640 1 --2- 172.21.15.76:0/1638983802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f525c147b90 0x7f525c1464b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f52480b0040 tx=0x7f5248019850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:09.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.222+0000 7f5253400640 1 -- 172.21.15.76:0/1638983802 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52480b2040 con 0x7f525c147b90 2024-03-28T12:42:09.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.222+0000 7f5253400640 1 -- 172.21.15.76:0/1638983802 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52480a5d60 con 0x7f525c147b90 2024-03-28T12:42:09.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.222+0000 7f5253400640 1 -- 172.21.15.76:0/1638983802 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248004260 con 0x7f525c147b90 2024-03-28T12:42:09.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.222+0000 7f5260a00640 1 -- 172.21.15.76:0/1638983802 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525c0cb490 con 0x7f525c147b90 2024-03-28T12:42:09.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.222+0000 7f5260a00640 1 -- 172.21.15.76:0/1638983802 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525c0cba50 con 0x7f525c147b90 2024-03-28T12:42:09.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.222+0000 7f5260a00640 1 -- 172.21.15.76:0/1638983802 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525c068df0 con 0x7f525c147b90 2024-03-28T12:42:09.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.242+0000 7f5253400640 1 -- 172.21.15.76:0/1638983802 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f52480bf060 con 0x7f525c147b90 2024-03-28T12:42:09.241 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.242+0000 7f5253400640 1 --2- 172.21.15.76:0/1638983802 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f523c068010 0x7f523c06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:09.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.242+0000 7f525b400640 1 --2- 172.21.15.76:0/1638983802 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f523c068010 0x7f523c06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:09.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.242+0000 7f5253400640 1 -- 172.21.15.76:0/1638983802 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f52480edf90 con 0x7f525c147b90 2024-03-28T12:42:09.243 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.242+0000 7f525b400640 1 --2- 172.21.15.76:0/1638983802 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f523c068010 0x7f523c06a4d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f524c009af0 tx=0x7f524c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:09.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.486+0000 7f5253400640 1 -- 172.21.15.76:0/1638983802 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f52480167c0 con 0x7f525c147b90 2024-03-28T12:42:09.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.678+0000 7f5260a00640 1 -- 172.21.15.76:0/1638983802 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f525c157f90 con 0x7f525c147b90 2024-03-28T12:42:09.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.706+0000 7f5253400640 1 -- 172.21.15.76:0/1638983802 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6828 (secure 0 0 0) 0x7f52480efef0 con 0x7f525c147b90 2024-03-28T12:42:09.706 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:09.706 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/335301918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":335301918},{"type":"v1","addr":"172.21.15.111:6835","nonce":335301918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1786218285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1786218285},{"type":"v1","addr":"172.21.15.76:6837","nonce":1786218285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/2729208421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":2729208421},{"type":"v1","addr":"172.21.15.76:6839","nonce":2729208421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6837/4176441330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":4176441330},{"type":"v1","addr":"172.21.15.111:6837","nonce":4176441330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/3175932821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":3175932821},{"type":"v1","addr":"172.21.15.111:6833","nonce":3175932821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T12:42:00.776505+0000","modified":"2024-03-28T12:42:08.578048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":9,"addr":"172.21.15.76:6835/544947706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":544947706},{"type":"v1","addr":"172.21.15.76:6835","nonce":544947706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4264,"qdb_cluster":[4264]},"id":1}]} 2024-03-28T12:42:09.706 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 6 2024-03-28T12:42:09.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.710+0000 7f5260a00640 1 -- 172.21.15.76:0/1638983802 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f523c068010 msgr2=0x7f523c06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:09.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.710+0000 7f5260a00640 1 --2- 172.21.15.76:0/1638983802 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f523c068010 0x7f523c06a4d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f524c009af0 tx=0x7f524c008040 comp rx=0 tx=0).stop 2024-03-28T12:42:09.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.710+0000 7f5260a00640 1 -- 172.21.15.76:0/1638983802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f525c147b90 msgr2=0x7f525c1464b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:09.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.710+0000 7f5260a00640 1 --2- 172.21.15.76:0/1638983802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f525c147b90 0x7f525c1464b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f52480b0040 tx=0x7f5248019850 comp rx=0 tx=0).stop 2024-03-28T12:42:09.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.710+0000 7f5260a00640 1 -- 172.21.15.76:0/1638983802 shutdown_connections 2024-03-28T12:42:09.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.710+0000 7f5260a00640 1 --2- 172.21.15.76:0/1638983802 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f523c068010 0x7f523c06a4d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.710+0000 7f5260a00640 1 --2- 172.21.15.76:0/1638983802 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f525c0cca40 0x7f525c1469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.710+0000 7f5260a00640 1 --2- 172.21.15.76:0/1638983802 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f525c147b90 0x7f525c1464b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.710+0000 7f5260a00640 1 --2- 172.21.15.76:0/1638983802 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5240003f90 0x7f525c163fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.710+0000 7f5260a00640 1 -- 172.21.15.76:0/1638983802 >> 172.21.15.76:0/1638983802 conn(0x7f525c070c10 msgr2=0x7f525c1583f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:09.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.710+0000 7f5260a00640 1 -- 172.21.15.76:0/1638983802 shutdown_connections 2024-03-28T12:42:09.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.710+0000 7f5260a00640 1 -- 172.21.15.76:0/1638983802 wait complete. 2024-03-28T12:42:09.729 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T12:42:09.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.870+0000 7f92ce600640 1 Processor -- start 2024-03-28T12:42:09.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.870+0000 7f92ce600640 1 -- start start 2024-03-28T12:42:09.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.870+0000 7f92ce600640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f92c8152800 0x7f92c806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:09.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.870+0000 7f92ce600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c81584c0 0x7f92c815c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:09.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.870+0000 7f92ce600640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f92c815c670 0x7f92c80ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:09.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.870+0000 7f92ce600640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f92c815bca0 con 0x7f92c815c670 2024-03-28T12:42:09.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.870+0000 7f92ce600640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f92c806c190 con 0x7f92c8152800 2024-03-28T12:42:09.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.870+0000 7f92ce600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f92c8158950 con 0x7f92c81584c0 2024-03-28T12:42:09.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.874+0000 7f92c7e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f92c815c670 0x7f92c80ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:09.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.874+0000 7f92bfe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c81584c0 0x7f92c815c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:09.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.874+0000 7f92c7e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f92c815c670 0x7f92c80ccfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36550/0 (socket says 172.21.15.76:36550) 2024-03-28T12:42:09.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.874+0000 7f92c7e00640 1 -- 172.21.15.76:0/3135056099 learned_addr learned my addr 172.21.15.76:0/3135056099 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:09.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.878+0000 7f92c7e00640 1 -- 172.21.15.76:0/3135056099 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c81584c0 msgr2=0x7f92c815c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:09.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.878+0000 7f92c7e00640 1 --2- 172.21.15.76:0/3135056099 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c81584c0 0x7f92c815c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.878+0000 7f92c7e00640 1 -- 172.21.15.76:0/3135056099 >> v2:172.21.15.111:3300/0 conn(0x7f92c8152800 msgr2=0x7f92c806f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:09.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.878+0000 7f92c7e00640 1 --2- 172.21.15.76:0/3135056099 >> v2:172.21.15.111:3300/0 conn(0x7f92c8152800 0x7f92c806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.878+0000 7f92c7e00640 1 -- 172.21.15.76:0/3135056099 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c8158c30 con 0x7f92c815c670 2024-03-28T12:42:09.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.882+0000 7f92c7e00640 1 --2- 172.21.15.76:0/3135056099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92c815c670 0x7f92c80ccfa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f92c80cdff0 tx=0x7f92c001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4f3eed3c1c17d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:09.883 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92c6a00640 1 -- 172.21.15.76:0/3135056099 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c00b4070 con 0x7f92c815c670 2024-03-28T12:42:09.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92c6a00640 1 -- 172.21.15.76:0/3135056099 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c00af400 con 0x7f92c815c670 2024-03-28T12:42:09.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92c6a00640 1 -- 172.21.15.76:0/3135056099 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c00af7d0 con 0x7f92c815c670 2024-03-28T12:42:09.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92ce600640 1 -- 172.21.15.76:0/3135056099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92c815c670 msgr2=0x7f92c80ccfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:09.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92ce600640 1 --2- 172.21.15.76:0/3135056099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92c815c670 0x7f92c80ccfa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f92c80cdff0 tx=0x7f92c001f1e0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92ce600640 1 -- 172.21.15.76:0/3135056099 shutdown_connections 2024-03-28T12:42:09.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92ce600640 1 --2- 172.21.15.76:0/3135056099 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92c815c670 0x7f92c80ccfa0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92ce600640 1 --2- 172.21.15.76:0/3135056099 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c81584c0 0x7f92c815c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92ce600640 1 --2- 172.21.15.76:0/3135056099 >> v2:172.21.15.111:3300/0 conn(0x7f92c8152800 0x7f92c806f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92ce600640 1 -- 172.21.15.76:0/3135056099 >> 172.21.15.76:0/3135056099 conn(0x7f92c806c6b0 msgr2=0x7f92c806cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:09.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92ce600640 1 -- 172.21.15.76:0/3135056099 shutdown_connections 2024-03-28T12:42:09.885 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92ce600640 1 -- 172.21.15.76:0/3135056099 wait complete. 2024-03-28T12:42:09.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92ce600640 1 Processor -- start 2024-03-28T12:42:09.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92ce600640 1 -- start start 2024-03-28T12:42:09.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92ce600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92c8152800 0x7f92c80cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:09.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92ce600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c815c670 0x7f92c81f09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:09.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92ce600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92c806ca90 0x7f92c81f0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:09.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92ce600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f92c8152be0 con 0x7f92c806ca90 2024-03-28T12:42:09.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92ce600640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f92c81591f0 con 0x7f92c8152800 2024-03-28T12:42:09.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.886+0000 7f92ce600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f92c8070220 con 0x7f92c815c670 2024-03-28T12:42:09.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.890+0000 7f92bfe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c815c670 0x7f92c81f09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:09.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.890+0000 7f92bfe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c815c670 0x7f92c81f09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:50006/0 (socket says 172.21.15.76:50006) 2024-03-28T12:42:09.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.890+0000 7f92bfe00640 1 -- 172.21.15.76:0/1015202379 learned_addr learned my addr 172.21.15.76:0/1015202379 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:09.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.890+0000 7f92c7400640 1 --2- 172.21.15.76:0/1015202379 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92c8152800 0x7f92c80cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:09.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.902+0000 7f92bfe00640 1 -- 172.21.15.76:0/1015202379 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92c8152800 msgr2=0x7f92c80cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:09.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.902+0000 7f92bfe00640 1 --2- 172.21.15.76:0/1015202379 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92c8152800 0x7f92c80cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.902+0000 7f92bfe00640 1 -- 172.21.15.76:0/1015202379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92c806ca90 msgr2=0x7f92c81f0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:09.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.902+0000 7f92bfe00640 1 --2- 172.21.15.76:0/1015202379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92c806ca90 0x7f92c81f0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:09.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.902+0000 7f92bfe00640 1 -- 172.21.15.76:0/1015202379 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c8159fb0 con 0x7f92c815c670 2024-03-28T12:42:09.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.906+0000 7f92bfe00640 1 --2- 172.21.15.76:0/1015202379 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c815c670 0x7f92c81f09d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f92b000e930 tx=0x7f92b000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:09.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.914+0000 7f92bf400640 1 -- 172.21.15.76:0/1015202379 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b0017070 con 0x7f92c815c670 2024-03-28T12:42:09.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.914+0000 7f92bf400640 1 -- 172.21.15.76:0/1015202379 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b000c9a0 con 0x7f92c815c670 2024-03-28T12:42:09.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.914+0000 7f92bf400640 1 -- 172.21.15.76:0/1015202379 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b000cd50 con 0x7f92c815c670 2024-03-28T12:42:09.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.914+0000 7f92ce600640 1 -- 172.21.15.76:0/1015202379 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c8154c00 con 0x7f92c815c670 2024-03-28T12:42:09.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.918+0000 7f92ce600640 1 -- 172.21.15.76:0/1015202379 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c81551c0 con 0x7f92c815c670 2024-03-28T12:42:09.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:09.918+0000 7f92ce600640 1 -- 172.21.15.76:0/1015202379 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92c806d640 con 0x7f92c815c670 2024-03-28T12:42:10.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.250+0000 7f92bf400640 1 -- 172.21.15.76:0/1015202379 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f92b001a070 con 0x7f92c815c670 2024-03-28T12:42:10.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.254+0000 7f92bf400640 1 --2- 172.21.15.76:0/1015202379 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f92a4068010 0x7f92a406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:10.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.254+0000 7f92c7400640 1 --2- 172.21.15.76:0/1015202379 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f92a4068010 0x7f92a406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:10.253 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.254+0000 7f92c7400640 1 --2- 172.21.15.76:0/1015202379 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f92a4068010 0x7f92a406a4d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009990 tx=0x7f92b8009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:10.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.262+0000 7f92bf400640 1 -- 172.21.15.76:0/1015202379 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f92b0054f00 con 0x7f92c815c670 2024-03-28T12:42:10.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.294+0000 7f92bf400640 1 -- 172.21.15.76:0/1015202379 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f92b0056e60 con 0x7f92c815c670 2024-03-28T12:42:10.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.454+0000 7f92ce600640 1 -- 172.21.15.76:0/1015202379 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92c80686e0 con 0x7f92c815c670 2024-03-28T12:42:10.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.610+0000 7f92bf400640 1 -- 172.21.15.76:0/1015202379 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18518 (secure 0 0 0) 0x7f92b005b160 con 0x7f92c815c670 2024-03-28T12:42:10.609 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:10.609 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":27,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:42:08.570229+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T12:41:58.010965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T12:41:59.698601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-28T12:42:05.363180+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:42:10.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.610+0000 7f92ce600640 1 -- 172.21.15.76:0/1015202379 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f92a4068010 msgr2=0x7f92a406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:10.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.610+0000 7f92ce600640 1 --2- 172.21.15.76:0/1015202379 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f92a4068010 0x7f92a406a4d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009990 tx=0x7f92b8009110 comp rx=0 tx=0).stop 2024-03-28T12:42:10.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.610+0000 7f92ce600640 1 -- 172.21.15.76:0/1015202379 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c815c670 msgr2=0x7f92c81f09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:10.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.610+0000 7f92ce600640 1 --2- 172.21.15.76:0/1015202379 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c815c670 0x7f92c81f09d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f92b000e930 tx=0x7f92b000edf0 comp rx=0 tx=0).stop 2024-03-28T12:42:10.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.610+0000 7f92ce600640 1 -- 172.21.15.76:0/1015202379 shutdown_connections 2024-03-28T12:42:10.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.610+0000 7f92ce600640 1 --2- 172.21.15.76:0/1015202379 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f92a4068010 0x7f92a406a4d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:10.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.610+0000 7f92ce600640 1 --2- 172.21.15.76:0/1015202379 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f92c806ca90 0x7f92c81f0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:10.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.610+0000 7f92ce600640 1 --2- 172.21.15.76:0/1015202379 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c815c670 0x7f92c81f09d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:10.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.610+0000 7f92ce600640 1 --2- 172.21.15.76:0/1015202379 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92c8152800 0x7f92c80cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:10.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.610+0000 7f92ce600640 1 -- 172.21.15.76:0/1015202379 >> 172.21.15.76:0/1015202379 conn(0x7f92c806c6b0 msgr2=0x7f92c80cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:10.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.610+0000 7f92ce600640 1 -- 172.21.15.76:0/1015202379 shutdown_connections 2024-03-28T12:42:10.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.610+0000 7f92ce600640 1 -- 172.21.15.76:0/1015202379 wait complete. 2024-03-28T12:42:10.631 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T12:42:10.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.778+0000 7f2115c00640 1 Processor -- start 2024-03-28T12:42:10.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.778+0000 7f2115c00640 1 -- start start 2024-03-28T12:42:10.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.778+0000 7f2115c00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f2110072060 0x7f21100cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:10.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.778+0000 7f2115c00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2110072440 0x7f21101524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:10.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.778+0000 7f2115c00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f211015bf40 con 0x7f21101592a0 2024-03-28T12:42:10.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.778+0000 7f2115c00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f21100c31e0 con 0x7f2110072060 2024-03-28T12:42:10.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.778+0000 7f2115c00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f211015c220 con 0x7f2110072440 2024-03-28T12:42:10.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.822+0000 7f210ea00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f2110072060 0x7f21100cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:10.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.822+0000 7f210ea00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f2110072060 0x7f21100cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36568/0 (socket says 172.21.15.76:36568) 2024-03-28T12:42:10.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.822+0000 7f210ea00640 1 -- 172.21.15.76:0/2800143868 learned_addr learned my addr 172.21.15.76:0/2800143868 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:10.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.826+0000 7f210ea00640 1 -- 172.21.15.76:0/2800143868 >> v2:172.21.15.111:3300/0 conn(0x7f2110072440 msgr2=0x7f21101524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:10.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.826+0000 7f210ea00640 1 --2- 172.21.15.76:0/2800143868 >> v2:172.21.15.111:3300/0 conn(0x7f2110072440 0x7f21101524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:10.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.826+0000 7f210ea00640 1 -- 172.21.15.76:0/2800143868 >> v1:172.21.15.111:6789/0 conn(0x7f21101592a0 legacy=0x7f21100c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:10.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.826+0000 7f210ea00640 1 -- 172.21.15.76:0/2800143868 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211015c500 con 0x7f2110072060 2024-03-28T12:42:10.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.830+0000 7f210ea00640 1 --2- 172.21.15.76:0/2800143868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2110072060 0x7f21100cb370 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2100009870 tx=0x7f210001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c6e9512ce6a7f5 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:10.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.834+0000 7f210d600640 1 -- 172.21.15.76:0/2800143868 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21000ab5f0 con 0x7f2110072060 2024-03-28T12:42:10.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.834+0000 7f210d600640 1 -- 172.21.15.76:0/2800143868 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21000b0070 con 0x7f2110072060 2024-03-28T12:42:10.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.834+0000 7f210d600640 1 -- 172.21.15.76:0/2800143868 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21000ab9b0 con 0x7f2110072060 2024-03-28T12:42:10.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.834+0000 7f2115c00640 1 -- 172.21.15.76:0/2800143868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2110072060 msgr2=0x7f21100cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:10.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.834+0000 7f2115c00640 1 --2- 172.21.15.76:0/2800143868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2110072060 0x7f21100cb370 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2100009870 tx=0x7f210001c4e0 comp rx=0 tx=0).stop 2024-03-28T12:42:10.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.834+0000 7f2115c00640 1 -- 172.21.15.76:0/2800143868 shutdown_connections 2024-03-28T12:42:10.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.834+0000 7f2115c00640 1 --2- 172.21.15.76:0/2800143868 >> v2:172.21.15.111:3300/0 conn(0x7f2110072440 0x7f21101524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:10.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.834+0000 7f2115c00640 1 --2- 172.21.15.76:0/2800143868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2110072060 0x7f21100cb370 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:10.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.834+0000 7f2115c00640 1 -- 172.21.15.76:0/2800143868 >> 172.21.15.76:0/2800143868 conn(0x7f2110071520 msgr2=0x7f2110070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:10.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.834+0000 7f2115c00640 1 -- 172.21.15.76:0/2800143868 shutdown_connections 2024-03-28T12:42:10.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.834+0000 7f2115c00640 1 -- 172.21.15.76:0/2800143868 wait complete. 2024-03-28T12:42:10.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.838+0000 7f2115c00640 1 Processor -- start 2024-03-28T12:42:10.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.838+0000 7f2115c00640 1 -- start start 2024-03-28T12:42:10.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.838+0000 7f2115c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2110072060 0x7f211014b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:10.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.838+0000 7f2115c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2110072440 0x7f2110150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:10.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.838+0000 7f2115c00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21101592a0 0x7f2110145970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:10.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.838+0000 7f2115c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2110165860 con 0x7f2110072060 2024-03-28T12:42:10.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.838+0000 7f2115c00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f21101656e0 con 0x7f21101592a0 2024-03-28T12:42:10.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.838+0000 7f2115c00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f21101659e0 con 0x7f2110072440 2024-03-28T12:42:10.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.838+0000 7f210ea00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2110072060 0x7f211014b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:10.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.838+0000 7f210ea00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2110072060 0x7f211014b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36580/0 (socket says 172.21.15.76:36580) 2024-03-28T12:42:10.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.838+0000 7f210ea00640 1 -- 172.21.15.76:0/3681608200 learned_addr learned my addr 172.21.15.76:0/3681608200 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:10.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.842+0000 7f210ea00640 1 -- 172.21.15.76:0/3681608200 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2110072440 msgr2=0x7f2110150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:10.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.842+0000 7f210ea00640 1 --2- 172.21.15.76:0/3681608200 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2110072440 0x7f2110150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:10.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.842+0000 7f210ea00640 1 -- 172.21.15.76:0/3681608200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21101592a0 msgr2=0x7f2110145970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:10.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.842+0000 7f210ea00640 1 --2- 172.21.15.76:0/3681608200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21101592a0 0x7f2110145970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:10.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.842+0000 7f210ea00640 1 -- 172.21.15.76:0/3681608200 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211015abd0 con 0x7f2110072060 2024-03-28T12:42:10.845 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.846+0000 7f210ea00640 1 --2- 172.21.15.76:0/3681608200 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2110072060 0x7f211014b070 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f21000ad040 tx=0x7f210001ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:10.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.850+0000 7f2106a00640 1 -- 172.21.15.76:0/3681608200 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21000be5f0 con 0x7f2110072060 2024-03-28T12:42:10.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.850+0000 7f2106a00640 1 -- 172.21.15.76:0/3681608200 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21000be7b0 con 0x7f2110072060 2024-03-28T12:42:10.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.850+0000 7f2106a00640 1 -- 172.21.15.76:0/3681608200 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21000beba0 con 0x7f2110072060 2024-03-28T12:42:10.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.850+0000 7f2115c00640 1 -- 172.21.15.76:0/3681608200 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f211015ae70 con 0x7f2110072060 2024-03-28T12:42:10.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.850+0000 7f2115c00640 1 -- 172.21.15.76:0/3681608200 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f211015b430 con 0x7f2110072060 2024-03-28T12:42:10.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:10.850+0000 7f2115c00640 1 -- 172.21.15.76:0/3681608200 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21100686e0 con 0x7f2110072060 2024-03-28T12:42:11.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.114+0000 7f2106a00640 1 -- 172.21.15.76:0/3681608200 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f21000b43f0 con 0x7f2110072060 2024-03-28T12:42:11.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.114+0000 7f2106a00640 1 --2- 172.21.15.76:0/3681608200 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f20f0068010 0x7f20f006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:11.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.114+0000 7f210e000640 1 --2- 172.21.15.76:0/3681608200 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f20f0068010 0x7f20f006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:11.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.114+0000 7f210e000640 1 --2- 172.21.15.76:0/3681608200 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f20f0068010 0x7f20f006a4d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f21100b0de0 tx=0x7f20fc006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:11.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.130+0000 7f2106a00640 1 -- 172.21.15.76:0/3681608200 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f21000ef170 con 0x7f2110072060 2024-03-28T12:42:11.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.130+0000 7f2106a00640 1 -- 172.21.15.76:0/3681608200 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f21000c4060 con 0x7f2110072060 2024-03-28T12:42:11.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.350+0000 7f2115c00640 1 -- 172.21.15.76:0/3681608200 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21100c99a0 con 0x7f2110072060 2024-03-28T12:42:11.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.398+0000 7f2106a00640 1 -- 172.21.15.76:0/3681608200 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18518 (secure 0 0 0) 0x7f21000160d0 con 0x7f2110072060 2024-03-28T12:42:11.399 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:11.399 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":27,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:42:08.570229+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T12:41:58.010965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T12:41:59.698601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-28T12:42:05.363180+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:42:11.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.402+0000 7f2115c00640 1 -- 172.21.15.76:0/3681608200 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f20f0068010 msgr2=0x7f20f006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:11.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.402+0000 7f2115c00640 1 --2- 172.21.15.76:0/3681608200 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f20f0068010 0x7f20f006a4d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f21100b0de0 tx=0x7f20fc006ca0 comp rx=0 tx=0).stop 2024-03-28T12:42:11.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.402+0000 7f2115c00640 1 -- 172.21.15.76:0/3681608200 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2110072060 msgr2=0x7f211014b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:11.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.402+0000 7f2115c00640 1 --2- 172.21.15.76:0/3681608200 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2110072060 0x7f211014b070 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f21000ad040 tx=0x7f210001ad20 comp rx=0 tx=0).stop 2024-03-28T12:42:11.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.402+0000 7f2115c00640 1 -- 172.21.15.76:0/3681608200 shutdown_connections 2024-03-28T12:42:11.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.402+0000 7f2115c00640 1 --2- 172.21.15.76:0/3681608200 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f20f0068010 0x7f20f006a4d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:11.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.402+0000 7f2115c00640 1 --2- 172.21.15.76:0/3681608200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21101592a0 0x7f2110145970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:11.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.402+0000 7f2115c00640 1 --2- 172.21.15.76:0/3681608200 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2110072440 0x7f2110150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:11.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.402+0000 7f2115c00640 1 --2- 172.21.15.76:0/3681608200 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2110072060 0x7f211014b070 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:11.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.402+0000 7f2115c00640 1 -- 172.21.15.76:0/3681608200 >> 172.21.15.76:0/3681608200 conn(0x7f2110071520 msgr2=0x7f21101589f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:11.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.402+0000 7f2115c00640 1 -- 172.21.15.76:0/3681608200 shutdown_connections 2024-03-28T12:42:11.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.402+0000 7f2115c00640 1 -- 172.21.15.76:0/3681608200 wait complete. 2024-03-28T12:42:11.435 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T12:42:11.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.578+0000 7f5ec7e00640 1 Processor -- start 2024-03-28T12:42:11.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.578+0000 7f5ec7e00640 1 -- start start 2024-03-28T12:42:11.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.578+0000 7f5ec7e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ec806eb90 0x7f5ec80c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:11.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.578+0000 7f5ec7e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5ec806ef90 0x7f5ec80c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:11.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.578+0000 7f5ec7e00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec8154d20 con 0x7f5ec8154940 2024-03-28T12:42:11.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.578+0000 7f5ec7e00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f5ec8070610 con 0x7f5ec806ef90 2024-03-28T12:42:11.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.578+0000 7f5ec7e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec80c4140 con 0x7f5ec806eb90 2024-03-28T12:42:11.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.578+0000 7f5ec6a00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f5ec8154940 0x7f5ec806fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:42508/0 (socket says 172.21.15.76:42508) 2024-03-28T12:42:11.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.578+0000 7f5ec6a00640 1 -- 172.21.15.76:0/1348776230 learned_addr learned my addr 172.21.15.76:0/1348776230 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:11.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.578+0000 7f5ec7400640 1 --2- 172.21.15.76:0/1348776230 >> v2:172.21.15.111:3300/0 conn(0x7f5ec806ef90 0x7f5ec80c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:11.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.578+0000 7f5ebfe00640 1 --2- 172.21.15.76:0/1348776230 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ec806eb90 0x7f5ec80c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:11.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.582+0000 7f5ec6000640 1 -- 172.21.15.76:0/1348776230 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3353799914 0 0) 0x7f5ec8154d20 con 0x7f5ec8154940 2024-03-28T12:42:11.581 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.582+0000 7f5ec6000640 1 -- 172.21.15.76:0/1348776230 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5eac003530 con 0x7f5ec8154940 2024-03-28T12:42:11.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.586+0000 7f5ec7400640 1 -- 172.21.15.76:0/1348776230 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ec806eb90 msgr2=0x7f5ec80c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:11.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.586+0000 7f5ec7400640 1 --2- 172.21.15.76:0/1348776230 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ec806eb90 0x7f5ec80c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:11.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.586+0000 7f5ec7400640 1 -- 172.21.15.76:0/1348776230 >> v1:172.21.15.76:6789/0 conn(0x7f5ec8154940 legacy=0x7f5ec806fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:11.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.586+0000 7f5ec6000640 1 -- 172.21.15.76:0/1348776230 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 367762605 0 0) 0x7f5eac003530 con 0x7f5ec8154940 2024-03-28T12:42:11.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.586+0000 7f5ec7400640 1 -- 172.21.15.76:0/1348776230 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec80c3530 con 0x7f5ec806ef90 2024-03-28T12:42:11.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.590+0000 7f5ec7400640 1 --2- 172.21.15.76:0/1348776230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ec806ef90 0x7f5ec80c9f90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009d90 tx=0x7f5ec001c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37ec9f984011e83f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:11.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.602+0000 7f5ec6000640 1 -- 172.21.15.76:0/1348776230 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec00b2070 con 0x7f5ec806ef90 2024-03-28T12:42:11.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.602+0000 7f5ec6000640 1 -- 172.21.15.76:0/1348776230 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec00a5510 con 0x7f5ec806ef90 2024-03-28T12:42:11.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.602+0000 7f5ec6000640 1 -- 172.21.15.76:0/1348776230 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8001680 con 0x7f5ec806ef90 2024-03-28T12:42:11.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.602+0000 7f5ec7e00640 1 -- 172.21.15.76:0/1348776230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ec806ef90 msgr2=0x7f5ec80c9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:11.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.602+0000 7f5ec7e00640 1 --2- 172.21.15.76:0/1348776230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ec806ef90 0x7f5ec80c9f90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009d90 tx=0x7f5ec001c800 comp rx=0 tx=0).stop 2024-03-28T12:42:11.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.602+0000 7f5ec7e00640 1 -- 172.21.15.76:0/1348776230 shutdown_connections 2024-03-28T12:42:11.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.602+0000 7f5ec7e00640 1 --2- 172.21.15.76:0/1348776230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ec806ef90 0x7f5ec80c9f90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:11.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.602+0000 7f5ec7e00640 1 --2- 172.21.15.76:0/1348776230 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ec806eb90 0x7f5ec80c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:11.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.602+0000 7f5ec7e00640 1 -- 172.21.15.76:0/1348776230 >> 172.21.15.76:0/1348776230 conn(0x7f5ec8070c10 msgr2=0x7f5ec8071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:11.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.602+0000 7f5ec7e00640 1 -- 172.21.15.76:0/1348776230 shutdown_connections 2024-03-28T12:42:11.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.602+0000 7f5ec7e00640 1 -- 172.21.15.76:0/1348776230 wait complete. 2024-03-28T12:42:11.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.606+0000 7f5ec7e00640 1 Processor -- start 2024-03-28T12:42:11.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.606+0000 7f5ec7e00640 1 -- start start 2024-03-28T12:42:11.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.606+0000 7f5ec7e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ec806eb90 0x7f5ec815b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:11.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.606+0000 7f5ec7e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ec806ef90 0x7f5ec8145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:11.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.606+0000 7f5ec7e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ec8154940 0x7f5ec8144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:11.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.606+0000 7f5ec7e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec8167070 con 0x7f5ec806ef90 2024-03-28T12:42:11.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.606+0000 7f5ec7e00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec8166ef0 con 0x7f5ec8154940 2024-03-28T12:42:11.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.606+0000 7f5ec7e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec81671f0 con 0x7f5ec806eb90 2024-03-28T12:42:11.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.606+0000 7f5ebfe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ec806ef90 0x7f5ec8145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:11.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.606+0000 7f5ebfe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ec806ef90 0x7f5ec8145e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36584/0 (socket says 172.21.15.76:36584) 2024-03-28T12:42:11.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.606+0000 7f5ebfe00640 1 -- 172.21.15.76:0/3374418964 learned_addr learned my addr 172.21.15.76:0/3374418964 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:11.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.606+0000 7f5ec6a00640 1 --2- 172.21.15.76:0/3374418964 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ec806eb90 0x7f5ec815b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:11.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.606+0000 7f5ec7400640 1 --2- 172.21.15.76:0/3374418964 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ec8154940 0x7f5ec8144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:11.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.610+0000 7f5ebfe00640 1 -- 172.21.15.76:0/3374418964 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ec806eb90 msgr2=0x7f5ec815b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:11.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.610+0000 7f5ebfe00640 1 --2- 172.21.15.76:0/3374418964 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ec806eb90 0x7f5ec815b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:11.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.610+0000 7f5ebfe00640 1 -- 172.21.15.76:0/3374418964 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ec8154940 msgr2=0x7f5ec8144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:11.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.610+0000 7f5ebfe00640 1 --2- 172.21.15.76:0/3374418964 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ec8154940 0x7f5ec8144770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:11.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.610+0000 7f5ebfe00640 1 -- 172.21.15.76:0/3374418964 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec80c7ba0 con 0x7f5ec806ef90 2024-03-28T12:42:11.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.614+0000 7f5ebfe00640 1 --2- 172.21.15.76:0/3374418964 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ec806ef90 0x7f5ec8145e30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000e930 tx=0x7f5eb000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:11.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.618+0000 7f5ebea00640 1 -- 172.21.15.76:0/3374418964 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0017070 con 0x7f5ec806ef90 2024-03-28T12:42:11.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.618+0000 7f5ebea00640 1 -- 172.21.15.76:0/3374418964 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb000ca00 con 0x7f5ec806ef90 2024-03-28T12:42:11.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.618+0000 7f5ec7e00640 1 -- 172.21.15.76:0/3374418964 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec80c7e60 con 0x7f5ec806ef90 2024-03-28T12:42:11.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.618+0000 7f5ebea00640 1 -- 172.21.15.76:0/3374418964 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb000cdb0 con 0x7f5ec806ef90 2024-03-28T12:42:11.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.618+0000 7f5ec7e00640 1 -- 172.21.15.76:0/3374418964 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec80c8420 con 0x7f5ec806ef90 2024-03-28T12:42:11.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.618+0000 7f5ec7e00640 1 -- 172.21.15.76:0/3374418964 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ec8068df0 con 0x7f5ec806ef90 2024-03-28T12:42:11.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.638+0000 7f5ebea00640 1 -- 172.21.15.76:0/3374418964 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f5eb001a070 con 0x7f5ec806ef90 2024-03-28T12:42:11.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.638+0000 7f5ebea00640 1 --2- 172.21.15.76:0/3374418964 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5ea4067fc0 0x7f5ea406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:11.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.638+0000 7f5ec6a00640 1 --2- 172.21.15.76:0/3374418964 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5ea4067fc0 0x7f5ea406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:11.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.638+0000 7f5ec6a00640 1 --2- 172.21.15.76:0/3374418964 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5ea4067fc0 0x7f5ea406a480 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80011f0 tx=0x7f5eb80016e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:11.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.638+0000 7f5ebea00640 1 -- 172.21.15.76:0/3374418964 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5eb0054f70 con 0x7f5ec806ef90 2024-03-28T12:42:11.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:11.886+0000 7f5ebea00640 1 -- 172.21.15.76:0/3374418964 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f5eb0056ed0 con 0x7f5ec806ef90 2024-03-28T12:42:12.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.086+0000 7f5ec7e00640 1 -- 172.21.15.76:0/3374418964 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ec806f6f0 con 0x7f5ec806ef90 2024-03-28T12:42:12.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.150+0000 7f5ebea00640 1 -- 172.21.15.76:0/3374418964 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6828 (secure 0 0 0) 0x7f5eb005b1d0 con 0x7f5ec806ef90 2024-03-28T12:42:12.150 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:12.150 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/335301918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":335301918},{"type":"v1","addr":"172.21.15.111:6835","nonce":335301918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1786218285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1786218285},{"type":"v1","addr":"172.21.15.76:6837","nonce":1786218285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/2729208421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":2729208421},{"type":"v1","addr":"172.21.15.76:6839","nonce":2729208421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4251,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6837/4176441330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":4176441330},{"type":"v1","addr":"172.21.15.111:6837","nonce":4176441330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6833/3175932821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":3175932821},{"type":"v1","addr":"172.21.15.111:6833","nonce":3175932821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T12:42:00.776505+0000","modified":"2024-03-28T12:42:08.578048+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4264":{"gid":4264,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":9,"addr":"172.21.15.76:6835/544947706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":544947706},{"type":"v1","addr":"172.21.15.76:6835","nonce":544947706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4264,"qdb_cluster":[4264]},"id":1}]} 2024-03-28T12:42:12.151 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 6 2024-03-28T12:42:12.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.154+0000 7f5ec7e00640 1 -- 172.21.15.76:0/3374418964 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5ea4067fc0 msgr2=0x7f5ea406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:12.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.154+0000 7f5ec7e00640 1 --2- 172.21.15.76:0/3374418964 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5ea4067fc0 0x7f5ea406a480 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80011f0 tx=0x7f5eb80016e0 comp rx=0 tx=0).stop 2024-03-28T12:42:12.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.154+0000 7f5ec7e00640 1 -- 172.21.15.76:0/3374418964 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ec806ef90 msgr2=0x7f5ec8145e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:12.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.154+0000 7f5ec7e00640 1 --2- 172.21.15.76:0/3374418964 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ec806ef90 0x7f5ec8145e30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000e930 tx=0x7f5eb000edf0 comp rx=0 tx=0).stop 2024-03-28T12:42:12.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.154+0000 7f5ec7e00640 1 -- 172.21.15.76:0/3374418964 shutdown_connections 2024-03-28T12:42:12.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.154+0000 7f5ec7e00640 1 --2- 172.21.15.76:0/3374418964 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5ea4067fc0 0x7f5ea406a480 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:12.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.154+0000 7f5ec7e00640 1 --2- 172.21.15.76:0/3374418964 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ec8154940 0x7f5ec8144770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:12.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.154+0000 7f5ec7e00640 1 --2- 172.21.15.76:0/3374418964 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5ec806ef90 0x7f5ec8145e30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:12.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.154+0000 7f5ec7e00640 1 --2- 172.21.15.76:0/3374418964 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5ec806eb90 0x7f5ec815b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:12.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.154+0000 7f5ec7e00640 1 -- 172.21.15.76:0/3374418964 >> 172.21.15.76:0/3374418964 conn(0x7f5ec8070c10 msgr2=0x7f5ec814f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:12.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.154+0000 7f5ec7e00640 1 -- 172.21.15.76:0/3374418964 shutdown_connections 2024-03-28T12:42:12.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.154+0000 7f5ec7e00640 1 -- 172.21.15.76:0/3374418964 wait complete. 2024-03-28T12:42:12.173 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T12:42:12.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.314+0000 7f1a11400640 1 Processor -- start 2024-03-28T12:42:12.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.314+0000 7f1a11400640 1 -- start start 2024-03-28T12:42:12.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.314+0000 7f1a11400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a0c06eb90 0x7f1a0c0c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:12.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.314+0000 7f1a11400640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a0c154d20 con 0x7f1a0c06ef90 2024-03-28T12:42:12.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.314+0000 7f1a11400640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a0c0c3530 con 0x7f1a0c154940 2024-03-28T12:42:12.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.314+0000 7f1a11400640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f1a0c070610 con 0x7f1a0c06eb90 2024-03-28T12:42:12.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.314+0000 7f1a10a00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f1a0c06ef90 0x7f1a0c15a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:42514/0 (socket says 172.21.15.76:42514) 2024-03-28T12:42:12.313 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.314+0000 7f1a10a00640 1 -- 172.21.15.76:0/2913985009 learned_addr learned my addr 172.21.15.76:0/2913985009 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:12.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.314+0000 7f1a0b400640 1 --2- 172.21.15.76:0/2913985009 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a0c06eb90 0x7f1a0c0c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:12.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.318+0000 7f1a0aa00640 1 -- 172.21.15.76:0/2913985009 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4212080535 0 0) 0x7f1a0c154d20 con 0x7f1a0c06ef90 2024-03-28T12:42:12.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.318+0000 7f1a0aa00640 1 -- 172.21.15.76:0/2913985009 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19f0003530 con 0x7f1a0c06ef90 2024-03-28T12:42:12.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.318+0000 7f1a0aa00640 1 -- 172.21.15.76:0/2913985009 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889609565 0 0) 0x7f1a0c0c3530 con 0x7f1a0c154940 2024-03-28T12:42:12.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.318+0000 7f1a0aa00640 1 -- 172.21.15.76:0/2913985009 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a0c154d20 con 0x7f1a0c154940 2024-03-28T12:42:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.322+0000 7f1a0aa00640 1 -- 172.21.15.76:0/2913985009 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2454603906 0 0) 0x7f19f0003530 con 0x7f1a0c06ef90 2024-03-28T12:42:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.322+0000 7f1a0aa00640 1 -- 172.21.15.76:0/2913985009 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a0c06eb90 msgr2=0x7f1a0c0c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.322+0000 7f1a0aa00640 1 --2- 172.21.15.76:0/2913985009 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a0c06eb90 0x7f1a0c0c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.322+0000 7f1a0aa00640 1 -- 172.21.15.76:0/2913985009 >> v1:172.21.15.111:6789/0 conn(0x7f1a0c154940 legacy=0x7f1a0c06fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.322+0000 7f1a0aa00640 1 -- 172.21.15.76:0/2913985009 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0c0c3810 con 0x7f1a0c06ef90 2024-03-28T12:42:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.322+0000 7f1a0aa00640 1 -- 172.21.15.76:0/2913985009 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7f1a04001a00 con 0x7f1a0c06ef90 2024-03-28T12:42:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.322+0000 7f1a0aa00640 1 -- 172.21.15.76:0/2913985009 >> v1:172.21.15.76:6789/0 conn(0x7f1a0c06ef90 legacy=0x7f1a0c15a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.322+0000 7f1a0aa00640 1 --2- 172.21.15.76:0/2913985009 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19f0003b80 0x7f19f0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.322+0000 7f1a0aa00640 1 --2- 172.21.15.76:0/2913985009 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19f0004810 0x7f19f0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:12.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.322+0000 7f1a0aa00640 1 --2- 172.21.15.76:0/2913985009 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a0c06eb90 0x7f19f0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:12.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.322+0000 7f1a0aa00640 1 -- 172.21.15.76:0/2913985009 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c070610 con 0x7f19f0004810 2024-03-28T12:42:12.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.322+0000 7f1a0aa00640 1 -- 172.21.15.76:0/2913985009 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f19f000bb60 con 0x7f19f0003b80 2024-03-28T12:42:12.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.322+0000 7f1a0aa00640 1 -- 172.21.15.76:0/2913985009 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f19f000bd30 con 0x7f1a0c06eb90 2024-03-28T12:42:12.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.322+0000 7f1a0b400640 1 --2- 172.21.15.76:0/2913985009 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19f0004810 0x7f19f0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:12.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.326+0000 7f1a0b400640 1 -- 172.21.15.76:0/2913985009 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a0c06eb90 msgr2=0x7f19f0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:12.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.326+0000 7f1a0b400640 1 --2- 172.21.15.76:0/2913985009 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a0c06eb90 0x7f19f0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:12.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.326+0000 7f1a0b400640 1 -- 172.21.15.76:0/2913985009 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19f0003b80 msgr2=0x7f19f0003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:12.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.326+0000 7f1a0b400640 1 --2- 172.21.15.76:0/2913985009 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19f0003b80 0x7f19f0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:12.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.326+0000 7f1a0b400640 1 -- 172.21.15.76:0/2913985009 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f0003530 con 0x7f19f0004810 2024-03-28T12:42:12.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.330+0000 7f1a0b400640 1 --2- 172.21.15.76:0/2913985009 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19f0004810 0x7f19f0004c90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009b10 tx=0x7f19f801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c14d67007e6777 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:12.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.334+0000 7f1a0aa00640 1 -- 172.21.15.76:0/2913985009 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f80b2070 con 0x7f19f0004810 2024-03-28T12:42:12.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.334+0000 7f1a0aa00640 1 -- 172.21.15.76:0/2913985009 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f80a5590 con 0x7f19f0004810 2024-03-28T12:42:12.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.334+0000 7f1a0aa00640 1 -- 172.21.15.76:0/2913985009 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f80096b0 con 0x7f19f0004810 2024-03-28T12:42:12.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.334+0000 7f1a11400640 1 -- 172.21.15.76:0/2913985009 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19f0004810 msgr2=0x7f19f0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:12.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.334+0000 7f1a11400640 1 --2- 172.21.15.76:0/2913985009 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f19f0004810 0x7f19f0004c90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009b10 tx=0x7f19f801cab0 comp rx=0 tx=0).stop 2024-03-28T12:42:12.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.334+0000 7f1a10a00640 1 -- 172.21.15.76:0/2913985009 reap_dead start 2024-03-28T12:42:12.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.334+0000 7f1a11400640 1 -- 172.21.15.76:0/2913985009 shutdown_connections 2024-03-28T12:42:12.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.334+0000 7f1a11400640 1 -- 172.21.15.76:0/2913985009 >> 172.21.15.76:0/2913985009 conn(0x7f1a0c070c10 msgr2=0x7f1a0c071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:12.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.334+0000 7f1a11400640 1 -- 172.21.15.76:0/2913985009 shutdown_connections 2024-03-28T12:42:12.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.334+0000 7f1a11400640 1 -- 172.21.15.76:0/2913985009 wait complete. 2024-03-28T12:42:12.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.338+0000 7f1a11400640 1 Processor -- start 2024-03-28T12:42:12.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.338+0000 7f1a11400640 1 -- start start 2024-03-28T12:42:12.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.338+0000 7f1a11400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19f0004810 0x7f1a0c1f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:12.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.338+0000 7f1a11400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a0c14ebd0 0x7f1a0c0c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:12.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.338+0000 7f1a11400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a0c0c7000 0x7f1a0c0c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:12.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.338+0000 7f1a11400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c166100 con 0x7f1a0c14ebd0 2024-03-28T12:42:12.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.338+0000 7f1a11400640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0c0c4140 con 0x7f19f0004810 2024-03-28T12:42:12.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.338+0000 7f1a11400640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f1a0c166280 con 0x7f1a0c0c7000 2024-03-28T12:42:12.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.338+0000 7f1a0b400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a0c14ebd0 0x7f1a0c0c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:12.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.338+0000 7f1a0b400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a0c14ebd0 0x7f1a0c0c76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:36608/0 (socket says 172.21.15.76:36608) 2024-03-28T12:42:12.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.338+0000 7f1a0b400640 1 -- 172.21.15.76:0/3381257049 learned_addr learned my addr 172.21.15.76:0/3381257049 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:12.338 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.338+0000 7f1a10a00640 1 --2- 172.21.15.76:0/3381257049 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a0c0c7000 0x7f1a0c0c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:12.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.342+0000 7f1a0be00640 1 --2- 172.21.15.76:0/3381257049 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19f0004810 0x7f1a0c1f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:12.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.342+0000 7f1a0b400640 1 -- 172.21.15.76:0/3381257049 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a0c0c7000 msgr2=0x7f1a0c0c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:12.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.342+0000 7f1a0b400640 1 --2- 172.21.15.76:0/3381257049 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a0c0c7000 0x7f1a0c0c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:12.341 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.342+0000 7f1a0b400640 1 -- 172.21.15.76:0/3381257049 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19f0004810 msgr2=0x7f1a0c1f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:12.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.342+0000 7f1a0b400640 1 --2- 172.21.15.76:0/3381257049 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19f0004810 0x7f1a0c1f44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:12.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.342+0000 7f1a0b400640 1 -- 172.21.15.76:0/3381257049 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0c15bf20 con 0x7f1a0c14ebd0 2024-03-28T12:42:12.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.346+0000 7f1a0b400640 1 --2- 172.21.15.76:0/3381257049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a0c14ebd0 0x7f1a0c0c76d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19f801c8e0 tx=0x7f19f0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:12.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.346+0000 7f1a03e00640 1 -- 172.21.15.76:0/3381257049 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f80b2040 con 0x7f1a0c14ebd0 2024-03-28T12:42:12.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.346+0000 7f1a11400640 1 -- 172.21.15.76:0/3381257049 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a0c15c200 con 0x7f1a0c14ebd0 2024-03-28T12:42:12.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.350+0000 7f1a11400640 1 -- 172.21.15.76:0/3381257049 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a0c1f39f0 con 0x7f1a0c14ebd0 2024-03-28T12:42:12.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.350+0000 7f1a11400640 1 -- 172.21.15.76:0/3381257049 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a0c068df0 con 0x7f1a0c14ebd0 2024-03-28T12:42:12.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.350+0000 7f1a03e00640 1 -- 172.21.15.76:0/3381257049 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f80a5590 con 0x7f1a0c14ebd0 2024-03-28T12:42:12.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.350+0000 7f1a03e00640 1 -- 172.21.15.76:0/3381257049 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8009770 con 0x7f1a0c14ebd0 2024-03-28T12:42:12.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.602+0000 7f1a03e00640 1 -- 172.21.15.76:0/3381257049 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f19f80c0020 con 0x7f1a0c14ebd0 2024-03-28T12:42:12.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.602+0000 7f1a03e00640 1 --2- 172.21.15.76:0/3381257049 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f19ec067ff0 0x7f19ec06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:12.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.602+0000 7f1a0be00640 1 --2- 172.21.15.76:0/3381257049 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f19ec067ff0 0x7f19ec06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:12.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.602+0000 7f1a0be00640 1 --2- 172.21.15.76:0/3381257049 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f19ec067ff0 0x7f19ec06a4b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f19fc000f70 tx=0x7f19fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:12.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.614+0000 7f1a03e00640 1 -- 172.21.15.76:0/3381257049 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f19f80eef60 con 0x7f1a0c14ebd0 2024-03-28T12:42:12.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.614+0000 7f1a03e00640 1 -- 172.21.15.76:0/3381257049 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f19f8016800 con 0x7f1a0c14ebd0 2024-03-28T12:42:12.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.774+0000 7f1a11400640 1 -- 172.21.15.76:0/3381257049 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a0c06f6f0 con 0x7f1a0c14ebd0 2024-03-28T12:42:12.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.834+0000 7f1a03e00640 1 -- 172.21.15.76:0/3381257049 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18518 (secure 0 0 0) 0x7f19f80f0ec0 con 0x7f1a0c14ebd0 2024-03-28T12:42:12.834 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:12.834 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":27,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:42:08.570229+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T12:41:58.010965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T12:41:59.698601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-28T12:42:05.363180+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:42:12.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.838+0000 7f1a11400640 1 -- 172.21.15.76:0/3381257049 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f19ec067ff0 msgr2=0x7f19ec06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:12.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.838+0000 7f1a11400640 1 --2- 172.21.15.76:0/3381257049 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f19ec067ff0 0x7f19ec06a4b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f19fc000f70 tx=0x7f19fc009040 comp rx=0 tx=0).stop 2024-03-28T12:42:12.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.838+0000 7f1a11400640 1 -- 172.21.15.76:0/3381257049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a0c14ebd0 msgr2=0x7f1a0c0c76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:12.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.838+0000 7f1a11400640 1 --2- 172.21.15.76:0/3381257049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a0c14ebd0 0x7f1a0c0c76d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f19f801c8e0 tx=0x7f19f0005840 comp rx=0 tx=0).stop 2024-03-28T12:42:12.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.838+0000 7f1a11400640 1 -- 172.21.15.76:0/3381257049 shutdown_connections 2024-03-28T12:42:12.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.838+0000 7f1a11400640 1 --2- 172.21.15.76:0/3381257049 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f19ec067ff0 0x7f19ec06a4b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:12.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.838+0000 7f1a11400640 1 --2- 172.21.15.76:0/3381257049 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a0c0c7000 0x7f1a0c0c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:12.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.838+0000 7f1a11400640 1 --2- 172.21.15.76:0/3381257049 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1a0c14ebd0 0x7f1a0c0c76d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:12.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.838+0000 7f1a11400640 1 --2- 172.21.15.76:0/3381257049 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19f0004810 0x7f1a0c1f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:12.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.838+0000 7f1a11400640 1 -- 172.21.15.76:0/3381257049 >> 172.21.15.76:0/3381257049 conn(0x7f1a0c070c10 msgr2=0x7f1a0c06fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:12.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.838+0000 7f1a11400640 1 -- 172.21.15.76:0/3381257049 shutdown_connections 2024-03-28T12:42:12.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:12.838+0000 7f1a11400640 1 -- 172.21.15.76:0/3381257049 wait complete. 2024-03-28T12:42:13.459 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-28T12:42:00.776505+0000', 'modified': '2024-03-28T12:42:08.578048+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4264}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4264': {'gid': 4264, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.76:6835/544947706', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6834', 'nonce': 544947706}, {'type': 'v1', 'addr': '172.21.15.76:6835', 'nonce': 544947706}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4264, 'qdb_cluster': [4264]} 2024-03-28T12:42:13.459 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-28T12:42:13.459 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-28T12:42:13.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.598+0000 7f5269400640 1 Processor -- start 2024-03-28T12:42:13.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.598+0000 7f5269400640 1 -- start start 2024-03-28T12:42:13.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.598+0000 7f5269400640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5264152800 0x7f52640cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.598+0000 7f5269400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52640cab80 0x7f52640cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.598+0000 7f5269400640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5264158680 con 0x7f52640c97e0 2024-03-28T12:42:13.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.598+0000 7f5269400640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f5264159550 con 0x7f5264152800 2024-03-28T12:42:13.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.598+0000 7f5269400640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f52640cb4f0 con 0x7f52640cab80 2024-03-28T12:42:13.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.598+0000 7f5261e00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f52640c97e0 0x7f5264071d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:49604/0 (socket says 172.21.15.76:49604) 2024-03-28T12:42:13.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.598+0000 7f5261e00640 1 -- 172.21.15.76:0/3728579930 learned_addr learned my addr 172.21.15.76:0/3728579930 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:13.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.598+0000 7f5262800640 1 --2- 172.21.15.76:0/3728579930 >> v2:172.21.15.111:3300/0 conn(0x7f5264152800 0x7f52640cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.598+0000 7f5263200640 1 --2- 172.21.15.76:0/3728579930 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52640cab80 0x7f52640cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.602+0000 7f5261400640 1 -- 172.21.15.76:0/3728579930 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4167944413 0 0) 0x7f5264158680 con 0x7f52640c97e0 2024-03-28T12:42:13.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.602+0000 7f5261400640 1 -- 172.21.15.76:0/3728579930 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5248003530 con 0x7f52640c97e0 2024-03-28T12:42:13.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.606+0000 7f5261400640 1 -- 172.21.15.76:0/3728579930 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3481617477 0 0) 0x7f5248003530 con 0x7f52640c97e0 2024-03-28T12:42:13.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.606+0000 7f5261400640 1 -- 172.21.15.76:0/3728579930 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52640cab80 msgr2=0x7f52640cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:13.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.606+0000 7f5261400640 1 --2- 172.21.15.76:0/3728579930 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52640cab80 0x7f52640cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.606+0000 7f5261400640 1 -- 172.21.15.76:0/3728579930 >> v2:172.21.15.111:3300/0 conn(0x7f5264152800 msgr2=0x7f52640cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:13.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.606+0000 7f5261400640 1 --2- 172.21.15.76:0/3728579930 >> v2:172.21.15.111:3300/0 conn(0x7f5264152800 0x7f52640cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.606+0000 7f5261400640 1 -- 172.21.15.76:0/3728579930 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5264158940 con 0x7f52640c97e0 2024-03-28T12:42:13.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.606+0000 7f5261400640 1 -- 172.21.15.76:0/3728579930 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7f52500016a0 con 0x7f52640c97e0 2024-03-28T12:42:13.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.606+0000 7f5261400640 1 -- 172.21.15.76:0/3728579930 >> v1:172.21.15.76:6789/0 conn(0x7f52640c97e0 legacy=0x7f5264071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:13.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.606+0000 7f5261400640 1 --2- 172.21.15.76:0/3728579930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5248003a30 0x7f5248003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.606+0000 7f5261400640 1 --2- 172.21.15.76:0/3728579930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5248004810 0x7f5248004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.606+0000 7f5261400640 1 --2- 172.21.15.76:0/3728579930 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52640cab80 0x7f52480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.606+0000 7f5261400640 1 -- 172.21.15.76:0/3728579930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f52640cb4f0 con 0x7f5248004810 2024-03-28T12:42:13.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.606+0000 7f5261400640 1 -- 172.21.15.76:0/3728579930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f524800b9d0 con 0x7f5248003a30 2024-03-28T12:42:13.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.606+0000 7f5261400640 1 -- 172.21.15.76:0/3728579930 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f524800bba0 con 0x7f52640cab80 2024-03-28T12:42:13.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.610+0000 7f5261e00640 1 --2- 172.21.15.76:0/3728579930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5248004810 0x7f5248004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.614+0000 7f5261e00640 1 -- 172.21.15.76:0/3728579930 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52640cab80 msgr2=0x7f52480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:13.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.614+0000 7f5261e00640 1 --2- 172.21.15.76:0/3728579930 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52640cab80 0x7f52480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.614+0000 7f5261e00640 1 -- 172.21.15.76:0/3728579930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5248003a30 msgr2=0x7f5248003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:13.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.614+0000 7f5261e00640 1 --2- 172.21.15.76:0/3728579930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5248003a30 0x7f5248003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.614+0000 7f5261e00640 1 -- 172.21.15.76:0/3728579930 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5248003530 con 0x7f5248004810 2024-03-28T12:42:13.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.618+0000 7f5261e00640 1 --2- 172.21.15.76:0/3728579930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5248004810 0x7f5248004c90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f525000c160 tx=0x7f525001f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8f54068d6ffb27 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:13.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.626+0000 7f5261400640 1 -- 172.21.15.76:0/3728579930 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250007cb0 con 0x7f5248004810 2024-03-28T12:42:13.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.626+0000 7f5261400640 1 -- 172.21.15.76:0/3728579930 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52500ac020 con 0x7f5248004810 2024-03-28T12:42:13.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.626+0000 7f5261400640 1 -- 172.21.15.76:0/3728579930 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52500058e0 con 0x7f5248004810 2024-03-28T12:42:13.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.626+0000 7f5269400640 1 -- 172.21.15.76:0/3728579930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5248004810 msgr2=0x7f5248004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:13.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.626+0000 7f5269400640 1 --2- 172.21.15.76:0/3728579930 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5248004810 0x7f5248004c90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f525000c160 tx=0x7f525001f310 comp rx=0 tx=0).stop 2024-03-28T12:42:13.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.626+0000 7f5263200640 1 -- 172.21.15.76:0/3728579930 reap_dead start 2024-03-28T12:42:13.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.626+0000 7f5269400640 1 -- 172.21.15.76:0/3728579930 shutdown_connections 2024-03-28T12:42:13.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.626+0000 7f5269400640 1 -- 172.21.15.76:0/3728579930 >> 172.21.15.76:0/3728579930 conn(0x7f5264071540 msgr2=0x7f5264070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:13.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.626+0000 7f5269400640 1 -- 172.21.15.76:0/3728579930 shutdown_connections 2024-03-28T12:42:13.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.626+0000 7f5269400640 1 -- 172.21.15.76:0/3728579930 wait complete. 2024-03-28T12:42:13.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.630+0000 7f5269400640 1 Processor -- start 2024-03-28T12:42:13.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.630+0000 7f5269400640 1 -- start start 2024-03-28T12:42:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.630+0000 7f5269400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5248004810 0x7f52640c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.630+0000 7f5269400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5264158250 0x7f52641f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.630+0000 7f5269400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5264157620 0x7f5264147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.630+0000 7f5269400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f52641591e0 con 0x7f5264158250 2024-03-28T12:42:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.630+0000 7f5269400640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5264158f00 con 0x7f5248004810 2024-03-28T12:42:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.630+0000 7f5269400640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f52640c8d00 con 0x7f5264157620 2024-03-28T12:42:13.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.630+0000 7f5261e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5264158250 0x7f52641f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.634+0000 7f5261e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5264158250 0x7f52641f3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50762/0 (socket says 172.21.15.76:50762) 2024-03-28T12:42:13.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.634+0000 7f5261e00640 1 -- 172.21.15.76:0/3392929407 learned_addr learned my addr 172.21.15.76:0/3392929407 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:13.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.634+0000 7f5263200640 1 --2- 172.21.15.76:0/3392929407 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5264157620 0x7f5264147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.634+0000 7f5262800640 1 --2- 172.21.15.76:0/3392929407 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5248004810 0x7f52640c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.634+0000 7f5261e00640 1 -- 172.21.15.76:0/3392929407 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5264157620 msgr2=0x7f5264147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:13.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.634+0000 7f5261e00640 1 --2- 172.21.15.76:0/3392929407 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5264157620 0x7f5264147910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.634+0000 7f5261e00640 1 -- 172.21.15.76:0/3392929407 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5248004810 msgr2=0x7f52640c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:13.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.634+0000 7f5261e00640 1 --2- 172.21.15.76:0/3392929407 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5248004810 0x7f52640c70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.634+0000 7f5261e00640 1 -- 172.21.15.76:0/3392929407 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526406ce10 con 0x7f5264158250 2024-03-28T12:42:13.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.638+0000 7f5261e00640 1 --2- 172.21.15.76:0/3392929407 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5264158250 0x7f52641f3be0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5250007040 tx=0x7f5248005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:13.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.642+0000 7f525aa00640 1 -- 172.21.15.76:0/3392929407 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52500049f0 con 0x7f5264158250 2024-03-28T12:42:13.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.642+0000 7f5269400640 1 -- 172.21.15.76:0/3392929407 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52640c7c90 con 0x7f5264158250 2024-03-28T12:42:13.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.642+0000 7f5269400640 1 -- 172.21.15.76:0/3392929407 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f526406c850 con 0x7f5264158250 2024-03-28T12:42:13.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.642+0000 7f525aa00640 1 -- 172.21.15.76:0/3392929407 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52500b6070 con 0x7f5264158250 2024-03-28T12:42:13.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.642+0000 7f525aa00640 1 -- 172.21.15.76:0/3392929407 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250004d90 con 0x7f5264158250 2024-03-28T12:42:13.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.646+0000 7f526c8e5000 1 Processor -- start 2024-03-28T12:42:13.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.646+0000 7f526c8e5000 1 -- start start 2024-03-28T12:42:13.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.646+0000 7f526c8e5000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531fbaf0 0x562a531c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.646+0000 7f526c8e5000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbed0 0x562a531c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.646+0000 7f526c8e5000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531e4210 0x562a531e45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.646+0000 7f526c8e5000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562a5300c950 con 0x562a531e4210 2024-03-28T12:42:13.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.646+0000 7f526c8e5000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x562a52fa9990 con 0x562a531fbaf0 2024-03-28T12:42:13.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.646+0000 7f526c8e5000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x562a53008900 con 0x562a531fbed0 2024-03-28T12:42:13.649 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.650+0000 7f5263200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531fbaf0 0x562a531c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.650+0000 7f5262800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbed0 0x562a531c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.650+0000 7f5263200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531fbaf0 0x562a531c1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:46768/0 (socket says 172.21.15.76:46768) 2024-03-28T12:42:13.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.650+0000 7f5263200640 1 -- 172.21.15.76:0/1528258932 learned_addr learned my addr 172.21.15.76:0/1528258932 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:13.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.658+0000 7f5263200640 1 -- 172.21.15.76:0/1528258932 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbed0 msgr2=0x562a531c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:13.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.658+0000 7f5263200640 1 --2- 172.21.15.76:0/1528258932 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbed0 0x562a531c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.658+0000 7f5263200640 1 -- 172.21.15.76:0/1528258932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531e4210 msgr2=0x562a531e45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:13.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.658+0000 7f5263200640 1 --2- 172.21.15.76:0/1528258932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531e4210 0x562a531e45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.658+0000 7f5263200640 1 -- 172.21.15.76:0/1528258932 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a53051100 con 0x562a531fbaf0 2024-03-28T12:42:13.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.662+0000 7f5263200640 1 --2- 172.21.15.76:0/1528258932 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531fbaf0 0x562a531c1bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5264073960 tx=0x7f525c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e29dbbbf38aebccc server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:13.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.666+0000 7f525aa00640 1 -- 172.21.15.76:0/3392929407 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f5250007070 con 0x7f5264158250 2024-03-28T12:42:13.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.666+0000 7f525aa00640 1 --2- 172.21.15.76:0/3392929407 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5244067fc0 0x7f524406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.666+0000 7f5262800640 1 --2- 172.21.15.76:0/3392929407 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5244067fc0 0x7f524406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.666+0000 7f5262800640 1 --2- 172.21.15.76:0/3392929407 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5244067fc0 0x7f524406a480 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f52540093f0 tx=0x7f52540094c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:13.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.666+0000 7f525aa00640 1 -- 172.21.15.76:0/3392929407 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f52500f1220 con 0x7f5264158250 2024-03-28T12:42:13.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.674+0000 7f524f400640 1 -- 172.21.15.76:0/1528258932 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c003ba0 con 0x562a531fbaf0 2024-03-28T12:42:13.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.674+0000 7f524f400640 1 -- 172.21.15.76:0/1528258932 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525c003d40 con 0x562a531fbaf0 2024-03-28T12:42:13.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.674+0000 7f524f400640 1 -- 172.21.15.76:0/1528258932 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c004230 con 0x562a531fbaf0 2024-03-28T12:42:13.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.674+0000 7f526c8e5000 1 -- 172.21.15.76:0/1528258932 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531fbaf0 msgr2=0x562a531c1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:13.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.674+0000 7f526c8e5000 1 --2- 172.21.15.76:0/1528258932 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531fbaf0 0x562a531c1bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5264073960 tx=0x7f525c00b040 comp rx=0 tx=0).stop 2024-03-28T12:42:13.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.674+0000 7f526c8e5000 1 -- 172.21.15.76:0/1528258932 shutdown_connections 2024-03-28T12:42:13.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.674+0000 7f526c8e5000 1 --2- 172.21.15.76:0/1528258932 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531e4210 0x562a531e45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.674+0000 7f526c8e5000 1 --2- 172.21.15.76:0/1528258932 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbed0 0x562a531c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.674+0000 7f526c8e5000 1 --2- 172.21.15.76:0/1528258932 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531fbaf0 0x562a531c1bf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.674+0000 7f526c8e5000 1 -- 172.21.15.76:0/1528258932 >> 172.21.15.76:0/1528258932 conn(0x562a530a4b80 msgr2=0x562a531fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:13.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.674+0000 7f526c8e5000 1 -- 172.21.15.76:0/1528258932 shutdown_connections 2024-03-28T12:42:13.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.674+0000 7f526c8e5000 1 -- 172.21.15.76:0/1528258932 wait complete. 2024-03-28T12:42:13.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.674+0000 7f526c8e5000 1 -- start start 2024-03-28T12:42:13.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.674+0000 7f526c8e5000 1 Processor -- start 2024-03-28T12:42:13.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.678+0000 7f526c8e5000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531e4210 0x562a531f7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.678+0000 7f526c8e5000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbaf0 0x562a53206090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.678+0000 7f526c8e5000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531fbed0 0x562a532065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.678+0000 7f526c8e5000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562a52fd4300 con 0x562a531fbed0 2024-03-28T12:42:13.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.678+0000 7f526c8e5000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x562a52fca3e0 con 0x562a531e4210 2024-03-28T12:42:13.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.678+0000 7f526c8e5000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x562a52f90b10 con 0x562a531fbaf0 2024-03-28T12:42:13.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.678+0000 7f526c8e5000 10 client.0 _ll_register_callbacks cb 0x562a5306d0f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T12:42:13.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.678+0000 7f5263200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531fbed0 0x562a532065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.678+0000 7f5263200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531fbed0 0x562a532065d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50788/0 (socket says 172.21.15.76:50788) 2024-03-28T12:42:13.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.678+0000 7f5263200640 1 -- 172.21.15.76:0/2577166640 learned_addr learned my addr 172.21.15.76:0/2577166640 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:13.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.678+0000 7f5261e00640 1 --2- 172.21.15.76:0/2577166640 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbaf0 0x562a53206090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.678+0000 7f5262800640 1 --2- 172.21.15.76:0/2577166640 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531e4210 0x562a531f7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.682+0000 7f5263200640 1 -- 172.21.15.76:0/2577166640 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbaf0 msgr2=0x562a53206090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:13.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.682+0000 7f5263200640 1 --2- 172.21.15.76:0/2577166640 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbaf0 0x562a53206090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.682+0000 7f5263200640 1 -- 172.21.15.76:0/2577166640 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531e4210 msgr2=0x562a531f7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:13.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.682+0000 7f5263200640 1 --2- 172.21.15.76:0/2577166640 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531e4210 0x562a531f7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.680 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.682+0000 7f5263200640 1 -- 172.21.15.76:0/2577166640 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a52fd68c0 con 0x562a531fbed0 2024-03-28T12:42:13.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.682+0000 7f5263200640 1 --2- 172.21.15.76:0/2577166640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531fbed0 0x562a532065d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f52640c5110 tx=0x7f525c004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f359aa4b3a13a814 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:13.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.682+0000 7f5243e00640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-03-28T12:42:13.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.686+0000 7f5243e00640 1 -- 172.21.15.76:0/2577166640 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c004770 con 0x562a531fbed0 2024-03-28T12:42:13.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.686+0000 7f526c8e5000 1 -- 172.21.15.76:0/2577166640 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f525c003d40 con 0x562a531fbed0 2024-03-28T12:42:13.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.686+0000 7f5243e00640 1 -- 172.21.15.76:0/2577166640 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f525c016450 con 0x562a531fbed0 2024-03-28T12:42:13.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.690+0000 7f5243e00640 1 -- 172.21.15.76:0/2577166640 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f525c0166b0 con 0x562a531fbed0 2024-03-28T12:42:13.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.690+0000 7f526c8e5000 10 client.4341 fetch_fsmap learned FSMap version 6 2024-03-28T12:42:13.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.690+0000 7f526c8e5000 1 -- 172.21.15.76:0/2577166640 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x562a52f94e80 con 0x562a531fbed0 2024-03-28T12:42:13.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.694+0000 7f5243e00640 1 -- 172.21.15.76:0/2577166640 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525c003d40 con 0x562a531fbed0 2024-03-28T12:42:13.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.694+0000 7f5243e00640 1 -- 172.21.15.76:0/2577166640 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f525c016850 con 0x562a531fbed0 2024-03-28T12:42:13.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.694+0000 7f526c8e5000 10 client.4341 fetch_fsmap finished waiting for FSMap version 6 2024-03-28T12:42:13.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.694+0000 7f526c8e5000 10 client.4341 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-28T12:42:13.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.694+0000 7f526c8e5000 20 client.4341 populate_metadata read hostname 'smithi076' 2024-03-28T12:42:13.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.694+0000 7f526c8e5000 1 --2- 172.21.15.76:0/2577166640 >> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] conn(0x562a532099b0 0x562a53209d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.694+0000 7f526c8e5000 4 client.4341 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T12:42:13.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.694+0000 7f526c8e5000 1 -- 172.21.15.76:0/2577166640 --> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a52fa7bc0 con 0x562a532099b0 2024-03-28T12:42:13.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.702+0000 7f5262800640 1 --2- 172.21.15.76:0/2577166640 >> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] conn(0x562a532099b0 0x562a53209d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.786+0000 7f5262800640 1 --2- 172.21.15.76:0/2577166640 >> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] conn(0x562a532099b0 0x562a53209d90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6799dd2c2ea9253b server_cookie=786792b3ce0447c8 in_seq=0 out_seq=0 2024-03-28T12:42:13.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.786+0000 7f5243e00640 10 client.4341 ms_handle_connect on v2:172.21.15.76:6834/544947706 2024-03-28T12:42:13.910 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.910+0000 7f5243e00640 1 -- 172.21.15.76:0/2577166640 <== mds.0 v2:172.21.15.76:6834/544947706 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562a52fa7bc0 con 0x562a532099b0 2024-03-28T12:42:13.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.910+0000 7f5243e00640 10 client.4341 handle_command_reply: tid=0 2024-03-28T12:42:13.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.910+0000 7f526c8e5000 1 client.4341 shutdown 2024-03-28T12:42:13.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.910+0000 7f526c8e5000 1 -- 172.21.15.76:0/2577166640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531fbed0 msgr2=0x562a532065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:13.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.910+0000 7f526c8e5000 1 --2- 172.21.15.76:0/2577166640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531fbed0 0x562a532065d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f52640c5110 tx=0x7f525c004a50 comp rx=0 tx=0).stop 2024-03-28T12:42:13.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.910+0000 7f526c8e5000 1 -- 172.21.15.76:0/2577166640 shutdown_connections 2024-03-28T12:42:13.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.910+0000 7f526c8e5000 1 --2- 172.21.15.76:0/2577166640 >> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] conn(0x562a532099b0 0x562a53209d90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.910+0000 7f526c8e5000 1 --2- 172.21.15.76:0/2577166640 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531fbed0 0x562a532065d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.910+0000 7f526c8e5000 1 --2- 172.21.15.76:0/2577166640 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbaf0 0x562a53206090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.910+0000 7f526c8e5000 1 --2- 172.21.15.76:0/2577166640 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531e4210 0x562a531f7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.910+0000 7f5243e00640 0 client.4341 ms_handle_reset on v2:172.21.15.76:6834/544947706 2024-03-28T12:42:13.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.910+0000 7f526c8e5000 1 -- 172.21.15.76:0/2577166640 >> 172.21.15.76:0/2577166640 conn(0x562a530a4b80 msgr2=0x562a531fae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:13.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.910+0000 7f526c8e5000 1 -- 172.21.15.76:0/2577166640 shutdown_connections 2024-03-28T12:42:13.911 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.910+0000 7f526c8e5000 1 -- 172.21.15.76:0/2577166640 wait complete. 2024-03-28T12:42:13.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.910+0000 7f526c8e5000 20 client.4341 trim_cache size 0 max 16384 2024-03-28T12:42:13.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.934+0000 7f526c8e5000 1 Processor -- start 2024-03-28T12:42:13.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.934+0000 7f526c8e5000 1 -- start start 2024-03-28T12:42:13.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.938+0000 7f526c8e5000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531e4210 0x562a53219ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.938+0000 7f526c8e5000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbaf0 0x562a5321a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.938+0000 7f526c8e5000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531fbed0 0x562a531e3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.938+0000 7f526c8e5000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f523c00c650 con 0x562a531fbed0 2024-03-28T12:42:13.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.938+0000 7f526c8e5000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f523c00cd20 con 0x562a531e4210 2024-03-28T12:42:13.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.938+0000 7f526c8e5000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x562a52fb2e80 con 0x562a531fbaf0 2024-03-28T12:42:13.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.938+0000 7f5263200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531fbed0 0x562a531e3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.938+0000 7f5263200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531fbed0 0x562a531e3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50800/0 (socket says 172.21.15.76:50800) 2024-03-28T12:42:13.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.938+0000 7f5263200640 1 -- 172.21.15.76:0/1742549818 learned_addr learned my addr 172.21.15.76:0/1742549818 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:13.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.938+0000 7f5262800640 1 --2- 172.21.15.76:0/1742549818 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531e4210 0x562a53219ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.938+0000 7f5261e00640 1 --2- 172.21.15.76:0/1742549818 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbaf0 0x562a5321a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.938+0000 7f5263200640 1 -- 172.21.15.76:0/1742549818 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbaf0 msgr2=0x562a5321a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:13.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.938+0000 7f5263200640 1 --2- 172.21.15.76:0/1742549818 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbaf0 0x562a5321a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.938+0000 7f5263200640 1 -- 172.21.15.76:0/1742549818 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531e4210 msgr2=0x562a53219ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:13.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.938+0000 7f5263200640 1 --2- 172.21.15.76:0/1742549818 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531e4210 0x562a53219ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.938+0000 7f5263200640 1 -- 172.21.15.76:0/1742549818 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a52fc7490 con 0x562a531fbed0 2024-03-28T12:42:13.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.942+0000 7f5263200640 1 --2- 172.21.15.76:0/1742549818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531fbed0 0x562a531e3670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f525c011b80 tx=0x7f525c020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9c85351b69f894 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:13.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f524ea00640 1 -- 172.21.15.76:0/1742549818 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c004570 con 0x562a531fbed0 2024-03-28T12:42:13.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f524ea00640 1 -- 172.21.15.76:0/1742549818 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525c022070 con 0x562a531fbed0 2024-03-28T12:42:13.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f524ea00640 1 -- 172.21.15.76:0/1742549818 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525c003cb0 con 0x562a531fbed0 2024-03-28T12:42:13.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f526c8e5000 1 -- 172.21.15.76:0/1742549818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531fbed0 msgr2=0x562a531e3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:13.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f526c8e5000 1 --2- 172.21.15.76:0/1742549818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531fbed0 0x562a531e3670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f525c011b80 tx=0x7f525c020070 comp rx=0 tx=0).stop 2024-03-28T12:42:13.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f526c8e5000 1 -- 172.21.15.76:0/1742549818 shutdown_connections 2024-03-28T12:42:13.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f526c8e5000 1 --2- 172.21.15.76:0/1742549818 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531fbed0 0x562a531e3670 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f526c8e5000 1 --2- 172.21.15.76:0/1742549818 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbaf0 0x562a5321a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f526c8e5000 1 --2- 172.21.15.76:0/1742549818 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531e4210 0x562a53219ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f526c8e5000 1 -- 172.21.15.76:0/1742549818 >> 172.21.15.76:0/1742549818 conn(0x562a530a4b80 msgr2=0x562a53210000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:13.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f526c8e5000 1 -- 172.21.15.76:0/1742549818 shutdown_connections 2024-03-28T12:42:13.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f526c8e5000 1 -- 172.21.15.76:0/1742549818 wait complete. 2024-03-28T12:42:13.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f526c8e5000 1 -- start start 2024-03-28T12:42:13.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f526c8e5000 1 Processor -- start 2024-03-28T12:42:13.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f526c8e5000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531e4210 0x562a531b9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f526c8e5000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbaf0 0x562a53219570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f526c8e5000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531fbed0 0x562a53219ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f526c8e5000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x562a52fa47b0 con 0x562a531e4210 2024-03-28T12:42:13.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f526c8e5000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x562a53010f80 con 0x562a531fbed0 2024-03-28T12:42:13.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.946+0000 7f526c8e5000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x562a530184f0 con 0x562a531fbaf0 2024-03-28T12:42:13.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.950+0000 7f526c8e5000 10 client.0 _ll_register_callbacks cb 0x7f52540096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T12:42:13.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.950+0000 7f5262800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531e4210 0x562a531b9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.950+0000 7f5262800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531e4210 0x562a531b9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50808/0 (socket says 172.21.15.76:50808) 2024-03-28T12:42:13.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.950+0000 7f5262800640 1 -- 172.21.15.76:0/1282970536 learned_addr learned my addr 172.21.15.76:0/1282970536 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:13.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.950+0000 7f5261e00640 1 --2- 172.21.15.76:0/1282970536 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbaf0 0x562a53219570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.950+0000 7f5263200640 1 --2- 172.21.15.76:0/1282970536 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531fbed0 0x562a53219ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.950+0000 7f5262800640 1 -- 172.21.15.76:0/1282970536 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbaf0 msgr2=0x562a53219570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:13.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.950+0000 7f5262800640 1 --2- 172.21.15.76:0/1282970536 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbaf0 0x562a53219570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.950+0000 7f5262800640 1 -- 172.21.15.76:0/1282970536 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531fbed0 msgr2=0x562a53219ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:13.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.950+0000 7f5262800640 1 --2- 172.21.15.76:0/1282970536 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531fbed0 0x562a53219ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.950+0000 7f5262800640 1 -- 172.21.15.76:0/1282970536 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a52fc5e80 con 0x562a531e4210 2024-03-28T12:42:13.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.954+0000 7f5262800640 1 --2- 172.21.15.76:0/1282970536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531e4210 0x562a531b9710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f525402afd0 tx=0x7f5254017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35d58939d52e0e7 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:13.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.954+0000 7f5243e00640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-03-28T12:42:13.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.958+0000 7f5243e00640 1 -- 172.21.15.76:0/1282970536 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525402f070 con 0x562a531e4210 2024-03-28T12:42:13.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.958+0000 7f5243e00640 1 -- 172.21.15.76:0/1282970536 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5254004020 con 0x562a531e4210 2024-03-28T12:42:13.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.958+0000 7f526c8e5000 1 -- 172.21.15.76:0/1282970536 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f525c022070 con 0x562a531e4210 2024-03-28T12:42:13.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.958+0000 7f5243e00640 1 -- 172.21.15.76:0/1282970536 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f5254039050 con 0x562a531e4210 2024-03-28T12:42:13.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.958+0000 7f526c8e5000 10 client.4347 fetch_fsmap learned FSMap version 6 2024-03-28T12:42:13.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.958+0000 7f526c8e5000 1 -- 172.21.15.76:0/1282970536 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x562a52fb3270 con 0x562a531e4210 2024-03-28T12:42:13.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.962+0000 7f5243e00640 1 -- 172.21.15.76:0/1282970536 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f525c022070 con 0x562a531e4210 2024-03-28T12:42:13.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.962+0000 7f5243e00640 1 -- 172.21.15.76:0/1282970536 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f525403c020 con 0x562a531e4210 2024-03-28T12:42:13.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.962+0000 7f526c8e5000 10 client.4347 fetch_fsmap finished waiting for FSMap version 6 2024-03-28T12:42:13.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.962+0000 7f526c8e5000 10 client.4347 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-28T12:42:13.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.962+0000 7f526c8e5000 20 client.4347 populate_metadata read hostname 'smithi076' 2024-03-28T12:42:13.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.962+0000 7f526c8e5000 1 --2- 172.21.15.76:0/1282970536 >> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] conn(0x562a5326f4b0 0x562a5326f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:13.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.962+0000 7f526c8e5000 4 client.4347 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-28T12:42:13.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.962+0000 7f526c8e5000 1 -- 172.21.15.76:0/1282970536 --> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] -- command(tid 0: {"prefix": "status"}) -- 0x562a53019e90 con 0x562a5326f4b0 2024-03-28T12:42:13.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.962+0000 7f5261e00640 1 --2- 172.21.15.76:0/1282970536 >> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] conn(0x562a5326f4b0 0x562a5326f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:13.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.966+0000 7f5261e00640 1 --2- 172.21.15.76:0/1282970536 >> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] conn(0x562a5326f4b0 0x562a5326f890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a245f9cd3710cfe6 server_cookie=d1cdef608708fb17 in_seq=0 out_seq=0 2024-03-28T12:42:13.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.966+0000 7f5243e00640 10 client.4347 ms_handle_connect on v2:172.21.15.76:6834/544947706 2024-03-28T12:42:13.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f5243e00640 1 -- 172.21.15.76:0/1282970536 <== mds.0 v2:172.21.15.76:6834/544947706 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x562a53019e90 con 0x562a5326f4b0 2024-03-28T12:42:13.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f5243e00640 10 client.4347 handle_command_reply: tid=0 2024-03-28T12:42:13.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f526c8e5000 1 client.4347 shutdown 2024-03-28T12:42:13.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f526c8e5000 1 -- 172.21.15.76:0/1282970536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531e4210 msgr2=0x562a531b9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:13.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f526c8e5000 1 --2- 172.21.15.76:0/1282970536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531e4210 0x562a531b9710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f525402afd0 tx=0x7f5254017070 comp rx=0 tx=0).stop 2024-03-28T12:42:13.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f526c8e5000 1 -- 172.21.15.76:0/1282970536 shutdown_connections 2024-03-28T12:42:13.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f526c8e5000 1 --2- 172.21.15.76:0/1282970536 >> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] conn(0x562a5326f4b0 0x562a5326f890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f526c8e5000 1 --2- 172.21.15.76:0/1282970536 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x562a531fbed0 0x562a53219ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f526c8e5000 1 --2- 172.21.15.76:0/1282970536 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x562a531fbaf0 0x562a53219570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f526c8e5000 1 --2- 172.21.15.76:0/1282970536 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x562a531e4210 0x562a531b9710 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f5243e00640 0 client.4347 ms_handle_reset on v2:172.21.15.76:6834/544947706 2024-03-28T12:42:13.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f526c8e5000 1 -- 172.21.15.76:0/1282970536 >> 172.21.15.76:0/1282970536 conn(0x562a530a4b80 msgr2=0x562a531bf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:13.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f526c8e5000 1 -- 172.21.15.76:0/1282970536 shutdown_connections 2024-03-28T12:42:13.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f526c8e5000 1 -- 172.21.15.76:0/1282970536 wait complete. 2024-03-28T12:42:13.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f526c8e5000 20 client.4347 trim_cache size 0 max 16384 2024-03-28T12:42:13.986 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-03-28T12:42:13.986 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "ed125c42-99c2-4574-a55f-ea7172f89d9c", 2024-03-28T12:42:13.986 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 0, 2024-03-28T12:42:13.986 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 4264, 2024-03-28T12:42:13.986 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-03-28T12:42:13.986 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-03-28T12:42:13.986 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-03-28T12:42:13.986 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 11.725508907, 2024-03-28T12:42:13.986 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 6, 2024-03-28T12:42:13.986 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 27, 2024-03-28T12:42:13.986 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 27, 2024-03-28T12:42:13.986 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 41.647961129999999 2024-03-28T12:42:13.987 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-03-28T12:42:13.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f5269400640 1 -- 172.21.15.76:0/3392929407 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5244067fc0 msgr2=0x7f524406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:13.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f5269400640 1 --2- 172.21.15.76:0/3392929407 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5244067fc0 0x7f524406a480 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f52540093f0 tx=0x7f52540094c0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f5269400640 1 -- 172.21.15.76:0/3392929407 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5264158250 msgr2=0x7f52641f3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:13.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f5269400640 1 --2- 172.21.15.76:0/3392929407 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5264158250 0x7f52641f3be0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5250007040 tx=0x7f5248005840 comp rx=0 tx=0).stop 2024-03-28T12:42:13.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f5269400640 1 -- 172.21.15.76:0/3392929407 shutdown_connections 2024-03-28T12:42:13.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f5269400640 1 --2- 172.21.15.76:0/3392929407 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5244067fc0 0x7f524406a480 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f5269400640 1 --2- 172.21.15.76:0/3392929407 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5264157620 0x7f5264147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f5269400640 1 --2- 172.21.15.76:0/3392929407 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5264158250 0x7f52641f3be0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f5269400640 1 --2- 172.21.15.76:0/3392929407 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5248004810 0x7f52640c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:13.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f5269400640 1 -- 172.21.15.76:0/3392929407 >> 172.21.15.76:0/3392929407 conn(0x7f5264071540 msgr2=0x7f5264150ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:13.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f5269400640 1 -- 172.21.15.76:0/3392929407 shutdown_connections 2024-03-28T12:42:13.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:13.986+0000 7f5269400640 1 -- 172.21.15.76:0/3392929407 wait complete. 2024-03-28T12:42:14.013 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-28T12:42:14.013 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-28T12:42:14.013 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-28T12:42:14.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.154+0000 7f37d5e00640 1 Processor -- start 2024-03-28T12:42:14.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.158+0000 7f37d5e00640 1 -- start start 2024-03-28T12:42:14.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.158+0000 7f37d5e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f37d0072060 0x7f37d00cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:14.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.158+0000 7f37d5e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f37d01592a0 0x7f37d00c3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:14.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.158+0000 7f37d5e00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37d015bf40 con 0x7f37d0072440 2024-03-28T12:42:14.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.158+0000 7f37d5e00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f37d00c31e0 con 0x7f37d01592a0 2024-03-28T12:42:14.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.158+0000 7f37d5e00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f37d015c220 con 0x7f37d0072060 2024-03-28T12:42:14.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.158+0000 7f37cea00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f37d0072060 0x7f37d00cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:14.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.158+0000 7f37cea00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f37d0072060 0x7f37d00cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:46806/0 (socket says 172.21.15.76:46806) 2024-03-28T12:42:14.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.158+0000 7f37cea00640 1 -- 172.21.15.76:0/990445724 learned_addr learned my addr 172.21.15.76:0/990445724 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:14.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.166+0000 7f37cea00640 1 -- 172.21.15.76:0/990445724 >> v2:172.21.15.76:3300/0 conn(0x7f37d01592a0 msgr2=0x7f37d00c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:14.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.166+0000 7f37cea00640 1 --2- 172.21.15.76:0/990445724 >> v2:172.21.15.76:3300/0 conn(0x7f37d01592a0 0x7f37d00c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:14.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.166+0000 7f37cea00640 1 -- 172.21.15.76:0/990445724 >> v1:172.21.15.111:6789/0 conn(0x7f37d0072440 legacy=0x7f37d01524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:14.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.166+0000 7f37cea00640 1 -- 172.21.15.76:0/990445724 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d015c500 con 0x7f37d0072060 2024-03-28T12:42:14.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.174+0000 7f37cea00640 1 --2- 172.21.15.76:0/990445724 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37d0072060 0x7f37d00cb370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f37c0009870 tx=0x7f37c001c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d9bf278dc286200 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:14.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.186+0000 7f37ce000640 1 -- 172.21.15.76:0/990445724 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c00b1070 con 0x7f37d0072060 2024-03-28T12:42:14.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.186+0000 7f37ce000640 1 -- 172.21.15.76:0/990445724 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c00ac410 con 0x7f37d0072060 2024-03-28T12:42:14.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.186+0000 7f37ce000640 1 -- 172.21.15.76:0/990445724 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c00ac7e0 con 0x7f37d0072060 2024-03-28T12:42:14.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.186+0000 7f37d5e00640 1 -- 172.21.15.76:0/990445724 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37d0072060 msgr2=0x7f37d00cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:14.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.186+0000 7f37d5e00640 1 --2- 172.21.15.76:0/990445724 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37d0072060 0x7f37d00cb370 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f37c0009870 tx=0x7f37c001c4e0 comp rx=0 tx=0).stop 2024-03-28T12:42:14.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.186+0000 7f37d5e00640 1 -- 172.21.15.76:0/990445724 shutdown_connections 2024-03-28T12:42:14.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.186+0000 7f37d5e00640 1 --2- 172.21.15.76:0/990445724 >> v2:172.21.15.76:3300/0 conn(0x7f37d01592a0 0x7f37d00c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:14.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.186+0000 7f37d5e00640 1 --2- 172.21.15.76:0/990445724 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37d0072060 0x7f37d00cb370 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:14.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.186+0000 7f37d5e00640 1 -- 172.21.15.76:0/990445724 >> 172.21.15.76:0/990445724 conn(0x7f37d0071520 msgr2=0x7f37d0070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:14.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.186+0000 7f37d5e00640 1 -- 172.21.15.76:0/990445724 shutdown_connections 2024-03-28T12:42:14.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.186+0000 7f37d5e00640 1 -- 172.21.15.76:0/990445724 wait complete. 2024-03-28T12:42:14.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.186+0000 7f37d5e00640 1 Processor -- start 2024-03-28T12:42:14.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.186+0000 7f37d5e00640 1 -- start start 2024-03-28T12:42:14.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.190+0000 7f37d5e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d0072060 0x7f37d015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:14.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.190+0000 7f37d5e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37d0072440 0x7f37d015af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:14.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.190+0000 7f37d5e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37d01592a0 0x7f37d01424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:14.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.190+0000 7f37d5e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f37d015bcf0 con 0x7f37d0072060 2024-03-28T12:42:14.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.190+0000 7f37d5e00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f37d015bb70 con 0x7f37d01592a0 2024-03-28T12:42:14.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.190+0000 7f37d5e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f37d0152bc0 con 0x7f37d0072440 2024-03-28T12:42:14.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.190+0000 7f37cf400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37d01592a0 0x7f37d01424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:14.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.190+0000 7f37cf400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37d01592a0 0x7f37d01424a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:46816/0 (socket says 172.21.15.76:46816) 2024-03-28T12:42:14.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.190+0000 7f37cf400640 1 -- 172.21.15.76:0/1335061257 learned_addr learned my addr 172.21.15.76:0/1335061257 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:14.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.202+0000 7f37cf400640 1 -- 172.21.15.76:0/1335061257 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37d0072440 msgr2=0x7f37d015af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:14.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.202+0000 7f37cf400640 1 --2- 172.21.15.76:0/1335061257 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37d0072440 0x7f37d015af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:14.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.202+0000 7f37cf400640 1 -- 172.21.15.76:0/1335061257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d0072060 msgr2=0x7f37d015a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:14.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.202+0000 7f37cf400640 1 --2- 172.21.15.76:0/1335061257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d0072060 0x7f37d015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:14.201 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.202+0000 7f37cf400640 1 -- 172.21.15.76:0/1335061257 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d0155d80 con 0x7f37d01592a0 2024-03-28T12:42:14.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.210+0000 7f37cf400640 1 --2- 172.21.15.76:0/1335061257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37d01592a0 0x7f37d01424a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f37c800ba40 tx=0x7f37c800bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:14.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.222+0000 7f37c7400640 1 -- 172.21.15.76:0/1335061257 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c8019070 con 0x7f37d01592a0 2024-03-28T12:42:14.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.222+0000 7f37c7400640 1 -- 172.21.15.76:0/1335061257 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c800cba0 con 0x7f37d01592a0 2024-03-28T12:42:14.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.222+0000 7f37c7400640 1 -- 172.21.15.76:0/1335061257 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c8014440 con 0x7f37d01592a0 2024-03-28T12:42:14.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.222+0000 7f37d5e00640 1 -- 172.21.15.76:0/1335061257 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d01f2160 con 0x7f37d01592a0 2024-03-28T12:42:14.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.222+0000 7f37d5e00640 1 -- 172.21.15.76:0/1335061257 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d01f2720 con 0x7f37d01592a0 2024-03-28T12:42:14.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.222+0000 7f37d5e00640 1 -- 172.21.15.76:0/1335061257 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37d00686e0 con 0x7f37d01592a0 2024-03-28T12:42:14.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.578+0000 7f37c7400640 1 -- 172.21.15.76:0/1335061257 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f37c801c070 con 0x7f37d01592a0 2024-03-28T12:42:14.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.578+0000 7f37c7400640 1 --2- 172.21.15.76:0/1335061257 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f37ac068010 0x7f37ac06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:14.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.578+0000 7f37cea00640 1 --2- 172.21.15.76:0/1335061257 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f37ac068010 0x7f37ac06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:14.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.578+0000 7f37cea00640 1 --2- 172.21.15.76:0/1335061257 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f37ac068010 0x7f37ac06a4d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f37c00ae000 tx=0x7f37c0004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:14.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.582+0000 7f37c7400640 1 -- 172.21.15.76:0/1335061257 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f37c80547e0 con 0x7f37d01592a0 2024-03-28T12:42:14.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.626+0000 7f37c7400640 1 -- 172.21.15.76:0/1335061257 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f37c8023020 con 0x7f37d01592a0 2024-03-28T12:42:14.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.846+0000 7f37d5e00640 1 -- 172.21.15.76:0/1335061257 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f37d00cebb0 con 0x7f37d01592a0 2024-03-28T12:42:14.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.870+0000 7f37c7400640 1 -- 172.21.15.76:0/1335061257 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f37c8056e40 con 0x7f37d01592a0 2024-03-28T12:42:14.871 INFO:teuthology.orchestra.run.smithi076.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-28T12:42:14.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.874+0000 7f37d5e00640 1 -- 172.21.15.76:0/1335061257 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f37ac068010 msgr2=0x7f37ac06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:14.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.874+0000 7f37d5e00640 1 --2- 172.21.15.76:0/1335061257 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f37ac068010 0x7f37ac06a4d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f37c00ae000 tx=0x7f37c0004740 comp rx=0 tx=0).stop 2024-03-28T12:42:14.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.874+0000 7f37d5e00640 1 -- 172.21.15.76:0/1335061257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37d01592a0 msgr2=0x7f37d01424a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:14.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.874+0000 7f37d5e00640 1 --2- 172.21.15.76:0/1335061257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37d01592a0 0x7f37d01424a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f37c800ba40 tx=0x7f37c800bf00 comp rx=0 tx=0).stop 2024-03-28T12:42:14.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.874+0000 7f37d5e00640 1 -- 172.21.15.76:0/1335061257 shutdown_connections 2024-03-28T12:42:14.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.874+0000 7f37d5e00640 1 --2- 172.21.15.76:0/1335061257 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f37ac068010 0x7f37ac06a4d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:14.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.874+0000 7f37d5e00640 1 --2- 172.21.15.76:0/1335061257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37d01592a0 0x7f37d01424a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:14.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.874+0000 7f37d5e00640 1 --2- 172.21.15.76:0/1335061257 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37d0072440 0x7f37d015af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:14.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.874+0000 7f37d5e00640 1 --2- 172.21.15.76:0/1335061257 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f37d0072060 0x7f37d015a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:14.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.874+0000 7f37d5e00640 1 -- 172.21.15.76:0/1335061257 >> 172.21.15.76:0/1335061257 conn(0x7f37d0071520 msgr2=0x7f37d00cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:14.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.874+0000 7f37d5e00640 1 -- 172.21.15.76:0/1335061257 shutdown_connections 2024-03-28T12:42:14.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14.874+0000 7f37d5e00640 1 -- 172.21.15.76:0/1335061257 wait complete. 2024-03-28T12:42:14.893 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-28T12:42:14.893 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-28T12:42:14.893 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi076.front.sepia.ceph.com 2024-03-28T12:42:14.893 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-03-28T12:42:14.894 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-28T12:42:14.894 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-28T12:42:14.894 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-28T12:42:14.894 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-28T12:42:14.894 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-03-28T12:42:14.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:42:14.894 DEBUG:teuthology.orchestra.run.smithi076:> ip addr 2024-03-28T12:42:14.903 INFO:teuthology.orchestra.run.smithi076.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-28T12:42:14.903 INFO:teuthology.orchestra.run.smithi076.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-28T12:42:14.903 INFO:teuthology.orchestra.run.smithi076.stdout: inet 127.0.0.1/8 scope host lo 2024-03-28T12:42:14.903 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft forever preferred_lft forever 2024-03-28T12:42:14.903 INFO:teuthology.orchestra.run.smithi076.stdout: inet6 ::1/128 scope host 2024-03-28T12:42:14.903 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft forever preferred_lft forever 2024-03-28T12:42:14.903 INFO:teuthology.orchestra.run.smithi076.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-28T12:42:14.903 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:d8:da:66 brd ff:ff:ff:ff:ff:ff 2024-03-28T12:42:14.903 INFO:teuthology.orchestra.run.smithi076.stdout: altname enp7s0f0 2024-03-28T12:42:14.903 INFO:teuthology.orchestra.run.smithi076.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-28T12:42:14.903 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:d8:da:67 brd ff:ff:ff:ff:ff:ff 2024-03-28T12:42:14.903 INFO:teuthology.orchestra.run.smithi076.stdout: altname enp7s0f1 2024-03-28T12:42:14.903 INFO:teuthology.orchestra.run.smithi076.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-28T12:42:14.904 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:8f:47:e0 brd ff:ff:ff:ff:ff:ff 2024-03-28T12:42:14.904 INFO:teuthology.orchestra.run.smithi076.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-28T12:42:14.904 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:8f:47:e1 brd ff:ff:ff:ff:ff:ff 2024-03-28T12:42:14.904 INFO:teuthology.orchestra.run.smithi076.stdout: inet 172.21.15.76/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-28T12:42:14.904 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft 42105sec preferred_lft 42105sec 2024-03-28T12:42:14.904 INFO:teuthology.orchestra.run.smithi076.stdout: inet6 fe80::ec4:7aff:fe8f:47e1/64 scope link 2024-03-28T12:42:14.904 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft forever preferred_lft forever 2024-03-28T12:42:14.904 INFO:teuthology.orchestra.run.smithi076.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-28T12:42:14.904 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 02:42:4b:86:a7:00 brd ff:ff:ff:ff:ff:ff 2024-03-28T12:42:14.904 INFO:teuthology.orchestra.run.smithi076.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-28T12:42:14.904 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft forever preferred_lft forever 2024-03-28T12:42:14.905 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-28T12:42:14.905 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T12:42:14.905 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-03-28T12:42:14.905 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link add name ceph-brx type bridge 2024-03-28T12:42:14.905 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip addr flush dev ceph-brx 2024-03-28T12:42:14.906 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link set ceph-brx up 2024-03-28T12:42:14.906 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-28T12:42:14.906 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-03-28T12:42:14.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T12:42:15.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T12:42:15.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:42:15.067 DEBUG:teuthology.orchestra.run.smithi076:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-28T12:42:15.085 INFO:teuthology.orchestra.run.smithi076.stdout:1 2024-03-28T12:42:15.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:42:15.087 DEBUG:teuthology.orchestra.run.smithi076:> route 2024-03-28T12:42:15.193 INFO:teuthology.orchestra.run.smithi076.stdout:Kernel IP routing table 2024-03-28T12:42:15.193 INFO:teuthology.orchestra.run.smithi076.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-28T12:42:15.193 INFO:teuthology.orchestra.run.smithi076.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-28T12:42:15.193 INFO:teuthology.orchestra.run.smithi076.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-28T12:42:15.193 INFO:teuthology.orchestra.run.smithi076.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-03-28T12:42:15.193 INFO:teuthology.orchestra.run.smithi076.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-28T12:42:15.194 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-28T12:42:15.194 INFO:teuthology.orchestra.run.smithi076.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-28T12:42:15.194 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-28T12:42:15.194 INFO:teuthology.orchestra.run.smithi076.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-28T12:42:15.194 INFO:teuthology.orchestra.run.smithi076.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-28T12:42:15.194 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T12:42:15.194 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-03-28T12:42:15.194 DEBUG:teuthology.orchestra.run.smithi076:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-28T12:42:15.194 DEBUG:teuthology.orchestra.run.smithi076:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-28T12:42:15.195 DEBUG:teuthology.orchestra.run.smithi076:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-28T12:42:15.195 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-03-28T12:42:15.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T12:42:15.290 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T12:42:15.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:42:15.296 DEBUG:teuthology.orchestra.run.smithi076:> ip netns list 2024-03-28T12:42:15.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:42:15.306 DEBUG:teuthology.orchestra.run.smithi076:> ip netns list-id 2024-03-28T12:42:15.358 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T12:42:15.358 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-03-28T12:42:15.358 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-28T12:42:15.358 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-03-28T12:42:15.358 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-03-28T12:42:15.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T12:42:15.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T12:42:15.488 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-03-28T12:42:15.488 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T12:42:15.488 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-03-28T12:42:15.488 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-03-28T12:42:15.488 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-28T12:42:15.488 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-03-28T12:42:15.488 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-03-28T12:42:15.488 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-03-28T12:42:15.488 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-03-28T12:42:15.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T12:42:15.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T12:42:15.711 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T12:42:15.711 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-03-28T12:42:15.711 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link set brx.0 up 2024-03-28T12:42:15.711 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link set dev brx.0 master ceph-brx 2024-03-28T12:42:15.711 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-03-28T12:42:15.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T12:42:15.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T12:42:15.800 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-03-28T12:42:15.800 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-28T12:42:15.800 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-03-28T12:42:15.808 INFO:teuthology.orchestra.run.smithi076.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-03-28T12:42:15.808 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-28T12:42:15.809 DEBUG:teuthology.orchestra.run.smithi076:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-03-28T12:42:15.858 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2024-03-28T12:42:15.919 DEBUG:teuthology.orchestra.run.smithi076:> cat /proc/self/mounts | awk '{print $2}' 2024-03-28T12:42:15.976 INFO:teuthology.orchestra.run.smithi076.stdout:/sys 2024-03-28T12:42:15.976 INFO:teuthology.orchestra.run.smithi076.stdout:/proc 2024-03-28T12:42:15.976 INFO:teuthology.orchestra.run.smithi076.stdout:/dev 2024-03-28T12:42:15.976 INFO:teuthology.orchestra.run.smithi076.stdout:/dev/pts 2024-03-28T12:42:15.976 INFO:teuthology.orchestra.run.smithi076.stdout:/run 2024-03-28T12:42:15.976 INFO:teuthology.orchestra.run.smithi076.stdout:/ 2024-03-28T12:42:15.976 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/kernel/security 2024-03-28T12:42:15.976 INFO:teuthology.orchestra.run.smithi076.stdout:/dev/shm 2024-03-28T12:42:15.976 INFO:teuthology.orchestra.run.smithi076.stdout:/run/lock 2024-03-28T12:42:15.976 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/fs/cgroup 2024-03-28T12:42:15.977 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/fs/pstore 2024-03-28T12:42:15.977 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/fs/bpf 2024-03-28T12:42:15.977 INFO:teuthology.orchestra.run.smithi076.stdout:/proc/sys/fs/binfmt_misc 2024-03-28T12:42:15.977 INFO:teuthology.orchestra.run.smithi076.stdout:/dev/hugepages 2024-03-28T12:42:15.977 INFO:teuthology.orchestra.run.smithi076.stdout:/dev/mqueue 2024-03-28T12:42:15.977 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/kernel/debug 2024-03-28T12:42:15.977 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/kernel/tracing 2024-03-28T12:42:15.977 INFO:teuthology.orchestra.run.smithi076.stdout:/proc/fs/nfsd 2024-03-28T12:42:15.977 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/fs/fuse/connections 2024-03-28T12:42:15.977 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/kernel/config 2024-03-28T12:42:15.977 INFO:teuthology.orchestra.run.smithi076.stdout:/run/credentials/systemd-sysusers.service 2024-03-28T12:42:15.977 INFO:teuthology.orchestra.run.smithi076.stdout:/run/rpc_pipefs 2024-03-28T12:42:15.977 INFO:teuthology.orchestra.run.smithi076.stdout:/run/user/1000 2024-03-28T12:42:15.977 INFO:teuthology.orchestra.run.smithi076.stdout:/var/lib/ceph 2024-03-28T12:42:15.977 INFO:teuthology.orchestra.run.smithi076.stdout:/var/lib/ceph/osd/ceph-0 2024-03-28T12:42:15.977 INFO:teuthology.orchestra.run.smithi076.stdout:/var/lib/ceph/osd/ceph-1 2024-03-28T12:42:15.978 INFO:teuthology.orchestra.run.smithi076.stdout:/var/lib/ceph/osd/ceph-2 2024-03-28T12:42:15.978 INFO:teuthology.orchestra.run.smithi076.stdout:/var/lib/ceph/osd/ceph-3 2024-03-28T12:42:15.978 INFO:teuthology.orchestra.run.smithi076.stdout:/run/netns 2024-03-28T12:42:15.978 INFO:teuthology.orchestra.run.smithi076.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-28T12:42:15.978 INFO:teuthology.orchestra.run.smithi076.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-28T12:42:15.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:42:15.979 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2024-03-28T12:42:16.030 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-28T12:42:16.031 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-03-28T12:42:16.073 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2024-03-28T12:42:16.094 DEBUG:teuthology.orchestra.run.smithi076:> cat /proc/self/mounts | awk '{print $2}' 2024-03-28T12:42:16.144 INFO:teuthology.orchestra.run.smithi076.stdout:/sys 2024-03-28T12:42:16.144 INFO:teuthology.orchestra.run.smithi076.stdout:/proc 2024-03-28T12:42:16.144 INFO:teuthology.orchestra.run.smithi076.stdout:/dev 2024-03-28T12:42:16.144 INFO:teuthology.orchestra.run.smithi076.stdout:/dev/pts 2024-03-28T12:42:16.144 INFO:teuthology.orchestra.run.smithi076.stdout:/run 2024-03-28T12:42:16.144 INFO:teuthology.orchestra.run.smithi076.stdout:/ 2024-03-28T12:42:16.144 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/kernel/security 2024-03-28T12:42:16.144 INFO:teuthology.orchestra.run.smithi076.stdout:/dev/shm 2024-03-28T12:42:16.144 INFO:teuthology.orchestra.run.smithi076.stdout:/run/lock 2024-03-28T12:42:16.144 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/fs/cgroup 2024-03-28T12:42:16.144 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/fs/pstore 2024-03-28T12:42:16.144 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/fs/bpf 2024-03-28T12:42:16.145 INFO:teuthology.orchestra.run.smithi076.stdout:/proc/sys/fs/binfmt_misc 2024-03-28T12:42:16.145 INFO:teuthology.orchestra.run.smithi076.stdout:/dev/hugepages 2024-03-28T12:42:16.145 INFO:teuthology.orchestra.run.smithi076.stdout:/dev/mqueue 2024-03-28T12:42:16.145 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/kernel/debug 2024-03-28T12:42:16.145 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/kernel/tracing 2024-03-28T12:42:16.145 INFO:teuthology.orchestra.run.smithi076.stdout:/proc/fs/nfsd 2024-03-28T12:42:16.145 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/fs/fuse/connections 2024-03-28T12:42:16.145 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/kernel/config 2024-03-28T12:42:16.145 INFO:teuthology.orchestra.run.smithi076.stdout:/run/credentials/systemd-sysusers.service 2024-03-28T12:42:16.145 INFO:teuthology.orchestra.run.smithi076.stdout:/run/rpc_pipefs 2024-03-28T12:42:16.145 INFO:teuthology.orchestra.run.smithi076.stdout:/run/user/1000 2024-03-28T12:42:16.145 INFO:teuthology.orchestra.run.smithi076.stdout:/var/lib/ceph 2024-03-28T12:42:16.145 INFO:teuthology.orchestra.run.smithi076.stdout:/var/lib/ceph/osd/ceph-0 2024-03-28T12:42:16.145 INFO:teuthology.orchestra.run.smithi076.stdout:/var/lib/ceph/osd/ceph-1 2024-03-28T12:42:16.145 INFO:teuthology.orchestra.run.smithi076.stdout:/var/lib/ceph/osd/ceph-2 2024-03-28T12:42:16.145 INFO:teuthology.orchestra.run.smithi076.stdout:/var/lib/ceph/osd/ceph-3 2024-03-28T12:42:16.146 INFO:teuthology.orchestra.run.smithi076.stdout:/run/netns 2024-03-28T12:42:16.146 INFO:teuthology.orchestra.run.smithi076.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-28T12:42:16.146 INFO:teuthology.orchestra.run.smithi076.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-28T12:42:16.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:42:16.147 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2024-03-28T12:42:16.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi076.stderr:2024-03-28T12:42:16.178+0000 7f269fe69580 -1 init, newargv = 0x564cd293e7e0 newargc=15 2024-03-28T12:42:16.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi076.stderr:ceph-fuse[32512]: starting ceph client 2024-03-28T12:42:16.430 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi076.stderr:ceph-fuse[32512]: starting fuse 2024-03-28T12:42:17.291 DEBUG:teuthology.orchestra.run.smithi076:> sudo modprobe fuse 2024-03-28T12:42:17.312 DEBUG:teuthology.orchestra.run.smithi076:> cat /proc/self/mounts | awk '{print $2}' 2024-03-28T12:42:17.364 INFO:teuthology.orchestra.run.smithi076.stdout:/sys 2024-03-28T12:42:17.364 INFO:teuthology.orchestra.run.smithi076.stdout:/proc 2024-03-28T12:42:17.364 INFO:teuthology.orchestra.run.smithi076.stdout:/dev 2024-03-28T12:42:17.364 INFO:teuthology.orchestra.run.smithi076.stdout:/dev/pts 2024-03-28T12:42:17.364 INFO:teuthology.orchestra.run.smithi076.stdout:/run 2024-03-28T12:42:17.364 INFO:teuthology.orchestra.run.smithi076.stdout:/ 2024-03-28T12:42:17.364 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/kernel/security 2024-03-28T12:42:17.364 INFO:teuthology.orchestra.run.smithi076.stdout:/dev/shm 2024-03-28T12:42:17.364 INFO:teuthology.orchestra.run.smithi076.stdout:/run/lock 2024-03-28T12:42:17.364 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/fs/cgroup 2024-03-28T12:42:17.365 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/fs/pstore 2024-03-28T12:42:17.365 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/fs/bpf 2024-03-28T12:42:17.365 INFO:teuthology.orchestra.run.smithi076.stdout:/proc/sys/fs/binfmt_misc 2024-03-28T12:42:17.365 INFO:teuthology.orchestra.run.smithi076.stdout:/dev/hugepages 2024-03-28T12:42:17.365 INFO:teuthology.orchestra.run.smithi076.stdout:/dev/mqueue 2024-03-28T12:42:17.365 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/kernel/debug 2024-03-28T12:42:17.365 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/kernel/tracing 2024-03-28T12:42:17.365 INFO:teuthology.orchestra.run.smithi076.stdout:/proc/fs/nfsd 2024-03-28T12:42:17.365 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/fs/fuse/connections 2024-03-28T12:42:17.365 INFO:teuthology.orchestra.run.smithi076.stdout:/sys/kernel/config 2024-03-28T12:42:17.365 INFO:teuthology.orchestra.run.smithi076.stdout:/run/credentials/systemd-sysusers.service 2024-03-28T12:42:17.365 INFO:teuthology.orchestra.run.smithi076.stdout:/run/rpc_pipefs 2024-03-28T12:42:17.365 INFO:teuthology.orchestra.run.smithi076.stdout:/run/user/1000 2024-03-28T12:42:17.365 INFO:teuthology.orchestra.run.smithi076.stdout:/var/lib/ceph 2024-03-28T12:42:17.365 INFO:teuthology.orchestra.run.smithi076.stdout:/var/lib/ceph/osd/ceph-0 2024-03-28T12:42:17.365 INFO:teuthology.orchestra.run.smithi076.stdout:/var/lib/ceph/osd/ceph-1 2024-03-28T12:42:17.365 INFO:teuthology.orchestra.run.smithi076.stdout:/var/lib/ceph/osd/ceph-2 2024-03-28T12:42:17.366 INFO:teuthology.orchestra.run.smithi076.stdout:/var/lib/ceph/osd/ceph-3 2024-03-28T12:42:17.366 INFO:teuthology.orchestra.run.smithi076.stdout:/run/netns 2024-03-28T12:42:17.366 INFO:teuthology.orchestra.run.smithi076.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-28T12:42:17.366 INFO:teuthology.orchestra.run.smithi076.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-28T12:42:17.366 INFO:teuthology.orchestra.run.smithi076.stdout:/home/ubuntu/cephtest/mnt.admin 2024-03-28T12:42:17.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:42:17.367 DEBUG:teuthology.orchestra.run.smithi076:> ls /sys/fs/fuse/connections 2024-03-28T12:42:17.418 INFO:teuthology.orchestra.run.smithi076.stdout:43 2024-03-28T12:42:17.418 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-03-28T12:42:17.419 DEBUG:teuthology.orchestra.run.smithi076:> sudo stdin-killer -- python3 -c ' 2024-03-28T12:42:17.419 DEBUG:teuthology.orchestra.run.smithi076:> import glob 2024-03-28T12:42:17.419 DEBUG:teuthology.orchestra.run.smithi076:> import re 2024-03-28T12:42:17.419 DEBUG:teuthology.orchestra.run.smithi076:> import os 2024-03-28T12:42:17.419 DEBUG:teuthology.orchestra.run.smithi076:> import subprocess 2024-03-28T12:42:17.419 DEBUG:teuthology.orchestra.run.smithi076:> 2024-03-28T12:42:17.419 DEBUG:teuthology.orchestra.run.smithi076:> def _find_admin_socket(client_name): 2024-03-28T12:42:17.419 DEBUG:teuthology.orchestra.run.smithi076:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-03-28T12:42:17.419 DEBUG:teuthology.orchestra.run.smithi076:> files = glob.glob(asok_path) 2024-03-28T12:42:17.419 DEBUG:teuthology.orchestra.run.smithi076:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-03-28T12:42:17.419 DEBUG:teuthology.orchestra.run.smithi076:> 2024-03-28T12:42:17.419 DEBUG:teuthology.orchestra.run.smithi076:> # Given a non-glob path, it better be there 2024-03-28T12:42:17.419 DEBUG:teuthology.orchestra.run.smithi076:> if "*" not in asok_path: 2024-03-28T12:42:17.419 DEBUG:teuthology.orchestra.run.smithi076:> assert(len(files) == 1) 2024-03-28T12:42:17.419 DEBUG:teuthology.orchestra.run.smithi076:> return files[0] 2024-03-28T12:42:17.419 DEBUG:teuthology.orchestra.run.smithi076:> 2024-03-28T12:42:17.420 DEBUG:teuthology.orchestra.run.smithi076:> for f in files: 2024-03-28T12:42:17.420 DEBUG:teuthology.orchestra.run.smithi076:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-28T12:42:17.420 DEBUG:teuthology.orchestra.run.smithi076:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-28T12:42:17.420 DEBUG:teuthology.orchestra.run.smithi076:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-28T12:42:17.420 DEBUG:teuthology.orchestra.run.smithi076:> contents = proc_f.read() 2024-03-28T12:42:17.420 DEBUG:teuthology.orchestra.run.smithi076:> if mountpoint in contents: 2024-03-28T12:42:17.420 DEBUG:teuthology.orchestra.run.smithi076:> return f 2024-03-28T12:42:17.420 DEBUG:teuthology.orchestra.run.smithi076:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-28T12:42:17.420 DEBUG:teuthology.orchestra.run.smithi076:> 2024-03-28T12:42:17.420 DEBUG:teuthology.orchestra.run.smithi076:> print(_find_admin_socket("client.admin")) 2024-03-28T12:42:17.420 DEBUG:teuthology.orchestra.run.smithi076:> ' 2024-03-28T12:42:17.538 INFO:teuthology.orchestra.run.smithi076.stdout:/var/run/ceph/ceph-client.admin.32512.asok 2024-03-28T12:42:17.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T12:42:17.550 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.32512.asok 2024-03-28T12:42:17.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:42:17.550 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.32512.asok status 2024-03-28T12:42:17.719 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-03-28T12:42:17.720 INFO:teuthology.orchestra.run.smithi076.stdout: "metadata": { 2024-03-28T12:42:17.720 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_sha1": "e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15", 2024-03-28T12:42:17.720 INFO:teuthology.orchestra.run.smithi076.stdout: "ceph_version": "ceph version 19.0.0-2499-ge0e48ba6 (e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15) squid (dev)", 2024-03-28T12:42:17.720 INFO:teuthology.orchestra.run.smithi076.stdout: "entity_id": "admin", 2024-03-28T12:42:17.720 INFO:teuthology.orchestra.run.smithi076.stdout: "hostname": "smithi076", 2024-03-28T12:42:17.720 INFO:teuthology.orchestra.run.smithi076.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-03-28T12:42:17.720 INFO:teuthology.orchestra.run.smithi076.stdout: "pid": "32512", 2024-03-28T12:42:17.720 INFO:teuthology.orchestra.run.smithi076.stdout: "root": "/" 2024-03-28T12:42:17.720 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-03-28T12:42:17.720 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_count": 0, 2024-03-28T12:42:17.720 INFO:teuthology.orchestra.run.smithi076.stdout: "dentry_pinned_count": 0, 2024-03-28T12:42:17.720 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 4353, 2024-03-28T12:42:17.720 INFO:teuthology.orchestra.run.smithi076.stdout: "inst": { 2024-03-28T12:42:17.720 INFO:teuthology.orchestra.run.smithi076.stdout: "name": { 2024-03-28T12:42:17.720 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "client", 2024-03-28T12:42:17.721 INFO:teuthology.orchestra.run.smithi076.stdout: "num": 4353 2024-03-28T12:42:17.721 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-03-28T12:42:17.721 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2024-03-28T12:42:17.721 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2024-03-28T12:42:17.721 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "192.168.0.1:0", 2024-03-28T12:42:17.721 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 2342750488 2024-03-28T12:42:17.721 INFO:teuthology.orchestra.run.smithi076.stdout: } 2024-03-28T12:42:17.721 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-03-28T12:42:17.721 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": { 2024-03-28T12:42:17.721 INFO:teuthology.orchestra.run.smithi076.stdout: "type": "v1", 2024-03-28T12:42:17.721 INFO:teuthology.orchestra.run.smithi076.stdout: "addr": "192.168.0.1:0", 2024-03-28T12:42:17.721 INFO:teuthology.orchestra.run.smithi076.stdout: "nonce": 2342750488 2024-03-28T12:42:17.721 INFO:teuthology.orchestra.run.smithi076.stdout: }, 2024-03-28T12:42:17.721 INFO:teuthology.orchestra.run.smithi076.stdout: "inst_str": "client.4353 192.168.0.1:0/2342750488", 2024-03-28T12:42:17.721 INFO:teuthology.orchestra.run.smithi076.stdout: "addr_str": "192.168.0.1:0/2342750488", 2024-03-28T12:42:17.721 INFO:teuthology.orchestra.run.smithi076.stdout: "inode_count": 1, 2024-03-28T12:42:17.721 INFO:teuthology.orchestra.run.smithi076.stdout: "mds_epoch": 6, 2024-03-28T12:42:17.722 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch": 29, 2024-03-28T12:42:17.722 INFO:teuthology.orchestra.run.smithi076.stdout: "osd_epoch_barrier": 0, 2024-03-28T12:42:17.722 INFO:teuthology.orchestra.run.smithi076.stdout: "blocklisted": false, 2024-03-28T12:42:17.722 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs" 2024-03-28T12:42:17.722 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-03-28T12:42:17.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:42:17.736 DEBUG:teuthology.orchestra.run.smithi076:> stat --file-system '--printf=%T 2024-03-28T12:42:17.736 DEBUG:teuthology.orchestra.run.smithi076:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-03-28T12:42:17.762 INFO:teuthology.orchestra.run.smithi076.stdout:fuseblk 2024-03-28T12:42:17.763 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-03-28T12:42:17.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:42:17.763 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-03-28T12:42:17.903 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-03-28T12:42:18.028 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-28T12:42:18.198 INFO:teuthology.orchestra.run.smithi076.stdout:# file: . 2024-03-28T12:42:18.198 INFO:teuthology.orchestra.run.smithi076.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-03-28T12:42:18.198 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:18.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T12:42:18.204 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:42:18.205 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T12:42:18.213 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T12:42:18.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.398+0000 7ffaad200640 1 Processor -- start 2024-03-28T12:42:18.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.398+0000 7ffaad200640 1 -- start start 2024-03-28T12:42:18.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.398+0000 7ffaad200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffaa8072440 0x7ffaa81524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:18.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.398+0000 7ffaad200640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ffaa81592a0 0x7ffaa81529f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:18.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.398+0000 7ffaad200640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaa815bf40 con 0x7ffaa8072060 2024-03-28T12:42:18.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.398+0000 7ffaad200640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa80c31e0 con 0x7ffaa81592a0 2024-03-28T12:42:18.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.398+0000 7ffaad200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa815c220 con 0x7ffaa8072440 2024-03-28T12:42:18.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.402+0000 7ffaa5400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffaa8072440 0x7ffaa81524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:18.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.402+0000 7ffaa6800640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ffaa81592a0 0x7ffaa81529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:18.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.402+0000 7ffaa5e00640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7ffaa8072060 0x7ffaa80cb370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:46792/0 (socket says 172.21.15.76:46792) 2024-03-28T12:42:18.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.402+0000 7ffaa5e00640 1 -- 172.21.15.76:0/3112619603 learned_addr learned my addr 172.21.15.76:0/3112619603 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:18.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.406+0000 7ffaa5400640 1 -- 172.21.15.76:0/3112619603 >> v2:172.21.15.111:3300/0 conn(0x7ffaa81592a0 msgr2=0x7ffaa81529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:18.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.406+0000 7ffaa5400640 1 --2- 172.21.15.76:0/3112619603 >> v2:172.21.15.111:3300/0 conn(0x7ffaa81592a0 0x7ffaa81529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:18.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.406+0000 7ffaa5400640 1 -- 172.21.15.76:0/3112619603 >> v1:172.21.15.111:6789/0 conn(0x7ffaa8072060 legacy=0x7ffaa80cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:18.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.406+0000 7ffaa5400640 1 -- 172.21.15.76:0/3112619603 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa815c500 con 0x7ffaa8072440 2024-03-28T12:42:18.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.414+0000 7ffaa5400640 1 --2- 172.21.15.76:0/3112619603 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffaa8072440 0x7ffaa81524b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffa940097c0 tx=0x7ffa9401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5402ac5aa6f97e6e server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:18.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.426+0000 7ffaa4a00640 1 -- 172.21.15.76:0/3112619603 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa940b1070 con 0x7ffaa8072440 2024-03-28T12:42:18.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.426+0000 7ffaa4a00640 1 -- 172.21.15.76:0/3112619603 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa940ac410 con 0x7ffaa8072440 2024-03-28T12:42:18.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.426+0000 7ffaa4a00640 1 -- 172.21.15.76:0/3112619603 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa940ac7e0 con 0x7ffaa8072440 2024-03-28T12:42:18.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.426+0000 7ffaad200640 1 -- 172.21.15.76:0/3112619603 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffaa8072440 msgr2=0x7ffaa81524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:18.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.426+0000 7ffaad200640 1 --2- 172.21.15.76:0/3112619603 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffaa8072440 0x7ffaa81524b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffa940097c0 tx=0x7ffa9401c4a0 comp rx=0 tx=0).stop 2024-03-28T12:42:18.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.426+0000 7ffaad200640 1 -- 172.21.15.76:0/3112619603 shutdown_connections 2024-03-28T12:42:18.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.426+0000 7ffaad200640 1 --2- 172.21.15.76:0/3112619603 >> v2:172.21.15.111:3300/0 conn(0x7ffaa81592a0 0x7ffaa81529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:18.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.426+0000 7ffaad200640 1 --2- 172.21.15.76:0/3112619603 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffaa8072440 0x7ffaa81524b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:18.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.426+0000 7ffaad200640 1 -- 172.21.15.76:0/3112619603 >> 172.21.15.76:0/3112619603 conn(0x7ffaa8071520 msgr2=0x7ffaa8070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:18.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.426+0000 7ffaad200640 1 -- 172.21.15.76:0/3112619603 shutdown_connections 2024-03-28T12:42:18.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.426+0000 7ffaad200640 1 -- 172.21.15.76:0/3112619603 wait complete. 2024-03-28T12:42:18.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.426+0000 7ffaad200640 1 Processor -- start 2024-03-28T12:42:18.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.430+0000 7ffaad200640 1 -- start start 2024-03-28T12:42:18.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.430+0000 7ffaad200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffaa8072060 0x7ffaa8145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:18.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.430+0000 7ffaad200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffaa8072440 0x7ffaa815b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:18.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.430+0000 7ffaad200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa81592a0 0x7ffaa81f7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:18.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.430+0000 7ffaad200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa8165260 con 0x7ffaa8072060 2024-03-28T12:42:18.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.430+0000 7ffaad200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa81650e0 con 0x7ffaa81592a0 2024-03-28T12:42:18.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.430+0000 7ffaad200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa81653e0 con 0x7ffaa8072440 2024-03-28T12:42:18.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.430+0000 7ffaa5e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffaa8072060 0x7ffaa8145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:18.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.430+0000 7ffaa5e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffaa8072060 0x7ffaa8145600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50842/0 (socket says 172.21.15.76:50842) 2024-03-28T12:42:18.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.430+0000 7ffaa5e00640 1 -- 172.21.15.76:0/1564603868 learned_addr learned my addr 172.21.15.76:0/1564603868 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:18.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.430+0000 7ffaa5400640 1 --2- 172.21.15.76:0/1564603868 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffaa8072440 0x7ffaa815b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:18.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.430+0000 7ffaa6800640 1 --2- 172.21.15.76:0/1564603868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa81592a0 0x7ffaa81f7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:18.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.434+0000 7ffaa5e00640 1 -- 172.21.15.76:0/1564603868 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffaa8072440 msgr2=0x7ffaa815b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:18.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.434+0000 7ffaa5e00640 1 --2- 172.21.15.76:0/1564603868 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffaa8072440 0x7ffaa815b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:18.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.434+0000 7ffaa5e00640 1 -- 172.21.15.76:0/1564603868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa81592a0 msgr2=0x7ffaa81f7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:18.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.434+0000 7ffaa5e00640 1 --2- 172.21.15.76:0/1564603868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa81592a0 0x7ffaa81f7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:18.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.434+0000 7ffaa5e00640 1 -- 172.21.15.76:0/1564603868 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa81f8290 con 0x7ffaa8072060 2024-03-28T12:42:18.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.438+0000 7ffaa5e00640 1 --2- 172.21.15.76:0/1564603868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffaa8072060 0x7ffaa8145600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800c430 tx=0x7ffa9800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:18.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.442+0000 7ffa9e000640 1 -- 172.21.15.76:0/1564603868 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98017070 con 0x7ffaa8072060 2024-03-28T12:42:18.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.442+0000 7ffa9e000640 1 -- 172.21.15.76:0/1564603868 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa98005cf0 con 0x7ffaa8072060 2024-03-28T12:42:18.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.442+0000 7ffa9e000640 1 -- 172.21.15.76:0/1564603868 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa980072d0 con 0x7ffaa8072060 2024-03-28T12:42:18.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.442+0000 7ffaad200640 1 -- 172.21.15.76:0/1564603868 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa815a700 con 0x7ffaa8072060 2024-03-28T12:42:18.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.442+0000 7ffaad200640 1 -- 172.21.15.76:0/1564603868 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa815acc0 con 0x7ffaa8072060 2024-03-28T12:42:18.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.442+0000 7ffaad200640 1 -- 172.21.15.76:0/1564603868 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa80686e0 con 0x7ffaa8072060 2024-03-28T12:42:18.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.690+0000 7ffa9e000640 1 -- 172.21.15.76:0/1564603868 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ffa9801a070 con 0x7ffaa8072060 2024-03-28T12:42:18.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.694+0000 7ffa9e000640 1 --2- 172.21.15.76:0/1564603868 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ffa88068010 0x7ffa8806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:18.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.694+0000 7ffaa5400640 1 --2- 172.21.15.76:0/1564603868 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ffa88068010 0x7ffa8806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:18.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.694+0000 7ffaa5400640 1 --2- 172.21.15.76:0/1564603868 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ffa88068010 0x7ffa8806a4d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa940ae000 tx=0x7ffa94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:18.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.702+0000 7ffa9e000640 1 -- 172.21.15.76:0/1564603868 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7ffa98053f00 con 0x7ffaa8072060 2024-03-28T12:42:18.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.702+0000 7ffa9e000640 1 -- 172.21.15.76:0/1564603868 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ffa98055e60 con 0x7ffaa8072060 2024-03-28T12:42:18.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.866+0000 7ffaad200640 1 -- 172.21.15.76:0/1564603868 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffaa8151f40 con 0x7ffaa8072060 2024-03-28T12:42:18.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.914+0000 7ffa9e000640 1 -- 172.21.15.76:0/1564603868 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18798 (secure 0 0 0) 0x7ffa9805a160 con 0x7ffaa8072060 2024-03-28T12:42:18.912 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:18.912 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":29,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:42:15.156639+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T12:41:58.010965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T12:41:59.698601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-28T12:42:05.363180+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.1","mappings":[{"from":3,"to":4}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]},{"pgid":"4.d","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":5}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:42:18.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.914+0000 7ffaad200640 1 -- 172.21.15.76:0/1564603868 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ffa88068010 msgr2=0x7ffa8806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:18.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.914+0000 7ffaad200640 1 --2- 172.21.15.76:0/1564603868 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ffa88068010 0x7ffa8806a4d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa940ae000 tx=0x7ffa94008040 comp rx=0 tx=0).stop 2024-03-28T12:42:18.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.914+0000 7ffaad200640 1 -- 172.21.15.76:0/1564603868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffaa8072060 msgr2=0x7ffaa8145600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:18.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.914+0000 7ffaad200640 1 --2- 172.21.15.76:0/1564603868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffaa8072060 0x7ffaa8145600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800c430 tx=0x7ffa9800c8f0 comp rx=0 tx=0).stop 2024-03-28T12:42:18.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.914+0000 7ffaad200640 1 -- 172.21.15.76:0/1564603868 shutdown_connections 2024-03-28T12:42:18.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.914+0000 7ffaad200640 1 --2- 172.21.15.76:0/1564603868 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ffa88068010 0x7ffa8806a4d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:18.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.914+0000 7ffaad200640 1 --2- 172.21.15.76:0/1564603868 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffaa81592a0 0x7ffaa81f7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:18.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.914+0000 7ffaad200640 1 --2- 172.21.15.76:0/1564603868 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffaa8072440 0x7ffaa815b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:18.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.914+0000 7ffaad200640 1 --2- 172.21.15.76:0/1564603868 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ffaa8072060 0x7ffaa8145600 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:18.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.914+0000 7ffaad200640 1 -- 172.21.15.76:0/1564603868 >> 172.21.15.76:0/1564603868 conn(0x7ffaa8071520 msgr2=0x7ffaa8161090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:18.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.914+0000 7ffaad200640 1 -- 172.21.15.76:0/1564603868 shutdown_connections 2024-03-28T12:42:18.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:18.914+0000 7ffaad200640 1 -- 172.21.15.76:0/1564603868 wait complete. 2024-03-28T12:42:18.934 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T12:41:23.389090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T12:41:58.010965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T12:41:59.698601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-28T12:42:05.363180+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-28T12:42:18.934 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T12:42:19.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.078+0000 7fe805000640 1 Processor -- start 2024-03-28T12:42:19.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.078+0000 7fe805000640 1 -- start start 2024-03-28T12:42:19.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.078+0000 7fe805000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe800152800 0x7fe8000cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:19.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.078+0000 7fe805000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe8000c97e0 0x7fe800071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:19.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.078+0000 7fe805000640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe800158680 con 0x7fe800072240 2024-03-28T12:42:19.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.078+0000 7fe805000640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fe800159550 con 0x7fe8000c97e0 2024-03-28T12:42:19.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.078+0000 7fe805000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe800158940 con 0x7fe800152800 2024-03-28T12:42:19.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.078+0000 7fe7fd400640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe8000c97e0 0x7fe800071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:19.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.078+0000 7fe7fde00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe800152800 0x7fe8000cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:19.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.082+0000 7fe7fde00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe800152800 0x7fe8000cea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:56954/0 (socket says 172.21.15.76:56954) 2024-03-28T12:42:19.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.082+0000 7fe7fde00640 1 -- 172.21.15.76:0/780163844 learned_addr learned my addr 172.21.15.76:0/780163844 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:19.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.086+0000 7fe7fde00640 1 -- 172.21.15.76:0/780163844 >> v2:172.21.15.111:3300/0 conn(0x7fe8000c97e0 msgr2=0x7fe800071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:19.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.086+0000 7fe7fde00640 1 --2- 172.21.15.76:0/780163844 >> v2:172.21.15.111:3300/0 conn(0x7fe8000c97e0 0x7fe800071d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:19.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.086+0000 7fe7fde00640 1 -- 172.21.15.76:0/780163844 >> v1:172.21.15.111:6789/0 conn(0x7fe800072240 legacy=0x7fe8000cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:19.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.086+0000 7fe7fde00640 1 -- 172.21.15.76:0/780163844 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe800158c20 con 0x7fe800152800 2024-03-28T12:42:19.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.090+0000 7fe7fde00640 1 --2- 172.21.15.76:0/780163844 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe800152800 0x7fe8000cea30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0009870 tx=0x7fe7f001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d769a346d319f4f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:19.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.106+0000 7fe7fca00640 1 -- 172.21.15.76:0/780163844 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f00ab650 con 0x7fe800152800 2024-03-28T12:42:19.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.106+0000 7fe7fca00640 1 -- 172.21.15.76:0/780163844 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f00b0070 con 0x7fe800152800 2024-03-28T12:42:19.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.106+0000 7fe7fca00640 1 -- 172.21.15.76:0/780163844 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f00aba10 con 0x7fe800152800 2024-03-28T12:42:19.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.106+0000 7fe805000640 1 -- 172.21.15.76:0/780163844 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe800152800 msgr2=0x7fe8000cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:19.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.106+0000 7fe805000640 1 --2- 172.21.15.76:0/780163844 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe800152800 0x7fe8000cea30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0009870 tx=0x7fe7f001c560 comp rx=0 tx=0).stop 2024-03-28T12:42:19.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.106+0000 7fe805000640 1 -- 172.21.15.76:0/780163844 shutdown_connections 2024-03-28T12:42:19.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.106+0000 7fe805000640 1 --2- 172.21.15.76:0/780163844 >> v2:172.21.15.111:3300/0 conn(0x7fe8000c97e0 0x7fe800071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:19.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.106+0000 7fe805000640 1 --2- 172.21.15.76:0/780163844 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe800152800 0x7fe8000cea30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:19.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.106+0000 7fe805000640 1 -- 172.21.15.76:0/780163844 >> 172.21.15.76:0/780163844 conn(0x7fe800071540 msgr2=0x7fe800070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:19.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.106+0000 7fe805000640 1 -- 172.21.15.76:0/780163844 shutdown_connections 2024-03-28T12:42:19.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.106+0000 7fe805000640 1 -- 172.21.15.76:0/780163844 wait complete. 2024-03-28T12:42:19.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.110+0000 7fe805000640 1 Processor -- start 2024-03-28T12:42:19.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.110+0000 7fe805000640 1 -- start start 2024-03-28T12:42:19.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.110+0000 7fe805000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe800072240 0x7fe8000c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:19.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.110+0000 7fe805000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe8000c97e0 0x7fe800143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:19.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.110+0000 7fe805000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe800152800 0x7fe800143fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:19.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.110+0000 7fe805000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe8000c9d40 con 0x7fe800072240 2024-03-28T12:42:19.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.110+0000 7fe805000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe8000c9bc0 con 0x7fe800152800 2024-03-28T12:42:19.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.110+0000 7fe805000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe800152be0 con 0x7fe8000c97e0 2024-03-28T12:42:19.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.110+0000 7fe7fe800640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe800152800 0x7fe800143fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:19.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.110+0000 7fe7fde00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe800072240 0x7fe8000c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:19.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.110+0000 7fe7fe800640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe800152800 0x7fe800143fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:46846/0 (socket says 172.21.15.76:46846) 2024-03-28T12:42:19.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.110+0000 7fe7fe800640 1 -- 172.21.15.76:0/2929106098 learned_addr learned my addr 172.21.15.76:0/2929106098 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:19.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.114+0000 7fe7fd400640 1 --2- 172.21.15.76:0/2929106098 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe8000c97e0 0x7fe800143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:19.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.118+0000 7fe7fde00640 1 -- 172.21.15.76:0/2929106098 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe8000c97e0 msgr2=0x7fe800143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:19.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.118+0000 7fe7fde00640 1 --2- 172.21.15.76:0/2929106098 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe8000c97e0 0x7fe800143a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:19.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.118+0000 7fe7fde00640 1 -- 172.21.15.76:0/2929106098 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe800152800 msgr2=0x7fe800143fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:19.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.118+0000 7fe7fde00640 1 --2- 172.21.15.76:0/2929106098 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe800152800 0x7fe800143fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:19.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.118+0000 7fe7fde00640 1 -- 172.21.15.76:0/2929106098 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8000c82b0 con 0x7fe800072240 2024-03-28T12:42:19.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.118+0000 7fe7fde00640 1 --2- 172.21.15.76:0/2929106098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe800072240 0x7fe8000c7950 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe8000cbc30 tx=0x7fe7f001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:19.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.122+0000 7fe7f6000640 1 -- 172.21.15.76:0/2929106098 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f00be640 con 0x7fe800072240 2024-03-28T12:42:19.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.122+0000 7fe7f6000640 1 -- 172.21.15.76:0/2929106098 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f00be7e0 con 0x7fe800072240 2024-03-28T12:42:19.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.122+0000 7fe805000640 1 -- 172.21.15.76:0/2929106098 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe800155420 con 0x7fe800072240 2024-03-28T12:42:19.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.122+0000 7fe7f6000640 1 -- 172.21.15.76:0/2929106098 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f00bebd0 con 0x7fe800072240 2024-03-28T12:42:19.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.126+0000 7fe805000640 1 -- 172.21.15.76:0/2929106098 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8001559e0 con 0x7fe800072240 2024-03-28T12:42:19.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.126+0000 7fe805000640 1 -- 172.21.15.76:0/2929106098 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8000686e0 con 0x7fe800072240 2024-03-28T12:42:19.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.382+0000 7fe7f6000640 1 -- 172.21.15.76:0/2929106098 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fe7f00c73f0 con 0x7fe800072240 2024-03-28T12:42:19.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.382+0000 7fe7f6000640 1 --2- 172.21.15.76:0/2929106098 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe7e0068040 0x7fe7e006a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:19.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.382+0000 7fe7fd400640 1 --2- 172.21.15.76:0/2929106098 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe7e0068040 0x7fe7e006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:19.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.386+0000 7fe7fd400640 1 --2- 172.21.15.76:0/2929106098 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe7e0068040 0x7fe7e006a500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe8000c4680 tx=0x7fe7ec009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:19.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.398+0000 7fe7f6000640 1 -- 172.21.15.76:0/2929106098 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fe7f00ef2d0 con 0x7fe800072240 2024-03-28T12:42:19.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.398+0000 7fe7f6000640 1 -- 172.21.15.76:0/2929106098 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fe7f0016150 con 0x7fe800072240 2024-03-28T12:42:19.571 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.570+0000 7fe805000640 1 -- 172.21.15.76:0/2929106098 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe8000c6600 con 0x7fe800072240 2024-03-28T12:42:19.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.614+0000 7fe7f6000640 1 -- 172.21.15.76:0/2929106098 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7fe7f00f1230 con 0x7fe800072240 2024-03-28T12:42:19.612 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-03-28T12:42:19.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.614+0000 7fe805000640 1 -- 172.21.15.76:0/2929106098 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe7e0068040 msgr2=0x7fe7e006a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:19.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.614+0000 7fe805000640 1 --2- 172.21.15.76:0/2929106098 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe7e0068040 0x7fe7e006a500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe8000c4680 tx=0x7fe7ec009190 comp rx=0 tx=0).stop 2024-03-28T12:42:19.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.614+0000 7fe805000640 1 -- 172.21.15.76:0/2929106098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe800072240 msgr2=0x7fe8000c7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:19.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.614+0000 7fe805000640 1 --2- 172.21.15.76:0/2929106098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe800072240 0x7fe8000c7950 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe8000cbc30 tx=0x7fe7f001ada0 comp rx=0 tx=0).stop 2024-03-28T12:42:19.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.614+0000 7fe805000640 1 -- 172.21.15.76:0/2929106098 shutdown_connections 2024-03-28T12:42:19.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.614+0000 7fe805000640 1 --2- 172.21.15.76:0/2929106098 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe7e0068040 0x7fe7e006a500 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:19.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.614+0000 7fe805000640 1 --2- 172.21.15.76:0/2929106098 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe800152800 0x7fe800143fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:19.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.614+0000 7fe805000640 1 --2- 172.21.15.76:0/2929106098 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe8000c97e0 0x7fe800143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:19.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.614+0000 7fe805000640 1 --2- 172.21.15.76:0/2929106098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe800072240 0x7fe8000c7950 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:19.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.614+0000 7fe805000640 1 -- 172.21.15.76:0/2929106098 >> 172.21.15.76:0/2929106098 conn(0x7fe800071540 msgr2=0x7fe800157e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:19.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.614+0000 7fe805000640 1 -- 172.21.15.76:0/2929106098 shutdown_connections 2024-03-28T12:42:19.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.614+0000 7fe805000640 1 -- 172.21.15.76:0/2929106098 wait complete. 2024-03-28T12:42:19.634 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T12:42:19.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.774+0000 7fc9d1600640 1 Processor -- start 2024-03-28T12:42:19.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.774+0000 7fc9d1600640 1 -- start start 2024-03-28T12:42:19.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.778+0000 7fc9d1600640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc9cc154a10 0x7fc9cc15a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:19.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.778+0000 7fc9d1600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc9cc0b21e0 0x7fc9cc0c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:19.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.778+0000 7fc9d1600640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9cc0c9820 con 0x7fc9cc0b1c90 2024-03-28T12:42:19.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.778+0000 7fc9d1600640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fc9cc154df0 con 0x7fc9cc154a10 2024-03-28T12:42:19.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.778+0000 7fc9d1600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc9cc06b5a0 con 0x7fc9cc0b21e0 2024-03-28T12:42:19.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.778+0000 7fc9d0c00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fc9cc0b1c90 0x7fc9cc06beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:49612/0 (socket says 172.21.15.76:49612) 2024-03-28T12:42:19.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.778+0000 7fc9d0c00640 1 -- 172.21.15.76:0/3620644202 learned_addr learned my addr 172.21.15.76:0/3620644202 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:19.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.778+0000 7fc9cbe00640 1 --2- 172.21.15.76:0/3620644202 >> v2:172.21.15.111:3300/0 conn(0x7fc9cc154a10 0x7fc9cc15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:19.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.778+0000 7fc9c3e00640 1 --2- 172.21.15.76:0/3620644202 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc9cc0b21e0 0x7fc9cc0c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:19.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.778+0000 7fc9cb400640 1 -- 172.21.15.76:0/3620644202 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3167114561 0 0) 0x7fc9c40014a0 con 0x7fc9cc0b1c90 2024-03-28T12:42:19.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.778+0000 7fc9cb400640 1 -- 172.21.15.76:0/3620644202 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9b0003530 con 0x7fc9cc0b1c90 2024-03-28T12:42:19.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.782+0000 7fc9cb400640 1 -- 172.21.15.76:0/3620644202 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3041622758 0 0) 0x7fc9b0003530 con 0x7fc9cc0b1c90 2024-03-28T12:42:19.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.782+0000 7fc9cb400640 1 -- 172.21.15.76:0/3620644202 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc9cc0b21e0 msgr2=0x7fc9cc0c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:19.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.782+0000 7fc9cb400640 1 --2- 172.21.15.76:0/3620644202 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc9cc0b21e0 0x7fc9cc0c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:19.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.782+0000 7fc9cb400640 1 -- 172.21.15.76:0/3620644202 >> v2:172.21.15.111:3300/0 conn(0x7fc9cc154a10 msgr2=0x7fc9cc15a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:19.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.782+0000 7fc9cb400640 1 --2- 172.21.15.76:0/3620644202 >> v2:172.21.15.111:3300/0 conn(0x7fc9cc154a10 0x7fc9cc15a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:19.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.782+0000 7fc9cb400640 1 -- 172.21.15.76:0/3620644202 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc0c7d40 con 0x7fc9cc0b1c90 2024-03-28T12:42:19.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.782+0000 7fc9cb400640 1 -- 172.21.15.76:0/3620644202 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7fc9c4001bd0 con 0x7fc9cc0b1c90 2024-03-28T12:42:19.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.782+0000 7fc9cb400640 1 -- 172.21.15.76:0/3620644202 >> v1:172.21.15.76:6789/0 conn(0x7fc9cc0b1c90 legacy=0x7fc9cc06beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:19.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.782+0000 7fc9cb400640 1 --2- 172.21.15.76:0/3620644202 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9b00039c0 0x7fc9b0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:19.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.782+0000 7fc9cb400640 1 --2- 172.21.15.76:0/3620644202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc9b0004810 0x7fc9b0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:19.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.782+0000 7fc9cb400640 1 --2- 172.21.15.76:0/3620644202 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc9cc0b21e0 0x7fc9b00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:19.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.782+0000 7fc9cb400640 1 -- 172.21.15.76:0/3620644202 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc06b5a0 con 0x7fc9b0004810 2024-03-28T12:42:19.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.782+0000 7fc9cb400640 1 -- 172.21.15.76:0/3620644202 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b000b9d0 con 0x7fc9b00039c0 2024-03-28T12:42:19.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.782+0000 7fc9cb400640 1 -- 172.21.15.76:0/3620644202 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc9b000bb50 con 0x7fc9cc0b21e0 2024-03-28T12:42:19.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.790+0000 7fc9c3e00640 1 --2- 172.21.15.76:0/3620644202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc9b0004810 0x7fc9b0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:19.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.790+0000 7fc9d0c00640 1 --2- 172.21.15.76:0/3620644202 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc9cc0b21e0 0x7fc9b00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:19.790 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.790+0000 7fc9cbe00640 1 --2- 172.21.15.76:0/3620644202 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9b00039c0 0x7fc9b0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:19.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.794+0000 7fc9c3e00640 1 -- 172.21.15.76:0/3620644202 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc9cc0b21e0 msgr2=0x7fc9b00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:19.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.794+0000 7fc9c3e00640 1 --2- 172.21.15.76:0/3620644202 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc9cc0b21e0 0x7fc9b00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:19.791 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.794+0000 7fc9c3e00640 1 -- 172.21.15.76:0/3620644202 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9b00039c0 msgr2=0x7fc9b0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:19.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.794+0000 7fc9c3e00640 1 --2- 172.21.15.76:0/3620644202 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9b00039c0 0x7fc9b0003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:19.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.794+0000 7fc9c3e00640 1 -- 172.21.15.76:0/3620644202 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b0003530 con 0x7fc9b0004810 2024-03-28T12:42:19.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.798+0000 7fc9c3e00640 1 --2- 172.21.15.76:0/3620644202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc9b0004810 0x7fc9b0004c90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009ae0 tx=0x7fc9b401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b581cd18637b99f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:19.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.802+0000 7fc9cb400640 1 -- 172.21.15.76:0/3620644202 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40b2070 con 0x7fc9b0004810 2024-03-28T12:42:19.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.802+0000 7fc9cb400640 1 -- 172.21.15.76:0/3620644202 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b40a5580 con 0x7fc9b0004810 2024-03-28T12:42:19.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.802+0000 7fc9cb400640 1 -- 172.21.15.76:0/3620644202 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40096b0 con 0x7fc9b0004810 2024-03-28T12:42:19.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.802+0000 7fc9d1600640 1 -- 172.21.15.76:0/3620644202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc9b0004810 msgr2=0x7fc9b0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:19.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.802+0000 7fc9d1600640 1 --2- 172.21.15.76:0/3620644202 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc9b0004810 0x7fc9b0004c90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009ae0 tx=0x7fc9b401ca10 comp rx=0 tx=0).stop 2024-03-28T12:42:19.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.802+0000 7fc9d0c00640 1 -- 172.21.15.76:0/3620644202 reap_dead start 2024-03-28T12:42:19.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.802+0000 7fc9d1600640 1 -- 172.21.15.76:0/3620644202 shutdown_connections 2024-03-28T12:42:19.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.802+0000 7fc9d1600640 1 -- 172.21.15.76:0/3620644202 >> 172.21.15.76:0/3620644202 conn(0x7fc9cc073520 msgr2=0x7fc9cc0ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:19.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.802+0000 7fc9d1600640 1 -- 172.21.15.76:0/3620644202 shutdown_connections 2024-03-28T12:42:19.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.802+0000 7fc9d1600640 1 -- 172.21.15.76:0/3620644202 wait complete. 2024-03-28T12:42:19.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.806+0000 7fc9d1600640 1 Processor -- start 2024-03-28T12:42:19.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.806+0000 7fc9d1600640 1 -- start start 2024-03-28T12:42:19.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.806+0000 7fc9d1600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc9b0004810 0x7fc9cc1e4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:19.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.806+0000 7fc9d1600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc9cc153130 0x7fc9cc1e1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:19.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.806+0000 7fc9d1600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9cc1e7360 0x7fc9cc1498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:19.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.806+0000 7fc9d1600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc0c8ae0 con 0x7fc9cc153130 2024-03-28T12:42:19.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.806+0000 7fc9d1600640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc06bad0 con 0x7fc9cc1e7360 2024-03-28T12:42:19.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.806+0000 7fc9d1600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc9cc0c8dc0 con 0x7fc9b0004810 2024-03-28T12:42:19.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.806+0000 7fc9c3e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc9cc153130 0x7fc9cc1e1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:19.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.806+0000 7fc9c3e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc9cc153130 0x7fc9cc1e1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50866/0 (socket says 172.21.15.76:50866) 2024-03-28T12:42:19.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.806+0000 7fc9c3e00640 1 -- 172.21.15.76:0/1537821232 learned_addr learned my addr 172.21.15.76:0/1537821232 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:19.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.806+0000 7fc9cbe00640 1 --2- 172.21.15.76:0/1537821232 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc9b0004810 0x7fc9cc1e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:19.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.806+0000 7fc9d0c00640 1 --2- 172.21.15.76:0/1537821232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9cc1e7360 0x7fc9cc1498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:19.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.810+0000 7fc9c3e00640 1 -- 172.21.15.76:0/1537821232 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc9b0004810 msgr2=0x7fc9cc1e4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:19.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.810+0000 7fc9c3e00640 1 --2- 172.21.15.76:0/1537821232 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc9b0004810 0x7fc9cc1e4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:19.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.810+0000 7fc9c3e00640 1 -- 172.21.15.76:0/1537821232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9cc1e7360 msgr2=0x7fc9cc1498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:19.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.810+0000 7fc9c3e00640 1 --2- 172.21.15.76:0/1537821232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9cc1e7360 0x7fc9cc1498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:19.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.810+0000 7fc9c3e00640 1 -- 172.21.15.76:0/1537821232 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc1f0f90 con 0x7fc9cc153130 2024-03-28T12:42:19.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.810+0000 7fc9d0c00640 1 --2- 172.21.15.76:0/1537821232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9cc1e7360 0x7fc9cc1498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T12:42:19.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.814+0000 7fc9c3e00640 1 --2- 172.21.15.76:0/1537821232 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc9cc153130 0x7fc9cc1e1790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc9b401c840 tx=0x7fc9b0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:19.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.818+0000 7fc9c8c00640 1 -- 172.21.15.76:0/1537821232 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40bc030 con 0x7fc9cc153130 2024-03-28T12:42:19.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.818+0000 7fc9c8c00640 1 -- 172.21.15.76:0/1537821232 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9b400f000 con 0x7fc9cc153130 2024-03-28T12:42:19.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.818+0000 7fc9c8c00640 1 -- 172.21.15.76:0/1537821232 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40b2040 con 0x7fc9cc153130 2024-03-28T12:42:19.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.818+0000 7fc9d1600640 1 -- 172.21.15.76:0/1537821232 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9cc1e3760 con 0x7fc9cc153130 2024-03-28T12:42:19.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.818+0000 7fc9d1600640 1 -- 172.21.15.76:0/1537821232 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9cc1e3a00 con 0x7fc9cc153130 2024-03-28T12:42:19.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:19.822+0000 7fc9d1600640 1 -- 172.21.15.76:0/1537821232 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9cc068df0 con 0x7fc9cc153130 2024-03-28T12:42:20.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.086+0000 7fc9c8c00640 1 -- 172.21.15.76:0/1537821232 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fc9b40bf070 con 0x7fc9cc153130 2024-03-28T12:42:20.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.086+0000 7fc9c8c00640 1 --2- 172.21.15.76:0/1537821232 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc9a8068040 0x7fc9a806a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:20.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.086+0000 7fc9cbe00640 1 --2- 172.21.15.76:0/1537821232 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc9a8068040 0x7fc9a806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:20.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.090+0000 7fc9cbe00640 1 --2- 172.21.15.76:0/1537821232 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc9a8068040 0x7fc9a806a500 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009b60 tx=0x7fc9bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:20.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.102+0000 7fc9c8c00640 1 -- 172.21.15.76:0/1537821232 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fc9b40eeac0 con 0x7fc9cc153130 2024-03-28T12:42:20.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.102+0000 7fc9c8c00640 1 -- 172.21.15.76:0/1537821232 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fc9b4016780 con 0x7fc9cc153130 2024-03-28T12:42:20.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.262+0000 7fc9d1600640 1 -- 172.21.15.76:0/1537821232 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc9cc154240 con 0x7fc9cc153130 2024-03-28T12:42:20.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.270+0000 7fc9c8c00640 1 -- 172.21.15.76:0/1537821232 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fc9b40f0a20 con 0x7fc9cc153130 2024-03-28T12:42:20.267 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-03-28T12:42:20.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.270+0000 7fc9d1600640 1 -- 172.21.15.76:0/1537821232 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc9a8068040 msgr2=0x7fc9a806a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:20.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.270+0000 7fc9d1600640 1 --2- 172.21.15.76:0/1537821232 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc9a8068040 0x7fc9a806a500 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009b60 tx=0x7fc9bc008040 comp rx=0 tx=0).stop 2024-03-28T12:42:20.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.270+0000 7fc9d1600640 1 -- 172.21.15.76:0/1537821232 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc9cc153130 msgr2=0x7fc9cc1e1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:20.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.270+0000 7fc9d1600640 1 --2- 172.21.15.76:0/1537821232 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc9cc153130 0x7fc9cc1e1790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc9b401c840 tx=0x7fc9b0005840 comp rx=0 tx=0).stop 2024-03-28T12:42:20.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.270+0000 7fc9d1600640 1 -- 172.21.15.76:0/1537821232 shutdown_connections 2024-03-28T12:42:20.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.270+0000 7fc9d1600640 1 --2- 172.21.15.76:0/1537821232 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fc9a8068040 0x7fc9a806a500 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:20.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.270+0000 7fc9d1600640 1 --2- 172.21.15.76:0/1537821232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9cc1e7360 0x7fc9cc1498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:20.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.270+0000 7fc9d1600640 1 --2- 172.21.15.76:0/1537821232 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fc9cc153130 0x7fc9cc1e1790 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:20.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.270+0000 7fc9d1600640 1 --2- 172.21.15.76:0/1537821232 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc9b0004810 0x7fc9cc1e4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:20.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.270+0000 7fc9d1600640 1 -- 172.21.15.76:0/1537821232 >> 172.21.15.76:0/1537821232 conn(0x7fc9cc073520 msgr2=0x7fc9cc0cb950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:20.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.270+0000 7fc9d1600640 1 -- 172.21.15.76:0/1537821232 shutdown_connections 2024-03-28T12:42:20.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.270+0000 7fc9d1600640 1 -- 172.21.15.76:0/1537821232 wait complete. 2024-03-28T12:42:20.288 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T12:42:20.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.430+0000 7fcd7ac00640 1 Processor -- start 2024-03-28T12:42:20.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.430+0000 7fcd7ac00640 1 -- start start 2024-03-28T12:42:20.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.430+0000 7fcd7ac00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fcd74152800 0x7fcd740cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:20.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.430+0000 7fcd7ac00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fcd740cab80 0x7fcd740cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:20.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.430+0000 7fcd7ac00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd74158680 con 0x7fcd740c97e0 2024-03-28T12:42:20.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.430+0000 7fcd7ac00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fcd74159550 con 0x7fcd740cab80 2024-03-28T12:42:20.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.430+0000 7fcd7ac00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fcd740cb4f0 con 0x7fcd74152800 2024-03-28T12:42:20.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.434+0000 7fcd78c00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fcd740cab80 0x7fcd740cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:20.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.434+0000 7fcd73400640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fcd740c97e0 0x7fcd74071d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:49628/0 (socket says 172.21.15.76:49628) 2024-03-28T12:42:20.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.434+0000 7fcd73400640 1 -- 172.21.15.76:0/3559440491 learned_addr learned my addr 172.21.15.76:0/3559440491 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:20.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.434+0000 7fcd73e00640 1 --2- 172.21.15.76:0/3559440491 >> v2:172.21.15.111:3300/0 conn(0x7fcd74152800 0x7fcd740cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:20.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.438+0000 7fcd78c00640 1 -- 172.21.15.76:0/3559440491 >> v2:172.21.15.111:3300/0 conn(0x7fcd74152800 msgr2=0x7fcd740cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:20.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.438+0000 7fcd78c00640 1 --2- 172.21.15.76:0/3559440491 >> v2:172.21.15.111:3300/0 conn(0x7fcd74152800 0x7fcd740cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:20.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.438+0000 7fcd78c00640 1 -- 172.21.15.76:0/3559440491 >> v1:172.21.15.76:6789/0 conn(0x7fcd740c97e0 legacy=0x7fcd74071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:20.436 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.438+0000 7fcd78c00640 1 -- 172.21.15.76:0/3559440491 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd74158940 con 0x7fcd740cab80 2024-03-28T12:42:20.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.442+0000 7fcd78c00640 1 --2- 172.21.15.76:0/3559440491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd740cab80 0x7fcd740cafb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcd740b0fe0 tx=0x7fcd6c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49952ebd9c0bcd5a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:20.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.446+0000 7fcd72a00640 1 -- 172.21.15.76:0/3559440491 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c0b2070 con 0x7fcd740cab80 2024-03-28T12:42:20.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.446+0000 7fcd72a00640 1 -- 172.21.15.76:0/3559440491 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd6c0a59c0 con 0x7fcd740cab80 2024-03-28T12:42:20.446 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.446+0000 7fcd72a00640 1 -- 172.21.15.76:0/3559440491 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c0a5d90 con 0x7fcd740cab80 2024-03-28T12:42:20.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.446+0000 7fcd7ac00640 1 -- 172.21.15.76:0/3559440491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd740cab80 msgr2=0x7fcd740cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:20.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.446+0000 7fcd7ac00640 1 --2- 172.21.15.76:0/3559440491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd740cab80 0x7fcd740cafb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcd740b0fe0 tx=0x7fcd6c01c900 comp rx=0 tx=0).stop 2024-03-28T12:42:20.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.446+0000 7fcd7ac00640 1 -- 172.21.15.76:0/3559440491 shutdown_connections 2024-03-28T12:42:20.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.446+0000 7fcd7ac00640 1 --2- 172.21.15.76:0/3559440491 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd740cab80 0x7fcd740cafb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:20.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.446+0000 7fcd7ac00640 1 --2- 172.21.15.76:0/3559440491 >> v2:172.21.15.111:3300/0 conn(0x7fcd74152800 0x7fcd740cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:20.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.446+0000 7fcd7ac00640 1 -- 172.21.15.76:0/3559440491 >> 172.21.15.76:0/3559440491 conn(0x7fcd74071540 msgr2=0x7fcd74070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:20.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.446+0000 7fcd7ac00640 1 -- 172.21.15.76:0/3559440491 shutdown_connections 2024-03-28T12:42:20.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.446+0000 7fcd7ac00640 1 -- 172.21.15.76:0/3559440491 wait complete. 2024-03-28T12:42:20.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.450+0000 7fcd7ac00640 1 Processor -- start 2024-03-28T12:42:20.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.450+0000 7fcd7ac00640 1 -- start start 2024-03-28T12:42:20.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.454+0000 7fcd7ac00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd740c97e0 0x7fcd7406e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:20.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.454+0000 7fcd7ac00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd740cab80 0x7fcd740adc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:20.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.454+0000 7fcd7ac00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd74152800 0x7fcd740b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:20.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.454+0000 7fcd7ac00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcd740c9bf0 con 0x7fcd740c97e0 2024-03-28T12:42:20.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.454+0000 7fcd7ac00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcd740c8d00 con 0x7fcd740cab80 2024-03-28T12:42:20.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.454+0000 7fcd7ac00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fcd740c9d70 con 0x7fcd74152800 2024-03-28T12:42:20.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.454+0000 7fcd73e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd740c97e0 0x7fcd7406e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:20.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.454+0000 7fcd73e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd740c97e0 0x7fcd7406e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50892/0 (socket says 172.21.15.76:50892) 2024-03-28T12:42:20.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.454+0000 7fcd73e00640 1 -- 172.21.15.76:0/3703214709 learned_addr learned my addr 172.21.15.76:0/3703214709 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:20.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.454+0000 7fcd73400640 1 --2- 172.21.15.76:0/3703214709 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd740cab80 0x7fcd740adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:20.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.454+0000 7fcd78c00640 1 --2- 172.21.15.76:0/3703214709 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd74152800 0x7fcd740b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:20.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.458+0000 7fcd73e00640 1 -- 172.21.15.76:0/3703214709 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd74152800 msgr2=0x7fcd740b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:20.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.458+0000 7fcd73e00640 1 --2- 172.21.15.76:0/3703214709 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd74152800 0x7fcd740b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:20.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.458+0000 7fcd73e00640 1 -- 172.21.15.76:0/3703214709 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd740cab80 msgr2=0x7fcd740adc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:20.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.458+0000 7fcd73e00640 1 --2- 172.21.15.76:0/3703214709 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd740cab80 0x7fcd740adc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:20.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.458+0000 7fcd73e00640 1 -- 172.21.15.76:0/3703214709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd740cd8c0 con 0x7fcd740c97e0 2024-03-28T12:42:20.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.458+0000 7fcd78c00640 1 --2- 172.21.15.76:0/3703214709 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd74152800 0x7fcd740b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T12:42:20.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.458+0000 7fcd73e00640 1 --2- 172.21.15.76:0/3703214709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd740c97e0 0x7fcd7406e060 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400e8a0 tx=0x7fcd6400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:20.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.462+0000 7fcd6be00640 1 -- 172.21.15.76:0/3703214709 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd64017070 con 0x7fcd740c97e0 2024-03-28T12:42:20.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.462+0000 7fcd6be00640 1 -- 172.21.15.76:0/3703214709 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd6400c8e0 con 0x7fcd740c97e0 2024-03-28T12:42:20.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.462+0000 7fcd7ac00640 1 -- 172.21.15.76:0/3703214709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd740cdba0 con 0x7fcd740c97e0 2024-03-28T12:42:20.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.462+0000 7fcd6be00640 1 -- 172.21.15.76:0/3703214709 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6400cc90 con 0x7fcd740c97e0 2024-03-28T12:42:20.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.462+0000 7fcd7ac00640 1 -- 172.21.15.76:0/3703214709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd740afe00 con 0x7fcd740c97e0 2024-03-28T12:42:20.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.462+0000 7fcd7ac00640 1 -- 172.21.15.76:0/3703214709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd740b0240 con 0x7fcd740c97e0 2024-03-28T12:42:20.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.722+0000 7fcd6be00640 1 -- 172.21.15.76:0/3703214709 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fcd6401a070 con 0x7fcd740c97e0 2024-03-28T12:42:20.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.726+0000 7fcd6be00640 1 --2- 172.21.15.76:0/3703214709 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcd54068040 0x7fcd5406a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:20.724 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.726+0000 7fcd73400640 1 --2- 172.21.15.76:0/3703214709 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcd54068040 0x7fcd5406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:20.724 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.726+0000 7fcd73400640 1 --2- 172.21.15.76:0/3703214709 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcd54068040 0x7fcd5406a500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcd740c4200 tx=0x7fcd60007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:20.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.746+0000 7fcd6be00640 1 -- 172.21.15.76:0/3703214709 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fcd6400ce30 con 0x7fcd740c97e0 2024-03-28T12:42:20.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.746+0000 7fcd6be00640 1 -- 172.21.15.76:0/3703214709 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fcd64056c40 con 0x7fcd740c97e0 2024-03-28T12:42:20.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.910+0000 7fcd7ac00640 1 -- 172.21.15.76:0/3703214709 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcd740686e0 con 0x7fcd740c97e0 2024-03-28T12:42:20.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.918+0000 7fcd6be00640 1 -- 172.21.15.76:0/3703214709 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fcd6405af40 con 0x7fcd740c97e0 2024-03-28T12:42:20.917 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-03-28T12:42:20.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.918+0000 7fcd7ac00640 1 -- 172.21.15.76:0/3703214709 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcd54068040 msgr2=0x7fcd5406a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:20.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.918+0000 7fcd7ac00640 1 --2- 172.21.15.76:0/3703214709 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcd54068040 0x7fcd5406a500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcd740c4200 tx=0x7fcd60007e90 comp rx=0 tx=0).stop 2024-03-28T12:42:20.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.918+0000 7fcd7ac00640 1 -- 172.21.15.76:0/3703214709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd740c97e0 msgr2=0x7fcd7406e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.918+0000 7fcd7ac00640 1 --2- 172.21.15.76:0/3703214709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd740c97e0 0x7fcd7406e060 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400e8a0 tx=0x7fcd6400eca0 comp rx=0 tx=0).stop 2024-03-28T12:42:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.922+0000 7fcd7ac00640 1 -- 172.21.15.76:0/3703214709 shutdown_connections 2024-03-28T12:42:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.922+0000 7fcd7ac00640 1 --2- 172.21.15.76:0/3703214709 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcd54068040 0x7fcd5406a500 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.922+0000 7fcd7ac00640 1 --2- 172.21.15.76:0/3703214709 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd74152800 0x7fcd740b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.922+0000 7fcd7ac00640 1 --2- 172.21.15.76:0/3703214709 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd740cab80 0x7fcd740adc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.922+0000 7fcd7ac00640 1 --2- 172.21.15.76:0/3703214709 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcd740c97e0 0x7fcd7406e060 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.922+0000 7fcd7ac00640 1 -- 172.21.15.76:0/3703214709 >> 172.21.15.76:0/3703214709 conn(0x7fcd74071540 msgr2=0x7fcd741579a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.922+0000 7fcd7ac00640 1 -- 172.21.15.76:0/3703214709 shutdown_connections 2024-03-28T12:42:20.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:20.922+0000 7fcd7ac00640 1 -- 172.21.15.76:0/3703214709 wait complete. 2024-03-28T12:42:20.939 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-28T12:42:21.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.078+0000 7f13e5200640 1 Processor -- start 2024-03-28T12:42:21.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.078+0000 7f13e5200640 1 -- start start 2024-03-28T12:42:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.082+0000 7f13e5200640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f13e0152800 0x7f13e00cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.082+0000 7f13e5200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f13e00c97e0 0x7f13e0071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.082+0000 7f13e5200640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e0158680 con 0x7f13e0072240 2024-03-28T12:42:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.082+0000 7f13e5200640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f13e0159550 con 0x7f13e00c97e0 2024-03-28T12:42:21.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.082+0000 7f13e5200640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f13e0158940 con 0x7f13e0152800 2024-03-28T12:42:21.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.082+0000 7f13de800640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f13e0072240 0x7f13e00cab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:49642/0 (socket says 172.21.15.76:49642) 2024-03-28T12:42:21.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.082+0000 7f13de800640 1 -- 172.21.15.76:0/751659077 learned_addr learned my addr 172.21.15.76:0/751659077 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:21.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.082+0000 7f13d7e00640 1 --2- 172.21.15.76:0/751659077 >> v2:172.21.15.76:3300/0 conn(0x7f13e00c97e0 0x7f13e0071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:21.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.082+0000 7f13dde00640 1 --2- 172.21.15.76:0/751659077 >> v2:172.21.15.111:3300/0 conn(0x7f13e0152800 0x7f13e00cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:21.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.086+0000 7f13dd400640 1 -- 172.21.15.76:0/751659077 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2636896073 0 0) 0x7f13e0158680 con 0x7f13e0072240 2024-03-28T12:42:21.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.086+0000 7f13dd400640 1 -- 172.21.15.76:0/751659077 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13c4003530 con 0x7f13e0072240 2024-03-28T12:42:21.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.090+0000 7f13d7e00640 1 -- 172.21.15.76:0/751659077 >> v2:172.21.15.111:3300/0 conn(0x7f13e0152800 msgr2=0x7f13e00cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:21.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.090+0000 7f13d7e00640 1 --2- 172.21.15.76:0/751659077 >> v2:172.21.15.111:3300/0 conn(0x7f13e0152800 0x7f13e00cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:21.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.090+0000 7f13d7e00640 1 -- 172.21.15.76:0/751659077 >> v1:172.21.15.76:6789/0 conn(0x7f13e0072240 legacy=0x7f13e00cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:21.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.090+0000 7f13d7e00640 1 -- 172.21.15.76:0/751659077 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e0158c20 con 0x7f13e00c97e0 2024-03-28T12:42:21.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.094+0000 7f13d7e00640 1 --2- 172.21.15.76:0/751659077 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13e00c97e0 0x7f13e0071d00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f13e00b0fe0 tx=0x7f13c801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a36d8b164c7723 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:21.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.098+0000 7f13dd400640 1 -- 172.21.15.76:0/751659077 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c80ab680 con 0x7f13e00c97e0 2024-03-28T12:42:21.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.098+0000 7f13dd400640 1 -- 172.21.15.76:0/751659077 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c80b0070 con 0x7f13e00c97e0 2024-03-28T12:42:21.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.098+0000 7f13dd400640 1 -- 172.21.15.76:0/751659077 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c80aba40 con 0x7f13e00c97e0 2024-03-28T12:42:21.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.098+0000 7f13e5200640 1 -- 172.21.15.76:0/751659077 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13e00c97e0 msgr2=0x7f13e0071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:21.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.098+0000 7f13e5200640 1 --2- 172.21.15.76:0/751659077 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13e00c97e0 0x7f13e0071d00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f13e00b0fe0 tx=0x7f13c801c480 comp rx=0 tx=0).stop 2024-03-28T12:42:21.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.098+0000 7f13e5200640 1 -- 172.21.15.76:0/751659077 shutdown_connections 2024-03-28T12:42:21.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.098+0000 7f13e5200640 1 --2- 172.21.15.76:0/751659077 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13e00c97e0 0x7f13e0071d00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:21.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.098+0000 7f13e5200640 1 --2- 172.21.15.76:0/751659077 >> v2:172.21.15.111:3300/0 conn(0x7f13e0152800 0x7f13e00cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:21.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.098+0000 7f13e5200640 1 -- 172.21.15.76:0/751659077 >> 172.21.15.76:0/751659077 conn(0x7f13e0071540 msgr2=0x7f13e0070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:21.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.098+0000 7f13e5200640 1 -- 172.21.15.76:0/751659077 shutdown_connections 2024-03-28T12:42:21.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.098+0000 7f13e5200640 1 -- 172.21.15.76:0/751659077 wait complete. 2024-03-28T12:42:21.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.098+0000 7f13e5200640 1 Processor -- start 2024-03-28T12:42:21.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.098+0000 7f13e5200640 1 -- start start 2024-03-28T12:42:21.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.102+0000 7f13e5200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13e0072240 0x7f13e0151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:21.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.102+0000 7f13e5200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13e00c97e0 0x7f13e01f28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:21.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.102+0000 7f13e5200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f13e0152800 0x7f13e01f2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:21.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.102+0000 7f13e5200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f13e0152be0 con 0x7f13e00c97e0 2024-03-28T12:42:21.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.102+0000 7f13e5200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f13e00c9c30 con 0x7f13e0072240 2024-03-28T12:42:21.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.102+0000 7f13e5200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f13e0152d60 con 0x7f13e0152800 2024-03-28T12:42:21.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.102+0000 7f13d7e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13e00c97e0 0x7f13e01f28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:21.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.102+0000 7f13d7e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13e00c97e0 0x7f13e01f28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:50902/0 (socket says 172.21.15.76:50902) 2024-03-28T12:42:21.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.102+0000 7f13d7e00640 1 -- 172.21.15.76:0/648112651 learned_addr learned my addr 172.21.15.76:0/648112651 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:21.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.102+0000 7f13dde00640 1 --2- 172.21.15.76:0/648112651 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13e0072240 0x7f13e0151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:21.103 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.106+0000 7f13de800640 1 --2- 172.21.15.76:0/648112651 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f13e0152800 0x7f13e01f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.106+0000 7f13d7e00640 1 -- 172.21.15.76:0/648112651 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f13e0152800 msgr2=0x7f13e01f2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.106+0000 7f13d7e00640 1 --2- 172.21.15.76:0/648112651 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f13e0152800 0x7f13e01f2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.106+0000 7f13d7e00640 1 -- 172.21.15.76:0/648112651 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13e0072240 msgr2=0x7f13e0151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.106+0000 7f13d7e00640 1 --2- 172.21.15.76:0/648112651 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13e0072240 0x7f13e0151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:21.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.106+0000 7f13d7e00640 1 -- 172.21.15.76:0/648112651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e01f5750 con 0x7f13e00c97e0 2024-03-28T12:42:21.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.110+0000 7f13d7e00640 1 --2- 172.21.15.76:0/648112651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13e00c97e0 0x7f13e01f28a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f13c80ad040 tx=0x7f13c801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:21.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.110+0000 7f13d6000640 1 -- 172.21.15.76:0/648112651 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c80abe60 con 0x7f13e00c97e0 2024-03-28T12:42:21.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.110+0000 7f13e5200640 1 -- 172.21.15.76:0/648112651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e0158170 con 0x7f13e00c97e0 2024-03-28T12:42:21.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.110+0000 7f13e5200640 1 -- 172.21.15.76:0/648112651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e01f5470 con 0x7f13e00c97e0 2024-03-28T12:42:21.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.114+0000 7f13e5200640 1 -- 172.21.15.76:0/648112651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e00686e0 con 0x7f13e00c97e0 2024-03-28T12:42:21.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.114+0000 7f13d6000640 1 -- 172.21.15.76:0/648112651 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c80a7070 con 0x7f13e00c97e0 2024-03-28T12:42:21.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.114+0000 7f13d6000640 1 -- 172.21.15.76:0/648112651 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c80bf810 con 0x7f13e00c97e0 2024-03-28T12:42:21.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.250+0000 7f13d6000640 1 -- 172.21.15.76:0/648112651 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f13c80bd020 con 0x7f13e00c97e0 2024-03-28T12:42:21.248 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.250+0000 7f13d6000640 1 --2- 172.21.15.76:0/648112651 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f13bc067fc0 0x7f13bc06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:21.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.250+0000 7f13dde00640 1 --2- 172.21.15.76:0/648112651 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f13bc067fc0 0x7f13bc06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:21.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.250+0000 7f13dde00640 1 --2- 172.21.15.76:0/648112651 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f13bc067fc0 0x7f13bc06a480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009af0 tx=0x7f13d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:21.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.438+0000 7f13d6000640 1 -- 172.21.15.76:0/648112651 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f13c80ef100 con 0x7f13e00c97e0 2024-03-28T12:42:21.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.442+0000 7f13d6000640 1 -- 172.21.15.76:0/648112651 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f13c8016070 con 0x7f13e00c97e0 2024-03-28T12:42:21.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.598+0000 7f13e5200640 1 -- 172.21.15.76:0/648112651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f13e00756d0 con 0x7f13e00c97e0 2024-03-28T12:42:21.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.606+0000 7f13d6000640 1 -- 172.21.15.76:0/648112651 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f13c80f1760 con 0x7f13e00c97e0 2024-03-28T12:42:21.604 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-03-28T12:42:21.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.606+0000 7f13e5200640 1 -- 172.21.15.76:0/648112651 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f13bc067fc0 msgr2=0x7f13bc06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:21.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.606+0000 7f13e5200640 1 --2- 172.21.15.76:0/648112651 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f13bc067fc0 0x7f13bc06a480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009af0 tx=0x7f13d0008040 comp rx=0 tx=0).stop 2024-03-28T12:42:21.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.606+0000 7f13e5200640 1 -- 172.21.15.76:0/648112651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13e00c97e0 msgr2=0x7f13e01f28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:21.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.606+0000 7f13e5200640 1 --2- 172.21.15.76:0/648112651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13e00c97e0 0x7f13e01f28a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f13c80ad040 tx=0x7f13c801acc0 comp rx=0 tx=0).stop 2024-03-28T12:42:21.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.606+0000 7f13e5200640 1 -- 172.21.15.76:0/648112651 shutdown_connections 2024-03-28T12:42:21.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.606+0000 7f13e5200640 1 --2- 172.21.15.76:0/648112651 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f13bc067fc0 0x7f13bc06a480 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:21.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.606+0000 7f13e5200640 1 --2- 172.21.15.76:0/648112651 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f13e0152800 0x7f13e01f2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:21.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.606+0000 7f13e5200640 1 --2- 172.21.15.76:0/648112651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f13e00c97e0 0x7f13e01f28a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:21.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.606+0000 7f13e5200640 1 --2- 172.21.15.76:0/648112651 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13e0072240 0x7f13e0151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:21.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.606+0000 7f13e5200640 1 -- 172.21.15.76:0/648112651 >> 172.21.15.76:0/648112651 conn(0x7f13e0071540 msgr2=0x7f13e00cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:21.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.606+0000 7f13e5200640 1 -- 172.21.15.76:0/648112651 shutdown_connections 2024-03-28T12:42:21.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.606+0000 7f13e5200640 1 -- 172.21.15.76:0/648112651 wait complete. 2024-03-28T12:42:21.626 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-28T12:42:21.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.774+0000 7f3171e00640 1 Processor -- start 2024-03-28T12:42:21.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.774+0000 7f3171e00640 1 -- start start 2024-03-28T12:42:21.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.774+0000 7f3171e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f316c152800 0x7f316c0cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:21.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.778+0000 7f3171e00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f316c158680 con 0x7f316c0c97e0 2024-03-28T12:42:21.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.778+0000 7f3171e00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f316c158940 con 0x7f316c0cab80 2024-03-28T12:42:21.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.778+0000 7f3171e00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f316c159550 con 0x7f316c152800 2024-03-28T12:42:21.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.778+0000 7f316a000640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f316c0c97e0 0x7f316c071d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:49652/0 (socket says 172.21.15.76:49652) 2024-03-28T12:42:21.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.778+0000 7f316a000640 1 -- 172.21.15.76:0/2386467907 learned_addr learned my addr 172.21.15.76:0/2386467907 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:21.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.778+0000 7f316aa00640 1 --2- 172.21.15.76:0/2386467907 >> v2:172.21.15.111:3300/0 conn(0x7f316c152800 0x7f316c0cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:21.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.782+0000 7f3169600640 1 -- 172.21.15.76:0/2386467907 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4071593530 0 0) 0x7f316c158680 con 0x7f316c0c97e0 2024-03-28T12:42:21.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.782+0000 7f3169600640 1 -- 172.21.15.76:0/2386467907 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3150003530 con 0x7f316c0c97e0 2024-03-28T12:42:21.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.782+0000 7f316aa00640 1 -- 172.21.15.76:0/2386467907 >> v1:172.21.15.111:6789/0 conn(0x7f316c0cab80 legacy=0x7f316c0cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:21.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.786+0000 7f316aa00640 1 -- 172.21.15.76:0/2386467907 >> v1:172.21.15.76:6789/0 conn(0x7f316c0c97e0 legacy=0x7f316c071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:21.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.786+0000 7f316aa00640 1 -- 172.21.15.76:0/2386467907 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316c158c20 con 0x7f316c152800 2024-03-28T12:42:21.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.794+0000 7f316aa00640 1 --2- 172.21.15.76:0/2386467907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f316c152800 0x7f316c0cea30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f315c0097c0 tx=0x7f315c01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37fb0dbf269bb494 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:21.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.810+0000 7f3169600640 1 -- 172.21.15.76:0/2386467907 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c0ab430 con 0x7f316c152800 2024-03-28T12:42:21.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.810+0000 7f3169600640 1 -- 172.21.15.76:0/2386467907 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f315c0b0070 con 0x7f316c152800 2024-03-28T12:42:21.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.810+0000 7f3169600640 1 -- 172.21.15.76:0/2386467907 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c0ab7f0 con 0x7f316c152800 2024-03-28T12:42:21.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.810+0000 7f3171e00640 1 -- 172.21.15.76:0/2386467907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f316c152800 msgr2=0x7f316c0cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:21.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.810+0000 7f3171e00640 1 --2- 172.21.15.76:0/2386467907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f316c152800 0x7f316c0cea30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f315c0097c0 tx=0x7f315c01c430 comp rx=0 tx=0).stop 2024-03-28T12:42:21.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.810+0000 7f3171e00640 1 -- 172.21.15.76:0/2386467907 shutdown_connections 2024-03-28T12:42:21.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.810+0000 7f3171e00640 1 --2- 172.21.15.76:0/2386467907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f316c152800 0x7f316c0cea30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:21.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.810+0000 7f3171e00640 1 -- 172.21.15.76:0/2386467907 >> 172.21.15.76:0/2386467907 conn(0x7f316c071540 msgr2=0x7f316c070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:21.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.810+0000 7f3171e00640 1 -- 172.21.15.76:0/2386467907 shutdown_connections 2024-03-28T12:42:21.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.810+0000 7f3171e00640 1 -- 172.21.15.76:0/2386467907 wait complete. 2024-03-28T12:42:21.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.810+0000 7f3171e00640 1 Processor -- start 2024-03-28T12:42:21.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.810+0000 7f3171e00640 1 -- start start 2024-03-28T12:42:21.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.814+0000 7f3171e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f316c0c97e0 0x7f316c143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:21.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.814+0000 7f3171e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f316c0cab80 0x7f316c1f7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:21.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.814+0000 7f3171e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f316c152800 0x7f316c144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:21.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.814+0000 7f3171e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f316c0c9d70 con 0x7f316c0cab80 2024-03-28T12:42:21.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.814+0000 7f3171e00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f316c0c9bf0 con 0x7f316c0c97e0 2024-03-28T12:42:21.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.814+0000 7f3171e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f316c072410 con 0x7f316c152800 2024-03-28T12:42:21.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.814+0000 7f316b400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f316c152800 0x7f316c144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:21.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.814+0000 7f316b400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f316c152800 0x7f316c144050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:57026/0 (socket says 172.21.15.76:57026) 2024-03-28T12:42:21.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.814+0000 7f316b400640 1 -- 172.21.15.76:0/425990076 learned_addr learned my addr 172.21.15.76:0/425990076 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:21.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.818+0000 7f316a000640 1 --2- 172.21.15.76:0/425990076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f316c0cab80 0x7f316c1f7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:21.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.818+0000 7f316aa00640 1 --2- 172.21.15.76:0/425990076 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f316c0c97e0 0x7f316c143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:21.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.826+0000 7f316b400640 1 -- 172.21.15.76:0/425990076 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f316c0c97e0 msgr2=0x7f316c143380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:21.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.826+0000 7f316b400640 1 --2- 172.21.15.76:0/425990076 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f316c0c97e0 0x7f316c143380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:21.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.826+0000 7f316b400640 1 -- 172.21.15.76:0/425990076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f316c0cab80 msgr2=0x7f316c1f7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:21.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.826+0000 7f316b400640 1 --2- 172.21.15.76:0/425990076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f316c0cab80 0x7f316c1f7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:21.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.826+0000 7f316b400640 1 -- 172.21.15.76:0/425990076 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316c1f7890 con 0x7f316c152800 2024-03-28T12:42:21.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.834+0000 7f316b400640 1 --2- 172.21.15.76:0/425990076 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f316c152800 0x7f316c144050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f316400c7b0 tx=0x7f316400cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:21.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.958+0000 7f3163400640 1 -- 172.21.15.76:0/425990076 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164017070 con 0x7f316c152800 2024-03-28T12:42:21.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.958+0000 7f3163400640 1 -- 172.21.15.76:0/425990076 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3164003db0 con 0x7f316c152800 2024-03-28T12:42:21.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.958+0000 7f3163400640 1 -- 172.21.15.76:0/425990076 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31640052b0 con 0x7f316c152800 2024-03-28T12:42:21.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.958+0000 7f3171e00640 1 -- 172.21.15.76:0/425990076 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f316c141e20 con 0x7f316c152800 2024-03-28T12:42:21.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.958+0000 7f3171e00640 1 -- 172.21.15.76:0/425990076 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f316c1426c0 con 0x7f316c152800 2024-03-28T12:42:21.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:21.962+0000 7f3171e00640 1 -- 172.21.15.76:0/425990076 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f316c0686e0 con 0x7f316c152800 2024-03-28T12:42:22.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.294+0000 7f3163400640 1 -- 172.21.15.76:0/425990076 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f316401a070 con 0x7f316c152800 2024-03-28T12:42:22.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.294+0000 7f3163400640 1 --2- 172.21.15.76:0/425990076 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f314c068010 0x7f314c06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:22.293 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.294+0000 7f316aa00640 1 --2- 172.21.15.76:0/425990076 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f314c068010 0x7f314c06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:22.294 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.294+0000 7f316aa00640 1 --2- 172.21.15.76:0/425990076 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f314c068010 0x7f314c06a4d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f315c0af000 tx=0x7f315c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:22.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.302+0000 7f3163400640 1 -- 172.21.15.76:0/425990076 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f3164054160 con 0x7f316c152800 2024-03-28T12:42:22.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.334+0000 7f3163400640 1 -- 172.21.15.76:0/425990076 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f3164021020 con 0x7f316c152800 2024-03-28T12:42:22.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.542+0000 7f3171e00640 1 -- 172.21.15.76:0/425990076 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f316c0c3f30 con 0x7f316c152800 2024-03-28T12:42:22.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.554+0000 7f3163400640 1 -- 172.21.15.76:0/425990076 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f31640560c0 con 0x7f316c152800 2024-03-28T12:42:22.552 INFO:teuthology.orchestra.run.smithi076.stderr:listed 0 entries 2024-03-28T12:42:22.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.554+0000 7f3171e00640 1 -- 172.21.15.76:0/425990076 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f314c068010 msgr2=0x7f314c06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:22.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.554+0000 7f3171e00640 1 --2- 172.21.15.76:0/425990076 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f314c068010 0x7f314c06a4d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f315c0af000 tx=0x7f315c0a7000 comp rx=0 tx=0).stop 2024-03-28T12:42:22.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.554+0000 7f3171e00640 1 -- 172.21.15.76:0/425990076 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f316c152800 msgr2=0x7f316c144050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:22.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.554+0000 7f3171e00640 1 --2- 172.21.15.76:0/425990076 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f316c152800 0x7f316c144050 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f316400c7b0 tx=0x7f316400cc70 comp rx=0 tx=0).stop 2024-03-28T12:42:22.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.554+0000 7f3171e00640 1 -- 172.21.15.76:0/425990076 shutdown_connections 2024-03-28T12:42:22.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.554+0000 7f3171e00640 1 --2- 172.21.15.76:0/425990076 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f314c068010 0x7f314c06a4d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:22.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.554+0000 7f3171e00640 1 --2- 172.21.15.76:0/425990076 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f316c152800 0x7f316c144050 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:22.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.554+0000 7f3171e00640 1 --2- 172.21.15.76:0/425990076 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f316c0cab80 0x7f316c1f7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:22.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.554+0000 7f3171e00640 1 --2- 172.21.15.76:0/425990076 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f316c0c97e0 0x7f316c143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:22.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.554+0000 7f3171e00640 1 -- 172.21.15.76:0/425990076 >> 172.21.15.76:0/425990076 conn(0x7f316c071540 msgr2=0x7f316c074e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:22.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.554+0000 7f3171e00640 1 -- 172.21.15.76:0/425990076 shutdown_connections 2024-03-28T12:42:22.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.554+0000 7f3171e00640 1 -- 172.21.15.76:0/425990076 wait complete. 2024-03-28T12:42:22.575 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:42:22.575 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T12:42:22.584 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T12:42:22.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.762+0000 7f184ae00640 1 Processor -- start 2024-03-28T12:42:22.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.762+0000 7f184ae00640 1 -- start start 2024-03-28T12:42:22.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.766+0000 7f184ae00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1844072060 0x7f18440cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:22.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.766+0000 7f184ae00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f1844072440 0x7f18441524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:22.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.766+0000 7f184ae00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f184415bf40 con 0x7f18441592a0 2024-03-28T12:42:22.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.766+0000 7f184ae00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f18440c31e0 con 0x7f1844072440 2024-03-28T12:42:22.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.766+0000 7f184ae00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f184415c220 con 0x7f1844072060 2024-03-28T12:42:22.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.766+0000 7f1848e00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f18441592a0 0x7f18440c3670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:49662/0 (socket says 172.21.15.76:49662) 2024-03-28T12:42:22.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.766+0000 7f1848e00640 1 -- 172.21.15.76:0/1120001696 learned_addr learned my addr 172.21.15.76:0/1120001696 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:22.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.766+0000 7f1843e00640 1 --2- 172.21.15.76:0/1120001696 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1844072060 0x7f18440cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:22.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.766+0000 7f1843400640 1 --2- 172.21.15.76:0/1120001696 >> v2:172.21.15.111:3300/0 conn(0x7f1844072440 0x7f18441524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:22.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.766+0000 7f1842a00640 1 -- 172.21.15.76:0/1120001696 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1445993384 0 0) 0x7f184415bf40 con 0x7f18441592a0 2024-03-28T12:42:22.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.766+0000 7f1842a00640 1 -- 172.21.15.76:0/1120001696 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1828003530 con 0x7f18441592a0 2024-03-28T12:42:22.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.770+0000 7f1842a00640 1 -- 172.21.15.76:0/1120001696 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 626075237 0 0) 0x7f1828003530 con 0x7f18441592a0 2024-03-28T12:42:22.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.770+0000 7f1842a00640 1 -- 172.21.15.76:0/1120001696 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1844072060 msgr2=0x7f18440cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:22.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.770+0000 7f1842a00640 1 --2- 172.21.15.76:0/1120001696 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1844072060 0x7f18440cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:22.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.770+0000 7f1842a00640 1 -- 172.21.15.76:0/1120001696 >> v2:172.21.15.111:3300/0 conn(0x7f1844072440 msgr2=0x7f18441524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:22.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.770+0000 7f1842a00640 1 --2- 172.21.15.76:0/1120001696 >> v2:172.21.15.111:3300/0 conn(0x7f1844072440 0x7f18441524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:22.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.770+0000 7f1842a00640 1 -- 172.21.15.76:0/1120001696 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184415c500 con 0x7f18441592a0 2024-03-28T12:42:22.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.770+0000 7f1842a00640 1 -- 172.21.15.76:0/1120001696 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7f183c001a00 con 0x7f18441592a0 2024-03-28T12:42:22.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.770+0000 7f1842a00640 1 -- 172.21.15.76:0/1120001696 >> v1:172.21.15.76:6789/0 conn(0x7f18441592a0 legacy=0x7f18440c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:22.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.770+0000 7f1842a00640 1 --2- 172.21.15.76:0/1120001696 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18280039c0 0x7f1828003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:22.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.770+0000 7f1842a00640 1 --2- 172.21.15.76:0/1120001696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1828004810 0x7f1828004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:22.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.770+0000 7f1842a00640 1 --2- 172.21.15.76:0/1120001696 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1844072060 0x7f18280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:22.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.770+0000 7f1842a00640 1 -- 172.21.15.76:0/1120001696 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f18440c31e0 con 0x7f1828004810 2024-03-28T12:42:22.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.770+0000 7f1842a00640 1 -- 172.21.15.76:0/1120001696 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f184415c220 con 0x7f18280039c0 2024-03-28T12:42:22.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.770+0000 7f1842a00640 1 -- 172.21.15.76:0/1120001696 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f182800b9d0 con 0x7f1844072060 2024-03-28T12:42:22.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.774+0000 7f1843400640 1 --2- 172.21.15.76:0/1120001696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1828004810 0x7f1828004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:22.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.778+0000 7f1843400640 1 -- 172.21.15.76:0/1120001696 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1844072060 msgr2=0x7f18280051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:22.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.778+0000 7f1843400640 1 --2- 172.21.15.76:0/1120001696 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1844072060 0x7f18280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:22.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.778+0000 7f1843400640 1 -- 172.21.15.76:0/1120001696 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18280039c0 msgr2=0x7f1828003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:22.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.778+0000 7f1843400640 1 --2- 172.21.15.76:0/1120001696 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18280039c0 0x7f1828003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:22.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.778+0000 7f1843400640 1 -- 172.21.15.76:0/1120001696 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1828003530 con 0x7f1828004810 2024-03-28T12:42:22.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.782+0000 7f1843400640 1 --2- 172.21.15.76:0/1120001696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1828004810 0x7f1828004c90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1830009ab0 tx=0x7f183001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d8d79731024863 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:22.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.782+0000 7f1842a00640 1 -- 172.21.15.76:0/1120001696 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18300b2070 con 0x7f1828004810 2024-03-28T12:42:22.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.782+0000 7f1842a00640 1 -- 172.21.15.76:0/1120001696 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18300a55a0 con 0x7f1828004810 2024-03-28T12:42:22.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.782+0000 7f1842a00640 1 -- 172.21.15.76:0/1120001696 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18300096b0 con 0x7f1828004810 2024-03-28T12:42:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.786+0000 7f184ae00640 1 -- 172.21.15.76:0/1120001696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1828004810 msgr2=0x7f1828004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.786+0000 7f184ae00640 1 --2- 172.21.15.76:0/1120001696 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f1828004810 0x7f1828004c90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1830009ab0 tx=0x7f183001ca30 comp rx=0 tx=0).stop 2024-03-28T12:42:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.786+0000 7f1848e00640 1 -- 172.21.15.76:0/1120001696 reap_dead start 2024-03-28T12:42:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.786+0000 7f184ae00640 1 -- 172.21.15.76:0/1120001696 shutdown_connections 2024-03-28T12:42:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.786+0000 7f184ae00640 1 -- 172.21.15.76:0/1120001696 >> 172.21.15.76:0/1120001696 conn(0x7f1844071520 msgr2=0x7f1844070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.786+0000 7f184ae00640 1 -- 172.21.15.76:0/1120001696 shutdown_connections 2024-03-28T12:42:22.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.786+0000 7f184ae00640 1 -- 172.21.15.76:0/1120001696 wait complete. 2024-03-28T12:42:22.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.786+0000 7f184ae00640 1 Processor -- start 2024-03-28T12:42:22.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.786+0000 7f184ae00640 1 -- start start 2024-03-28T12:42:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.786+0000 7f184ae00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1828004810 0x7f18441f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.786+0000 7f184ae00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18440c8120 0x7f184406de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.786+0000 7f184ae00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18440ae820 0x7f18440ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.786+0000 7f184ae00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f184415bcf0 con 0x7f18440ae820 2024-03-28T12:42:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.786+0000 7f184ae00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f184415bb70 con 0x7f18440c8120 2024-03-28T12:42:22.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.786+0000 7f184ae00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f18440c3d80 con 0x7f1828004810 2024-03-28T12:42:22.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.790+0000 7f1843400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18440c8120 0x7f184406de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:22.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.790+0000 7f1843e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1828004810 0x7f18441f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:22.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.790+0000 7f1843400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18440c8120 0x7f184406de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:46962/0 (socket says 172.21.15.76:46962) 2024-03-28T12:42:22.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.790+0000 7f1843400640 1 -- 172.21.15.76:0/3884820334 learned_addr learned my addr 172.21.15.76:0/3884820334 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:22.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.798+0000 7f1843400640 1 -- 172.21.15.76:0/3884820334 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1828004810 msgr2=0x7f18441f4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:22.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.798+0000 7f1843400640 1 --2- 172.21.15.76:0/3884820334 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1828004810 0x7f18441f4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:22.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.798+0000 7f1843400640 1 -- 172.21.15.76:0/3884820334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18440ae820 msgr2=0x7f18440ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:22.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.798+0000 7f1843400640 1 --2- 172.21.15.76:0/3884820334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18440ae820 0x7f18440ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:22.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.798+0000 7f1843400640 1 -- 172.21.15.76:0/3884820334 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18441f4680 con 0x7f18440c8120 2024-03-28T12:42:22.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.806+0000 7f1843400640 1 --2- 172.21.15.76:0/3884820334 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18440c8120 0x7f184406de60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f183001d2d0 tx=0x7f1828005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:22.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.814+0000 7f183be00640 1 -- 172.21.15.76:0/3884820334 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18300be070 con 0x7f18440c8120 2024-03-28T12:42:22.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.814+0000 7f183be00640 1 -- 172.21.15.76:0/3884820334 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f183000f000 con 0x7f18440c8120 2024-03-28T12:42:22.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.814+0000 7f183be00640 1 -- 172.21.15.76:0/3884820334 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18300b2040 con 0x7f18440c8120 2024-03-28T12:42:22.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.814+0000 7f184ae00640 1 -- 172.21.15.76:0/3884820334 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18441525d0 con 0x7f18440c8120 2024-03-28T12:42:22.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.814+0000 7f184ae00640 1 -- 172.21.15.76:0/3884820334 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18440ae060 con 0x7f18440c8120 2024-03-28T12:42:22.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:22.814+0000 7f184ae00640 1 -- 172.21.15.76:0/3884820334 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18440686e0 con 0x7f18440c8120 2024-03-28T12:42:23.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.146+0000 7f183be00640 1 -- 172.21.15.76:0/3884820334 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f18300c1070 con 0x7f18440c8120 2024-03-28T12:42:23.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.146+0000 7f183be00640 1 --2- 172.21.15.76:0/3884820334 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1824068010 0x7f182406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:23.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.150+0000 7f1843e00640 1 --2- 172.21.15.76:0/3884820334 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1824068010 0x7f182406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:23.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.150+0000 7f1843e00640 1 --2- 172.21.15.76:0/3884820334 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1824068010 0x7f182406a4d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f18340093f0 tx=0x7f18340094c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:23.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.162+0000 7f183be00640 1 -- 172.21.15.76:0/3884820334 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f18300ee5d0 con 0x7f18440c8120 2024-03-28T12:42:23.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.194+0000 7f183be00640 1 -- 172.21.15.76:0/3884820334 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f18300c8080 con 0x7f18440c8120 2024-03-28T12:42:23.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.358+0000 7f184ae00640 1 -- 172.21.15.76:0/3884820334 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18440b25a0 con 0x7f18440c8120 2024-03-28T12:42:23.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.654+0000 7f183be00640 1 -- 172.21.15.76:0/3884820334 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18798 (secure 0 0 0) 0x7f18441f4680 con 0x7f18440c8120 2024-03-28T12:42:23.655 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:23.655 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":29,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:42:15.156639+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T12:41:58.010965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T12:41:59.698601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-28T12:42:05.363180+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.1","mappings":[{"from":3,"to":4}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]},{"pgid":"4.d","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":5}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:42:23.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.658+0000 7f184ae00640 1 -- 172.21.15.76:0/3884820334 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1824068010 msgr2=0x7f182406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:23.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.658+0000 7f184ae00640 1 --2- 172.21.15.76:0/3884820334 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1824068010 0x7f182406a4d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f18340093f0 tx=0x7f18340094c0 comp rx=0 tx=0).stop 2024-03-28T12:42:23.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.658+0000 7f184ae00640 1 -- 172.21.15.76:0/3884820334 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18440c8120 msgr2=0x7f184406de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:23.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.658+0000 7f184ae00640 1 --2- 172.21.15.76:0/3884820334 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18440c8120 0x7f184406de60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f183001d2d0 tx=0x7f1828005840 comp rx=0 tx=0).stop 2024-03-28T12:42:23.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.658+0000 7f184ae00640 1 -- 172.21.15.76:0/3884820334 shutdown_connections 2024-03-28T12:42:23.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.658+0000 7f184ae00640 1 --2- 172.21.15.76:0/3884820334 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1824068010 0x7f182406a4d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:23.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.658+0000 7f184ae00640 1 --2- 172.21.15.76:0/3884820334 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18440ae820 0x7f18440ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:23.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.658+0000 7f184ae00640 1 --2- 172.21.15.76:0/3884820334 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18440c8120 0x7f184406de60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:23.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.658+0000 7f184ae00640 1 --2- 172.21.15.76:0/3884820334 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1828004810 0x7f18441f4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:23.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.658+0000 7f184ae00640 1 -- 172.21.15.76:0/3884820334 >> 172.21.15.76:0/3884820334 conn(0x7f1844071520 msgr2=0x7f18441510a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:23.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.658+0000 7f184ae00640 1 -- 172.21.15.76:0/3884820334 shutdown_connections 2024-03-28T12:42:23.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.658+0000 7f184ae00640 1 -- 172.21.15.76:0/3884820334 wait complete. 2024-03-28T12:42:23.678 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T12:41:23.389090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T12:41:58.010965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T12:41:59.698601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-28T12:42:05.363180+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-28T12:42:23.678 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T12:42:23.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.822+0000 7f4053c00640 1 Processor -- start 2024-03-28T12:42:23.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.822+0000 7f4053c00640 1 -- start start 2024-03-28T12:42:23.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.822+0000 7f4053c00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f404c071f60 0x7f404c0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:23.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.822+0000 7f4053c00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f404c072340 0x7f404c15b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:23.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.822+0000 7f4053c00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f404c06d7f0 con 0x7f404c0ce9c0 2024-03-28T12:42:23.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.822+0000 7f4053c00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f404c06c750 con 0x7f404c071f60 2024-03-28T12:42:23.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.822+0000 7f4053c00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f404c06ca30 con 0x7f404c072340 2024-03-28T12:42:23.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.822+0000 7f4051200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f404c071f60 0x7f404c0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:23.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.822+0000 7f4051200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f404c071f60 0x7f404c0c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48300/0 (socket says 172.21.15.76:48300) 2024-03-28T12:42:23.821 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.822+0000 7f4051200640 1 -- 172.21.15.76:0/3104512316 learned_addr learned my addr 172.21.15.76:0/3104512316 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:23.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.822+0000 7f404be00640 1 --2- 172.21.15.76:0/3104512316 >> v2:172.21.15.111:3300/0 conn(0x7f404c072340 0x7f404c15b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:23.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.826+0000 7f4051200640 1 -- 172.21.15.76:0/3104512316 >> v2:172.21.15.111:3300/0 conn(0x7f404c072340 msgr2=0x7f404c15b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:23.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.826+0000 7f4051200640 1 --2- 172.21.15.76:0/3104512316 >> v2:172.21.15.111:3300/0 conn(0x7f404c072340 0x7f404c15b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:23.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.826+0000 7f4051200640 1 -- 172.21.15.76:0/3104512316 >> v1:172.21.15.111:6789/0 conn(0x7f404c0ce9c0 legacy=0x7f404c0c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:23.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.826+0000 7f4051200640 1 -- 172.21.15.76:0/3104512316 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404c06cd10 con 0x7f404c071f60 2024-03-28T12:42:23.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.830+0000 7f4051200640 1 --2- 172.21.15.76:0/3104512316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c071f60 0x7f404c0c8d10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4040009870 tx=0x7f404001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5963f2f9fc3b8c8e server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:23.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.834+0000 7f404b400640 1 -- 172.21.15.76:0/3104512316 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40400b0070 con 0x7f404c071f60 2024-03-28T12:42:23.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.834+0000 7f404b400640 1 -- 172.21.15.76:0/3104512316 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40400ab600 con 0x7f404c071f60 2024-03-28T12:42:23.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.834+0000 7f404b400640 1 -- 172.21.15.76:0/3104512316 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40400ab9d0 con 0x7f404c071f60 2024-03-28T12:42:23.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.834+0000 7f4053c00640 1 -- 172.21.15.76:0/3104512316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c071f60 msgr2=0x7f404c0c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:23.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.834+0000 7f4053c00640 1 --2- 172.21.15.76:0/3104512316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c071f60 0x7f404c0c8d10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4040009870 tx=0x7f404001c4e0 comp rx=0 tx=0).stop 2024-03-28T12:42:23.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.834+0000 7f4053c00640 1 -- 172.21.15.76:0/3104512316 shutdown_connections 2024-03-28T12:42:23.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.834+0000 7f4053c00640 1 --2- 172.21.15.76:0/3104512316 >> v2:172.21.15.111:3300/0 conn(0x7f404c072340 0x7f404c15b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:23.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.834+0000 7f4053c00640 1 --2- 172.21.15.76:0/3104512316 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c071f60 0x7f404c0c8d10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:23.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.834+0000 7f4053c00640 1 -- 172.21.15.76:0/3104512316 >> 172.21.15.76:0/3104512316 conn(0x7f404c071540 msgr2=0x7f404c070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:23.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.834+0000 7f4053c00640 1 -- 172.21.15.76:0/3104512316 shutdown_connections 2024-03-28T12:42:23.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.834+0000 7f4053c00640 1 -- 172.21.15.76:0/3104512316 wait complete. 2024-03-28T12:42:23.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.838+0000 7f4053c00640 1 Processor -- start 2024-03-28T12:42:23.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.838+0000 7f4053c00640 1 -- start start 2024-03-28T12:42:23.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.838+0000 7f4053c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f404c071f60 0x7f404c0b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:23.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.838+0000 7f4053c00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f404c072340 0x7f404c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:23.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.838+0000 7f4053c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c0ce9c0 0x7f404c0af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:23.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.838+0000 7f4053c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f404c1672e0 con 0x7f404c0ce9c0 2024-03-28T12:42:23.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.838+0000 7f4053c00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f404c0cef00 con 0x7f404c072340 2024-03-28T12:42:23.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.838+0000 7f4053c00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f404c167460 con 0x7f404c071f60 2024-03-28T12:42:23.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.838+0000 7f4051c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c0ce9c0 0x7f404c0af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:23.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.838+0000 7f4051c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c0ce9c0 0x7f404c0af470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48304/0 (socket says 172.21.15.76:48304) 2024-03-28T12:42:23.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.838+0000 7f4051c00640 1 -- 172.21.15.76:0/3270215689 learned_addr learned my addr 172.21.15.76:0/3270215689 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:23.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.838+0000 7f404be00640 1 --2- 172.21.15.76:0/3270215689 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f404c072340 0x7f404c0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:23.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.838+0000 7f4051200640 1 --2- 172.21.15.76:0/3270215689 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f404c071f60 0x7f404c0b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:23.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.842+0000 7f4051c00640 1 -- 172.21.15.76:0/3270215689 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f404c071f60 msgr2=0x7f404c0b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:23.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.842+0000 7f4051c00640 1 --2- 172.21.15.76:0/3270215689 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f404c071f60 0x7f404c0b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:23.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.842+0000 7f4051c00640 1 -- 172.21.15.76:0/3270215689 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f404c072340 msgr2=0x7f404c0aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:23.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.842+0000 7f4051c00640 1 --2- 172.21.15.76:0/3270215689 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f404c072340 0x7f404c0aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:23.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.842+0000 7f4051c00640 1 -- 172.21.15.76:0/3270215689 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f404c0adf90 con 0x7f404c0ce9c0 2024-03-28T12:42:23.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.846+0000 7f4051c00640 1 --2- 172.21.15.76:0/3270215689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c0ce9c0 0x7f404c0af470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f404400c7b0 tx=0x7f404400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:23.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.850+0000 7f4048c00640 1 -- 172.21.15.76:0/3270215689 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4044016020 con 0x7f404c0ce9c0 2024-03-28T12:42:23.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.850+0000 7f4048c00640 1 -- 172.21.15.76:0/3270215689 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f404400a9f0 con 0x7f404c0ce9c0 2024-03-28T12:42:23.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.850+0000 7f4053c00640 1 -- 172.21.15.76:0/3270215689 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f404c0ae230 con 0x7f404c0ce9c0 2024-03-28T12:42:23.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.850+0000 7f4048c00640 1 -- 172.21.15.76:0/3270215689 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404400ade0 con 0x7f404c0ce9c0 2024-03-28T12:42:23.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.850+0000 7f4053c00640 1 -- 172.21.15.76:0/3270215689 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f404c0c7b70 con 0x7f404c0ce9c0 2024-03-28T12:42:23.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.850+0000 7f4053c00640 1 -- 172.21.15.76:0/3270215689 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f404c0686e0 con 0x7f404c0ce9c0 2024-03-28T12:42:23.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.866+0000 7f4048c00640 1 -- 172.21.15.76:0/3270215689 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f4044019020 con 0x7f404c0ce9c0 2024-03-28T12:42:23.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.870+0000 7f4048c00640 1 --2- 172.21.15.76:0/3270215689 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f402c068010 0x7f402c06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:23.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.870+0000 7f4051200640 1 --2- 172.21.15.76:0/3270215689 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f402c068010 0x7f402c06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:23.868 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:23.870+0000 7f4051200640 1 --2- 172.21.15.76:0/3270215689 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f402c068010 0x7f402c06a4d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f40400ad000 tx=0x7f40400a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:24.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.110+0000 7f4048c00640 1 -- 172.21.15.76:0/3270215689 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f4044054eb0 con 0x7f404c0ce9c0 2024-03-28T12:42:24.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.110+0000 7f4048c00640 1 -- 172.21.15.76:0/3270215689 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f4044020020 con 0x7f404c0ce9c0 2024-03-28T12:42:24.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.274+0000 7f4053c00640 1 -- 172.21.15.76:0/3270215689 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f404c15a7c0 con 0x7f404c0ce9c0 2024-03-28T12:42:24.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.278+0000 7f4048c00640 1 -- 172.21.15.76:0/3270215689 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f4044056e10 con 0x7f404c0ce9c0 2024-03-28T12:42:24.278 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-03-28T12:42:24.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.282+0000 7f4053c00640 1 -- 172.21.15.76:0/3270215689 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f402c068010 msgr2=0x7f402c06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:24.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.282+0000 7f4053c00640 1 --2- 172.21.15.76:0/3270215689 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f402c068010 0x7f402c06a4d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f40400ad000 tx=0x7f40400a6000 comp rx=0 tx=0).stop 2024-03-28T12:42:24.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.282+0000 7f4053c00640 1 -- 172.21.15.76:0/3270215689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c0ce9c0 msgr2=0x7f404c0af470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:24.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.282+0000 7f4053c00640 1 --2- 172.21.15.76:0/3270215689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c0ce9c0 0x7f404c0af470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f404400c7b0 tx=0x7f404400cc70 comp rx=0 tx=0).stop 2024-03-28T12:42:24.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.282+0000 7f4053c00640 1 -- 172.21.15.76:0/3270215689 shutdown_connections 2024-03-28T12:42:24.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.282+0000 7f4053c00640 1 --2- 172.21.15.76:0/3270215689 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f402c068010 0x7f402c06a4d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:24.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.282+0000 7f4053c00640 1 --2- 172.21.15.76:0/3270215689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f404c0ce9c0 0x7f404c0af470 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:24.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.282+0000 7f4053c00640 1 --2- 172.21.15.76:0/3270215689 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f404c072340 0x7f404c0aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:24.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.282+0000 7f4053c00640 1 --2- 172.21.15.76:0/3270215689 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f404c071f60 0x7f404c0b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:24.281 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.282+0000 7f4053c00640 1 -- 172.21.15.76:0/3270215689 >> 172.21.15.76:0/3270215689 conn(0x7f404c071540 msgr2=0x7f404c0c8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:24.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.282+0000 7f4053c00640 1 -- 172.21.15.76:0/3270215689 shutdown_connections 2024-03-28T12:42:24.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.282+0000 7f4053c00640 1 -- 172.21.15.76:0/3270215689 wait complete. 2024-03-28T12:42:24.300 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T12:42:24.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.442+0000 7fcae1c00640 1 Processor -- start 2024-03-28T12:42:24.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.442+0000 7fcae1c00640 1 -- start start 2024-03-28T12:42:24.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.446+0000 7fcae1c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcadc152800 0x7fcadc0cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:24.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.446+0000 7fcae1c00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fcadc0c97e0 0x7fcadc071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:24.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.446+0000 7fcae1c00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcadc158680 con 0x7fcadc072240 2024-03-28T12:42:24.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.446+0000 7fcae1c00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fcadc159550 con 0x7fcadc0c97e0 2024-03-28T12:42:24.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.446+0000 7fcae1c00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fcadc158940 con 0x7fcadc152800 2024-03-28T12:42:24.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.482+0000 7fcadb400640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fcadc072240 0x7fcadc0cab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:35070/0 (socket says 172.21.15.76:35070) 2024-03-28T12:42:24.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.482+0000 7fcadb400640 1 -- 172.21.15.76:0/3335047008 learned_addr learned my addr 172.21.15.76:0/3335047008 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:24.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.482+0000 7fcada000640 1 --2- 172.21.15.76:0/3335047008 >> v2:172.21.15.76:3300/0 conn(0x7fcadc0c97e0 0x7fcadc071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:24.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.486+0000 7fcad9600640 1 -- 172.21.15.76:0/3335047008 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1093181603 0 0) 0x7fcadc158680 con 0x7fcadc072240 2024-03-28T12:42:24.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.486+0000 7fcad9600640 1 -- 172.21.15.76:0/3335047008 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcac0003530 con 0x7fcadc072240 2024-03-28T12:42:24.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.490+0000 7fcada000640 1 -- 172.21.15.76:0/3335047008 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcadc152800 msgr2=0x7fcadc0cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:24.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.490+0000 7fcada000640 1 --2- 172.21.15.76:0/3335047008 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcadc152800 0x7fcadc0cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:24.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.490+0000 7fcada000640 1 -- 172.21.15.76:0/3335047008 >> v1:172.21.15.76:6789/0 conn(0x7fcadc072240 legacy=0x7fcadc0cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:24.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.490+0000 7fcada000640 1 -- 172.21.15.76:0/3335047008 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcadc158c20 con 0x7fcadc0c97e0 2024-03-28T12:42:24.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.494+0000 7fcada000640 1 --2- 172.21.15.76:0/3335047008 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcadc0c97e0 0x7fcadc071d00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcac80097c0 tx=0x7fcac801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b500395d6f82f9f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:24.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.498+0000 7fcad9600640 1 -- 172.21.15.76:0/3335047008 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac80b2070 con 0x7fcadc0c97e0 2024-03-28T12:42:24.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.498+0000 7fcad9600640 1 -- 172.21.15.76:0/3335047008 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac80ad640 con 0x7fcadc0c97e0 2024-03-28T12:42:24.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.502+0000 7fcad9600640 1 -- 172.21.15.76:0/3335047008 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac80ada10 con 0x7fcadc0c97e0 2024-03-28T12:42:24.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.502+0000 7fcae1c00640 1 -- 172.21.15.76:0/3335047008 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcadc0c97e0 msgr2=0x7fcadc071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:24.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.502+0000 7fcae1c00640 1 --2- 172.21.15.76:0/3335047008 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcadc0c97e0 0x7fcadc071d00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcac80097c0 tx=0x7fcac801c4a0 comp rx=0 tx=0).stop 2024-03-28T12:42:24.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.502+0000 7fcae1c00640 1 -- 172.21.15.76:0/3335047008 shutdown_connections 2024-03-28T12:42:24.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.502+0000 7fcae1c00640 1 --2- 172.21.15.76:0/3335047008 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcadc0c97e0 0x7fcadc071d00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:24.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.502+0000 7fcae1c00640 1 --2- 172.21.15.76:0/3335047008 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcadc152800 0x7fcadc0cea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:24.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.502+0000 7fcae1c00640 1 -- 172.21.15.76:0/3335047008 >> 172.21.15.76:0/3335047008 conn(0x7fcadc071540 msgr2=0x7fcadc070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:24.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.502+0000 7fcae1c00640 1 -- 172.21.15.76:0/3335047008 shutdown_connections 2024-03-28T12:42:24.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.502+0000 7fcae1c00640 1 -- 172.21.15.76:0/3335047008 wait complete. 2024-03-28T12:42:24.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.502+0000 7fcae1c00640 1 Processor -- start 2024-03-28T12:42:24.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.502+0000 7fcae1c00640 1 -- start start 2024-03-28T12:42:24.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.502+0000 7fcae1c00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcadc072240 0x7fcadc15c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:24.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.502+0000 7fcae1c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcadc0c97e0 0x7fcadc06d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:24.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.502+0000 7fcae1c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcadc152800 0x7fcadc153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:24.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.502+0000 7fcae1c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc0c9c00 con 0x7fcadc152800 2024-03-28T12:42:24.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.502+0000 7fcae1c00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcadc152be0 con 0x7fcadc072240 2024-03-28T12:42:24.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.502+0000 7fcae1c00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fcadc06dd70 con 0x7fcadc0c97e0 2024-03-28T12:42:24.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.506+0000 7fcadb400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcadc152800 0x7fcadc153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:24.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.506+0000 7fcadb400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcadc152800 0x7fcadc153840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48326/0 (socket says 172.21.15.76:48326) 2024-03-28T12:42:24.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.506+0000 7fcadb400640 1 -- 172.21.15.76:0/1511319563 learned_addr learned my addr 172.21.15.76:0/1511319563 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:24.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.506+0000 7fcadb400640 1 -- 172.21.15.76:0/1511319563 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcadc0c97e0 msgr2=0x7fcadc06d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:24.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.506+0000 7fcadb400640 1 --2- 172.21.15.76:0/1511319563 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcadc0c97e0 0x7fcadc06d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:24.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.506+0000 7fcadb400640 1 -- 172.21.15.76:0/1511319563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcadc072240 msgr2=0x7fcadc15c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:24.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.506+0000 7fcadb400640 1 --2- 172.21.15.76:0/1511319563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcadc072240 0x7fcadc15c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:24.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.506+0000 7fcadb400640 1 -- 172.21.15.76:0/1511319563 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcadc1f30c0 con 0x7fcadc152800 2024-03-28T12:42:24.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.510+0000 7fcadb400640 1 --2- 172.21.15.76:0/1511319563 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcadc152800 0x7fcadc153840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcad400caa0 tx=0x7fcad400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:24.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.514+0000 7fcad2a00640 1 -- 172.21.15.76:0/1511319563 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4017070 con 0x7fcadc152800 2024-03-28T12:42:24.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.514+0000 7fcad2a00640 1 -- 172.21.15.76:0/1511319563 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcad400ac00 con 0x7fcadc152800 2024-03-28T12:42:24.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.514+0000 7fcad2a00640 1 -- 172.21.15.76:0/1511319563 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcad4012400 con 0x7fcadc152800 2024-03-28T12:42:24.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.514+0000 7fcae1c00640 1 -- 172.21.15.76:0/1511319563 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcadc06df90 con 0x7fcadc152800 2024-03-28T12:42:24.513 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.514+0000 7fcae1c00640 1 -- 172.21.15.76:0/1511319563 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcadc1f3660 con 0x7fcadc152800 2024-03-28T12:42:24.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.514+0000 7fcae1c00640 1 -- 172.21.15.76:0/1511319563 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcadc0686e0 con 0x7fcadc152800 2024-03-28T12:42:24.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.534+0000 7fcad2a00640 1 -- 172.21.15.76:0/1511319563 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fcad401a070 con 0x7fcadc152800 2024-03-28T12:42:24.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.538+0000 7fcad2a00640 1 --2- 172.21.15.76:0/1511319563 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcabc068010 0x7fcabc06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:24.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.538+0000 7fcadaa00640 1 --2- 172.21.15.76:0/1511319563 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcabc068010 0x7fcabc06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:24.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.538+0000 7fcadaa00640 1 --2- 172.21.15.76:0/1511319563 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcabc068010 0x7fcabc06a4d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009730 tx=0x7fcacc006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:24.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.538+0000 7fcad2a00640 1 -- 172.21.15.76:0/1511319563 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fcad4054870 con 0x7fcadc152800 2024-03-28T12:42:24.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.794+0000 7fcad2a00640 1 -- 172.21.15.76:0/1511319563 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fcad4021020 con 0x7fcadc152800 2024-03-28T12:42:24.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.954+0000 7fcae1c00640 1 -- 172.21.15.76:0/1511319563 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcadc0c3940 con 0x7fcadc152800 2024-03-28T12:42:24.960 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.962+0000 7fcad2a00640 1 -- 172.21.15.76:0/1511319563 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fcad4056ed0 con 0x7fcadc152800 2024-03-28T12:42:24.960 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-03-28T12:42:24.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.962+0000 7fcae1c00640 1 -- 172.21.15.76:0/1511319563 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcabc068010 msgr2=0x7fcabc06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:24.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.962+0000 7fcae1c00640 1 --2- 172.21.15.76:0/1511319563 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcabc068010 0x7fcabc06a4d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcacc009730 tx=0x7fcacc006ca0 comp rx=0 tx=0).stop 2024-03-28T12:42:24.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.962+0000 7fcae1c00640 1 -- 172.21.15.76:0/1511319563 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcadc152800 msgr2=0x7fcadc153840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:24.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.962+0000 7fcae1c00640 1 --2- 172.21.15.76:0/1511319563 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcadc152800 0x7fcadc153840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcad400caa0 tx=0x7fcad400cf60 comp rx=0 tx=0).stop 2024-03-28T12:42:24.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.962+0000 7fcae1c00640 1 -- 172.21.15.76:0/1511319563 shutdown_connections 2024-03-28T12:42:24.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.962+0000 7fcae1c00640 1 --2- 172.21.15.76:0/1511319563 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcabc068010 0x7fcabc06a4d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:24.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.962+0000 7fcae1c00640 1 --2- 172.21.15.76:0/1511319563 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcadc152800 0x7fcadc153840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:24.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.962+0000 7fcae1c00640 1 --2- 172.21.15.76:0/1511319563 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcadc0c97e0 0x7fcadc06d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:24.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.962+0000 7fcae1c00640 1 --2- 172.21.15.76:0/1511319563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcadc072240 0x7fcadc15c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:24.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.962+0000 7fcae1c00640 1 -- 172.21.15.76:0/1511319563 >> 172.21.15.76:0/1511319563 conn(0x7fcadc071540 msgr2=0x7fcadc0cab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:24.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.962+0000 7fcae1c00640 1 -- 172.21.15.76:0/1511319563 shutdown_connections 2024-03-28T12:42:24.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:24.962+0000 7fcae1c00640 1 -- 172.21.15.76:0/1511319563 wait complete. 2024-03-28T12:42:24.982 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T12:42:25.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.122+0000 7fdbee400640 1 Processor -- start 2024-03-28T12:42:25.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.122+0000 7fdbee400640 1 -- start start 2024-03-28T12:42:25.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.126+0000 7fdbee400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdbe8152800 0x7fdbe80cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:25.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.126+0000 7fdbee400640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe8158680 con 0x7fdbe80c97e0 2024-03-28T12:42:25.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.126+0000 7fdbee400640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe8158940 con 0x7fdbe80cab80 2024-03-28T12:42:25.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.126+0000 7fdbee400640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe8159550 con 0x7fdbe8152800 2024-03-28T12:42:25.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.126+0000 7fdbe6a00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fdbe80c97e0 0x7fdbe8071d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:35086/0 (socket says 172.21.15.76:35086) 2024-03-28T12:42:25.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.126+0000 7fdbe6a00640 1 -- 172.21.15.76:0/212167369 learned_addr learned my addr 172.21.15.76:0/212167369 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:25.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.126+0000 7fdbe7400640 1 --2- 172.21.15.76:0/212167369 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdbe8152800 0x7fdbe80cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:25.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.130+0000 7fdbe6000640 1 -- 172.21.15.76:0/212167369 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3289170787 0 0) 0x7fdbe8158680 con 0x7fdbe80c97e0 2024-03-28T12:42:25.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.130+0000 7fdbe6000640 1 -- 172.21.15.76:0/212167369 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbcc003530 con 0x7fdbe80c97e0 2024-03-28T12:42:25.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.130+0000 7fdbe6000640 1 -- 172.21.15.76:0/212167369 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1936667982 0 0) 0x7fdbcc003530 con 0x7fdbe80c97e0 2024-03-28T12:42:25.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.130+0000 7fdbe6000640 1 -- 172.21.15.76:0/212167369 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdbe8152800 msgr2=0x7fdbe80cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:25.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.130+0000 7fdbe6000640 1 --2- 172.21.15.76:0/212167369 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdbe8152800 0x7fdbe80cea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.130+0000 7fdbe6000640 1 -- 172.21.15.76:0/212167369 >> v1:172.21.15.111:6789/0 conn(0x7fdbe80cab80 legacy=0x7fdbe80caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:25.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.130+0000 7fdbe6000640 1 -- 172.21.15.76:0/212167369 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe8158c20 con 0x7fdbe80c97e0 2024-03-28T12:42:25.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.130+0000 7fdbe6000640 1 -- 172.21.15.76:0/212167369 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7fdbd4001680 con 0x7fdbe80c97e0 2024-03-28T12:42:25.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.130+0000 7fdbe6000640 1 -- 172.21.15.76:0/212167369 >> v1:172.21.15.76:6789/0 conn(0x7fdbe80c97e0 legacy=0x7fdbe8071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:25.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.130+0000 7fdbe6000640 1 --2- 172.21.15.76:0/212167369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbcc003a60 0x7fdbcc003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:25.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.130+0000 7fdbe6000640 1 --2- 172.21.15.76:0/212167369 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdbe8152800 0x7fdbcc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:25.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.130+0000 7fdbe6000640 1 --2- 172.21.15.76:0/212167369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbcc004d50 0x7fdbcc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:25.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.130+0000 7fdbe6000640 1 -- 172.21.15.76:0/212167369 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc00bab0 con 0x7fdbcc004d50 2024-03-28T12:42:25.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.130+0000 7fdbe6000640 1 -- 172.21.15.76:0/212167369 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc00bc60 con 0x7fdbcc003a60 2024-03-28T12:42:25.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.130+0000 7fdbe6000640 1 -- 172.21.15.76:0/212167369 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fdbcc00be60 con 0x7fdbe8152800 2024-03-28T12:42:25.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.134+0000 7fdbe7e00640 1 --2- 172.21.15.76:0/212167369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbcc004d50 0x7fdbcc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:25.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.134+0000 7fdbe7e00640 1 -- 172.21.15.76:0/212167369 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdbe8152800 msgr2=0x7fdbcc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:25.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.134+0000 7fdbe7e00640 1 --2- 172.21.15.76:0/212167369 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdbe8152800 0x7fdbcc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.138+0000 7fdbe7e00640 1 -- 172.21.15.76:0/212167369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbcc003a60 msgr2=0x7fdbcc003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:25.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.138+0000 7fdbe7e00640 1 --2- 172.21.15.76:0/212167369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbcc003a60 0x7fdbcc003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.138+0000 7fdbe7e00640 1 -- 172.21.15.76:0/212167369 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe8158c20 con 0x7fdbcc004d50 2024-03-28T12:42:25.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.138+0000 7fdbe7e00640 1 --2- 172.21.15.76:0/212167369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbcc004d50 0x7fdbcc0051d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0001e40 tx=0x7fdbe001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dae8144a099b7d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:25.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.142+0000 7fdbe6000640 1 -- 172.21.15.76:0/212167369 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0001a90 con 0x7fdbcc004d50 2024-03-28T12:42:25.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.142+0000 7fdbe6000640 1 -- 172.21.15.76:0/212167369 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe0003b80 con 0x7fdbcc004d50 2024-03-28T12:42:25.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.142+0000 7fdbe6000640 1 -- 172.21.15.76:0/212167369 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0005080 con 0x7fdbcc004d50 2024-03-28T12:42:25.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.146+0000 7fdbee400640 1 -- 172.21.15.76:0/212167369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbcc004d50 msgr2=0x7fdbcc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:25.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.146+0000 7fdbee400640 1 --2- 172.21.15.76:0/212167369 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbcc004d50 0x7fdbcc0051d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0001e40 tx=0x7fdbe001c760 comp rx=0 tx=0).stop 2024-03-28T12:42:25.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.146+0000 7fdbe7e00640 1 -- 172.21.15.76:0/212167369 reap_dead start 2024-03-28T12:42:25.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.146+0000 7fdbee400640 1 -- 172.21.15.76:0/212167369 shutdown_connections 2024-03-28T12:42:25.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.146+0000 7fdbee400640 1 -- 172.21.15.76:0/212167369 >> 172.21.15.76:0/212167369 conn(0x7fdbe8071540 msgr2=0x7fdbe8070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:25.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.146+0000 7fdbee400640 1 -- 172.21.15.76:0/212167369 shutdown_connections 2024-03-28T12:42:25.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.146+0000 7fdbee400640 1 -- 172.21.15.76:0/212167369 wait complete. 2024-03-28T12:42:25.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.146+0000 7fdbee400640 1 Processor -- start 2024-03-28T12:42:25.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.146+0000 7fdbee400640 1 -- start start 2024-03-28T12:42:25.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.146+0000 7fdbee400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbcc004d50 0x7fdbe81f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:25.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.146+0000 7fdbee400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbe8149d30 0x7fdbe814fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:25.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.146+0000 7fdbee400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdbe81500d0 0x7fdbe815a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:25.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.146+0000 7fdbee400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe80c8d00 con 0x7fdbcc004d50 2024-03-28T12:42:25.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.146+0000 7fdbee400640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe81591e0 con 0x7fdbe8149d30 2024-03-28T12:42:25.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.146+0000 7fdbee400640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe80c9c00 con 0x7fdbe81500d0 2024-03-28T12:42:25.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.146+0000 7fdbe7400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbcc004d50 0x7fdbe81f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:25.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.150+0000 7fdbe7400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbcc004d50 0x7fdbe81f3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48340/0 (socket says 172.21.15.76:48340) 2024-03-28T12:42:25.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.150+0000 7fdbe7400640 1 -- 172.21.15.76:0/3653528664 learned_addr learned my addr 172.21.15.76:0/3653528664 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:25.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.150+0000 7fdbe7e00640 1 --2- 172.21.15.76:0/3653528664 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdbe81500d0 0x7fdbe815a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:25.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.150+0000 7fdbe6a00640 1 --2- 172.21.15.76:0/3653528664 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbe8149d30 0x7fdbe814fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:25.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.150+0000 7fdbe7400640 1 -- 172.21.15.76:0/3653528664 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdbe81500d0 msgr2=0x7fdbe815a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:25.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.150+0000 7fdbe7400640 1 --2- 172.21.15.76:0/3653528664 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdbe81500d0 0x7fdbe815a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.150+0000 7fdbe7400640 1 -- 172.21.15.76:0/3653528664 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbe8149d30 msgr2=0x7fdbe814fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:25.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.150+0000 7fdbe7400640 1 --2- 172.21.15.76:0/3653528664 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbe8149d30 0x7fdbe814fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.150+0000 7fdbe7400640 1 -- 172.21.15.76:0/3653528664 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe81f4520 con 0x7fdbcc004d50 2024-03-28T12:42:25.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.154+0000 7fdbe7400640 1 --2- 172.21.15.76:0/3653528664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbcc004d50 0x7fdbe81f3fe0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800e7f0 tx=0x7fdbd800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:25.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.158+0000 7fdbdf400640 1 -- 172.21.15.76:0/3653528664 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8017070 con 0x7fdbcc004d50 2024-03-28T12:42:25.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.158+0000 7fdbdf400640 1 -- 172.21.15.76:0/3653528664 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd800c860 con 0x7fdbcc004d50 2024-03-28T12:42:25.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.158+0000 7fdbdf400640 1 -- 172.21.15.76:0/3653528664 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd800cc50 con 0x7fdbcc004d50 2024-03-28T12:42:25.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.158+0000 7fdbee400640 1 -- 172.21.15.76:0/3653528664 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe8159840 con 0x7fdbcc004d50 2024-03-28T12:42:25.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.158+0000 7fdbee400640 1 -- 172.21.15.76:0/3653528664 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe8159de0 con 0x7fdbcc004d50 2024-03-28T12:42:25.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.158+0000 7fdbee400640 1 -- 172.21.15.76:0/3653528664 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe80686e0 con 0x7fdbcc004d50 2024-03-28T12:42:25.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.178+0000 7fdbdf400640 1 -- 172.21.15.76:0/3653528664 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fdbd801a070 con 0x7fdbcc004d50 2024-03-28T12:42:25.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.178+0000 7fdbdf400640 1 --2- 172.21.15.76:0/3653528664 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdbc8068040 0x7fdbc806a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:25.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.178+0000 7fdbe6a00640 1 --2- 172.21.15.76:0/3653528664 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdbc8068040 0x7fdbc806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:25.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.182+0000 7fdbe6a00640 1 --2- 172.21.15.76:0/3653528664 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdbc8068040 0x7fdbc806a500 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4001ec0 tx=0x7fdbd4001960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:25.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.418+0000 7fdbdf400640 1 -- 172.21.15.76:0/3653528664 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fdbd8054c80 con 0x7fdbcc004d50 2024-03-28T12:42:25.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.418+0000 7fdbdf400640 1 -- 172.21.15.76:0/3653528664 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fdbd8056be0 con 0x7fdbcc004d50 2024-03-28T12:42:25.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.586+0000 7fdbee400640 1 -- 172.21.15.76:0/3653528664 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdbe815a4f0 con 0x7fdbcc004d50 2024-03-28T12:42:25.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.590+0000 7fdbdf400640 1 -- 172.21.15.76:0/3653528664 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fdbd805aee0 con 0x7fdbcc004d50 2024-03-28T12:42:25.590 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-03-28T12:42:25.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.594+0000 7fdbee400640 1 -- 172.21.15.76:0/3653528664 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdbc8068040 msgr2=0x7fdbc806a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.594+0000 7fdbee400640 1 --2- 172.21.15.76:0/3653528664 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdbc8068040 0x7fdbc806a500 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4001ec0 tx=0x7fdbd4001960 comp rx=0 tx=0).stop 2024-03-28T12:42:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.594+0000 7fdbee400640 1 -- 172.21.15.76:0/3653528664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbcc004d50 msgr2=0x7fdbe81f3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.594+0000 7fdbee400640 1 --2- 172.21.15.76:0/3653528664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbcc004d50 0x7fdbe81f3fe0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800e7f0 tx=0x7fdbd800ecb0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.594+0000 7fdbee400640 1 -- 172.21.15.76:0/3653528664 shutdown_connections 2024-03-28T12:42:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.594+0000 7fdbee400640 1 --2- 172.21.15.76:0/3653528664 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdbc8068040 0x7fdbc806a500 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.594+0000 7fdbee400640 1 --2- 172.21.15.76:0/3653528664 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdbe81500d0 0x7fdbe815a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.594+0000 7fdbee400640 1 --2- 172.21.15.76:0/3653528664 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdbe8149d30 0x7fdbe814fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.594+0000 7fdbee400640 1 --2- 172.21.15.76:0/3653528664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdbcc004d50 0x7fdbe81f3fe0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.594+0000 7fdbee400640 1 -- 172.21.15.76:0/3653528664 >> 172.21.15.76:0/3653528664 conn(0x7fdbe8071540 msgr2=0x7fdbe814dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.594+0000 7fdbee400640 1 -- 172.21.15.76:0/3653528664 shutdown_connections 2024-03-28T12:42:25.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.594+0000 7fdbee400640 1 -- 172.21.15.76:0/3653528664 wait complete. 2024-03-28T12:42:25.612 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-28T12:42:25.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.758+0000 7f82efe00640 1 Processor -- start 2024-03-28T12:42:25.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.758+0000 7f82efe00640 1 -- start start 2024-03-28T12:42:25.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.758+0000 7f82efe00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f82f0071e00 0x7f82f00c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:25.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.758+0000 7f82efe00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f82f00721e0 0x7f82f0158a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:25.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.758+0000 7f82efe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f82f00ca0b0 0x7f82f0158f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:25.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.758+0000 7f82efe00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f82f015bd90 con 0x7f82f00721e0 2024-03-28T12:42:25.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.758+0000 7f82efe00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f82f015c030 con 0x7f82f0071e00 2024-03-28T12:42:25.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.758+0000 7f82efe00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f82f015c310 con 0x7f82f00ca0b0 2024-03-28T12:42:25.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.762+0000 7f82e6000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f82f00721e0 0x7f82f0158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:25.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.762+0000 7f82e6000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f82f00721e0 0x7f82f0158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48352/0 (socket says 172.21.15.76:48352) 2024-03-28T12:42:25.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.762+0000 7f82e6000640 1 -- 172.21.15.76:0/100286654 learned_addr learned my addr 172.21.15.76:0/100286654 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:25.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.762+0000 7f82ef400640 1 --2- 172.21.15.76:0/100286654 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f82f00ca0b0 0x7f82f0158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:25.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.762+0000 7f82eea00640 1 --2- 172.21.15.76:0/100286654 >> v2:172.21.15.111:3300/0 conn(0x7f82f0071e00 0x7f82f00c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:25.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.766+0000 7f82e6000640 1 -- 172.21.15.76:0/100286654 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f82f00ca0b0 msgr2=0x7f82f0158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:25.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.766+0000 7f82e6000640 1 --2- 172.21.15.76:0/100286654 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f82f00ca0b0 0x7f82f0158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.766+0000 7f82e6000640 1 -- 172.21.15.76:0/100286654 >> v2:172.21.15.111:3300/0 conn(0x7f82f0071e00 msgr2=0x7f82f00c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:25.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.766+0000 7f82e6000640 1 --2- 172.21.15.76:0/100286654 >> v2:172.21.15.111:3300/0 conn(0x7f82f0071e00 0x7f82f00c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.766+0000 7f82e6000640 1 -- 172.21.15.76:0/100286654 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f015c5f0 con 0x7f82f00721e0 2024-03-28T12:42:25.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.770+0000 7f82e6000640 1 --2- 172.21.15.76:0/100286654 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82f00721e0 0x7f82f0158a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f82f00680a0 tx=0x7f82d801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472f3a61be8a633 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:25.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.774+0000 7f82ee000640 1 -- 172.21.15.76:0/100286654 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d80a5780 con 0x7f82f00721e0 2024-03-28T12:42:25.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.774+0000 7f82ee000640 1 -- 172.21.15.76:0/100286654 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d80a5920 con 0x7f82f00721e0 2024-03-28T12:42:25.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.774+0000 7f82ee000640 1 -- 172.21.15.76:0/100286654 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d80a5cf0 con 0x7f82f00721e0 2024-03-28T12:42:25.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.774+0000 7f82efe00640 1 -- 172.21.15.76:0/100286654 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82f00721e0 msgr2=0x7f82f0158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:25.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.774+0000 7f82efe00640 1 --2- 172.21.15.76:0/100286654 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82f00721e0 0x7f82f0158a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f82f00680a0 tx=0x7f82d801c9f0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.774+0000 7f82efe00640 1 -- 172.21.15.76:0/100286654 shutdown_connections 2024-03-28T12:42:25.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.774+0000 7f82efe00640 1 --2- 172.21.15.76:0/100286654 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f82f00ca0b0 0x7f82f0158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.774+0000 7f82efe00640 1 --2- 172.21.15.76:0/100286654 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82f00721e0 0x7f82f0158a00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.774+0000 7f82efe00640 1 --2- 172.21.15.76:0/100286654 >> v2:172.21.15.111:3300/0 conn(0x7f82f0071e00 0x7f82f00c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.774+0000 7f82efe00640 1 -- 172.21.15.76:0/100286654 >> 172.21.15.76:0/100286654 conn(0x7f82f0067330 msgr2=0x7f82f0067740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:25.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.774+0000 7f82efe00640 1 -- 172.21.15.76:0/100286654 shutdown_connections 2024-03-28T12:42:25.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.774+0000 7f82efe00640 1 -- 172.21.15.76:0/100286654 wait complete. 2024-03-28T12:42:25.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.778+0000 7f82efe00640 1 Processor -- start 2024-03-28T12:42:25.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.778+0000 7f82efe00640 1 -- start start 2024-03-28T12:42:25.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.778+0000 7f82efe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f82f0071e00 0x7f82f00b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:25.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.778+0000 7f82efe00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82f00721e0 0x7f82f00ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:25.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.778+0000 7f82efe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82f00ca0b0 0x7f82f00cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:25.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.778+0000 7f82efe00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f82f00c3750 con 0x7f82f00ca0b0 2024-03-28T12:42:25.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.778+0000 7f82efe00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f82f0152c70 con 0x7f82f00721e0 2024-03-28T12:42:25.776 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.778+0000 7f82efe00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f82f00ca7c0 con 0x7f82f0071e00 2024-03-28T12:42:25.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.778+0000 7f82ef400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82f00ca0b0 0x7f82f00cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:25.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.778+0000 7f82ef400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82f00ca0b0 0x7f82f00cd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48362/0 (socket says 172.21.15.76:48362) 2024-03-28T12:42:25.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.778+0000 7f82ef400640 1 -- 172.21.15.76:0/3617785462 learned_addr learned my addr 172.21.15.76:0/3617785462 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:25.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.778+0000 7f82e6000640 1 --2- 172.21.15.76:0/3617785462 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82f00721e0 0x7f82f00ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:25.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.778+0000 7f82eea00640 1 --2- 172.21.15.76:0/3617785462 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f82f0071e00 0x7f82f00b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:25.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.782+0000 7f82ef400640 1 -- 172.21.15.76:0/3617785462 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f82f0071e00 msgr2=0x7f82f00b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:25.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.782+0000 7f82ef400640 1 --2- 172.21.15.76:0/3617785462 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f82f0071e00 0x7f82f00b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.782+0000 7f82ef400640 1 -- 172.21.15.76:0/3617785462 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82f00721e0 msgr2=0x7f82f00ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:25.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.782+0000 7f82ef400640 1 --2- 172.21.15.76:0/3617785462 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82f00721e0 0x7f82f00ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:25.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.782+0000 7f82ef400640 1 -- 172.21.15.76:0/3617785462 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f0143840 con 0x7f82f00ca0b0 2024-03-28T12:42:25.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.782+0000 7f82ef400640 1 --2- 172.21.15.76:0/3617785462 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82f00ca0b0 0x7f82f00cd080 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f82e800e7f0 tx=0x7f82e800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:25.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.790+0000 7f82e7e00640 1 -- 172.21.15.76:0/3617785462 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e8017070 con 0x7f82f00ca0b0 2024-03-28T12:42:25.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.790+0000 7f82e7e00640 1 -- 172.21.15.76:0/3617785462 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e800c940 con 0x7f82f00ca0b0 2024-03-28T12:42:25.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.790+0000 7f82e7e00640 1 -- 172.21.15.76:0/3617785462 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e800eea0 con 0x7f82f00ca0b0 2024-03-28T12:42:25.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.790+0000 7f82efe00640 1 -- 172.21.15.76:0/3617785462 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f0143b20 con 0x7f82f00ca0b0 2024-03-28T12:42:25.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.790+0000 7f82efe00640 1 -- 172.21.15.76:0/3617785462 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f01440e0 con 0x7f82f00ca0b0 2024-03-28T12:42:25.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.790+0000 7f82efe00640 1 -- 172.21.15.76:0/3617785462 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f00cc650 con 0x7f82f00ca0b0 2024-03-28T12:42:25.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.814+0000 7f82e7e00640 1 -- 172.21.15.76:0/3617785462 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f82e801a070 con 0x7f82f00ca0b0 2024-03-28T12:42:25.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.814+0000 7f82e7e00640 1 --2- 172.21.15.76:0/3617785462 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f82cc067ff0 0x7f82cc06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:25.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.814+0000 7f82eea00640 1 --2- 172.21.15.76:0/3617785462 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f82cc067ff0 0x7f82cc06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:25.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.814+0000 7f82eea00640 1 --2- 172.21.15.76:0/3617785462 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f82cc067ff0 0x7f82cc06a4b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009ae0 tx=0x7f82e0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:25.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:25.818+0000 7f82e7e00640 1 -- 172.21.15.76:0/3617785462 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f82e8054d10 con 0x7f82f00ca0b0 2024-03-28T12:42:26.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.062+0000 7f82e7e00640 1 -- 172.21.15.76:0/3617785462 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f82e8056c70 con 0x7f82f00ca0b0 2024-03-28T12:42:26.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.230+0000 7f82efe00640 1 -- 172.21.15.76:0/3617785462 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f82f0068df0 con 0x7f82f00ca0b0 2024-03-28T12:42:26.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.234+0000 7f82e7e00640 1 -- 172.21.15.76:0/3617785462 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f82e805af70 con 0x7f82f00ca0b0 2024-03-28T12:42:26.233 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-03-28T12:42:26.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.238+0000 7f82efe00640 1 -- 172.21.15.76:0/3617785462 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f82cc067ff0 msgr2=0x7f82cc06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:26.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.238+0000 7f82efe00640 1 --2- 172.21.15.76:0/3617785462 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f82cc067ff0 0x7f82cc06a4b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009ae0 tx=0x7f82e0009190 comp rx=0 tx=0).stop 2024-03-28T12:42:26.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.238+0000 7f82efe00640 1 -- 172.21.15.76:0/3617785462 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82f00ca0b0 msgr2=0x7f82f00cd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:26.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.238+0000 7f82efe00640 1 --2- 172.21.15.76:0/3617785462 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82f00ca0b0 0x7f82f00cd080 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f82e800e7f0 tx=0x7f82e800ecb0 comp rx=0 tx=0).stop 2024-03-28T12:42:26.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.238+0000 7f82efe00640 1 -- 172.21.15.76:0/3617785462 shutdown_connections 2024-03-28T12:42:26.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.238+0000 7f82efe00640 1 --2- 172.21.15.76:0/3617785462 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f82cc067ff0 0x7f82cc06a4b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:26.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.238+0000 7f82efe00640 1 --2- 172.21.15.76:0/3617785462 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f82f00ca0b0 0x7f82f00cd080 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:26.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.238+0000 7f82efe00640 1 --2- 172.21.15.76:0/3617785462 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82f00721e0 0x7f82f00ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:26.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.238+0000 7f82efe00640 1 --2- 172.21.15.76:0/3617785462 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f82f0071e00 0x7f82f00b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:26.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.238+0000 7f82efe00640 1 -- 172.21.15.76:0/3617785462 >> 172.21.15.76:0/3617785462 conn(0x7f82f0067330 msgr2=0x7f82f014da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:26.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.238+0000 7f82efe00640 1 -- 172.21.15.76:0/3617785462 shutdown_connections 2024-03-28T12:42:26.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.238+0000 7f82efe00640 1 -- 172.21.15.76:0/3617785462 wait complete. 2024-03-28T12:42:26.255 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-28T12:42:26.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.394+0000 7fdf34800640 1 Processor -- start 2024-03-28T12:42:26.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.394+0000 7fdf34800640 1 -- start start 2024-03-28T12:42:26.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.394+0000 7fdf34800640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fdf2c071f60 0x7fdf2c15b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:26.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.394+0000 7fdf34800640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf2c15b820 con 0x7fdf2c072340 2024-03-28T12:42:26.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.394+0000 7fdf34800640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf2c0cef50 con 0x7fdf2c0c8ae0 2024-03-28T12:42:26.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.394+0000 7fdf34800640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fdf2c06d7f0 con 0x7fdf2c071f60 2024-03-28T12:42:26.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.394+0000 7fdf31400640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fdf2c072340 0x7fdf2c0c3550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:35102/0 (socket says 172.21.15.76:35102) 2024-03-28T12:42:26.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.394+0000 7fdf31400640 1 -- 172.21.15.76:0/3548099688 learned_addr learned my addr 172.21.15.76:0/3548099688 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:26.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.394+0000 7fdf31e00640 1 --2- 172.21.15.76:0/3548099688 >> v2:172.21.15.111:3300/0 conn(0x7fdf2c071f60 0x7fdf2c15b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:26.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.398+0000 7fdf30a00640 1 -- 172.21.15.76:0/3548099688 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3291786249 0 0) 0x7fdf1c001120 con 0x7fdf2c072340 2024-03-28T12:42:26.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.398+0000 7fdf30a00640 1 -- 172.21.15.76:0/3548099688 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf14003530 con 0x7fdf2c072340 2024-03-28T12:42:26.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.402+0000 7fdf30a00640 1 -- 172.21.15.76:0/3548099688 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2852833702 0 0) 0x7fdf14003530 con 0x7fdf2c072340 2024-03-28T12:42:26.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.402+0000 7fdf30a00640 1 -- 172.21.15.76:0/3548099688 >> v2:172.21.15.111:3300/0 conn(0x7fdf2c071f60 msgr2=0x7fdf2c15b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:26.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.402+0000 7fdf30a00640 1 --2- 172.21.15.76:0/3548099688 >> v2:172.21.15.111:3300/0 conn(0x7fdf2c071f60 0x7fdf2c15b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:26.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.402+0000 7fdf30a00640 1 -- 172.21.15.76:0/3548099688 >> v1:172.21.15.111:6789/0 conn(0x7fdf2c0c8ae0 legacy=0x7fdf2c154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:26.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.402+0000 7fdf30a00640 1 -- 172.21.15.76:0/3548099688 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2c06c750 con 0x7fdf2c072340 2024-03-28T12:42:26.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.402+0000 7fdf30a00640 1 -- 172.21.15.76:0/3548099688 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7fdf1c001850 con 0x7fdf2c072340 2024-03-28T12:42:26.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.402+0000 7fdf30a00640 1 -- 172.21.15.76:0/3548099688 >> v1:172.21.15.76:6789/0 conn(0x7fdf2c072340 legacy=0x7fdf2c0c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:26.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.402+0000 7fdf30a00640 1 --2- 172.21.15.76:0/3548099688 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf14003a80 0x7fdf14003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:26.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.402+0000 7fdf30a00640 1 --2- 172.21.15.76:0/3548099688 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf14004810 0x7fdf14004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:26.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.402+0000 7fdf30a00640 1 --2- 172.21.15.76:0/3548099688 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf14005220 0x7fdf1400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:26.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.402+0000 7fdf30a00640 1 -- 172.21.15.76:0/3548099688 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c06d7f0 con 0x7fdf14004810 2024-03-28T12:42:26.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.402+0000 7fdf30a00640 1 -- 172.21.15.76:0/3548099688 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1400c130 con 0x7fdf14005220 2024-03-28T12:42:26.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.402+0000 7fdf30a00640 1 -- 172.21.15.76:0/3548099688 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fdf1400c330 con 0x7fdf14003a80 2024-03-28T12:42:26.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.402+0000 7fdf31e00640 1 --2- 172.21.15.76:0/3548099688 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf14003a80 0x7fdf14003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:26.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.406+0000 7fdf31400640 1 --2- 172.21.15.76:0/3548099688 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf14004810 0x7fdf14004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:26.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.410+0000 7fdf31400640 1 -- 172.21.15.76:0/3548099688 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf14003a80 msgr2=0x7fdf14003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:26.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.410+0000 7fdf31400640 1 --2- 172.21.15.76:0/3548099688 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf14003a80 0x7fdf14003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:26.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.410+0000 7fdf31400640 1 -- 172.21.15.76:0/3548099688 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf14005220 msgr2=0x7fdf1400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:26.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.410+0000 7fdf31400640 1 --2- 172.21.15.76:0/3548099688 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf14005220 0x7fdf1400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:26.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.410+0000 7fdf31400640 1 -- 172.21.15.76:0/3548099688 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf14003530 con 0x7fdf14004810 2024-03-28T12:42:26.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.410+0000 7fdf32800640 1 -- 172.21.15.76:0/3548099688 reap_dead start 2024-03-28T12:42:26.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.414+0000 7fdf31400640 1 --2- 172.21.15.76:0/3548099688 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf14004810 0x7fdf14004c90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00c2f0 tx=0x7fdf1c01cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db88681342b381d0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:26.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.418+0000 7fdf30a00640 1 -- 172.21.15.76:0/3548099688 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c007e20 con 0x7fdf14004810 2024-03-28T12:42:26.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.418+0000 7fdf30a00640 1 -- 172.21.15.76:0/3548099688 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf1c0a9070 con 0x7fdf14004810 2024-03-28T12:42:26.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.418+0000 7fdf30a00640 1 -- 172.21.15.76:0/3548099688 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c005dc0 con 0x7fdf14004810 2024-03-28T12:42:26.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.418+0000 7fdf34800640 1 -- 172.21.15.76:0/3548099688 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf14004810 msgr2=0x7fdf14004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:26.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.418+0000 7fdf34800640 1 --2- 172.21.15.76:0/3548099688 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf14004810 0x7fdf14004c90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00c2f0 tx=0x7fdf1c01cb80 comp rx=0 tx=0).stop 2024-03-28T12:42:26.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.418+0000 7fdf34800640 1 -- 172.21.15.76:0/3548099688 shutdown_connections 2024-03-28T12:42:26.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.418+0000 7fdf34800640 1 --2- 172.21.15.76:0/3548099688 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf14004810 0x7fdf14004c90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:26.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.418+0000 7fdf34800640 1 -- 172.21.15.76:0/3548099688 >> 172.21.15.76:0/3548099688 conn(0x7fdf2c071540 msgr2=0x7fdf2c070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:26.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.418+0000 7fdf34800640 1 -- 172.21.15.76:0/3548099688 shutdown_connections 2024-03-28T12:42:26.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.418+0000 7fdf34800640 1 -- 172.21.15.76:0/3548099688 wait complete. 2024-03-28T12:42:26.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.418+0000 7fdf34800640 1 Processor -- start 2024-03-28T12:42:26.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.418+0000 7fdf34800640 1 -- start start 2024-03-28T12:42:26.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.422+0000 7fdf34800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf14004810 0x7fdf2c1f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:26.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.422+0000 7fdf34800640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf2c0b3360 0x7fdf2c1f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:26.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.422+0000 7fdf34800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf2c14de90 0x7fdf2c0b0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:26.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.422+0000 7fdf34800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c06cff0 con 0x7fdf2c14de90 2024-03-28T12:42:26.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.422+0000 7fdf34800640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c06cd10 con 0x7fdf2c0b3360 2024-03-28T12:42:26.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.422+0000 7fdf34800640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fdf2c0cea30 con 0x7fdf14004810 2024-03-28T12:42:26.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.422+0000 7fdf32800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf2c14de90 0x7fdf2c0b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:26.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.422+0000 7fdf32800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf2c14de90 0x7fdf2c0b0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:48390/0 (socket says 172.21.15.76:48390) 2024-03-28T12:42:26.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.422+0000 7fdf32800640 1 -- 172.21.15.76:0/902214197 learned_addr learned my addr 172.21.15.76:0/902214197 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:26.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.422+0000 7fdf31400640 1 --2- 172.21.15.76:0/902214197 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf2c0b3360 0x7fdf2c1f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:26.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.426+0000 7fdf32800640 1 -- 172.21.15.76:0/902214197 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf14004810 msgr2=0x7fdf2c1f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:26.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.426+0000 7fdf32800640 1 --2- 172.21.15.76:0/902214197 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf14004810 0x7fdf2c1f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:26.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.426+0000 7fdf32800640 1 -- 172.21.15.76:0/902214197 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf2c0b3360 msgr2=0x7fdf2c1f1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:26.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.426+0000 7fdf32800640 1 --2- 172.21.15.76:0/902214197 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf2c0b3360 0x7fdf2c1f1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:26.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.426+0000 7fdf32800640 1 -- 172.21.15.76:0/902214197 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2c0c4f90 con 0x7fdf2c14de90 2024-03-28T12:42:26.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.430+0000 7fdf32800640 1 --2- 172.21.15.76:0/902214197 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf2c14de90 0x7fdf2c0b0530 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0c3470 tx=0x7fdf2800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:26.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.434+0000 7fdf26000640 1 -- 172.21.15.76:0/902214197 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf28017070 con 0x7fdf2c14de90 2024-03-28T12:42:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.434+0000 7fdf26000640 1 -- 172.21.15.76:0/902214197 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf28005d70 con 0x7fdf2c14de90 2024-03-28T12:42:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.434+0000 7fdf26000640 1 -- 172.21.15.76:0/902214197 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800a7f0 con 0x7fdf2c14de90 2024-03-28T12:42:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.434+0000 7fdf34800640 1 -- 172.21.15.76:0/902214197 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2c14e310 con 0x7fdf2c14de90 2024-03-28T12:42:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.434+0000 7fdf34800640 1 -- 172.21.15.76:0/902214197 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf2c15e8a0 con 0x7fdf2c14de90 2024-03-28T12:42:26.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.434+0000 7fdf34800640 1 -- 172.21.15.76:0/902214197 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf2c0686e0 con 0x7fdf2c14de90 2024-03-28T12:42:26.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.454+0000 7fdf26000640 1 -- 172.21.15.76:0/902214197 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fdf2801a070 con 0x7fdf2c14de90 2024-03-28T12:42:26.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.454+0000 7fdf26000640 1 --2- 172.21.15.76:0/902214197 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdf10068040 0x7fdf1006a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:26.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.454+0000 7fdf31e00640 1 --2- 172.21.15.76:0/902214197 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdf10068040 0x7fdf1006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:26.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.458+0000 7fdf31e00640 1 --2- 172.21.15.76:0/902214197 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdf10068040 0x7fdf1006a500 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf20006e90 tx=0x7fdf20006e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:26.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.458+0000 7fdf26000640 1 -- 172.21.15.76:0/902214197 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fdf28053e00 con 0x7fdf2c14de90 2024-03-28T12:42:26.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.718+0000 7fdf26000640 1 -- 172.21.15.76:0/902214197 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fdf28021020 con 0x7fdf2c14de90 2024-03-28T12:42:26.899 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.898+0000 7fdf34800640 1 -- 172.21.15.76:0/902214197 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdf2c1523a0 con 0x7fdf2c14de90 2024-03-28T12:42:26.904 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.906+0000 7fdf26000640 1 -- 172.21.15.76:0/902214197 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fdf28055d60 con 0x7fdf2c14de90 2024-03-28T12:42:26.904 INFO:teuthology.orchestra.run.smithi076.stderr:listed 0 entries 2024-03-28T12:42:26.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.910+0000 7fdf34800640 1 -- 172.21.15.76:0/902214197 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdf10068040 msgr2=0x7fdf1006a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:26.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.910+0000 7fdf34800640 1 --2- 172.21.15.76:0/902214197 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdf10068040 0x7fdf1006a500 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf20006e90 tx=0x7fdf20006e00 comp rx=0 tx=0).stop 2024-03-28T12:42:26.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.910+0000 7fdf34800640 1 -- 172.21.15.76:0/902214197 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf2c14de90 msgr2=0x7fdf2c0b0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:26.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.910+0000 7fdf34800640 1 --2- 172.21.15.76:0/902214197 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf2c14de90 0x7fdf2c0b0530 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0c3470 tx=0x7fdf2800cb90 comp rx=0 tx=0).stop 2024-03-28T12:42:26.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.910+0000 7fdf34800640 1 -- 172.21.15.76:0/902214197 shutdown_connections 2024-03-28T12:42:26.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.910+0000 7fdf34800640 1 --2- 172.21.15.76:0/902214197 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdf10068040 0x7fdf1006a500 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:26.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.910+0000 7fdf34800640 1 --2- 172.21.15.76:0/902214197 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdf2c14de90 0x7fdf2c0b0530 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:26.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.910+0000 7fdf34800640 1 --2- 172.21.15.76:0/902214197 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf2c0b3360 0x7fdf2c1f1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:26.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.910+0000 7fdf34800640 1 --2- 172.21.15.76:0/902214197 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf14004810 0x7fdf2c1f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:26.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.910+0000 7fdf34800640 1 -- 172.21.15.76:0/902214197 >> 172.21.15.76:0/902214197 conn(0x7fdf2c071540 msgr2=0x7fdf2c070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:26.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.910+0000 7fdf34800640 1 -- 172.21.15.76:0/902214197 shutdown_connections 2024-03-28T12:42:26.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:26.910+0000 7fdf34800640 1 -- 172.21.15.76:0/902214197 wait complete. 2024-03-28T12:42:26.928 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi076.front.sepia.ceph.com... 2024-03-28T12:42:26.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:42:26.928 DEBUG:teuthology.orchestra.run.smithi076:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-03-28T12:42:26.956 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi076.stderr:ceph-fuse[32512]: fuse finished with error 0 and tester_r 0 2024-03-28T12:42:26.959 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T12:42:33.061 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi076.front.sepia.ceph.com 2024-03-28T12:42:33.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:42:33.061 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-03-28T12:42:33.076 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T12:42:33.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.258+0000 7f3657200640 1 Processor -- start 2024-03-28T12:42:33.258 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.258+0000 7f3657200640 1 -- start start 2024-03-28T12:42:33.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.262+0000 7f3657200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3658071e80 0x7f36581582a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:33.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.262+0000 7f3657200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f365815c090 0x7f3658152140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:33.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.262+0000 7f3657200640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36581588c0 con 0x7f3658072260 2024-03-28T12:42:33.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.262+0000 7f3657200640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f365815bc00 con 0x7f365815c090 2024-03-28T12:42:33.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.262+0000 7f3657200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f36580c8240 con 0x7f3658071e80 2024-03-28T12:42:33.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.262+0000 7f3656800640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f365815c090 0x7f3658152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:33.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.262+0000 7f364fe00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f3658072260 0x7f36580cb0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:50536/0 (socket says 172.21.15.76:50536) 2024-03-28T12:42:33.260 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.262+0000 7f364fe00640 1 -- 172.21.15.76:0/839122163 learned_addr learned my addr 172.21.15.76:0/839122163 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:33.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.266+0000 7f3656800640 1 -- 172.21.15.76:0/839122163 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3658071e80 msgr2=0x7f36581582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:33.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.266+0000 7f3656800640 1 --2- 172.21.15.76:0/839122163 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3658071e80 0x7f36581582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:33.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.266+0000 7f3656800640 1 -- 172.21.15.76:0/839122163 >> v1:172.21.15.76:6789/0 conn(0x7f3658072260 legacy=0x7f36580cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:33.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.266+0000 7f3656800640 1 -- 172.21.15.76:0/839122163 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3658158ba0 con 0x7f365815c090 2024-03-28T12:42:33.273 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.274+0000 7f3656800640 1 --2- 172.21.15.76:0/839122163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f365815c090 0x7f3658152140 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3650009d90 tx=0x7f365001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa055a05e29fd353 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:33.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.278+0000 7f3655400640 1 -- 172.21.15.76:0/839122163 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36500b4070 con 0x7f365815c090 2024-03-28T12:42:33.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.278+0000 7f3655400640 1 -- 172.21.15.76:0/839122163 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36500af600 con 0x7f365815c090 2024-03-28T12:42:33.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.278+0000 7f3655400640 1 -- 172.21.15.76:0/839122163 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36500af9d0 con 0x7f365815c090 2024-03-28T12:42:33.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.278+0000 7f3657200640 1 -- 172.21.15.76:0/839122163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f365815c090 msgr2=0x7f3658152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:33.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.278+0000 7f3657200640 1 --2- 172.21.15.76:0/839122163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f365815c090 0x7f3658152140 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3650009d90 tx=0x7f365001f150 comp rx=0 tx=0).stop 2024-03-28T12:42:33.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.278+0000 7f3657200640 1 -- 172.21.15.76:0/839122163 shutdown_connections 2024-03-28T12:42:33.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.278+0000 7f3657200640 1 --2- 172.21.15.76:0/839122163 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f365815c090 0x7f3658152140 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:33.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.278+0000 7f3657200640 1 --2- 172.21.15.76:0/839122163 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3658071e80 0x7f36581582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:33.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.278+0000 7f3657200640 1 -- 172.21.15.76:0/839122163 >> 172.21.15.76:0/839122163 conn(0x7f365806b770 msgr2=0x7f3658070330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:33.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.282+0000 7f3657200640 1 -- 172.21.15.76:0/839122163 shutdown_connections 2024-03-28T12:42:33.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.282+0000 7f3657200640 1 -- 172.21.15.76:0/839122163 wait complete. 2024-03-28T12:42:33.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.282+0000 7f3657200640 1 Processor -- start 2024-03-28T12:42:33.280 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.282+0000 7f3657200640 1 -- start start 2024-03-28T12:42:33.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.282+0000 7f3657200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3658071e80 0x7f36581579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:33.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.282+0000 7f3657200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3658072260 0x7f36581f0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:33.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.282+0000 7f3657200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f365815c090 0x7f365814b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:33.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.282+0000 7f3657200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f365815b890 con 0x7f3658071e80 2024-03-28T12:42:33.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.282+0000 7f3657200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f3658159160 con 0x7f3658072260 2024-03-28T12:42:33.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.282+0000 7f3657200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f36580c2d30 con 0x7f365815c090 2024-03-28T12:42:33.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.282+0000 7f3655e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3658071e80 0x7f36581579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:33.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.282+0000 7f3655e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3658071e80 0x7f36581579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39660/0 (socket says 172.21.15.76:39660) 2024-03-28T12:42:33.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.282+0000 7f3655e00640 1 -- 172.21.15.76:0/1720083425 learned_addr learned my addr 172.21.15.76:0/1720083425 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:33.285 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.286+0000 7f3655e00640 1 -- 172.21.15.76:0/1720083425 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f365815c090 msgr2=0x7f365814b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:33.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.286+0000 7f3655e00640 1 --2- 172.21.15.76:0/1720083425 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f365815c090 0x7f365814b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:33.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.286+0000 7f3655e00640 1 -- 172.21.15.76:0/1720083425 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3658072260 msgr2=0x7f36581f0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:33.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.286+0000 7f3655e00640 1 --2- 172.21.15.76:0/1720083425 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3658072260 0x7f36581f0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:33.286 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.286+0000 7f3655e00640 1 -- 172.21.15.76:0/1720083425 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36581580c0 con 0x7f3658071e80 2024-03-28T12:42:33.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.290+0000 7f3655e00640 1 --2- 172.21.15.76:0/1720083425 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3658071e80 0x7f36581579c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f364800b550 tx=0x7f364800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:33.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.294+0000 7f364e000640 1 -- 172.21.15.76:0/1720083425 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648014070 con 0x7f3658071e80 2024-03-28T12:42:33.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.294+0000 7f364e000640 1 -- 172.21.15.76:0/1720083425 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3648010890 con 0x7f3658071e80 2024-03-28T12:42:33.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.294+0000 7f364e000640 1 -- 172.21.15.76:0/1720083425 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648010c80 con 0x7f3658071e80 2024-03-28T12:42:33.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.294+0000 7f3657200640 1 -- 172.21.15.76:0/1720083425 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36581576e0 con 0x7f3658071e80 2024-03-28T12:42:33.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.294+0000 7f3657200640 1 -- 172.21.15.76:0/1720083425 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f365814b9f0 con 0x7f3658071e80 2024-03-28T12:42:33.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.294+0000 7f3657200640 1 -- 172.21.15.76:0/1720083425 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3658068df0 con 0x7f3658071e80 2024-03-28T12:42:33.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.542+0000 7f364e000640 1 -- 172.21.15.76:0/1720083425 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f3648017070 con 0x7f3658071e80 2024-03-28T12:42:33.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.542+0000 7f364e000640 1 --2- 172.21.15.76:0/1720083425 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3634068010 0x7f363406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:33.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.542+0000 7f364fe00640 1 --2- 172.21.15.76:0/1720083425 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3634068010 0x7f363406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:33.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.542+0000 7f364fe00640 1 --2- 172.21.15.76:0/1720083425 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3634068010 0x7f363406a4d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3640000f70 tx=0x7f3640007a90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:33.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.554+0000 7f364e000640 1 -- 172.21.15.76:0/1720083425 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f36480548e0 con 0x7f3658071e80 2024-03-28T12:42:33.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.554+0000 7f364e000640 1 -- 172.21.15.76:0/1720083425 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f3648056f40 con 0x7f3658071e80 2024-03-28T12:42:33.715 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.718+0000 7f3657200640 1 -- 172.21.15.76:0/1720083425 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3658152430 con 0x7f3658071e80 2024-03-28T12:42:33.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.758+0000 7f364e000640 1 -- 172.21.15.76:0/1720083425 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18798 (secure 0 0 0) 0x7f3648010e20 con 0x7f3658071e80 2024-03-28T12:42:33.756 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:33.756 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":29,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:42:15.156639+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T12:41:58.010965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T12:41:59.698601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-28T12:42:05.363180+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.1","mappings":[{"from":3,"to":4}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]},{"pgid":"4.d","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":5}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:42:33.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.758+0000 7f3657200640 1 -- 172.21.15.76:0/1720083425 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3634068010 msgr2=0x7f363406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:33.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.758+0000 7f3657200640 1 --2- 172.21.15.76:0/1720083425 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3634068010 0x7f363406a4d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3640000f70 tx=0x7f3640007a90 comp rx=0 tx=0).stop 2024-03-28T12:42:33.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.758+0000 7f3657200640 1 -- 172.21.15.76:0/1720083425 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3658071e80 msgr2=0x7f36581579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:33.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.758+0000 7f3657200640 1 --2- 172.21.15.76:0/1720083425 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3658071e80 0x7f36581579c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f364800b550 tx=0x7f364800ba10 comp rx=0 tx=0).stop 2024-03-28T12:42:33.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.758+0000 7f3657200640 1 -- 172.21.15.76:0/1720083425 shutdown_connections 2024-03-28T12:42:33.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.758+0000 7f3657200640 1 --2- 172.21.15.76:0/1720083425 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3634068010 0x7f363406a4d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:33.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.758+0000 7f3657200640 1 --2- 172.21.15.76:0/1720083425 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f365815c090 0x7f365814b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:33.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.758+0000 7f3657200640 1 --2- 172.21.15.76:0/1720083425 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3658072260 0x7f36581f0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:33.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.758+0000 7f3657200640 1 --2- 172.21.15.76:0/1720083425 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3658071e80 0x7f36581579c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:33.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.758+0000 7f3657200640 1 -- 172.21.15.76:0/1720083425 >> 172.21.15.76:0/1720083425 conn(0x7f365806b770 msgr2=0x7f3658151d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:33.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.758+0000 7f3657200640 1 -- 172.21.15.76:0/1720083425 shutdown_connections 2024-03-28T12:42:33.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.758+0000 7f3657200640 1 -- 172.21.15.76:0/1720083425 wait complete. 2024-03-28T12:42:33.779 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T12:42:33.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.918+0000 7f6d49800640 1 Processor -- start 2024-03-28T12:42:33.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.918+0000 7f6d49800640 1 -- start start 2024-03-28T12:42:33.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.918+0000 7f6d49800640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6d44072060 0x7f6d440cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:33.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.918+0000 7f6d49800640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f6d44072440 0x7f6d441524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:33.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.918+0000 7f6d49800640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d4415bf40 con 0x7f6d441592a0 2024-03-28T12:42:33.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.918+0000 7f6d49800640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f6d440c31e0 con 0x7f6d44072440 2024-03-28T12:42:33.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.918+0000 7f6d49800640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f6d4415c220 con 0x7f6d44072060 2024-03-28T12:42:33.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.918+0000 7f6d42000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f6d44072440 0x7f6d441524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:33.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.922+0000 7f6d42000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f6d44072440 0x7f6d441524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39670/0 (socket says 172.21.15.76:39670) 2024-03-28T12:42:33.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.922+0000 7f6d42000640 1 -- 172.21.15.76:0/2481013281 learned_addr learned my addr 172.21.15.76:0/2481013281 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:33.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.922+0000 7f6d42a00640 1 --2- 172.21.15.76:0/2481013281 >> v2:172.21.15.111:3300/0 conn(0x7f6d44072060 0x7f6d440cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:33.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.922+0000 7f6d42000640 1 -- 172.21.15.76:0/2481013281 >> v2:172.21.15.111:3300/0 conn(0x7f6d44072060 msgr2=0x7f6d440cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:33.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.922+0000 7f6d42000640 1 --2- 172.21.15.76:0/2481013281 >> v2:172.21.15.111:3300/0 conn(0x7f6d44072060 0x7f6d440cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:33.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.922+0000 7f6d42000640 1 -- 172.21.15.76:0/2481013281 >> v1:172.21.15.111:6789/0 conn(0x7f6d441592a0 legacy=0x7f6d440c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:33.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.922+0000 7f6d42000640 1 -- 172.21.15.76:0/2481013281 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4415c500 con 0x7f6d44072440 2024-03-28T12:42:33.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.926+0000 7f6d42000640 1 --2- 172.21.15.76:0/2481013281 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d44072440 0x7f6d441524b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009870 tx=0x7f6d3001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7332ca644a41acf6 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:33.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.930+0000 7f6d41600640 1 -- 172.21.15.76:0/2481013281 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d300ab5f0 con 0x7f6d44072440 2024-03-28T12:42:33.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.930+0000 7f6d41600640 1 -- 172.21.15.76:0/2481013281 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d300b0070 con 0x7f6d44072440 2024-03-28T12:42:33.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.930+0000 7f6d41600640 1 -- 172.21.15.76:0/2481013281 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d300ab9b0 con 0x7f6d44072440 2024-03-28T12:42:33.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.930+0000 7f6d49800640 1 -- 172.21.15.76:0/2481013281 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d44072440 msgr2=0x7f6d441524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:33.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.930+0000 7f6d49800640 1 --2- 172.21.15.76:0/2481013281 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d44072440 0x7f6d441524b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009870 tx=0x7f6d3001c4e0 comp rx=0 tx=0).stop 2024-03-28T12:42:33.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.930+0000 7f6d49800640 1 -- 172.21.15.76:0/2481013281 shutdown_connections 2024-03-28T12:42:33.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.930+0000 7f6d49800640 1 --2- 172.21.15.76:0/2481013281 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d44072440 0x7f6d441524b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:33.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.930+0000 7f6d49800640 1 --2- 172.21.15.76:0/2481013281 >> v2:172.21.15.111:3300/0 conn(0x7f6d44072060 0x7f6d440cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:33.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.930+0000 7f6d49800640 1 -- 172.21.15.76:0/2481013281 >> 172.21.15.76:0/2481013281 conn(0x7f6d44071520 msgr2=0x7f6d44070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:33.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.930+0000 7f6d49800640 1 -- 172.21.15.76:0/2481013281 shutdown_connections 2024-03-28T12:42:33.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.930+0000 7f6d49800640 1 -- 172.21.15.76:0/2481013281 wait complete. 2024-03-28T12:42:33.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.934+0000 7f6d49800640 1 Processor -- start 2024-03-28T12:42:33.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.934+0000 7f6d49800640 1 -- start start 2024-03-28T12:42:33.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.934+0000 7f6d49800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d44072060 0x7f6d44161da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:33.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.934+0000 7f6d49800640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d44072440 0x7f6d4414b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:33.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.934+0000 7f6d49800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d441592a0 0x7f6d440b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:33.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.934+0000 7f6d49800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6d44165860 con 0x7f6d441592a0 2024-03-28T12:42:33.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.934+0000 7f6d49800640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6d441656e0 con 0x7f6d44072440 2024-03-28T12:42:33.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.934+0000 7f6d49800640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6d441659e0 con 0x7f6d44072060 2024-03-28T12:42:33.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.934+0000 7f6d43400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d441592a0 0x7f6d440b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:33.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.934+0000 7f6d43400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d441592a0 0x7f6d440b2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39674/0 (socket says 172.21.15.76:39674) 2024-03-28T12:42:33.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.934+0000 7f6d43400640 1 -- 172.21.15.76:0/3302271988 learned_addr learned my addr 172.21.15.76:0/3302271988 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:33.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.934+0000 7f6d42a00640 1 --2- 172.21.15.76:0/3302271988 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d44072060 0x7f6d44161da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:33.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.938+0000 7f6d42000640 1 --2- 172.21.15.76:0/3302271988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d44072440 0x7f6d4414b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:33.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.938+0000 7f6d43400640 1 -- 172.21.15.76:0/3302271988 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d44072060 msgr2=0x7f6d44161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:33.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.938+0000 7f6d43400640 1 --2- 172.21.15.76:0/3302271988 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d44072060 0x7f6d44161da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:33.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.938+0000 7f6d43400640 1 -- 172.21.15.76:0/3302271988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d44072440 msgr2=0x7f6d4414b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:33.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.938+0000 7f6d43400640 1 --2- 172.21.15.76:0/3302271988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d44072440 0x7f6d4414b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:33.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.938+0000 7f6d43400640 1 -- 172.21.15.76:0/3302271988 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d441625f0 con 0x7f6d441592a0 2024-03-28T12:42:33.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.942+0000 7f6d43400640 1 --2- 172.21.15.76:0/3302271988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d441592a0 0x7f6d440b2c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00c7b0 tx=0x7f6d3c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:33.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.946+0000 7f6d3aa00640 1 -- 172.21.15.76:0/3302271988 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c017070 con 0x7f6d441592a0 2024-03-28T12:42:33.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.946+0000 7f6d3aa00640 1 -- 172.21.15.76:0/3302271988 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3c003db0 con 0x7f6d441592a0 2024-03-28T12:42:33.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.946+0000 7f6d3aa00640 1 -- 172.21.15.76:0/3302271988 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00ce60 con 0x7f6d441592a0 2024-03-28T12:42:33.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.946+0000 7f6d49800640 1 -- 172.21.15.76:0/3302271988 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d4406c750 con 0x7f6d441592a0 2024-03-28T12:42:33.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.946+0000 7f6d49800640 1 -- 172.21.15.76:0/3302271988 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d441615c0 con 0x7f6d441592a0 2024-03-28T12:42:33.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.946+0000 7f6d49800640 1 -- 172.21.15.76:0/3302271988 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d440686e0 con 0x7f6d441592a0 2024-03-28T12:42:33.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.970+0000 7f6d3aa00640 1 -- 172.21.15.76:0/3302271988 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f6d3c01a070 con 0x7f6d441592a0 2024-03-28T12:42:33.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.974+0000 7f6d3aa00640 1 --2- 172.21.15.76:0/3302271988 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6d24068010 0x7f6d2406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:33.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.974+0000 7f6d42a00640 1 --2- 172.21.15.76:0/3302271988 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6d24068010 0x7f6d2406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:33.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.974+0000 7f6d42a00640 1 --2- 172.21.15.76:0/3302271988 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6d24068010 0x7f6d2406a4d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6d340079c0 tx=0x7f6d34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:33.973 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:33.974+0000 7f6d3aa00640 1 -- 172.21.15.76:0/3302271988 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f6d3c0540e0 con 0x7f6d441592a0 2024-03-28T12:42:34.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.214+0000 7f6d3aa00640 1 -- 172.21.15.76:0/3302271988 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f6d3c021020 con 0x7f6d441592a0 2024-03-28T12:42:34.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.390+0000 7f6d49800640 1 -- 172.21.15.76:0/3302271988 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d44070390 con 0x7f6d441592a0 2024-03-28T12:42:34.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.458+0000 7f6d3aa00640 1 -- 172.21.15.76:0/3302271988 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18798 (secure 0 0 0) 0x7f6d3c056040 con 0x7f6d441592a0 2024-03-28T12:42:34.459 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:34.459 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":29,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:42:15.156639+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T12:41:58.010965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T12:41:59.698601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-28T12:42:05.363180+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.1","mappings":[{"from":3,"to":4}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]},{"pgid":"4.d","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":5}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:42:34.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.462+0000 7f6d49800640 1 -- 172.21.15.76:0/3302271988 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6d24068010 msgr2=0x7f6d2406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:34.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.462+0000 7f6d49800640 1 --2- 172.21.15.76:0/3302271988 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6d24068010 0x7f6d2406a4d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6d340079c0 tx=0x7f6d34008040 comp rx=0 tx=0).stop 2024-03-28T12:42:34.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.462+0000 7f6d49800640 1 -- 172.21.15.76:0/3302271988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d441592a0 msgr2=0x7f6d440b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:34.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.462+0000 7f6d49800640 1 --2- 172.21.15.76:0/3302271988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d441592a0 0x7f6d440b2c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00c7b0 tx=0x7f6d3c00cc70 comp rx=0 tx=0).stop 2024-03-28T12:42:34.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.462+0000 7f6d49800640 1 -- 172.21.15.76:0/3302271988 shutdown_connections 2024-03-28T12:42:34.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.462+0000 7f6d49800640 1 --2- 172.21.15.76:0/3302271988 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6d24068010 0x7f6d2406a4d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:34.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.462+0000 7f6d49800640 1 --2- 172.21.15.76:0/3302271988 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6d441592a0 0x7f6d440b2c40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:34.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.462+0000 7f6d49800640 1 --2- 172.21.15.76:0/3302271988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6d44072440 0x7f6d4414b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:34.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.462+0000 7f6d49800640 1 --2- 172.21.15.76:0/3302271988 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6d44072060 0x7f6d44161da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:34.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.462+0000 7f6d49800640 1 -- 172.21.15.76:0/3302271988 >> 172.21.15.76:0/3302271988 conn(0x7f6d44071520 msgr2=0x7f6d44156470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:34.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.462+0000 7f6d49800640 1 -- 172.21.15.76:0/3302271988 shutdown_connections 2024-03-28T12:42:34.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.462+0000 7f6d49800640 1 -- 172.21.15.76:0/3302271988 wait complete. 2024-03-28T12:42:34.481 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-28T12:42:34.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.622+0000 7fa9c6400640 1 Processor -- start 2024-03-28T12:42:34.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.622+0000 7fa9c6400640 1 -- start start 2024-03-28T12:42:34.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.622+0000 7fa9c6400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fa9c0071f60 0x7fa9c015b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:34.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.622+0000 7fa9c6400640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa9c0072340 0x7fa9c00c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:34.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.622+0000 7fa9c6400640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9c015b820 con 0x7fa9c00c8ae0 2024-03-28T12:42:34.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.622+0000 7fa9c6400640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fa9c00cef50 con 0x7fa9c0071f60 2024-03-28T12:42:34.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.622+0000 7fa9c6400640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fa9c006d7f0 con 0x7fa9c0072340 2024-03-28T12:42:34.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.626+0000 7fa9bf400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fa9c0071f60 0x7fa9c015b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:34.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.626+0000 7fa9bf400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fa9c0071f60 0x7fa9c015b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39678/0 (socket says 172.21.15.76:39678) 2024-03-28T12:42:34.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.626+0000 7fa9bf400640 1 -- 172.21.15.76:0/1834391837 learned_addr learned my addr 172.21.15.76:0/1834391837 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:34.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.626+0000 7fa9b7e00640 1 --2- 172.21.15.76:0/1834391837 >> v2:172.21.15.111:3300/0 conn(0x7fa9c0072340 0x7fa9c00c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:34.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.626+0000 7fa9bf400640 1 -- 172.21.15.76:0/1834391837 >> v2:172.21.15.111:3300/0 conn(0x7fa9c0072340 msgr2=0x7fa9c00c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:34.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.626+0000 7fa9bf400640 1 --2- 172.21.15.76:0/1834391837 >> v2:172.21.15.111:3300/0 conn(0x7fa9c0072340 0x7fa9c00c3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:34.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.626+0000 7fa9bf400640 1 -- 172.21.15.76:0/1834391837 >> v1:172.21.15.111:6789/0 conn(0x7fa9c00c8ae0 legacy=0x7fa9c0154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:34.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.626+0000 7fa9bf400640 1 -- 172.21.15.76:0/1834391837 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c006c750 con 0x7fa9c0071f60 2024-03-28T12:42:34.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.630+0000 7fa9bf400640 1 --2- 172.21.15.76:0/1834391837 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9c0071f60 0x7fa9c015b2e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009870 tx=0x7fa9b001eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8d36bc77d7ac59 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:34.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.634+0000 7fa9bea00640 1 -- 172.21.15.76:0/1834391837 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00b5070 con 0x7fa9c0071f60 2024-03-28T12:42:34.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.634+0000 7fa9bea00640 1 -- 172.21.15.76:0/1834391837 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b00a87f0 con 0x7fa9c0071f60 2024-03-28T12:42:34.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.634+0000 7fa9bea00640 1 -- 172.21.15.76:0/1834391837 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00a8bc0 con 0x7fa9c0071f60 2024-03-28T12:42:34.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.634+0000 7fa9c6400640 1 -- 172.21.15.76:0/1834391837 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9c0071f60 msgr2=0x7fa9c015b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:34.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.634+0000 7fa9c6400640 1 --2- 172.21.15.76:0/1834391837 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9c0071f60 0x7fa9c015b2e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009870 tx=0x7fa9b001eaf0 comp rx=0 tx=0).stop 2024-03-28T12:42:34.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.634+0000 7fa9c6400640 1 -- 172.21.15.76:0/1834391837 shutdown_connections 2024-03-28T12:42:34.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.634+0000 7fa9c6400640 1 --2- 172.21.15.76:0/1834391837 >> v2:172.21.15.111:3300/0 conn(0x7fa9c0072340 0x7fa9c00c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:34.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.634+0000 7fa9c6400640 1 --2- 172.21.15.76:0/1834391837 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9c0071f60 0x7fa9c015b2e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:34.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.634+0000 7fa9c6400640 1 -- 172.21.15.76:0/1834391837 >> 172.21.15.76:0/1834391837 conn(0x7fa9c0071540 msgr2=0x7fa9c0070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:34.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.634+0000 7fa9c6400640 1 -- 172.21.15.76:0/1834391837 shutdown_connections 2024-03-28T12:42:34.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.634+0000 7fa9c6400640 1 -- 172.21.15.76:0/1834391837 wait complete. 2024-03-28T12:42:34.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.638+0000 7fa9c6400640 1 Processor -- start 2024-03-28T12:42:34.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.638+0000 7fa9c6400640 1 -- start start 2024-03-28T12:42:34.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.638+0000 7fa9c6400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa9c0071f60 0x7fa9c00c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:34.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.638+0000 7fa9c6400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9c0072340 0x7fa9c00c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:34.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.638+0000 7fa9c6400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa9c00c8ae0 0x7fa9c00b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:34.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.638+0000 7fa9c6400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c006cff0 con 0x7fa9c0072340 2024-03-28T12:42:34.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.638+0000 7fa9c6400640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c006cd10 con 0x7fa9c0071f60 2024-03-28T12:42:34.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.638+0000 7fa9c6400640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa9c0154b10 con 0x7fa9c00c8ae0 2024-03-28T12:42:34.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.638+0000 7fa9b7e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9c0072340 0x7fa9c00c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:34.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.638+0000 7fa9b7e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9c0072340 0x7fa9c00c7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39690/0 (socket says 172.21.15.76:39690) 2024-03-28T12:42:34.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.638+0000 7fa9b7e00640 1 -- 172.21.15.76:0/1490877739 learned_addr learned my addr 172.21.15.76:0/1490877739 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:34.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.638+0000 7fa9bf400640 1 --2- 172.21.15.76:0/1490877739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa9c0071f60 0x7fa9c00c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:34.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.642+0000 7fa9bfe00640 1 --2- 172.21.15.76:0/1490877739 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa9c00c8ae0 0x7fa9c00b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:34.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.642+0000 7fa9b7e00640 1 -- 172.21.15.76:0/1490877739 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa9c00c8ae0 msgr2=0x7fa9c00b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:34.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.642+0000 7fa9b7e00640 1 --2- 172.21.15.76:0/1490877739 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa9c00c8ae0 0x7fa9c00b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:34.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.642+0000 7fa9b7e00640 1 -- 172.21.15.76:0/1490877739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa9c0071f60 msgr2=0x7fa9c00c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:34.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.642+0000 7fa9b7e00640 1 --2- 172.21.15.76:0/1490877739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa9c0071f60 0x7fa9c00c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:34.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.642+0000 7fa9b7e00640 1 -- 172.21.15.76:0/1490877739 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c00c8050 con 0x7fa9c0072340 2024-03-28T12:42:34.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.646+0000 7fa9b7e00640 1 --2- 172.21.15.76:0/1490877739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9c0072340 0x7fa9c00c7600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800d7d0 tx=0x7fa9a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:34.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.650+0000 7fa9b7400640 1 -- 172.21.15.76:0/1490877739 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a800b660 con 0x7fa9c0072340 2024-03-28T12:42:34.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.650+0000 7fa9b7400640 1 -- 172.21.15.76:0/1490877739 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9a8019070 con 0x7fa9c0072340 2024-03-28T12:42:34.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.650+0000 7fa9b7400640 1 -- 172.21.15.76:0/1490877739 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a800ba40 con 0x7fa9c0072340 2024-03-28T12:42:34.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.650+0000 7fa9c6400640 1 -- 172.21.15.76:0/1490877739 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c00c8310 con 0x7fa9c0072340 2024-03-28T12:42:34.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.650+0000 7fa9c6400640 1 -- 172.21.15.76:0/1490877739 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c00c5aa0 con 0x7fa9c0072340 2024-03-28T12:42:34.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.650+0000 7fa9c6400640 1 -- 172.21.15.76:0/1490877739 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9c00686e0 con 0x7fa9c0072340 2024-03-28T12:42:34.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.902+0000 7fa9b7400640 1 -- 172.21.15.76:0/1490877739 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fa9a800bbe0 con 0x7fa9c0072340 2024-03-28T12:42:34.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.902+0000 7fa9b7400640 1 --2- 172.21.15.76:0/1490877739 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa99c068010 0x7fa99c06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:34.902 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.902+0000 7fa9bf400640 1 --2- 172.21.15.76:0/1490877739 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa99c068010 0x7fa99c06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:34.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.906+0000 7fa9bf400640 1 --2- 172.21.15.76:0/1490877739 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa99c068010 0x7fa99c06a4d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00b2000 tx=0x7fa9b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:34.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.918+0000 7fa9b7400640 1 -- 172.21.15.76:0/1490877739 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fa9a80554e0 con 0x7fa9c0072340 2024-03-28T12:42:34.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:34.918+0000 7fa9b7400640 1 -- 172.21.15.76:0/1490877739 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fa9a8057b40 con 0x7fa9c0072340 2024-03-28T12:42:35.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.114+0000 7fa9c6400640 1 -- 172.21.15.76:0/1490877739 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa9c00c92c0 con 0x7fa9c0072340 2024-03-28T12:42:35.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.466+0000 7fa9b7400640 1 -- 172.21.15.76:0/1490877739 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fa9a8057440 con 0x7fa9c0072340 2024-03-28T12:42:35.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.470+0000 7fa9c6400640 1 -- 172.21.15.76:0/1490877739 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa99c068010 msgr2=0x7fa99c06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:35.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.470+0000 7fa9c6400640 1 --2- 172.21.15.76:0/1490877739 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa99c068010 0x7fa99c06a4d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00b2000 tx=0x7fa9b0009040 comp rx=0 tx=0).stop 2024-03-28T12:42:35.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.470+0000 7fa9c6400640 1 -- 172.21.15.76:0/1490877739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9c0072340 msgr2=0x7fa9c00c7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:35.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.470+0000 7fa9c6400640 1 --2- 172.21.15.76:0/1490877739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9c0072340 0x7fa9c00c7600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800d7d0 tx=0x7fa9a800dc90 comp rx=0 tx=0).stop 2024-03-28T12:42:35.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.470+0000 7fa9c6400640 1 -- 172.21.15.76:0/1490877739 shutdown_connections 2024-03-28T12:42:35.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.470+0000 7fa9c6400640 1 --2- 172.21.15.76:0/1490877739 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa99c068010 0x7fa99c06a4d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:35.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.470+0000 7fa9c6400640 1 --2- 172.21.15.76:0/1490877739 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa9c00c8ae0 0x7fa9c00b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:35.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.470+0000 7fa9c6400640 1 --2- 172.21.15.76:0/1490877739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa9c0072340 0x7fa9c00c7600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:35.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.470+0000 7fa9c6400640 1 --2- 172.21.15.76:0/1490877739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa9c0071f60 0x7fa9c00c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:35.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.470+0000 7fa9c6400640 1 -- 172.21.15.76:0/1490877739 >> 172.21.15.76:0/1490877739 conn(0x7fa9c0071540 msgr2=0x7fa9c00c49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:35.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.470+0000 7fa9c6400640 1 -- 172.21.15.76:0/1490877739 shutdown_connections 2024-03-28T12:42:35.469 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.470+0000 7fa9c6400640 1 -- 172.21.15.76:0/1490877739 wait complete. 2024-03-28T12:42:35.489 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-03-28T12:42:35.490 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-03-28T12:42:35.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.634+0000 7f25eb600640 1 Processor -- start 2024-03-28T12:42:35.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.634+0000 7f25eb600640 1 -- start start 2024-03-28T12:42:35.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.638+0000 7f25eb600640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f25e4071f60 0x7f25e415b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:35.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.638+0000 7f25eb600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f25e4072340 0x7f25e40c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:35.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.638+0000 7f25eb600640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25e415b820 con 0x7f25e40c8ae0 2024-03-28T12:42:35.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.638+0000 7f25eb600640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f25e40cef50 con 0x7f25e4071f60 2024-03-28T12:42:35.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.638+0000 7f25eb600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f25e406d7f0 con 0x7f25e4072340 2024-03-28T12:42:35.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.638+0000 7f25e9600640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f25e40c8ae0 0x7f25e4154400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:50550/0 (socket says 172.21.15.76:50550) 2024-03-28T12:42:35.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.638+0000 7f25e9600640 1 -- 172.21.15.76:0/683662978 learned_addr learned my addr 172.21.15.76:0/683662978 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:35.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.638+0000 7f25e8c00640 1 --2- 172.21.15.76:0/683662978 >> v2:172.21.15.111:3300/0 conn(0x7f25e4071f60 0x7f25e415b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:35.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.638+0000 7f25e3e00640 1 --2- 172.21.15.76:0/683662978 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f25e4072340 0x7f25e40c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:35.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.638+0000 7f25e3400640 1 -- 172.21.15.76:0/683662978 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 542831304 0 0) 0x7f25dc0014a0 con 0x7f25e40c8ae0 2024-03-28T12:42:35.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.642+0000 7f25e3400640 1 -- 172.21.15.76:0/683662978 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25cc003530 con 0x7f25e40c8ae0 2024-03-28T12:42:35.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.642+0000 7f25e3400640 1 -- 172.21.15.76:0/683662978 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2299698167 0 0) 0x7f25cc003530 con 0x7f25e40c8ae0 2024-03-28T12:42:35.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.642+0000 7f25e3400640 1 -- 172.21.15.76:0/683662978 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f25e4072340 msgr2=0x7f25e40c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:35.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.642+0000 7f25e3400640 1 --2- 172.21.15.76:0/683662978 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f25e4072340 0x7f25e40c3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:35.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.642+0000 7f25e3400640 1 -- 172.21.15.76:0/683662978 >> v2:172.21.15.111:3300/0 conn(0x7f25e4071f60 msgr2=0x7f25e415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:35.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.642+0000 7f25e3400640 1 --2- 172.21.15.76:0/683662978 >> v2:172.21.15.111:3300/0 conn(0x7f25e4071f60 0x7f25e415b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:35.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.642+0000 7f25e3400640 1 -- 172.21.15.76:0/683662978 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e406c750 con 0x7f25e40c8ae0 2024-03-28T12:42:35.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.642+0000 7f25e3400640 1 -- 172.21.15.76:0/683662978 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7f25dc001bd0 con 0x7f25e40c8ae0 2024-03-28T12:42:35.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.642+0000 7f25e3400640 1 -- 172.21.15.76:0/683662978 >> v1:172.21.15.76:6789/0 conn(0x7f25e40c8ae0 legacy=0x7f25e4154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:35.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.642+0000 7f25e3400640 1 --2- 172.21.15.76:0/683662978 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25cc003a30 0x7f25cc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:35.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.642+0000 7f25e3400640 1 --2- 172.21.15.76:0/683662978 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f25e4072340 0x7f25cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:35.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.642+0000 7f25e3400640 1 --2- 172.21.15.76:0/683662978 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f25cc004d50 0x7f25cc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:35.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.642+0000 7f25e3400640 1 -- 172.21.15.76:0/683662978 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f25e40cef50 con 0x7f25cc004d50 2024-03-28T12:42:35.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.642+0000 7f25e3400640 1 -- 172.21.15.76:0/683662978 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f25e406d7f0 con 0x7f25cc003a30 2024-03-28T12:42:35.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.642+0000 7f25e3400640 1 -- 172.21.15.76:0/683662978 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f25cc00ba90 con 0x7f25e4072340 2024-03-28T12:42:35.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.646+0000 7f25e9600640 1 --2- 172.21.15.76:0/683662978 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f25cc004d50 0x7f25cc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:35.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.650+0000 7f25e9600640 1 -- 172.21.15.76:0/683662978 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f25e4072340 msgr2=0x7f25cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:35.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.650+0000 7f25e9600640 1 --2- 172.21.15.76:0/683662978 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f25e4072340 0x7f25cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:35.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.650+0000 7f25e9600640 1 -- 172.21.15.76:0/683662978 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25cc003a30 msgr2=0x7f25cc003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:35.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.650+0000 7f25e9600640 1 --2- 172.21.15.76:0/683662978 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25cc003a30 0x7f25cc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:35.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.650+0000 7f25e9600640 1 -- 172.21.15.76:0/683662978 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25cc003530 con 0x7f25cc004d50 2024-03-28T12:42:35.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.654+0000 7f25e9600640 1 --2- 172.21.15.76:0/683662978 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f25cc004d50 0x7f25cc0051d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00a9a0 tx=0x7f25dc01d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ced2d99bb0f289 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:35.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.658+0000 7f25e3400640 1 -- 172.21.15.76:0/683662978 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00a5c0 con 0x7f25cc004d50 2024-03-28T12:42:35.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.658+0000 7f25e3400640 1 -- 172.21.15.76:0/683662978 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25dc0ad650 con 0x7f25cc004d50 2024-03-28T12:42:35.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.658+0000 7f25e3400640 1 -- 172.21.15.76:0/683662978 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25dc0ada40 con 0x7f25cc004d50 2024-03-28T12:42:35.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.658+0000 7f25eb600640 1 -- 172.21.15.76:0/683662978 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f25cc004d50 msgr2=0x7f25cc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:35.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.658+0000 7f25eb600640 1 --2- 172.21.15.76:0/683662978 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f25cc004d50 0x7f25cc0051d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00a9a0 tx=0x7f25dc01d280 comp rx=0 tx=0).stop 2024-03-28T12:42:35.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.658+0000 7f25e9600640 1 -- 172.21.15.76:0/683662978 reap_dead start 2024-03-28T12:42:35.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.662+0000 7f25eb600640 1 -- 172.21.15.76:0/683662978 shutdown_connections 2024-03-28T12:42:35.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.662+0000 7f25eb600640 1 -- 172.21.15.76:0/683662978 >> 172.21.15.76:0/683662978 conn(0x7f25e4071540 msgr2=0x7f25e4070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:35.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.662+0000 7f25eb600640 1 -- 172.21.15.76:0/683662978 shutdown_connections 2024-03-28T12:42:35.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.662+0000 7f25eb600640 1 -- 172.21.15.76:0/683662978 wait complete. 2024-03-28T12:42:35.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.662+0000 7f25eb600640 1 Processor -- start 2024-03-28T12:42:35.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.662+0000 7f25eb600640 1 -- start start 2024-03-28T12:42:35.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.662+0000 7f25eb600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f25cc004d50 0x7f25e4159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:35.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.662+0000 7f25eb600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25e40c8180 0x7f25e40ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:35.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.662+0000 7f25eb600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f25e40cd460 0x7f25e41f3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:35.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.662+0000 7f25eb600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f25e406cff0 con 0x7f25cc004d50 2024-03-28T12:42:35.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.662+0000 7f25eb600640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f25e406cd10 con 0x7f25e40c8180 2024-03-28T12:42:35.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.662+0000 7f25eb600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f25e4154b10 con 0x7f25e40cd460 2024-03-28T12:42:35.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.662+0000 7f25e8c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f25cc004d50 0x7f25e4159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:35.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.666+0000 7f25e8c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f25cc004d50 0x7f25e4159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39704/0 (socket says 172.21.15.76:39704) 2024-03-28T12:42:35.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.666+0000 7f25e8c00640 1 -- 172.21.15.76:0/2595132406 learned_addr learned my addr 172.21.15.76:0/2595132406 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:35.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.666+0000 7f25e3e00640 1 --2- 172.21.15.76:0/2595132406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25e40c8180 0x7f25e40ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:35.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.666+0000 7f25e9600640 1 --2- 172.21.15.76:0/2595132406 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f25e40cd460 0x7f25e41f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:35.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.666+0000 7f25e8c00640 1 -- 172.21.15.76:0/2595132406 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f25e40cd460 msgr2=0x7f25e41f3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:35.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.666+0000 7f25e8c00640 1 --2- 172.21.15.76:0/2595132406 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f25e40cd460 0x7f25e41f3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:35.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.666+0000 7f25e8c00640 1 -- 172.21.15.76:0/2595132406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25e40c8180 msgr2=0x7f25e40ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:35.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.666+0000 7f25e8c00640 1 --2- 172.21.15.76:0/2595132406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25e40c8180 0x7f25e40ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:35.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.666+0000 7f25e8c00640 1 -- 172.21.15.76:0/2595132406 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e41e6b10 con 0x7f25cc004d50 2024-03-28T12:42:35.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.670+0000 7f25e8c00640 1 --2- 172.21.15.76:0/2595132406 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f25cc004d50 0x7f25e4159c00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f25d800e7c0 tx=0x7f25d800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:35.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.674+0000 7f25e0c00640 1 -- 172.21.15.76:0/2595132406 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d8017070 con 0x7f25cc004d50 2024-03-28T12:42:35.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.674+0000 7f25e0c00640 1 -- 172.21.15.76:0/2595132406 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d800ee70 con 0x7f25cc004d50 2024-03-28T12:42:35.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.674+0000 7f25e0c00640 1 -- 172.21.15.76:0/2595132406 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d800cb60 con 0x7f25cc004d50 2024-03-28T12:42:35.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.674+0000 7f25eb600640 1 -- 172.21.15.76:0/2595132406 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e40cbe70 con 0x7f25cc004d50 2024-03-28T12:42:35.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.678+0000 7f25eb600640 1 -- 172.21.15.76:0/2595132406 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e40cc130 con 0x7f25cc004d50 2024-03-28T12:42:35.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.678+0000 7f25eb600640 1 -- 172.21.15.76:0/2595132406 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e40686e0 con 0x7f25cc004d50 2024-03-28T12:42:35.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.702+0000 7f25e0c00640 1 -- 172.21.15.76:0/2595132406 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f25d801a070 con 0x7f25cc004d50 2024-03-28T12:42:35.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.702+0000 7f25e0c00640 1 --2- 172.21.15.76:0/2595132406 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f25c4067fc0 0x7f25c406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:35.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.702+0000 7f25e3e00640 1 --2- 172.21.15.76:0/2595132406 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f25c4067fc0 0x7f25c406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:35.701 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.702+0000 7f25e3e00640 1 --2- 172.21.15.76:0/2595132406 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f25c4067fc0 0x7f25c406a480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f25d00047c0 tx=0x7f25d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:35.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.946+0000 7f25e0c00640 1 -- 172.21.15.76:0/2595132406 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f25d8054d40 con 0x7f25cc004d50 2024-03-28T12:42:35.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:35.946+0000 7f25e0c00640 1 -- 172.21.15.76:0/2595132406 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f25d80573a0 con 0x7f25cc004d50 2024-03-28T12:42:36.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.142+0000 7f25eb600640 1 -- 172.21.15.76:0/2595132406 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f25e4070540 con 0x7f25cc004d50 2024-03-28T12:42:36.395 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:42:36.400 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:42:36.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.726+0000 7f25e0c00640 1 -- 172.21.15.76:0/2595132406 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v8) ==== 105+0+0 (secure 0 0 0) 0x7f25d8056ca0 con 0x7f25cc004d50 2024-03-28T12:42:36.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.730+0000 7f25eb600640 1 -- 172.21.15.76:0/2595132406 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f25c4067fc0 msgr2=0x7f25c406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:36.728 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.730+0000 7f25eb600640 1 --2- 172.21.15.76:0/2595132406 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f25c4067fc0 0x7f25c406a480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f25d00047c0 tx=0x7f25d0008040 comp rx=0 tx=0).stop 2024-03-28T12:42:36.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.730+0000 7f25eb600640 1 -- 172.21.15.76:0/2595132406 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f25cc004d50 msgr2=0x7f25e4159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:36.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.730+0000 7f25eb600640 1 --2- 172.21.15.76:0/2595132406 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f25cc004d50 0x7f25e4159c00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f25d800e7c0 tx=0x7f25d800ec80 comp rx=0 tx=0).stop 2024-03-28T12:42:36.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.730+0000 7f25eb600640 1 -- 172.21.15.76:0/2595132406 shutdown_connections 2024-03-28T12:42:36.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.730+0000 7f25eb600640 1 --2- 172.21.15.76:0/2595132406 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f25c4067fc0 0x7f25c406a480 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:36.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.730+0000 7f25eb600640 1 --2- 172.21.15.76:0/2595132406 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f25e40cd460 0x7f25e41f3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:36.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.730+0000 7f25eb600640 1 --2- 172.21.15.76:0/2595132406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25e40c8180 0x7f25e40ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:36.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.730+0000 7f25eb600640 1 --2- 172.21.15.76:0/2595132406 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f25cc004d50 0x7f25e4159c00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:36.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.730+0000 7f25eb600640 1 -- 172.21.15.76:0/2595132406 >> 172.21.15.76:0/2595132406 conn(0x7f25e4071540 msgr2=0x7f25e40c34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:36.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.730+0000 7f25eb600640 1 -- 172.21.15.76:0/2595132406 shutdown_connections 2024-03-28T12:42:36.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.730+0000 7f25eb600640 1 -- 172.21.15.76:0/2595132406 wait complete. 2024-03-28T12:42:36.749 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-28T12:42:36.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.894+0000 7f04a6c00640 1 Processor -- start 2024-03-28T12:42:36.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.894+0000 7f04a6c00640 1 -- start start 2024-03-28T12:42:36.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.898+0000 7f04a6c00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f04a0071f60 0x7f04a00c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:36.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.898+0000 7f04a6c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f04a0072340 0x7f04a01545c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:36.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.898+0000 7f04a6c00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04a00cef70 con 0x7f04a015b5c0 2024-03-28T12:42:36.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.898+0000 7f04a6c00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f04a006d7d0 con 0x7f04a0071f60 2024-03-28T12:42:36.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.898+0000 7f04a6c00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f04a006c750 con 0x7f04a0072340 2024-03-28T12:42:36.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.898+0000 7f049fe00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f04a0071f60 0x7f04a00c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:36.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.898+0000 7f04a4c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f04a0072340 0x7f04a01545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:36.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.898+0000 7f049fe00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f04a0071f60 0x7f04a00c8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:34042/0 (socket says 172.21.15.76:34042) 2024-03-28T12:42:36.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.898+0000 7f049fe00640 1 -- 172.21.15.76:0/861092789 learned_addr learned my addr 172.21.15.76:0/861092789 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:36.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.906+0000 7f049fe00640 1 -- 172.21.15.76:0/861092789 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f04a0072340 msgr2=0x7f04a01545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:36.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.906+0000 7f049fe00640 1 --2- 172.21.15.76:0/861092789 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f04a0072340 0x7f04a01545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:36.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.906+0000 7f049fe00640 1 -- 172.21.15.76:0/861092789 >> v1:172.21.15.76:6789/0 conn(0x7f04a015b5c0 legacy=0x7f04a00c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:36.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.906+0000 7f049fe00640 1 -- 172.21.15.76:0/861092789 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a00c8fb0 con 0x7f04a0071f60 2024-03-28T12:42:36.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:36.914+0000 7f049fe00640 1 --2- 172.21.15.76:0/861092789 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04a0071f60 0x7f04a00c8a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0490009e50 tx=0x7f049001c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3179b42a14604830 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:37.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.018+0000 7f049f400640 1 -- 172.21.15.76:0/861092789 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04900a5760 con 0x7f04a0071f60 2024-03-28T12:42:37.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.018+0000 7f049f400640 1 -- 172.21.15.76:0/861092789 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04900a5900 con 0x7f04a0071f60 2024-03-28T12:42:37.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.018+0000 7f049f400640 1 -- 172.21.15.76:0/861092789 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04900a5cd0 con 0x7f04a0071f60 2024-03-28T12:42:37.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.018+0000 7f04a6c00640 1 -- 172.21.15.76:0/861092789 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04a0071f60 msgr2=0x7f04a00c8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:37.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.018+0000 7f04a6c00640 1 --2- 172.21.15.76:0/861092789 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04a0071f60 0x7f04a00c8a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0490009e50 tx=0x7f049001c9f0 comp rx=0 tx=0).stop 2024-03-28T12:42:37.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.018+0000 7f04a6c00640 1 -- 172.21.15.76:0/861092789 shutdown_connections 2024-03-28T12:42:37.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.018+0000 7f04a6c00640 1 --2- 172.21.15.76:0/861092789 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f04a0072340 0x7f04a01545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:37.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.018+0000 7f04a6c00640 1 --2- 172.21.15.76:0/861092789 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04a0071f60 0x7f04a00c8a70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:37.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.018+0000 7f04a6c00640 1 -- 172.21.15.76:0/861092789 >> 172.21.15.76:0/861092789 conn(0x7f04a0071540 msgr2=0x7f04a0070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:37.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.018+0000 7f04a6c00640 1 -- 172.21.15.76:0/861092789 shutdown_connections 2024-03-28T12:42:37.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.018+0000 7f04a6c00640 1 -- 172.21.15.76:0/861092789 wait complete. 2024-03-28T12:42:37.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.018+0000 7f04a6c00640 1 Processor -- start 2024-03-28T12:42:37.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.022+0000 7f04a6c00640 1 -- start start 2024-03-28T12:42:37.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.022+0000 7f04a6c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f04a0071f60 0x7f04a01f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:37.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.022+0000 7f04a6c00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04a0072340 0x7f04a00afa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:37.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.022+0000 7f04a6c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04a015b5c0 0x7f04a0157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:37.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.022+0000 7f04a6c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f04a00c3c80 con 0x7f04a015b5c0 2024-03-28T12:42:37.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.022+0000 7f04a6c00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f04a0154f10 con 0x7f04a0072340 2024-03-28T12:42:37.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.022+0000 7f04a6c00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f04a00ae120 con 0x7f04a0071f60 2024-03-28T12:42:37.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.022+0000 7f049fe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f04a0071f60 0x7f04a01f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:37.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.022+0000 7f049fe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f04a0071f60 0x7f04a01f4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:46160/0 (socket says 172.21.15.76:46160) 2024-03-28T12:42:37.022 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.022+0000 7f049fe00640 1 -- 172.21.15.76:0/2014522059 learned_addr learned my addr 172.21.15.76:0/2014522059 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:37.024 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.026+0000 7f0497400640 1 --2- 172.21.15.76:0/2014522059 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04a0072340 0x7f04a00afa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:37.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.030+0000 7f04a4c00640 1 --2- 172.21.15.76:0/2014522059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04a015b5c0 0x7f04a0157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:37.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.034+0000 7f04a4c00640 1 -- 172.21.15.76:0/2014522059 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f04a0071f60 msgr2=0x7f04a01f4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:37.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.034+0000 7f04a4c00640 1 --2- 172.21.15.76:0/2014522059 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f04a0071f60 0x7f04a01f4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:37.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.034+0000 7f04a4c00640 1 -- 172.21.15.76:0/2014522059 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04a0072340 msgr2=0x7f04a00afa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:37.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.034+0000 7f04a4c00640 1 --2- 172.21.15.76:0/2014522059 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04a0072340 0x7f04a00afa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:37.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.034+0000 7f04a4c00640 1 -- 172.21.15.76:0/2014522059 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a00c8ae0 con 0x7f04a015b5c0 2024-03-28T12:42:37.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.038+0000 7f04a4c00640 1 --2- 172.21.15.76:0/2014522059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04a015b5c0 0x7f04a0157120 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f049800e7d0 tx=0x7f049800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:37.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.042+0000 7f049cc00640 1 -- 172.21.15.76:0/2014522059 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0498017070 con 0x7f04a015b5c0 2024-03-28T12:42:37.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.042+0000 7f049cc00640 1 -- 172.21.15.76:0/2014522059 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049800c940 con 0x7f04a015b5c0 2024-03-28T12:42:37.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.042+0000 7f04a6c00640 1 -- 172.21.15.76:0/2014522059 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a00ae370 con 0x7f04a015b5c0 2024-03-28T12:42:37.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.042+0000 7f049cc00640 1 -- 172.21.15.76:0/2014522059 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049800cd30 con 0x7f04a015b5c0 2024-03-28T12:42:37.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.042+0000 7f04a6c00640 1 -- 172.21.15.76:0/2014522059 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a00af280 con 0x7f04a015b5c0 2024-03-28T12:42:37.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.042+0000 7f04a6c00640 1 -- 172.21.15.76:0/2014522059 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a00af070 con 0x7f04a015b5c0 2024-03-28T12:42:37.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.074+0000 7f049cc00640 1 -- 172.21.15.76:0/2014522059 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f049801a070 con 0x7f04a015b5c0 2024-03-28T12:42:37.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.074+0000 7f049cc00640 1 --2- 172.21.15.76:0/2014522059 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f047c067fc0 0x7f047c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:37.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.074+0000 7f049fe00640 1 --2- 172.21.15.76:0/2014522059 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f047c067fc0 0x7f047c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:37.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.074+0000 7f049cc00640 1 -- 172.21.15.76:0/2014522059 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f0498054da0 con 0x7f04a015b5c0 2024-03-28T12:42:37.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.074+0000 7f049fe00640 1 --2- 172.21.15.76:0/2014522059 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f047c067fc0 0x7f047c06a480 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0490009e50 tx=0x7f04900a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:37.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.314+0000 7f049cc00640 1 -- 172.21.15.76:0/2014522059 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f0498056d00 con 0x7f04a015b5c0 2024-03-28T12:42:37.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.506+0000 7f04a6c00640 1 -- 172.21.15.76:0/2014522059 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f04a00686e0 con 0x7f04a015b5c0 2024-03-28T12:42:37.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.934+0000 7f049cc00640 1 -- 172.21.15.76:0/2014522059 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f049805b000 con 0x7f04a015b5c0 2024-03-28T12:42:37.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.934+0000 7f04a6c00640 1 -- 172.21.15.76:0/2014522059 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f047c067fc0 msgr2=0x7f047c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:37.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.934+0000 7f04a6c00640 1 --2- 172.21.15.76:0/2014522059 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f047c067fc0 0x7f047c06a480 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0490009e50 tx=0x7f04900a7070 comp rx=0 tx=0).stop 2024-03-28T12:42:37.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.934+0000 7f04a6c00640 1 -- 172.21.15.76:0/2014522059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04a015b5c0 msgr2=0x7f04a0157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:37.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.934+0000 7f04a6c00640 1 --2- 172.21.15.76:0/2014522059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04a015b5c0 0x7f04a0157120 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f049800e7d0 tx=0x7f049800ec90 comp rx=0 tx=0).stop 2024-03-28T12:42:37.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.934+0000 7f04a6c00640 1 -- 172.21.15.76:0/2014522059 shutdown_connections 2024-03-28T12:42:37.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.934+0000 7f04a6c00640 1 --2- 172.21.15.76:0/2014522059 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f047c067fc0 0x7f047c06a480 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:37.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.934+0000 7f04a6c00640 1 --2- 172.21.15.76:0/2014522059 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f04a015b5c0 0x7f04a0157120 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:37.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.934+0000 7f04a6c00640 1 --2- 172.21.15.76:0/2014522059 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04a0072340 0x7f04a00afa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:37.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.934+0000 7f04a6c00640 1 --2- 172.21.15.76:0/2014522059 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f04a0071f60 0x7f04a01f4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:37.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.934+0000 7f04a6c00640 1 -- 172.21.15.76:0/2014522059 >> 172.21.15.76:0/2014522059 conn(0x7f04a0071540 msgr2=0x7f04a0153850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:37.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.934+0000 7f04a6c00640 1 -- 172.21.15.76:0/2014522059 shutdown_connections 2024-03-28T12:42:37.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:37.934+0000 7f04a6c00640 1 -- 172.21.15.76:0/2014522059 wait complete. 2024-03-28T12:42:37.955 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-03-28T12:42:38.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.098+0000 7f5174000640 1 Processor -- start 2024-03-28T12:42:38.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.098+0000 7f5174000640 1 -- start start 2024-03-28T12:42:38.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.102+0000 7f5174000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f516c072340 0x7f516c0c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:38.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.102+0000 7f5174000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f516c0c8ae0 0x7f516c154400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:38.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.102+0000 7f5174000640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f516c0cef50 con 0x7f516c071f60 2024-03-28T12:42:38.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.102+0000 7f5174000640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f516c06d7f0 con 0x7f516c072340 2024-03-28T12:42:38.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.102+0000 7f5174000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f516c06c750 con 0x7f516c0c8ae0 2024-03-28T12:42:38.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.102+0000 7f5172000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f516c0c8ae0 0x7f516c154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:38.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.102+0000 7f5172000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f516c0c8ae0 0x7f516c154400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:46174/0 (socket says 172.21.15.76:46174) 2024-03-28T12:42:38.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.102+0000 7f5172000640 1 -- 172.21.15.76:0/1671802913 learned_addr learned my addr 172.21.15.76:0/1671802913 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:38.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.110+0000 7f5172000640 1 -- 172.21.15.76:0/1671802913 >> v2:172.21.15.76:3300/0 conn(0x7f516c072340 msgr2=0x7f516c0c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:38.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.110+0000 7f5172000640 1 --2- 172.21.15.76:0/1671802913 >> v2:172.21.15.76:3300/0 conn(0x7f516c072340 0x7f516c0c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:38.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.110+0000 7f5172000640 1 -- 172.21.15.76:0/1671802913 >> v1:172.21.15.76:6789/0 conn(0x7f516c071f60 legacy=0x7f516c15b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:38.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.110+0000 7f5172000640 1 -- 172.21.15.76:0/1671802913 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516c06ca30 con 0x7f516c0c8ae0 2024-03-28T12:42:38.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.118+0000 7f5172000640 1 --2- 172.21.15.76:0/1671802913 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f516c0c8ae0 0x7f516c154400 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5164009e80 tx=0x7f516401f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55531bed3151f946 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:38.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.126+0000 7f516be00640 1 -- 172.21.15.76:0/1671802913 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51640b4070 con 0x7f516c0c8ae0 2024-03-28T12:42:38.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.126+0000 7f516be00640 1 -- 172.21.15.76:0/1671802913 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51640af400 con 0x7f516c0c8ae0 2024-03-28T12:42:38.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.126+0000 7f516be00640 1 -- 172.21.15.76:0/1671802913 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51640af7d0 con 0x7f516c0c8ae0 2024-03-28T12:42:38.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.130+0000 7f5174000640 1 -- 172.21.15.76:0/1671802913 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f516c0c8ae0 msgr2=0x7f516c154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:38.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.130+0000 7f5174000640 1 --2- 172.21.15.76:0/1671802913 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f516c0c8ae0 0x7f516c154400 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5164009e80 tx=0x7f516401f1c0 comp rx=0 tx=0).stop 2024-03-28T12:42:38.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.130+0000 7f5174000640 1 -- 172.21.15.76:0/1671802913 shutdown_connections 2024-03-28T12:42:38.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.130+0000 7f5174000640 1 --2- 172.21.15.76:0/1671802913 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f516c0c8ae0 0x7f516c154400 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:38.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.130+0000 7f5174000640 1 --2- 172.21.15.76:0/1671802913 >> v2:172.21.15.76:3300/0 conn(0x7f516c072340 0x7f516c0c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:38.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.130+0000 7f5174000640 1 -- 172.21.15.76:0/1671802913 >> 172.21.15.76:0/1671802913 conn(0x7f516c071540 msgr2=0x7f516c070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:38.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.130+0000 7f5174000640 1 -- 172.21.15.76:0/1671802913 shutdown_connections 2024-03-28T12:42:38.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.130+0000 7f5174000640 1 -- 172.21.15.76:0/1671802913 wait complete. 2024-03-28T12:42:38.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.130+0000 7f5174000640 1 Processor -- start 2024-03-28T12:42:38.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.130+0000 7f5174000640 1 -- start start 2024-03-28T12:42:38.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.134+0000 7f5174000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f516c071f60 0x7f516c1f11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:38.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.134+0000 7f5174000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f516c072340 0x7f516c14dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:38.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.134+0000 7f5174000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f516c0c8ae0 0x7f516c0ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:38.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.134+0000 7f5174000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f516c0cea30 con 0x7f516c071f60 2024-03-28T12:42:38.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.134+0000 7f5174000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f516c06cff0 con 0x7f516c0c8ae0 2024-03-28T12:42:38.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.134+0000 7f5174000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f516c0cebb0 con 0x7f516c072340 2024-03-28T12:42:38.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.134+0000 7f5170c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f516c072340 0x7f516c14dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:38.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.134+0000 7f5170c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f516c072340 0x7f516c14dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:46180/0 (socket says 172.21.15.76:46180) 2024-03-28T12:42:38.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.134+0000 7f5170c00640 1 -- 172.21.15.76:0/3129193208 learned_addr learned my addr 172.21.15.76:0/3129193208 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:38.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.146+0000 7f5170c00640 1 -- 172.21.15.76:0/3129193208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f516c0c8ae0 msgr2=0x7f516c0ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:38.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.146+0000 7f5170c00640 1 --2- 172.21.15.76:0/3129193208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f516c0c8ae0 0x7f516c0ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:38.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.146+0000 7f5170c00640 1 -- 172.21.15.76:0/3129193208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f516c071f60 msgr2=0x7f516c1f11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:38.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.146+0000 7f5170c00640 1 --2- 172.21.15.76:0/3129193208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f516c071f60 0x7f516c1f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:38.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.146+0000 7f5170c00640 1 -- 172.21.15.76:0/3129193208 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516c0b3150 con 0x7f516c072340 2024-03-28T12:42:38.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.150+0000 7f5170c00640 1 --2- 172.21.15.76:0/3129193208 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f516c072340 0x7f516c14dd20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f515800b480 tx=0x7f515800b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:38.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.162+0000 7f5169600640 1 -- 172.21.15.76:0/3129193208 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5158014070 con 0x7f516c072340 2024-03-28T12:42:38.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.162+0000 7f5174000640 1 -- 172.21.15.76:0/3129193208 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f516c0b3430 con 0x7f516c072340 2024-03-28T12:42:38.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.162+0000 7f5174000640 1 -- 172.21.15.76:0/3129193208 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f516c1f0ca0 con 0x7f516c072340 2024-03-28T12:42:38.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.162+0000 7f5174000640 1 -- 172.21.15.76:0/3129193208 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f516c0686e0 con 0x7f516c072340 2024-03-28T12:42:38.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.378+0000 7f5169600640 1 -- 172.21.15.76:0/3129193208 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5158010870 con 0x7f516c072340 2024-03-28T12:42:38.581 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.582+0000 7f5169600640 1 -- 172.21.15.76:0/3129193208 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515801e060 con 0x7f516c072340 2024-03-28T12:42:38.582 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.582+0000 7f5169600640 1 -- 172.21.15.76:0/3129193208 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f5158017070 con 0x7f516c072340 2024-03-28T12:42:38.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.586+0000 7f5169600640 1 --2- 172.21.15.76:0/3129193208 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f514c067ff0 0x7f514c06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:38.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.586+0000 7f5171600640 1 --2- 172.21.15.76:0/3129193208 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f514c067ff0 0x7f514c06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:38.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.586+0000 7f5171600640 1 --2- 172.21.15.76:0/3129193208 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f514c067ff0 0x7f514c06a4b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5160007fd0 tx=0x7f51600079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:38.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.598+0000 7f5169600640 1 -- 172.21.15.76:0/3129193208 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f5158054960 con 0x7f516c072340 2024-03-28T12:42:38.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.630+0000 7f5169600640 1 -- 172.21.15.76:0/3129193208 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f5158056fc0 con 0x7f516c072340 2024-03-28T12:42:38.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:38.830+0000 7f5174000640 1 -- 172.21.15.76:0/3129193208 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f516c0b3600 con 0x7f516c072340 2024-03-28T12:42:39.985 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:39.986+0000 7f5169600640 1 -- 172.21.15.76:0/3129193208 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7f51580568c0 con 0x7f516c072340 2024-03-28T12:42:39.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:39.990+0000 7f5174000640 1 -- 172.21.15.76:0/3129193208 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f514c067ff0 msgr2=0x7f514c06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:39.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:39.990+0000 7f5174000640 1 --2- 172.21.15.76:0/3129193208 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f514c067ff0 0x7f514c06a4b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5160007fd0 tx=0x7f51600079a0 comp rx=0 tx=0).stop 2024-03-28T12:42:39.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:39.990+0000 7f5174000640 1 -- 172.21.15.76:0/3129193208 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f516c072340 msgr2=0x7f516c14dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:39.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:39.990+0000 7f5174000640 1 --2- 172.21.15.76:0/3129193208 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f516c072340 0x7f516c14dd20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f515800b480 tx=0x7f515800b940 comp rx=0 tx=0).stop 2024-03-28T12:42:39.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:39.990+0000 7f5174000640 1 -- 172.21.15.76:0/3129193208 shutdown_connections 2024-03-28T12:42:39.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:39.990+0000 7f5174000640 1 --2- 172.21.15.76:0/3129193208 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f514c067ff0 0x7f514c06a4b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:39.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:39.990+0000 7f5174000640 1 --2- 172.21.15.76:0/3129193208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f516c0c8ae0 0x7f516c0ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:39.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:39.990+0000 7f5174000640 1 --2- 172.21.15.76:0/3129193208 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f516c072340 0x7f516c14dd20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:39.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:39.990+0000 7f5174000640 1 --2- 172.21.15.76:0/3129193208 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f516c071f60 0x7f516c1f11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:39.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:39.990+0000 7f5174000640 1 -- 172.21.15.76:0/3129193208 >> 172.21.15.76:0/3129193208 conn(0x7f516c071540 msgr2=0x7f516c151f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:39.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:39.990+0000 7f5174000640 1 -- 172.21.15.76:0/3129193208 shutdown_connections 2024-03-28T12:42:39.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:39.990+0000 7f5174000640 1 -- 172.21.15.76:0/3129193208 wait complete. 2024-03-28T12:42:40.018 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-28T12:42:40.018 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T12:42:40.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.166+0000 7fa7db600640 1 Processor -- start 2024-03-28T12:42:40.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.166+0000 7fa7db600640 1 -- start start 2024-03-28T12:42:40.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.166+0000 7fa7db600640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fa7d40ce470 0x7fa7d40cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:40.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.166+0000 7fa7db600640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa7d40ce8e0 0x7fa7d40cb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:40.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.166+0000 7fa7db600640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7d41584c0 con 0x7fa7d4152780 2024-03-28T12:42:40.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.166+0000 7fa7db600640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fa7d40ca7d0 con 0x7fa7d40ce470 2024-03-28T12:42:40.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.166+0000 7fa7db600640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fa7d40c8390 con 0x7fa7d40ce8e0 2024-03-28T12:42:40.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.170+0000 7fa7d9600640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa7d40ce8e0 0x7fa7d40cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:40.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.170+0000 7fa7d8c00640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fa7d4152780 0x7fa7d4071050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:40784/0 (socket says 172.21.15.76:40784) 2024-03-28T12:42:40.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.170+0000 7fa7d8c00640 1 -- 172.21.15.76:0/1095639830 learned_addr learned my addr 172.21.15.76:0/1095639830 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:40.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.174+0000 7fa7d9600640 1 -- 172.21.15.76:0/1095639830 >> v2:172.21.15.76:3300/0 conn(0x7fa7d40ce470 msgr2=0x7fa7d40cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:40.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.174+0000 7fa7d9600640 1 --2- 172.21.15.76:0/1095639830 >> v2:172.21.15.76:3300/0 conn(0x7fa7d40ce470 0x7fa7d40cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:40.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.174+0000 7fa7d9600640 1 -- 172.21.15.76:0/1095639830 >> v1:172.21.15.111:6789/0 conn(0x7fa7d4152780 legacy=0x7fa7d4071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:40.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.174+0000 7fa7d9600640 1 -- 172.21.15.76:0/1095639830 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d40b33e0 con 0x7fa7d40ce8e0 2024-03-28T12:42:40.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.178+0000 7fa7d9600640 1 --2- 172.21.15.76:0/1095639830 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7d40ce8e0 0x7fa7d40cb360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40c4b90 tx=0x7fa7cc01f110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e474091d6a3835da server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:40.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.190+0000 7fa7d3e00640 1 -- 172.21.15.76:0/1095639830 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc0b4070 con 0x7fa7d40ce8e0 2024-03-28T12:42:40.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.190+0000 7fa7d3e00640 1 -- 172.21.15.76:0/1095639830 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7cc0af600 con 0x7fa7d40ce8e0 2024-03-28T12:42:40.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.190+0000 7fa7d3e00640 1 -- 172.21.15.76:0/1095639830 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc0af9d0 con 0x7fa7d40ce8e0 2024-03-28T12:42:40.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.190+0000 7fa7db600640 1 -- 172.21.15.76:0/1095639830 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7d40ce8e0 msgr2=0x7fa7d40cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:40.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.190+0000 7fa7db600640 1 --2- 172.21.15.76:0/1095639830 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7d40ce8e0 0x7fa7d40cb360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40c4b90 tx=0x7fa7cc01f110 comp rx=0 tx=0).stop 2024-03-28T12:42:40.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.190+0000 7fa7db600640 1 -- 172.21.15.76:0/1095639830 shutdown_connections 2024-03-28T12:42:40.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.190+0000 7fa7db600640 1 --2- 172.21.15.76:0/1095639830 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7d40ce8e0 0x7fa7d40cb360 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:40.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.190+0000 7fa7db600640 1 --2- 172.21.15.76:0/1095639830 >> v2:172.21.15.76:3300/0 conn(0x7fa7d40ce470 0x7fa7d40cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:40.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.190+0000 7fa7db600640 1 -- 172.21.15.76:0/1095639830 >> 172.21.15.76:0/1095639830 conn(0x7fa7d4067730 msgr2=0x7fa7d4067b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:40.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.190+0000 7fa7db600640 1 -- 172.21.15.76:0/1095639830 shutdown_connections 2024-03-28T12:42:40.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.190+0000 7fa7db600640 1 -- 172.21.15.76:0/1095639830 wait complete. 2024-03-28T12:42:40.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.190+0000 7fa7db600640 1 Processor -- start 2024-03-28T12:42:40.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.190+0000 7fa7db600640 1 -- start start 2024-03-28T12:42:40.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.194+0000 7fa7db600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7d40ce470 0x7fa7d40cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:40.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.194+0000 7fa7db600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7d40ce8e0 0x7fa7d414dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:40.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.194+0000 7fa7db600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7d4152780 0x7fa7d4144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:40.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.194+0000 7fa7db600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d40ca210 con 0x7fa7d40ce470 2024-03-28T12:42:40.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.194+0000 7fa7db600640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d40c9f30 con 0x7fa7d40ce8e0 2024-03-28T12:42:40.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.194+0000 7fa7db600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa7d40ca4f0 con 0x7fa7d4152780 2024-03-28T12:42:40.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.194+0000 7fa7d8c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7d40ce470 0x7fa7d40cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:40.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.194+0000 7fa7cbe00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7d40ce8e0 0x7fa7d414dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:40.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.194+0000 7fa7d9600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7d4152780 0x7fa7d4144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:40.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.194+0000 7fa7d8c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7d40ce470 0x7fa7d40cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39738/0 (socket says 172.21.15.76:39738) 2024-03-28T12:42:40.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.194+0000 7fa7d8c00640 1 -- 172.21.15.76:0/1359214545 learned_addr learned my addr 172.21.15.76:0/1359214545 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:40.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.198+0000 7fa7d8c00640 1 -- 172.21.15.76:0/1359214545 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7d4152780 msgr2=0x7fa7d4144760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:40.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.198+0000 7fa7d8c00640 1 --2- 172.21.15.76:0/1359214545 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7d4152780 0x7fa7d4144760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:40.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.198+0000 7fa7d8c00640 1 -- 172.21.15.76:0/1359214545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7d40ce8e0 msgr2=0x7fa7d414dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:40.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.198+0000 7fa7d8c00640 1 --2- 172.21.15.76:0/1359214545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7d40ce8e0 0x7fa7d414dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:40.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.198+0000 7fa7d8c00640 1 -- 172.21.15.76:0/1359214545 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d4153320 con 0x7fa7d40ce470 2024-03-28T12:42:40.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.198+0000 7fa7d8c00640 1 --2- 172.21.15.76:0/1359214545 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7d40ce470 0x7fa7d40cd8a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400c370 tx=0x7fa7c400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:40.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.202+0000 7fa7d1600640 1 -- 172.21.15.76:0/1359214545 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4017070 con 0x7fa7d40ce470 2024-03-28T12:42:40.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.202+0000 7fa7d1600640 1 -- 172.21.15.76:0/1359214545 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c4005cf0 con 0x7fa7d40ce470 2024-03-28T12:42:40.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.202+0000 7fa7d1600640 1 -- 172.21.15.76:0/1359214545 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c40072f0 con 0x7fa7d40ce470 2024-03-28T12:42:40.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.202+0000 7fa7db600640 1 -- 172.21.15.76:0/1359214545 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d4154a50 con 0x7fa7d40ce470 2024-03-28T12:42:40.202 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.202+0000 7fa7db600640 1 -- 172.21.15.76:0/1359214545 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d4155010 con 0x7fa7d40ce470 2024-03-28T12:42:40.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.206+0000 7fa7db600640 1 -- 172.21.15.76:0/1359214545 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d4068df0 con 0x7fa7d40ce470 2024-03-28T12:42:40.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.454+0000 7fa7d1600640 1 -- 172.21.15.76:0/1359214545 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fa7c401a070 con 0x7fa7d40ce470 2024-03-28T12:42:40.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.454+0000 7fa7d1600640 1 --2- 172.21.15.76:0/1359214545 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7b0068010 0x7fa7b006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:40.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.454+0000 7fa7cbe00640 1 --2- 172.21.15.76:0/1359214545 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7b0068010 0x7fa7b006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:40.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.458+0000 7fa7cbe00640 1 --2- 172.21.15.76:0/1359214545 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7b0068010 0x7fa7b006a4d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40cd2f0 tx=0x7fa7bc009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:40.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.470+0000 7fa7d1600640 1 -- 172.21.15.76:0/1359214545 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fa7c4053e50 con 0x7fa7d40ce470 2024-03-28T12:42:40.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.470+0000 7fa7d1600640 1 -- 172.21.15.76:0/1359214545 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fa7c4021020 con 0x7fa7d40ce470 2024-03-28T12:42:40.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.662+0000 7fa7db600640 1 -- 172.21.15.76:0/1359214545 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7d40c5ef0 con 0x7fa7d40ce470 2024-03-28T12:42:40.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.678+0000 7fa7d1600640 1 -- 172.21.15.76:0/1359214545 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6868 (secure 0 0 0) 0x7fa7c4055db0 con 0x7fa7d40ce470 2024-03-28T12:42:40.676 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:40.676 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/335301918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":335301918},{"type":"v1","addr":"172.21.15.111:6835","nonce":335301918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4245,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6837/1786218285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1786218285},{"type":"v1","addr":"172.21.15.76:6837","nonce":1786218285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.76:6839/2729208421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":2729208421},{"type":"v1","addr":"172.21.15.76:6839","nonce":2729208421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T12:42:00.776505+0000","modified":"2024-03-28T12:42:39.864949+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2],"up":{"mds_0":4264,"mds_1":4258,"mds_2":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"b","rank":2,"incarnation":12,"state":"up:creating","state_seq":1,"addr":"172.21.15.111:6837/4176441330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":4176441330},{"type":"v1","addr":"172.21.15.111:6837","nonce":4176441330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4258":{"gid":4258,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":18,"addr":"172.21.15.111:6833/3175932821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":3175932821},{"type":"v1","addr":"172.21.15.111:6833","nonce":3175932821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":9,"addr":"172.21.15.76:6835/544947706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":544947706},{"type":"v1","addr":"172.21.15.76:6835","nonce":544947706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4264,"qdb_cluster":[4264,4258]},"id":1}]} 2024-03-28T12:42:40.677 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 12 2024-03-28T12:42:40.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.678+0000 7fa7db600640 1 -- 172.21.15.76:0/1359214545 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7b0068010 msgr2=0x7fa7b006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:40.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.678+0000 7fa7db600640 1 --2- 172.21.15.76:0/1359214545 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7b0068010 0x7fa7b006a4d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40cd2f0 tx=0x7fa7bc009110 comp rx=0 tx=0).stop 2024-03-28T12:42:40.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.678+0000 7fa7db600640 1 -- 172.21.15.76:0/1359214545 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7d40ce470 msgr2=0x7fa7d40cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:40.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.678+0000 7fa7db600640 1 --2- 172.21.15.76:0/1359214545 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7d40ce470 0x7fa7d40cd8a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400c370 tx=0x7fa7c400c830 comp rx=0 tx=0).stop 2024-03-28T12:42:40.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.678+0000 7fa7db600640 1 -- 172.21.15.76:0/1359214545 shutdown_connections 2024-03-28T12:42:40.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.678+0000 7fa7db600640 1 --2- 172.21.15.76:0/1359214545 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7b0068010 0x7fa7b006a4d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:40.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.678+0000 7fa7db600640 1 --2- 172.21.15.76:0/1359214545 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7d4152780 0x7fa7d4144760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:40.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.678+0000 7fa7db600640 1 --2- 172.21.15.76:0/1359214545 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7d40ce8e0 0x7fa7d414dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:40.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.678+0000 7fa7db600640 1 --2- 172.21.15.76:0/1359214545 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7d40ce470 0x7fa7d40cd8a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:40.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.678+0000 7fa7db600640 1 -- 172.21.15.76:0/1359214545 >> 172.21.15.76:0/1359214545 conn(0x7fa7d4067730 msgr2=0x7fa7d4067b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:40.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.682+0000 7fa7db600640 1 -- 172.21.15.76:0/1359214545 shutdown_connections 2024-03-28T12:42:40.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.682+0000 7fa7db600640 1 -- 172.21.15.76:0/1359214545 wait complete. 2024-03-28T12:42:40.698 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T12:42:40.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.850+0000 7f01f9a00640 1 Processor -- start 2024-03-28T12:42:40.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.850+0000 7f01f9a00640 1 -- start start 2024-03-28T12:42:40.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.850+0000 7f01f9a00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f01f4151550 0x7f01f4070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:40.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.850+0000 7f01f9a00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f01f406f300 0x7f01f406f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:40.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.850+0000 7f01f9a00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01f40c3da0 con 0x7f01f40c79e0 2024-03-28T12:42:40.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.850+0000 7f01f9a00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f01f40c3b70 con 0x7f01f4151550 2024-03-28T12:42:40.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.850+0000 7f01f9a00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f01f4151cb0 con 0x7f01f406f300 2024-03-28T12:42:40.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.874+0000 7f01f3400640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f01f406f300 0x7f01f406f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:40.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.878+0000 7f01f3400640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f01f406f300 0x7f01f406f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:34094/0 (socket says 172.21.15.76:34094) 2024-03-28T12:42:40.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.878+0000 7f01f3400640 1 -- 172.21.15.76:0/3523648883 learned_addr learned my addr 172.21.15.76:0/3523648883 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:40.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.882+0000 7f01f3400640 1 -- 172.21.15.76:0/3523648883 >> v2:172.21.15.76:3300/0 conn(0x7f01f4151550 msgr2=0x7f01f4070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:40.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.882+0000 7f01f3400640 1 --2- 172.21.15.76:0/3523648883 >> v2:172.21.15.76:3300/0 conn(0x7f01f4151550 0x7f01f4070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:40.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.882+0000 7f01f3400640 1 -- 172.21.15.76:0/3523648883 >> v1:172.21.15.111:6789/0 conn(0x7f01f40c79e0 legacy=0x7f01f4157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:40.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.882+0000 7f01f3400640 1 -- 172.21.15.76:0/3523648883 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f40c4080 con 0x7f01f406f300 2024-03-28T12:42:40.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.890+0000 7f01f3400640 1 --2- 172.21.15.76:0/3523648883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f01f406f300 0x7f01f406f750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f01f4070800 tx=0x7f01ec01f1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=777d21b5126d2021 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:40.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.994+0000 7f01f1600640 1 -- 172.21.15.76:0/3523648883 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0b4070 con 0x7f01f406f300 2024-03-28T12:42:40.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.994+0000 7f01f1600640 1 -- 172.21.15.76:0/3523648883 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01ec0af400 con 0x7f01f406f300 2024-03-28T12:42:40.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.994+0000 7f01f1600640 1 -- 172.21.15.76:0/3523648883 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0af7d0 con 0x7f01f406f300 2024-03-28T12:42:40.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.994+0000 7f01f9a00640 1 -- 172.21.15.76:0/3523648883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f01f406f300 msgr2=0x7f01f406f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:40.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.994+0000 7f01f9a00640 1 --2- 172.21.15.76:0/3523648883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f01f406f300 0x7f01f406f750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f01f4070800 tx=0x7f01ec01f1a0 comp rx=0 tx=0).stop 2024-03-28T12:42:40.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.994+0000 7f01f9a00640 1 -- 172.21.15.76:0/3523648883 shutdown_connections 2024-03-28T12:42:40.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.994+0000 7f01f9a00640 1 --2- 172.21.15.76:0/3523648883 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f01f406f300 0x7f01f406f750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:40.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.994+0000 7f01f9a00640 1 --2- 172.21.15.76:0/3523648883 >> v2:172.21.15.76:3300/0 conn(0x7f01f4151550 0x7f01f4070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:40.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.994+0000 7f01f9a00640 1 -- 172.21.15.76:0/3523648883 >> 172.21.15.76:0/3523648883 conn(0x7f01f406c6b0 msgr2=0x7f01f406cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:40.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.994+0000 7f01f9a00640 1 -- 172.21.15.76:0/3523648883 shutdown_connections 2024-03-28T12:42:40.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.994+0000 7f01f9a00640 1 -- 172.21.15.76:0/3523648883 wait complete. 2024-03-28T12:42:40.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.994+0000 7f01f9a00640 1 Processor -- start 2024-03-28T12:42:40.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.994+0000 7f01f9a00640 1 -- start start 2024-03-28T12:42:40.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.998+0000 7f01f9a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01f406f300 0x7f01f414b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:40.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.998+0000 7f01f9a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f01f40c79e0 0x7f01f414ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:40.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.998+0000 7f01f9a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f01f4151550 0x7f01f4154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:40.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.998+0000 7f01f9a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f01f4157560 con 0x7f01f406f300 2024-03-28T12:42:40.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.998+0000 7f01f9a00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f01f4157940 con 0x7f01f4151550 2024-03-28T12:42:40.995 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.998+0000 7f01f9a00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f01f40c2460 con 0x7f01f40c79e0 2024-03-28T12:42:40.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.998+0000 7f01f2a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01f406f300 0x7f01f414b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:40.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.998+0000 7f01f2000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f01f40c79e0 0x7f01f414ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:40.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.998+0000 7f01f2a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01f406f300 0x7f01f414b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39752/0 (socket says 172.21.15.76:39752) 2024-03-28T12:42:40.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:40.998+0000 7f01f2a00640 1 -- 172.21.15.76:0/493331534 learned_addr learned my addr 172.21.15.76:0/493331534 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:40.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.002+0000 7f01f2a00640 1 -- 172.21.15.76:0/493331534 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f01f40c79e0 msgr2=0x7f01f414ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:40.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.002+0000 7f01f2a00640 1 --2- 172.21.15.76:0/493331534 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f01f40c79e0 0x7f01f414ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:40.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.002+0000 7f01f2a00640 1 -- 172.21.15.76:0/493331534 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f01f4151550 msgr2=0x7f01f4154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:41.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.002+0000 7f01f2a00640 1 --2- 172.21.15.76:0/493331534 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f01f4151550 0x7f01f4154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:41.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.002+0000 7f01f2a00640 1 -- 172.21.15.76:0/493331534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f406cfd0 con 0x7f01f406f300 2024-03-28T12:42:41.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.002+0000 7f01f2a00640 1 --2- 172.21.15.76:0/493331534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01f406f300 0x7f01f414b880 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f01e400b550 tx=0x7f01e400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:41.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.010+0000 7f01eaa00640 1 -- 172.21.15.76:0/493331534 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e4014070 con 0x7f01f406f300 2024-03-28T12:42:41.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.010+0000 7f01eaa00640 1 -- 172.21.15.76:0/493331534 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01e4010890 con 0x7f01f406f300 2024-03-28T12:42:41.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.010+0000 7f01eaa00640 1 -- 172.21.15.76:0/493331534 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e4010c80 con 0x7f01f406f300 2024-03-28T12:42:41.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.010+0000 7f01f9a00640 1 -- 172.21.15.76:0/493331534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f415a290 con 0x7f01f406f300 2024-03-28T12:42:41.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.010+0000 7f01f9a00640 1 -- 172.21.15.76:0/493331534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f41f1090 con 0x7f01f406f300 2024-03-28T12:42:41.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.010+0000 7f01f9a00640 1 -- 172.21.15.76:0/493331534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f4068df0 con 0x7f01f406f300 2024-03-28T12:42:41.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.030+0000 7f01eaa00640 1 -- 172.21.15.76:0/493331534 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f01e4017070 con 0x7f01f406f300 2024-03-28T12:42:41.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.034+0000 7f01eaa00640 1 --2- 172.21.15.76:0/493331534 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f01d4067fc0 0x7f01d406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:41.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.034+0000 7f01f2000640 1 --2- 172.21.15.76:0/493331534 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f01d4067fc0 0x7f01d406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:41.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.034+0000 7f01f2000640 1 --2- 172.21.15.76:0/493331534 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f01d4067fc0 0x7f01d406a480 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f01f4155060 tx=0x7f01e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:41.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.034+0000 7f01eaa00640 1 -- 172.21.15.76:0/493331534 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f01e4054960 con 0x7f01f406f300 2024-03-28T12:42:41.048 INFO:tasks.ceph.mds.c.smithi076.stderr:2024-03-28T12:42:41.046+0000 f9f5640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-28T12:42:41.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.298+0000 7f01eaa00640 1 -- 172.21.15.76:0/493331534 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f01e40568c0 con 0x7f01f406f300 2024-03-28T12:42:41.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.458+0000 7f01f9a00640 1 -- 172.21.15.76:0/493331534 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01f406fe60 con 0x7f01f406f300 2024-03-28T12:42:41.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.498+0000 7f01eaa00640 1 -- 172.21.15.76:0/493331534 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18798 (secure 0 0 0) 0x7f01e4010e20 con 0x7f01f406f300 2024-03-28T12:42:41.498 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:41.499 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":29,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:42:15.156639+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T12:41:58.010965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T12:41:59.698601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-28T12:42:05.363180+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.1","mappings":[{"from":3,"to":4}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]},{"pgid":"4.d","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":5}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:42:41.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.502+0000 7f01f9a00640 1 -- 172.21.15.76:0/493331534 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f01d4067fc0 msgr2=0x7f01d406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:41.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.502+0000 7f01f9a00640 1 --2- 172.21.15.76:0/493331534 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f01d4067fc0 0x7f01d406a480 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f01f4155060 tx=0x7f01e0009040 comp rx=0 tx=0).stop 2024-03-28T12:42:41.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.502+0000 7f01f9a00640 1 -- 172.21.15.76:0/493331534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01f406f300 msgr2=0x7f01f414b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:41.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.502+0000 7f01f9a00640 1 --2- 172.21.15.76:0/493331534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01f406f300 0x7f01f414b880 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f01e400b550 tx=0x7f01e400ba10 comp rx=0 tx=0).stop 2024-03-28T12:42:41.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.502+0000 7f01f9a00640 1 -- 172.21.15.76:0/493331534 shutdown_connections 2024-03-28T12:42:41.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.502+0000 7f01f9a00640 1 --2- 172.21.15.76:0/493331534 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f01d4067fc0 0x7f01d406a480 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:41.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.502+0000 7f01f9a00640 1 --2- 172.21.15.76:0/493331534 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f01f4151550 0x7f01f4154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:41.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.502+0000 7f01f9a00640 1 --2- 172.21.15.76:0/493331534 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f01f40c79e0 0x7f01f414ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:41.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.502+0000 7f01f9a00640 1 --2- 172.21.15.76:0/493331534 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f01f406f300 0x7f01f414b880 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:41.501 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.502+0000 7f01f9a00640 1 -- 172.21.15.76:0/493331534 >> 172.21.15.76:0/493331534 conn(0x7f01f406c6b0 msgr2=0x7f01f41e09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:41.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.502+0000 7f01f9a00640 1 -- 172.21.15.76:0/493331534 shutdown_connections 2024-03-28T12:42:41.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.502+0000 7f01f9a00640 1 -- 172.21.15.76:0/493331534 wait complete. 2024-03-28T12:42:41.520 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-28T12:42:41.521 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T12:42:41.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.662+0000 7f532a800640 1 Processor -- start 2024-03-28T12:42:41.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.662+0000 7f532a800640 1 -- start start 2024-03-28T12:42:41.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.666+0000 7f532a800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5324072440 0x7f53241524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:41.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.666+0000 7f532a800640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f53241592a0 0x7f53241529f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:41.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.666+0000 7f532a800640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f532415bf40 con 0x7f5324072060 2024-03-28T12:42:41.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.666+0000 7f532a800640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f53240c31e0 con 0x7f53241592a0 2024-03-28T12:42:41.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.666+0000 7f532a800640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f532415c220 con 0x7f5324072440 2024-03-28T12:42:41.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.666+0000 7f5323e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f53241592a0 0x7f53241529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:41.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.666+0000 7f5323400640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f5324072060 0x7f53240cb370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:50580/0 (socket says 172.21.15.76:50580) 2024-03-28T12:42:41.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.666+0000 7f5323400640 1 -- 172.21.15.76:0/566908073 learned_addr learned my addr 172.21.15.76:0/566908073 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:41.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.666+0000 7f5322a00640 1 --2- 172.21.15.76:0/566908073 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5324072440 0x7f53241524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:41.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.670+0000 7f5323e00640 1 -- 172.21.15.76:0/566908073 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5324072440 msgr2=0x7f53241524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:41.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.670+0000 7f5323e00640 1 --2- 172.21.15.76:0/566908073 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5324072440 0x7f53241524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:41.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.670+0000 7f5323e00640 1 -- 172.21.15.76:0/566908073 >> v1:172.21.15.76:6789/0 conn(0x7f5324072060 legacy=0x7f53240cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:41.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.670+0000 7f5323e00640 1 -- 172.21.15.76:0/566908073 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532415c500 con 0x7f53241592a0 2024-03-28T12:42:41.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.674+0000 7f5323e00640 1 --2- 172.21.15.76:0/566908073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53241592a0 0x7f53241529f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f531c009d90 tx=0x7f531c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6b4dfa7fee157d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:41.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.682+0000 7f5322000640 1 -- 172.21.15.76:0/566908073 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c0b2070 con 0x7f53241592a0 2024-03-28T12:42:41.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.682+0000 7f5322000640 1 -- 172.21.15.76:0/566908073 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f531c0a5940 con 0x7f53241592a0 2024-03-28T12:42:41.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.682+0000 7f5322000640 1 -- 172.21.15.76:0/566908073 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c0a5d10 con 0x7f53241592a0 2024-03-28T12:42:41.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.686+0000 7f532a800640 1 -- 172.21.15.76:0/566908073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53241592a0 msgr2=0x7f53241529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:41.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.686+0000 7f532a800640 1 --2- 172.21.15.76:0/566908073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53241592a0 0x7f53241529f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f531c009d90 tx=0x7f531c01c970 comp rx=0 tx=0).stop 2024-03-28T12:42:41.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.686+0000 7f532a800640 1 -- 172.21.15.76:0/566908073 shutdown_connections 2024-03-28T12:42:41.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.686+0000 7f532a800640 1 --2- 172.21.15.76:0/566908073 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53241592a0 0x7f53241529f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:41.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.686+0000 7f532a800640 1 --2- 172.21.15.76:0/566908073 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5324072440 0x7f53241524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:41.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.686+0000 7f532a800640 1 -- 172.21.15.76:0/566908073 >> 172.21.15.76:0/566908073 conn(0x7f5324071520 msgr2=0x7f5324070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:41.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.686+0000 7f532a800640 1 -- 172.21.15.76:0/566908073 shutdown_connections 2024-03-28T12:42:41.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.686+0000 7f532a800640 1 -- 172.21.15.76:0/566908073 wait complete. 2024-03-28T12:42:41.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.686+0000 7f532a800640 1 Processor -- start 2024-03-28T12:42:41.685 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.686+0000 7f532a800640 1 -- start start 2024-03-28T12:42:41.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.686+0000 7f532a800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5324072060 0x7f532414af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:41.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.686+0000 7f532a800640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5324072440 0x7f532406de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:41.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.686+0000 7f532a800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53241592a0 0x7f5324156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:41.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.686+0000 7f532a800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5324165260 con 0x7f53241592a0 2024-03-28T12:42:41.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.686+0000 7f532a800640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f53241650e0 con 0x7f5324072440 2024-03-28T12:42:41.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.686+0000 7f532a800640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f53241653e0 con 0x7f5324072060 2024-03-28T12:42:41.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.690+0000 7f5323e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53241592a0 0x7f5324156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:41.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.690+0000 7f5323400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5324072060 0x7f532414af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:41.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.690+0000 7f5323e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53241592a0 0x7f5324156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:39772/0 (socket says 172.21.15.76:39772) 2024-03-28T12:42:41.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.690+0000 7f5323e00640 1 -- 172.21.15.76:0/688407339 learned_addr learned my addr 172.21.15.76:0/688407339 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:41.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.690+0000 7f5322a00640 1 --2- 172.21.15.76:0/688407339 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5324072440 0x7f532406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:41.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.694+0000 7f5323e00640 1 -- 172.21.15.76:0/688407339 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5324072060 msgr2=0x7f532414af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:41.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.694+0000 7f5323e00640 1 --2- 172.21.15.76:0/688407339 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5324072060 0x7f532414af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:41.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.694+0000 7f5323e00640 1 -- 172.21.15.76:0/688407339 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5324072440 msgr2=0x7f532406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:41.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.694+0000 7f5323e00640 1 --2- 172.21.15.76:0/688407339 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5324072440 0x7f532406de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:41.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.694+0000 7f5323e00640 1 -- 172.21.15.76:0/688407339 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5324149d40 con 0x7f53241592a0 2024-03-28T12:42:41.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.694+0000 7f5323e00640 1 --2- 172.21.15.76:0/688407339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53241592a0 0x7f5324156a10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f531c01b020 tx=0x7f531c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:41.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.698+0000 7f531b400640 1 -- 172.21.15.76:0/688407339 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c0b2040 con 0x7f53241592a0 2024-03-28T12:42:41.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.698+0000 7f531b400640 1 -- 172.21.15.76:0/688407339 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f531c0bd070 con 0x7f53241592a0 2024-03-28T12:42:41.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.698+0000 7f532a800640 1 -- 172.21.15.76:0/688407339 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f532414a020 con 0x7f53241592a0 2024-03-28T12:42:41.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.698+0000 7f531b400640 1 -- 172.21.15.76:0/688407339 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c0ad440 con 0x7f53241592a0 2024-03-28T12:42:41.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.698+0000 7f532a800640 1 -- 172.21.15.76:0/688407339 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5324144de0 con 0x7f53241592a0 2024-03-28T12:42:41.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.698+0000 7f532a800640 1 -- 172.21.15.76:0/688407339 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53240686e0 con 0x7f53241592a0 2024-03-28T12:42:41.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.718+0000 7f531b400640 1 -- 172.21.15.76:0/688407339 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f531c0ad5e0 con 0x7f53241592a0 2024-03-28T12:42:41.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.722+0000 7f531b400640 1 --2- 172.21.15.76:0/688407339 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5304068010 0x7f530406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:41.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.722+0000 7f5323400640 1 --2- 172.21.15.76:0/688407339 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5304068010 0x7f530406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:41.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.722+0000 7f5323400640 1 --2- 172.21.15.76:0/688407339 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5304068010 0x7f530406a4d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5314000f70 tx=0x7f5314007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:41.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.722+0000 7f531b400640 1 -- 172.21.15.76:0/688407339 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f531c002020 con 0x7f53241592a0 2024-03-28T12:42:41.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:41.966+0000 7f531b400640 1 -- 172.21.15.76:0/688407339 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f531c0c7020 con 0x7f53241592a0 2024-03-28T12:42:42.136 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.138+0000 7f532a800640 1 -- 172.21.15.76:0/688407339 --> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f532414a300 con 0x7f5304068010 2024-03-28T12:42:42.146 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.146+0000 7f531b400640 1 -- 172.21.15.76:0/688407339 <== mgr.4107 v2:172.21.15.76:6800/1313648511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332698 (secure 0 0 0) 0x7f532414a300 con 0x7f5304068010 2024-03-28T12:42:42.150 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:42.152 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-03-28T12:42:42.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.154+0000 7f532a800640 1 -- 172.21.15.76:0/688407339 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5304068010 msgr2=0x7f530406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:42.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.154+0000 7f532a800640 1 --2- 172.21.15.76:0/688407339 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5304068010 0x7f530406a4d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5314000f70 tx=0x7f5314007e90 comp rx=0 tx=0).stop 2024-03-28T12:42:42.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.154+0000 7f532a800640 1 -- 172.21.15.76:0/688407339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53241592a0 msgr2=0x7f5324156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:42.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.154+0000 7f532a800640 1 --2- 172.21.15.76:0/688407339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53241592a0 0x7f5324156a10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f531c01b020 tx=0x7f531c019710 comp rx=0 tx=0).stop 2024-03-28T12:42:42.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.154+0000 7f532a800640 1 -- 172.21.15.76:0/688407339 shutdown_connections 2024-03-28T12:42:42.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.154+0000 7f532a800640 1 --2- 172.21.15.76:0/688407339 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5304068010 0x7f530406a4d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:42.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.154+0000 7f532a800640 1 --2- 172.21.15.76:0/688407339 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f53241592a0 0x7f5324156a10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:42.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.154+0000 7f532a800640 1 --2- 172.21.15.76:0/688407339 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5324072440 0x7f532406de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:42.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.154+0000 7f532a800640 1 --2- 172.21.15.76:0/688407339 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5324072060 0x7f532414af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:42.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.154+0000 7f532a800640 1 -- 172.21.15.76:0/688407339 >> 172.21.15.76:0/688407339 conn(0x7f5324071520 msgr2=0x7f53240cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:42.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.154+0000 7f532a800640 1 -- 172.21.15.76:0/688407339 shutdown_connections 2024-03-28T12:42:42.153 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.154+0000 7f532a800640 1 -- 172.21.15.76:0/688407339 wait complete. 2024-03-28T12:42:42.179 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-03-28T12:42:41.014831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595770,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":237,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218772,"kb_used_data":2624,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755948,"statfs":{"total":773094113280,"available":772870090752,"internally_reserved":0,"allocated":2686976,"data_stored":2203254,"data_compressed":66494,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":903,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002813"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.218889+0000","last_change":"2024-03-28T12:42:00.080769+0000","last_active":"2024-03-28T12:42:15.218889+0000","last_peered":"2024-03-28T12:42:15.218889+0000","last_clean":"2024-03-28T12:42:15.218889+0000","last_became_active":"2024-03-28T12:42:00.079900+0000","last_became_peered":"2024-03-28T12:42:00.079900+0000","last_unstale":"2024-03-28T12:42:15.218889+0000","last_undegraded":"2024-03-28T12:42:15.218889+0000","last_fullsized":"2024-03-28T12:42:15.218889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:26.156056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229988+0000","last_change":"2024-03-28T12:42:01.960244+0000","last_active":"2024-03-28T12:42:15.229988+0000","last_peered":"2024-03-28T12:42:15.229988+0000","last_clean":"2024-03-28T12:42:15.229988+0000","last_became_active":"2024-03-28T12:42:01.959408+0000","last_became_peered":"2024-03-28T12:42:01.959408+0000","last_unstale":"2024-03-28T12:42:15.229988+0000","last_undegraded":"2024-03-28T12:42:15.229988+0000","last_fullsized":"2024-03-28T12:42:15.229988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:00:51.741925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.218968+0000","last_change":"2024-03-28T12:42:07.880943+0000","last_active":"2024-03-28T12:42:15.218968+0000","last_peered":"2024-03-28T12:42:15.218968+0000","last_clean":"2024-03-28T12:42:15.218968+0000","last_became_active":"2024-03-28T12:42:07.880354+0000","last_became_peered":"2024-03-28T12:42:07.880354+0000","last_unstale":"2024-03-28T12:42:15.218968+0000","last_undegraded":"2024-03-28T12:42:15.218968+0000","last_fullsized":"2024-03-28T12:42:15.218968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:39.078379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.230130+0000","last_change":"2024-03-28T12:42:00.138569+0000","last_active":"2024-03-28T12:42:15.230130+0000","last_peered":"2024-03-28T12:42:15.230130+0000","last_clean":"2024-03-28T12:42:15.230130+0000","last_became_active":"2024-03-28T12:42:00.137978+0000","last_became_peered":"2024-03-28T12:42:00.137978+0000","last_unstale":"2024-03-28T12:42:15.230130+0000","last_undegraded":"2024-03-28T12:42:15.230130+0000","last_fullsized":"2024-03-28T12:42:15.230130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:38:28.575778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.232451+0000","last_change":"2024-03-28T12:42:01.958236+0000","last_active":"2024-03-28T12:42:15.232451+0000","last_peered":"2024-03-28T12:42:15.232451+0000","last_clean":"2024-03-28T12:42:15.232451+0000","last_became_active":"2024-03-28T12:42:01.957875+0000","last_became_peered":"2024-03-28T12:42:01.957875+0000","last_unstale":"2024-03-28T12:42:15.232451+0000","last_undegraded":"2024-03-28T12:42:15.232451+0000","last_fullsized":"2024-03-28T12:42:15.232451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:48:52.933175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.214830+0000","last_change":"2024-03-28T12:42:07.905799+0000","last_active":"2024-03-28T12:42:15.214830+0000","last_peered":"2024-03-28T12:42:15.214830+0000","last_clean":"2024-03-28T12:42:15.214830+0000","last_became_active":"2024-03-28T12:42:07.905350+0000","last_became_peered":"2024-03-28T12:42:07.905350+0000","last_unstale":"2024-03-28T12:42:15.214830+0000","last_undegraded":"2024-03-28T12:42:15.214830+0000","last_fullsized":"2024-03-28T12:42:15.214830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:33:42.281079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360068+0000","last_change":"2024-03-28T12:42:00.150272+0000","last_active":"2024-03-28T12:42:15.360068+0000","last_peered":"2024-03-28T12:42:15.360068+0000","last_clean":"2024-03-28T12:42:15.360068+0000","last_became_active":"2024-03-28T12:42:00.148367+0000","last_became_peered":"2024-03-28T12:42:00.148367+0000","last_unstale":"2024-03-28T12:42:15.360068+0000","last_undegraded":"2024-03-28T12:42:15.360068+0000","last_fullsized":"2024-03-28T12:42:15.360068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:26.156056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352641+0000","last_change":"2024-03-28T12:42:01.965158+0000","last_active":"2024-03-28T12:42:15.352641+0000","last_peered":"2024-03-28T12:42:15.352641+0000","last_clean":"2024-03-28T12:42:15.352641+0000","last_became_active":"2024-03-28T12:42:01.964817+0000","last_became_peered":"2024-03-28T12:42:01.964817+0000","last_unstale":"2024-03-28T12:42:15.352641+0000","last_undegraded":"2024-03-28T12:42:15.352641+0000","last_fullsized":"2024-03-28T12:42:15.352641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215063+0000","last_change":"2024-03-28T12:42:07.906794+0000","last_active":"2024-03-28T12:42:15.215063+0000","last_peered":"2024-03-28T12:42:15.215063+0000","last_clean":"2024-03-28T12:42:15.215063+0000","last_became_active":"2024-03-28T12:42:07.905522+0000","last_became_peered":"2024-03-28T12:42:07.905522+0000","last_unstale":"2024-03-28T12:42:15.215063+0000","last_undegraded":"2024-03-28T12:42:15.215063+0000","last_fullsized":"2024-03-28T12:42:15.215063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:21.970094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359867+0000","last_change":"2024-03-28T12:42:00.149947+0000","last_active":"2024-03-28T12:42:15.359867+0000","last_peered":"2024-03-28T12:42:15.359867+0000","last_clean":"2024-03-28T12:42:15.359867+0000","last_became_active":"2024-03-28T12:42:00.148446+0000","last_became_peered":"2024-03-28T12:42:00.148446+0000","last_unstale":"2024-03-28T12:42:15.359867+0000","last_undegraded":"2024-03-28T12:42:15.359867+0000","last_fullsized":"2024-03-28T12:42:15.359867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:47:28.765823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228727+0000","last_change":"2024-03-28T12:42:01.935596+0000","last_active":"2024-03-28T12:42:15.228727+0000","last_peered":"2024-03-28T12:42:15.228727+0000","last_clean":"2024-03-28T12:42:15.228727+0000","last_became_active":"2024-03-28T12:42:01.935231+0000","last_became_peered":"2024-03-28T12:42:01.935231+0000","last_unstale":"2024-03-28T12:42:15.228727+0000","last_undegraded":"2024-03-28T12:42:15.228727+0000","last_fullsized":"2024-03-28T12:42:15.228727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:17:41.296627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215002+0000","last_change":"2024-03-28T12:42:07.904616+0000","last_active":"2024-03-28T12:42:15.215002+0000","last_peered":"2024-03-28T12:42:15.215002+0000","last_clean":"2024-03-28T12:42:15.215002+0000","last_became_active":"2024-03-28T12:42:07.904240+0000","last_became_peered":"2024-03-28T12:42:07.904240+0000","last_unstale":"2024-03-28T12:42:15.215002+0000","last_undegraded":"2024-03-28T12:42:15.215002+0000","last_fullsized":"2024-03-28T12:42:15.215002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:19:27.175393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228168+0000","last_change":"2024-03-28T12:42:01.963116+0000","last_active":"2024-03-28T12:42:15.228168+0000","last_peered":"2024-03-28T12:42:15.228168+0000","last_clean":"2024-03-28T12:42:15.228168+0000","last_became_active":"2024-03-28T12:42:01.962885+0000","last_became_peered":"2024-03-28T12:42:01.962885+0000","last_unstale":"2024-03-28T12:42:15.228168+0000","last_undegraded":"2024-03-28T12:42:15.228168+0000","last_fullsized":"2024-03-28T12:42:15.228168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:19:06.640780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228968+0000","last_change":"2024-03-28T12:42:00.134353+0000","last_active":"2024-03-28T12:42:15.228968+0000","last_peered":"2024-03-28T12:42:15.228968+0000","last_clean":"2024-03-28T12:42:15.228968+0000","last_became_active":"2024-03-28T12:42:00.133880+0000","last_became_peered":"2024-03-28T12:42:00.133880+0000","last_unstale":"2024-03-28T12:42:15.228968+0000","last_undegraded":"2024-03-28T12:42:15.228968+0000","last_fullsized":"2024-03-28T12:42:15.228968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:45:14.194934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.238142+0000","last_change":"2024-03-28T12:42:15.238142+0000","last_active":"2024-03-28T12:42:15.238142+0000","last_peered":"2024-03-28T12:42:15.238142+0000","last_clean":"2024-03-28T12:42:15.238142+0000","last_became_active":"2024-03-28T12:42:15.237739+0000","last_became_peered":"2024-03-28T12:42:15.237739+0000","last_unstale":"2024-03-28T12:42:15.238142+0000","last_undegraded":"2024-03-28T12:42:15.238142+0000","last_fullsized":"2024-03-28T12:42:15.238142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:41:14.243482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.221374+0000","last_change":"2024-03-28T12:42:01.948688+0000","last_active":"2024-03-28T12:42:15.221374+0000","last_peered":"2024-03-28T12:42:15.221374+0000","last_clean":"2024-03-28T12:42:15.221374+0000","last_became_active":"2024-03-28T12:42:01.948049+0000","last_became_peered":"2024-03-28T12:42:01.948049+0000","last_unstale":"2024-03-28T12:42:15.221374+0000","last_undegraded":"2024-03-28T12:42:15.221374+0000","last_fullsized":"2024-03-28T12:42:15.221374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361477+0000","last_change":"2024-03-28T12:42:00.139208+0000","last_active":"2024-03-28T12:42:15.361477+0000","last_peered":"2024-03-28T12:42:15.361477+0000","last_clean":"2024-03-28T12:42:15.361477+0000","last_became_active":"2024-03-28T12:42:00.138264+0000","last_became_peered":"2024-03-28T12:42:00.138264+0000","last_unstale":"2024-03-28T12:42:15.361477+0000","last_undegraded":"2024-03-28T12:42:15.361477+0000","last_fullsized":"2024-03-28T12:42:15.361477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359578+0000","last_change":"2024-03-28T12:42:07.941636+0000","last_active":"2024-03-28T12:42:15.359578+0000","last_peered":"2024-03-28T12:42:15.359578+0000","last_clean":"2024-03-28T12:42:15.359578+0000","last_became_active":"2024-03-28T12:42:07.941114+0000","last_became_peered":"2024-03-28T12:42:07.941114+0000","last_unstale":"2024-03-28T12:42:15.359578+0000","last_undegraded":"2024-03-28T12:42:15.359578+0000","last_fullsized":"2024-03-28T12:42:15.359578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:00:58.736580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216501+0000","last_change":"2024-03-28T12:42:01.949545+0000","last_active":"2024-03-28T12:42:15.216501+0000","last_peered":"2024-03-28T12:42:15.216501+0000","last_clean":"2024-03-28T12:42:15.216501+0000","last_became_active":"2024-03-28T12:42:01.946576+0000","last_became_peered":"2024-03-28T12:42:01.946576+0000","last_unstale":"2024-03-28T12:42:15.216501+0000","last_undegraded":"2024-03-28T12:42:15.216501+0000","last_fullsized":"2024-03-28T12:42:15.216501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:32.704186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.314300+0000","last_change":"2024-03-28T12:42:00.142804+0000","last_active":"2024-03-28T12:42:38.314300+0000","last_peered":"2024-03-28T12:42:38.314300+0000","last_clean":"2024-03-28T12:42:38.314300+0000","last_became_active":"2024-03-28T12:42:00.142063+0000","last_became_peered":"2024-03-28T12:42:00.142063+0000","last_unstale":"2024-03-28T12:42:38.314300+0000","last_undegraded":"2024-03-28T12:42:38.314300+0000","last_fullsized":"2024-03-28T12:42:38.314300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:20:01.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.234431+0000","last_change":"2024-03-28T12:42:15.234431+0000","last_active":"2024-03-28T12:42:15.234431+0000","last_peered":"2024-03-28T12:42:15.234431+0000","last_clean":"2024-03-28T12:42:15.234431+0000","last_became_active":"2024-03-28T12:42:15.232928+0000","last_became_peered":"2024-03-28T12:42:15.232928+0000","last_unstale":"2024-03-28T12:42:15.234431+0000","last_undegraded":"2024-03-28T12:42:15.234431+0000","last_fullsized":"2024-03-28T12:42:15.234431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:05:19.841176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,5],"acting":[7,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228360+0000","last_change":"2024-03-28T12:42:01.787457+0000","last_active":"2024-03-28T12:42:15.228360+0000","last_peered":"2024-03-28T12:42:15.228360+0000","last_clean":"2024-03-28T12:42:15.228360+0000","last_became_active":"2024-03-28T12:42:01.787253+0000","last_became_peered":"2024-03-28T12:42:01.787253+0000","last_unstale":"2024-03-28T12:42:15.228360+0000","last_undegraded":"2024-03-28T12:42:15.228360+0000","last_fullsized":"2024-03-28T12:42:15.228360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:33.620394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.524652+0000","last_change":"2024-03-28T12:42:00.146723+0000","last_active":"2024-03-28T12:42:38.524652+0000","last_peered":"2024-03-28T12:42:38.524652+0000","last_clean":"2024-03-28T12:42:38.524652+0000","last_became_active":"2024-03-28T12:42:00.146394+0000","last_became_peered":"2024-03-28T12:42:00.146394+0000","last_unstale":"2024-03-28T12:42:38.524652+0000","last_undegraded":"2024-03-28T12:42:38.524652+0000","last_fullsized":"2024-03-28T12:42:38.524652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:20:01.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216137+0000","last_change":"2024-03-28T12:42:07.906623+0000","last_active":"2024-03-28T12:42:15.216137+0000","last_peered":"2024-03-28T12:42:15.216137+0000","last_clean":"2024-03-28T12:42:15.216137+0000","last_became_active":"2024-03-28T12:42:07.906233+0000","last_became_peered":"2024-03-28T12:42:07.906233+0000","last_unstale":"2024-03-28T12:42:15.216137+0000","last_undegraded":"2024-03-28T12:42:15.216137+0000","last_fullsized":"2024-03-28T12:42:15.216137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:45.857353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217128+0000","last_change":"2024-03-28T12:42:01.946498+0000","last_active":"2024-03-28T12:42:15.217128+0000","last_peered":"2024-03-28T12:42:15.217128+0000","last_clean":"2024-03-28T12:42:15.217128+0000","last_became_active":"2024-03-28T12:42:01.946087+0000","last_became_peered":"2024-03-28T12:42:01.946087+0000","last_unstale":"2024-03-28T12:42:15.217128+0000","last_undegraded":"2024-03-28T12:42:15.217128+0000","last_fullsized":"2024-03-28T12:42:15.217128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:05:13.466983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229900+0000","last_change":"2024-03-28T12:42:00.143860+0000","last_active":"2024-03-28T12:42:15.229900+0000","last_peered":"2024-03-28T12:42:15.229900+0000","last_clean":"2024-03-28T12:42:15.229900+0000","last_became_active":"2024-03-28T12:42:00.143537+0000","last_became_peered":"2024-03-28T12:42:00.143537+0000","last_unstale":"2024-03-28T12:42:15.229900+0000","last_undegraded":"2024-03-28T12:42:15.229900+0000","last_fullsized":"2024-03-28T12:42:15.229900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:38:32.416338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.365975+0000","last_change":"2024-03-28T12:42:15.365975+0000","last_active":"2024-03-28T12:42:15.365975+0000","last_peered":"2024-03-28T12:42:15.365975+0000","last_clean":"2024-03-28T12:42:15.365975+0000","last_became_active":"2024-03-28T12:42:15.365535+0000","last_became_peered":"2024-03-28T12:42:15.365535+0000","last_unstale":"2024-03-28T12:42:15.365975+0000","last_undegraded":"2024-03-28T12:42:15.365975+0000","last_fullsized":"2024-03-28T12:42:15.365975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,1],"acting":[2,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.218523+0000","last_change":"2024-03-28T12:42:01.802128+0000","last_active":"2024-03-28T12:42:15.218523+0000","last_peered":"2024-03-28T12:42:15.218523+0000","last_clean":"2024-03-28T12:42:15.218523+0000","last_became_active":"2024-03-28T12:42:01.801492+0000","last_became_peered":"2024-03-28T12:42:01.801492+0000","last_unstale":"2024-03-28T12:42:15.218523+0000","last_undegraded":"2024-03-28T12:42:15.218523+0000","last_fullsized":"2024-03-28T12:42:15.218523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:23:08.932618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:18.177557+0000","last_change":"2024-03-28T12:42:00.145914+0000","last_active":"2024-03-28T12:42:18.177557+0000","last_peered":"2024-03-28T12:42:18.177557+0000","last_clean":"2024-03-28T12:42:18.177557+0000","last_became_active":"2024-03-28T12:42:00.145638+0000","last_became_peered":"2024-03-28T12:42:00.145638+0000","last_unstale":"2024-03-28T12:42:18.177557+0000","last_undegraded":"2024-03-28T12:42:18.177557+0000","last_fullsized":"2024-03-28T12:42:18.177557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:47:28.765823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216394+0000","last_change":"2024-03-28T12:42:07.882697+0000","last_active":"2024-03-28T12:42:15.216394+0000","last_peered":"2024-03-28T12:42:15.216394+0000","last_clean":"2024-03-28T12:42:15.216394+0000","last_became_active":"2024-03-28T12:42:07.881730+0000","last_became_peered":"2024-03-28T12:42:07.881730+0000","last_unstale":"2024-03-28T12:42:15.216394+0000","last_undegraded":"2024-03-28T12:42:15.216394+0000","last_fullsized":"2024-03-28T12:42:15.216394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:12:27.231636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361319+0000","last_change":"2024-03-28T12:42:01.810914+0000","last_active":"2024-03-28T12:42:15.361319+0000","last_peered":"2024-03-28T12:42:15.361319+0000","last_clean":"2024-03-28T12:42:15.361319+0000","last_became_active":"2024-03-28T12:42:01.810207+0000","last_became_peered":"2024-03-28T12:42:01.810207+0000","last_unstale":"2024-03-28T12:42:15.361319+0000","last_undegraded":"2024-03-28T12:42:15.361319+0000","last_fullsized":"2024-03-28T12:42:15.361319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:32.704186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229681+0000","last_change":"2024-03-28T12:42:00.078402+0000","last_active":"2024-03-28T12:42:15.229681+0000","last_peered":"2024-03-28T12:42:15.229681+0000","last_clean":"2024-03-28T12:42:15.229681+0000","last_became_active":"2024-03-28T12:42:00.077988+0000","last_became_peered":"2024-03-28T12:42:00.077988+0000","last_unstale":"2024-03-28T12:42:15.229681+0000","last_undegraded":"2024-03-28T12:42:15.229681+0000","last_fullsized":"2024-03-28T12:42:15.229681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:21:58.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.362387+0000","last_change":"2024-03-28T12:42:07.936419+0000","last_active":"2024-03-28T12:42:15.362387+0000","last_peered":"2024-03-28T12:42:15.362387+0000","last_clean":"2024-03-28T12:42:15.362387+0000","last_became_active":"2024-03-28T12:42:07.935820+0000","last_became_peered":"2024-03-28T12:42:07.935820+0000","last_unstale":"2024-03-28T12:42:15.362387+0000","last_undegraded":"2024-03-28T12:42:15.362387+0000","last_fullsized":"2024-03-28T12:42:15.362387+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:35:08.334379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216161+0000","last_change":"2024-03-28T12:42:01.968887+0000","last_active":"2024-03-28T12:42:15.216161+0000","last_peered":"2024-03-28T12:42:15.216161+0000","last_clean":"2024-03-28T12:42:15.216161+0000","last_became_active":"2024-03-28T12:42:01.965491+0000","last_became_peered":"2024-03-28T12:42:01.965491+0000","last_unstale":"2024-03-28T12:42:15.216161+0000","last_undegraded":"2024-03-28T12:42:15.216161+0000","last_fullsized":"2024-03-28T12:42:15.216161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:35:50.246850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229216+0000","last_change":"2024-03-28T12:42:00.135482+0000","last_active":"2024-03-28T12:42:15.229216+0000","last_peered":"2024-03-28T12:42:15.229216+0000","last_clean":"2024-03-28T12:42:15.229216+0000","last_became_active":"2024-03-28T12:42:00.132939+0000","last_became_peered":"2024-03-28T12:42:00.132939+0000","last_unstale":"2024-03-28T12:42:15.229216+0000","last_undegraded":"2024-03-28T12:42:15.229216+0000","last_fullsized":"2024-03-28T12:42:15.229216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:31:41.407157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360749+0000","last_change":"2024-03-28T12:42:07.865644+0000","last_active":"2024-03-28T12:42:15.360749+0000","last_peered":"2024-03-28T12:42:15.360749+0000","last_clean":"2024-03-28T12:42:15.360749+0000","last_became_active":"2024-03-28T12:42:07.864804+0000","last_became_peered":"2024-03-28T12:42:07.864804+0000","last_unstale":"2024-03-28T12:42:15.360749+0000","last_undegraded":"2024-03-28T12:42:15.360749+0000","last_fullsized":"2024-03-28T12:42:15.360749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:28.659784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359688+0000","last_change":"2024-03-28T12:42:01.966222+0000","last_active":"2024-03-28T12:42:15.359688+0000","last_peered":"2024-03-28T12:42:15.359688+0000","last_clean":"2024-03-28T12:42:15.359688+0000","last_became_active":"2024-03-28T12:42:01.962305+0000","last_became_peered":"2024-03-28T12:42:01.962305+0000","last_unstale":"2024-03-28T12:42:15.359688+0000","last_undegraded":"2024-03-28T12:42:15.359688+0000","last_fullsized":"2024-03-28T12:42:15.359688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:33:35.906886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228509+0000","last_change":"2024-03-28T12:42:00.137406+0000","last_active":"2024-03-28T12:42:15.228509+0000","last_peered":"2024-03-28T12:42:15.228509+0000","last_clean":"2024-03-28T12:42:15.228509+0000","last_became_active":"2024-03-28T12:42:00.137086+0000","last_became_peered":"2024-03-28T12:42:00.137086+0000","last_unstale":"2024-03-28T12:42:15.228509+0000","last_undegraded":"2024-03-28T12:42:15.228509+0000","last_fullsized":"2024-03-28T12:42:15.228509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:44:10.945015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360602+0000","last_change":"2024-03-28T12:42:07.940726+0000","last_active":"2024-03-28T12:42:15.360602+0000","last_peered":"2024-03-28T12:42:15.360602+0000","last_clean":"2024-03-28T12:42:15.360602+0000","last_became_active":"2024-03-28T12:42:07.939926+0000","last_became_peered":"2024-03-28T12:42:07.939926+0000","last_unstale":"2024-03-28T12:42:15.360602+0000","last_undegraded":"2024-03-28T12:42:15.360602+0000","last_fullsized":"2024-03-28T12:42:15.360602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:45.857353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.226194+0000","last_change":"2024-03-28T12:42:01.949510+0000","last_active":"2024-03-28T12:42:15.226194+0000","last_peered":"2024-03-28T12:42:15.226194+0000","last_clean":"2024-03-28T12:42:15.226194+0000","last_became_active":"2024-03-28T12:42:01.949046+0000","last_became_peered":"2024-03-28T12:42:01.949046+0000","last_unstale":"2024-03-28T12:42:15.226194+0000","last_undegraded":"2024-03-28T12:42:15.226194+0000","last_fullsized":"2024-03-28T12:42:15.226194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:50:04.915302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.221135+0000","last_change":"2024-03-28T12:42:00.150734+0000","last_active":"2024-03-28T12:42:15.221135+0000","last_peered":"2024-03-28T12:42:15.221135+0000","last_clean":"2024-03-28T12:42:15.221135+0000","last_became_active":"2024-03-28T12:42:00.150209+0000","last_became_peered":"2024-03-28T12:42:00.150209+0000","last_unstale":"2024-03-28T12:42:15.221135+0000","last_undegraded":"2024-03-28T12:42:15.221135+0000","last_fullsized":"2024-03-28T12:42:15.221135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:01:08.734929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361808+0000","last_change":"2024-03-28T12:42:07.935974+0000","last_active":"2024-03-28T12:42:15.361808+0000","last_peered":"2024-03-28T12:42:15.361808+0000","last_clean":"2024-03-28T12:42:15.361808+0000","last_became_active":"2024-03-28T12:42:07.935342+0000","last_became_peered":"2024-03-28T12:42:07.935342+0000","last_unstale":"2024-03-28T12:42:15.361808+0000","last_undegraded":"2024-03-28T12:42:15.361808+0000","last_fullsized":"2024-03-28T12:42:15.361808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:21.970094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360601+0000","last_change":"2024-03-28T12:42:01.961701+0000","last_active":"2024-03-28T12:42:15.360601+0000","last_peered":"2024-03-28T12:42:15.360601+0000","last_clean":"2024-03-28T12:42:15.360601+0000","last_became_active":"2024-03-28T12:42:01.961228+0000","last_became_peered":"2024-03-28T12:42:01.961228+0000","last_unstale":"2024-03-28T12:42:15.360601+0000","last_undegraded":"2024-03-28T12:42:15.360601+0000","last_fullsized":"2024-03-28T12:42:15.360601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227858+0000","last_change":"2024-03-28T12:42:00.069398+0000","last_active":"2024-03-28T12:42:15.227858+0000","last_peered":"2024-03-28T12:42:15.227858+0000","last_clean":"2024-03-28T12:42:15.227858+0000","last_became_active":"2024-03-28T12:42:00.069134+0000","last_became_peered":"2024-03-28T12:42:00.069134+0000","last_unstale":"2024-03-28T12:42:15.227858+0000","last_undegraded":"2024-03-28T12:42:15.227858+0000","last_fullsized":"2024-03-28T12:42:15.227858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:57:54.776311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.365776+0000","last_change":"2024-03-28T12:42:15.365776+0000","last_active":"2024-03-28T12:42:15.365776+0000","last_peered":"2024-03-28T12:42:15.365776+0000","last_clean":"2024-03-28T12:42:15.365776+0000","last_became_active":"2024-03-28T12:42:15.364496+0000","last_became_peered":"2024-03-28T12:42:15.364496+0000","last_unstale":"2024-03-28T12:42:15.365776+0000","last_undegraded":"2024-03-28T12:42:15.365776+0000","last_fullsized":"2024-03-28T12:42:15.365776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:22:09.948471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217033+0000","last_change":"2024-03-28T12:42:01.959210+0000","last_active":"2024-03-28T12:42:15.217033+0000","last_peered":"2024-03-28T12:42:15.217033+0000","last_clean":"2024-03-28T12:42:15.217033+0000","last_became_active":"2024-03-28T12:42:01.958117+0000","last_became_peered":"2024-03-28T12:42:01.958117+0000","last_unstale":"2024-03-28T12:42:15.217033+0000","last_undegraded":"2024-03-28T12:42:15.217033+0000","last_fullsized":"2024-03-28T12:42:15.217033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:28:17.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229068+0000","last_change":"2024-03-28T12:42:00.134120+0000","last_active":"2024-03-28T12:42:15.229068+0000","last_peered":"2024-03-28T12:42:15.229068+0000","last_clean":"2024-03-28T12:42:15.229068+0000","last_became_active":"2024-03-28T12:42:00.133540+0000","last_became_peered":"2024-03-28T12:42:00.133540+0000","last_unstale":"2024-03-28T12:42:15.229068+0000","last_undegraded":"2024-03-28T12:42:15.229068+0000","last_fullsized":"2024-03-28T12:42:15.229068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:49:47.641947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352740+0000","last_change":"2024-03-28T12:41:26.701485+0000","last_active":"2024-03-28T12:42:15.352740+0000","last_peered":"2024-03-28T12:42:15.352740+0000","last_clean":"2024-03-28T12:42:15.352740+0000","last_became_active":"2024-03-28T12:41:26.700338+0000","last_became_peered":"2024-03-28T12:41:26.700338+0000","last_unstale":"2024-03-28T12:42:15.352740+0000","last_undegraded":"2024-03-28T12:42:15.352740+0000","last_fullsized":"2024-03-28T12:42:15.352740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:24.290713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:24.290713+0000","last_clean_scrub_stamp":"2024-03-28T12:41:24.290713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:58:57.536691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229580+0000","last_change":"2024-03-28T12:42:07.938384+0000","last_active":"2024-03-28T12:42:15.229580+0000","last_peered":"2024-03-28T12:42:15.229580+0000","last_clean":"2024-03-28T12:42:15.229580+0000","last_became_active":"2024-03-28T12:42:07.937553+0000","last_became_peered":"2024-03-28T12:42:07.937553+0000","last_unstale":"2024-03-28T12:42:15.229580+0000","last_undegraded":"2024-03-28T12:42:15.229580+0000","last_fullsized":"2024-03-28T12:42:15.229580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:28:13.502930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228823+0000","last_change":"2024-03-28T12:42:01.960107+0000","last_active":"2024-03-28T12:42:15.228823+0000","last_peered":"2024-03-28T12:42:15.228823+0000","last_clean":"2024-03-28T12:42:15.228823+0000","last_became_active":"2024-03-28T12:42:01.959809+0000","last_became_peered":"2024-03-28T12:42:01.959809+0000","last_unstale":"2024-03-28T12:42:15.228823+0000","last_undegraded":"2024-03-28T12:42:15.228823+0000","last_fullsized":"2024-03-28T12:42:15.228823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:38.797683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361372+0000","last_change":"2024-03-28T12:42:00.144133+0000","last_active":"2024-03-28T12:42:15.361372+0000","last_peered":"2024-03-28T12:42:15.361372+0000","last_clean":"2024-03-28T12:42:15.361372+0000","last_became_active":"2024-03-28T12:42:00.143460+0000","last_became_peered":"2024-03-28T12:42:00.143460+0000","last_unstale":"2024-03-28T12:42:15.361372+0000","last_undegraded":"2024-03-28T12:42:15.361372+0000","last_fullsized":"2024-03-28T12:42:15.361372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215115+0000","last_change":"2024-03-28T12:42:07.902848+0000","last_active":"2024-03-28T12:42:15.215115+0000","last_peered":"2024-03-28T12:42:15.215115+0000","last_clean":"2024-03-28T12:42:15.215115+0000","last_became_active":"2024-03-28T12:42:07.902428+0000","last_became_peered":"2024-03-28T12:42:07.902428+0000","last_unstale":"2024-03-28T12:42:15.215115+0000","last_undegraded":"2024-03-28T12:42:15.215115+0000","last_fullsized":"2024-03-28T12:42:15.215115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:28.659784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359765+0000","last_change":"2024-03-28T12:42:01.950786+0000","last_active":"2024-03-28T12:42:15.359765+0000","last_peered":"2024-03-28T12:42:15.359765+0000","last_clean":"2024-03-28T12:42:15.359765+0000","last_became_active":"2024-03-28T12:42:01.950592+0000","last_became_peered":"2024-03-28T12:42:01.950592+0000","last_unstale":"2024-03-28T12:42:15.359765+0000","last_undegraded":"2024-03-28T12:42:15.359765+0000","last_fullsized":"2024-03-28T12:42:15.359765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:53.224241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229716+0000","last_change":"2024-03-28T12:42:00.148307+0000","last_active":"2024-03-28T12:42:15.229716+0000","last_peered":"2024-03-28T12:42:15.229716+0000","last_clean":"2024-03-28T12:42:15.229716+0000","last_became_active":"2024-03-28T12:42:00.139237+0000","last_became_peered":"2024-03-28T12:42:00.139237+0000","last_unstale":"2024-03-28T12:42:15.229716+0000","last_undegraded":"2024-03-28T12:42:15.229716+0000","last_fullsized":"2024-03-28T12:42:15.229716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:43:33.699843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227129+0000","last_change":"2024-03-28T12:42:07.885520+0000","last_active":"2024-03-28T12:42:15.227129+0000","last_peered":"2024-03-28T12:42:15.227129+0000","last_clean":"2024-03-28T12:42:15.227129+0000","last_became_active":"2024-03-28T12:42:07.880300+0000","last_became_peered":"2024-03-28T12:42:07.880300+0000","last_unstale":"2024-03-28T12:42:15.227129+0000","last_undegraded":"2024-03-28T12:42:15.227129+0000","last_fullsized":"2024-03-28T12:42:15.227129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:17:47.670820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359833+0000","last_change":"2024-03-28T12:42:01.962888+0000","last_active":"2024-03-28T12:42:15.359833+0000","last_peered":"2024-03-28T12:42:15.359833+0000","last_clean":"2024-03-28T12:42:15.359833+0000","last_became_active":"2024-03-28T12:42:01.962604+0000","last_became_peered":"2024-03-28T12:42:01.962604+0000","last_unstale":"2024-03-28T12:42:15.359833+0000","last_undegraded":"2024-03-28T12:42:15.359833+0000","last_fullsized":"2024-03-28T12:42:15.359833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:49.327792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217421+0000","last_change":"2024-03-28T12:42:00.085372+0000","last_active":"2024-03-28T12:42:15.217421+0000","last_peered":"2024-03-28T12:42:15.217421+0000","last_clean":"2024-03-28T12:42:15.217421+0000","last_became_active":"2024-03-28T12:42:00.084866+0000","last_became_peered":"2024-03-28T12:42:00.084866+0000","last_unstale":"2024-03-28T12:42:15.217421+0000","last_undegraded":"2024-03-28T12:42:15.217421+0000","last_fullsized":"2024-03-28T12:42:15.217421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:21:45.688123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227629+0000","last_change":"2024-03-28T12:42:07.899218+0000","last_active":"2024-03-28T12:42:15.227629+0000","last_peered":"2024-03-28T12:42:15.227629+0000","last_clean":"2024-03-28T12:42:15.227629+0000","last_became_active":"2024-03-28T12:42:07.898853+0000","last_became_peered":"2024-03-28T12:42:07.898853+0000","last_unstale":"2024-03-28T12:42:15.227629+0000","last_undegraded":"2024-03-28T12:42:15.227629+0000","last_fullsized":"2024-03-28T12:42:15.227629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:21.240557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216536+0000","last_change":"2024-03-28T12:42:01.965370+0000","last_active":"2024-03-28T12:42:15.216536+0000","last_peered":"2024-03-28T12:42:15.216536+0000","last_clean":"2024-03-28T12:42:15.216536+0000","last_became_active":"2024-03-28T12:42:01.964442+0000","last_became_peered":"2024-03-28T12:42:01.964442+0000","last_unstale":"2024-03-28T12:42:15.216536+0000","last_undegraded":"2024-03-28T12:42:15.216536+0000","last_fullsized":"2024-03-28T12:42:15.216536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:35.775033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359937+0000","last_change":"2024-03-28T12:42:00.153658+0000","last_active":"2024-03-28T12:42:15.359937+0000","last_peered":"2024-03-28T12:42:15.359937+0000","last_clean":"2024-03-28T12:42:15.359937+0000","last_became_active":"2024-03-28T12:42:00.153292+0000","last_became_peered":"2024-03-28T12:42:00.153292+0000","last_unstale":"2024-03-28T12:42:15.359937+0000","last_undegraded":"2024-03-28T12:42:15.359937+0000","last_fullsized":"2024-03-28T12:42:15.359937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:54.524905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.353046+0000","last_change":"2024-03-28T12:42:07.900126+0000","last_active":"2024-03-28T12:42:15.353046+0000","last_peered":"2024-03-28T12:42:15.353046+0000","last_clean":"2024-03-28T12:42:15.353046+0000","last_became_active":"2024-03-28T12:42:07.899780+0000","last_became_peered":"2024-03-28T12:42:07.899780+0000","last_unstale":"2024-03-28T12:42:15.353046+0000","last_undegraded":"2024-03-28T12:42:15.353046+0000","last_fullsized":"2024-03-28T12:42:15.353046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:31.070732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228279+0000","last_change":"2024-03-28T12:42:01.962221+0000","last_active":"2024-03-28T12:42:15.228279+0000","last_peered":"2024-03-28T12:42:15.228279+0000","last_clean":"2024-03-28T12:42:15.228279+0000","last_became_active":"2024-03-28T12:42:01.961938+0000","last_became_peered":"2024-03-28T12:42:01.961938+0000","last_unstale":"2024-03-28T12:42:15.228279+0000","last_undegraded":"2024-03-28T12:42:15.228279+0000","last_fullsized":"2024-03-28T12:42:15.228279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:55:52.354803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'10","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.313359+0000","last_change":"2024-03-28T12:42:00.132287+0000","last_active":"2024-03-28T12:42:38.313359+0000","last_peered":"2024-03-28T12:42:38.313359+0000","last_clean":"2024-03-28T12:42:38.313359+0000","last_became_active":"2024-03-28T12:42:00.131064+0000","last_became_peered":"2024-03-28T12:42:00.131064+0000","last_unstale":"2024-03-28T12:42:38.313359+0000","last_undegraded":"2024-03-28T12:42:38.313359+0000","last_fullsized":"2024-03-28T12:42:38.313359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229667+0000","last_change":"2024-03-28T12:42:07.887453+0000","last_active":"2024-03-28T12:42:15.229667+0000","last_peered":"2024-03-28T12:42:15.229667+0000","last_clean":"2024-03-28T12:42:15.229667+0000","last_became_active":"2024-03-28T12:42:07.886685+0000","last_became_peered":"2024-03-28T12:42:07.886685+0000","last_unstale":"2024-03-28T12:42:15.229667+0000","last_undegraded":"2024-03-28T12:42:15.229667+0000","last_fullsized":"2024-03-28T12:42:15.229667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:10:05.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352581+0000","last_change":"2024-03-28T12:42:01.961318+0000","last_active":"2024-03-28T12:42:15.352581+0000","last_peered":"2024-03-28T12:42:15.352581+0000","last_clean":"2024-03-28T12:42:15.352581+0000","last_became_active":"2024-03-28T12:42:01.960102+0000","last_became_peered":"2024-03-28T12:42:01.960102+0000","last_unstale":"2024-03-28T12:42:15.352581+0000","last_undegraded":"2024-03-28T12:42:15.352581+0000","last_fullsized":"2024-03-28T12:42:15.352581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359413+0000","last_change":"2024-03-28T12:42:00.145117+0000","last_active":"2024-03-28T12:42:15.359413+0000","last_peered":"2024-03-28T12:42:15.359413+0000","last_clean":"2024-03-28T12:42:15.359413+0000","last_became_active":"2024-03-28T12:42:00.144572+0000","last_became_peered":"2024-03-28T12:42:00.144572+0000","last_unstale":"2024-03-28T12:42:15.359413+0000","last_undegraded":"2024-03-28T12:42:15.359413+0000","last_fullsized":"2024-03-28T12:42:15.359413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:21:45.688123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.232187+0000","last_change":"2024-03-28T12:42:07.885727+0000","last_active":"2024-03-28T12:42:15.232187+0000","last_peered":"2024-03-28T12:42:15.232187+0000","last_clean":"2024-03-28T12:42:15.232187+0000","last_became_active":"2024-03-28T12:42:07.884760+0000","last_became_peered":"2024-03-28T12:42:07.884760+0000","last_unstale":"2024-03-28T12:42:15.232187+0000","last_undegraded":"2024-03-28T12:42:15.232187+0000","last_fullsized":"2024-03-28T12:42:15.232187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:45.171876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228766+0000","last_change":"2024-03-28T12:42:01.936371+0000","last_active":"2024-03-28T12:42:15.228766+0000","last_peered":"2024-03-28T12:42:15.228766+0000","last_clean":"2024-03-28T12:42:15.228766+0000","last_became_active":"2024-03-28T12:42:01.936080+0000","last_became_peered":"2024-03-28T12:42:01.936080+0000","last_unstale":"2024-03-28T12:42:15.228766+0000","last_undegraded":"2024-03-28T12:42:15.228766+0000","last_fullsized":"2024-03-28T12:42:15.228766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:36.955339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228493+0000","last_change":"2024-03-28T12:42:00.139149+0000","last_active":"2024-03-28T12:42:15.228493+0000","last_peered":"2024-03-28T12:42:15.228493+0000","last_clean":"2024-03-28T12:42:15.228493+0000","last_became_active":"2024-03-28T12:42:00.138555+0000","last_became_peered":"2024-03-28T12:42:00.138555+0000","last_unstale":"2024-03-28T12:42:15.228493+0000","last_undegraded":"2024-03-28T12:42:15.228493+0000","last_fullsized":"2024-03-28T12:42:15.228493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:44:12.403916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360325+0000","last_change":"2024-03-28T12:42:07.940362+0000","last_active":"2024-03-28T12:42:15.360325+0000","last_peered":"2024-03-28T12:42:15.360325+0000","last_clean":"2024-03-28T12:42:15.360325+0000","last_became_active":"2024-03-28T12:42:07.939396+0000","last_became_peered":"2024-03-28T12:42:07.939396+0000","last_unstale":"2024-03-28T12:42:15.360325+0000","last_undegraded":"2024-03-28T12:42:15.360325+0000","last_fullsized":"2024-03-28T12:42:15.360325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:59.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361226+0000","last_change":"2024-03-28T12:42:01.800361+0000","last_active":"2024-03-28T12:42:15.361226+0000","last_peered":"2024-03-28T12:42:15.361226+0000","last_clean":"2024-03-28T12:42:15.361226+0000","last_became_active":"2024-03-28T12:42:01.799594+0000","last_became_peered":"2024-03-28T12:42:01.799594+0000","last_unstale":"2024-03-28T12:42:15.361226+0000","last_undegraded":"2024-03-28T12:42:15.361226+0000","last_fullsized":"2024-03-28T12:42:15.361226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:35.775033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.314123+0000","last_change":"2024-03-28T12:42:00.143501+0000","last_active":"2024-03-28T12:42:38.314123+0000","last_peered":"2024-03-28T12:42:38.314123+0000","last_clean":"2024-03-28T12:42:38.314123+0000","last_became_active":"2024-03-28T12:42:00.142913+0000","last_became_peered":"2024-03-28T12:42:00.142913+0000","last_unstale":"2024-03-28T12:42:38.314123+0000","last_undegraded":"2024-03-28T12:42:38.314123+0000","last_fullsized":"2024-03-28T12:42:38.314123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228689+0000","last_change":"2024-03-28T12:42:07.938687+0000","last_active":"2024-03-28T12:42:15.228689+0000","last_peered":"2024-03-28T12:42:15.228689+0000","last_clean":"2024-03-28T12:42:15.228689+0000","last_became_active":"2024-03-28T12:42:07.938081+0000","last_became_peered":"2024-03-28T12:42:07.938081+0000","last_unstale":"2024-03-28T12:42:15.228689+0000","last_undegraded":"2024-03-28T12:42:15.228689+0000","last_fullsized":"2024-03-28T12:42:15.228689+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:47.148457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359939+0000","last_change":"2024-03-28T12:42:01.938516+0000","last_active":"2024-03-28T12:42:15.359939+0000","last_peered":"2024-03-28T12:42:15.359939+0000","last_clean":"2024-03-28T12:42:15.359939+0000","last_became_active":"2024-03-28T12:42:01.938251+0000","last_became_peered":"2024-03-28T12:42:01.938251+0000","last_unstale":"2024-03-28T12:42:15.359939+0000","last_undegraded":"2024-03-28T12:42:15.359939+0000","last_fullsized":"2024-03-28T12:42:15.359939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:15.595901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'13","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.470673+0000","last_change":"2024-03-28T12:42:00.141127+0000","last_active":"2024-03-28T12:42:38.470673+0000","last_peered":"2024-03-28T12:42:38.470673+0000","last_clean":"2024-03-28T12:42:38.470673+0000","last_became_active":"2024-03-28T12:42:00.140832+0000","last_became_peered":"2024-03-28T12:42:00.140832+0000","last_unstale":"2024-03-28T12:42:38.470673+0000","last_undegraded":"2024-03-28T12:42:38.470673+0000","last_fullsized":"2024-03-28T12:42:38.470673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:01:04.151858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216619+0000","last_change":"2024-03-28T12:42:07.936963+0000","last_active":"2024-03-28T12:42:15.216619+0000","last_peered":"2024-03-28T12:42:15.216619+0000","last_clean":"2024-03-28T12:42:15.216619+0000","last_became_active":"2024-03-28T12:42:07.936606+0000","last_became_peered":"2024-03-28T12:42:07.936606+0000","last_unstale":"2024-03-28T12:42:15.216619+0000","last_undegraded":"2024-03-28T12:42:15.216619+0000","last_fullsized":"2024-03-28T12:42:15.216619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:37:04.083032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228759+0000","last_change":"2024-03-28T12:42:01.962855+0000","last_active":"2024-03-28T12:42:15.228759+0000","last_peered":"2024-03-28T12:42:15.228759+0000","last_clean":"2024-03-28T12:42:15.228759+0000","last_became_active":"2024-03-28T12:42:01.962546+0000","last_became_peered":"2024-03-28T12:42:01.962546+0000","last_unstale":"2024-03-28T12:42:15.228759+0000","last_undegraded":"2024-03-28T12:42:15.228759+0000","last_fullsized":"2024-03-28T12:42:15.228759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:08.429940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.222908+0000","last_change":"2024-03-28T12:42:00.138923+0000","last_active":"2024-03-28T12:42:15.222908+0000","last_peered":"2024-03-28T12:42:15.222908+0000","last_clean":"2024-03-28T12:42:15.222908+0000","last_became_active":"2024-03-28T12:42:00.138233+0000","last_became_peered":"2024-03-28T12:42:00.138233+0000","last_unstale":"2024-03-28T12:42:15.222908+0000","last_undegraded":"2024-03-28T12:42:15.222908+0000","last_fullsized":"2024-03-28T12:42:15.222908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215066+0000","last_change":"2024-03-28T12:42:07.907163+0000","last_active":"2024-03-28T12:42:15.215066+0000","last_peered":"2024-03-28T12:42:15.215066+0000","last_clean":"2024-03-28T12:42:15.215066+0000","last_became_active":"2024-03-28T12:42:07.906334+0000","last_became_peered":"2024-03-28T12:42:07.906334+0000","last_unstale":"2024-03-28T12:42:15.215066+0000","last_undegraded":"2024-03-28T12:42:15.215066+0000","last_fullsized":"2024-03-28T12:42:15.215066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:59.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.232689+0000","last_change":"2024-03-28T12:42:01.809232+0000","last_active":"2024-03-28T12:42:15.232689+0000","last_peered":"2024-03-28T12:42:15.232689+0000","last_clean":"2024-03-28T12:42:15.232689+0000","last_became_active":"2024-03-28T12:42:01.805284+0000","last_became_peered":"2024-03-28T12:42:01.805284+0000","last_unstale":"2024-03-28T12:42:15.232689+0000","last_undegraded":"2024-03-28T12:42:15.232689+0000","last_fullsized":"2024-03-28T12:42:15.232689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:20:54.180080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.524133+0000","last_change":"2024-03-28T12:42:00.147739+0000","last_active":"2024-03-28T12:42:38.524133+0000","last_peered":"2024-03-28T12:42:38.524133+0000","last_clean":"2024-03-28T12:42:38.524133+0000","last_became_active":"2024-03-28T12:42:00.147407+0000","last_became_peered":"2024-03-28T12:42:00.147407+0000","last_unstale":"2024-03-28T12:42:38.524133+0000","last_undegraded":"2024-03-28T12:42:38.524133+0000","last_fullsized":"2024-03-28T12:42:38.524133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:29.908949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.218877+0000","last_change":"2024-03-28T12:42:07.900662+0000","last_active":"2024-03-28T12:42:15.218877+0000","last_peered":"2024-03-28T12:42:15.218877+0000","last_clean":"2024-03-28T12:42:15.218877+0000","last_became_active":"2024-03-28T12:42:07.899628+0000","last_became_peered":"2024-03-28T12:42:07.899628+0000","last_unstale":"2024-03-28T12:42:15.218877+0000","last_undegraded":"2024-03-28T12:42:15.218877+0000","last_fullsized":"2024-03-28T12:42:15.218877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:31.070732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216320+0000","last_change":"2024-03-28T12:42:01.967776+0000","last_active":"2024-03-28T12:42:15.216320+0000","last_peered":"2024-03-28T12:42:15.216320+0000","last_clean":"2024-03-28T12:42:15.216320+0000","last_became_active":"2024-03-28T12:42:01.964830+0000","last_became_peered":"2024-03-28T12:42:01.964830+0000","last_unstale":"2024-03-28T12:42:15.216320+0000","last_undegraded":"2024-03-28T12:42:15.216320+0000","last_fullsized":"2024-03-28T12:42:15.216320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.454134+0000","last_change":"2024-03-28T12:42:00.142326+0000","last_active":"2024-03-28T12:42:38.454134+0000","last_peered":"2024-03-28T12:42:38.454134+0000","last_clean":"2024-03-28T12:42:38.454134+0000","last_became_active":"2024-03-28T12:42:00.141602+0000","last_became_peered":"2024-03-28T12:42:00.141602+0000","last_unstale":"2024-03-28T12:42:38.454134+0000","last_undegraded":"2024-03-28T12:42:38.454134+0000","last_fullsized":"2024-03-28T12:42:38.454134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217682+0000","last_change":"2024-03-28T12:42:07.935882+0000","last_active":"2024-03-28T12:42:15.217682+0000","last_peered":"2024-03-28T12:42:15.217682+0000","last_clean":"2024-03-28T12:42:15.217682+0000","last_became_active":"2024-03-28T12:42:07.935525+0000","last_became_peered":"2024-03-28T12:42:07.935525+0000","last_unstale":"2024-03-28T12:42:15.217682+0000","last_undegraded":"2024-03-28T12:42:15.217682+0000","last_fullsized":"2024-03-28T12:42:15.217682+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:50:31.463779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216828+0000","last_change":"2024-03-28T12:42:07.882782+0000","last_active":"2024-03-28T12:42:15.216828+0000","last_peered":"2024-03-28T12:42:15.216828+0000","last_clean":"2024-03-28T12:42:15.216828+0000","last_became_active":"2024-03-28T12:42:07.881527+0000","last_became_peered":"2024-03-28T12:42:07.881527+0000","last_unstale":"2024-03-28T12:42:15.216828+0000","last_undegraded":"2024-03-28T12:42:15.216828+0000","last_fullsized":"2024-03-28T12:42:15.216828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:55.701985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217935+0000","last_change":"2024-03-28T12:42:01.958791+0000","last_active":"2024-03-28T12:42:15.217935+0000","last_peered":"2024-03-28T12:42:15.217935+0000","last_clean":"2024-03-28T12:42:15.217935+0000","last_became_active":"2024-03-28T12:42:01.957991+0000","last_became_peered":"2024-03-28T12:42:01.957991+0000","last_unstale":"2024-03-28T12:42:15.217935+0000","last_undegraded":"2024-03-28T12:42:15.217935+0000","last_fullsized":"2024-03-28T12:42:15.217935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:24.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227838+0000","last_change":"2024-03-28T12:42:00.132942+0000","last_active":"2024-03-28T12:42:15.227838+0000","last_peered":"2024-03-28T12:42:15.227838+0000","last_clean":"2024-03-28T12:42:15.227838+0000","last_became_active":"2024-03-28T12:42:00.132663+0000","last_became_peered":"2024-03-28T12:42:00.132663+0000","last_unstale":"2024-03-28T12:42:15.227838+0000","last_undegraded":"2024-03-28T12:42:15.227838+0000","last_fullsized":"2024-03-28T12:42:15.227838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:41.612613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229445+0000","last_change":"2024-03-28T12:42:07.901907+0000","last_active":"2024-03-28T12:42:15.229445+0000","last_peered":"2024-03-28T12:42:15.229445+0000","last_clean":"2024-03-28T12:42:15.229445+0000","last_became_active":"2024-03-28T12:42:07.901398+0000","last_became_peered":"2024-03-28T12:42:07.901398+0000","last_unstale":"2024-03-28T12:42:15.229445+0000","last_undegraded":"2024-03-28T12:42:15.229445+0000","last_fullsized":"2024-03-28T12:42:15.229445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:49:41.408808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.226666+0000","last_change":"2024-03-28T12:42:01.811306+0000","last_active":"2024-03-28T12:42:15.226666+0000","last_peered":"2024-03-28T12:42:15.226666+0000","last_clean":"2024-03-28T12:42:15.226666+0000","last_became_active":"2024-03-28T12:42:01.810142+0000","last_became_peered":"2024-03-28T12:42:01.810142+0000","last_unstale":"2024-03-28T12:42:15.226666+0000","last_undegraded":"2024-03-28T12:42:15.226666+0000","last_fullsized":"2024-03-28T12:42:15.226666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:37:22.386341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360858+0000","last_change":"2024-03-28T12:42:00.142916+0000","last_active":"2024-03-28T12:42:15.360858+0000","last_peered":"2024-03-28T12:42:15.360858+0000","last_clean":"2024-03-28T12:42:15.360858+0000","last_became_active":"2024-03-28T12:42:00.142006+0000","last_became_peered":"2024-03-28T12:42:00.142006+0000","last_unstale":"2024-03-28T12:42:15.360858+0000","last_undegraded":"2024-03-28T12:42:15.360858+0000","last_fullsized":"2024-03-28T12:42:15.360858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:01:08.734929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228344+0000","last_change":"2024-03-28T12:42:00.143738+0000","last_active":"2024-03-28T12:42:15.228344+0000","last_peered":"2024-03-28T12:42:15.228344+0000","last_clean":"2024-03-28T12:42:15.228344+0000","last_became_active":"2024-03-28T12:42:00.143474+0000","last_became_peered":"2024-03-28T12:42:00.143474+0000","last_unstale":"2024-03-28T12:42:15.228344+0000","last_undegraded":"2024-03-28T12:42:15.228344+0000","last_fullsized":"2024-03-28T12:42:15.228344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:43:33.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217213+0000","last_change":"2024-03-28T12:42:01.938147+0000","last_active":"2024-03-28T12:42:15.217213+0000","last_peered":"2024-03-28T12:42:15.217213+0000","last_clean":"2024-03-28T12:42:15.217213+0000","last_became_active":"2024-03-28T12:42:01.937612+0000","last_became_peered":"2024-03-28T12:42:01.937612+0000","last_unstale":"2024-03-28T12:42:15.217213+0000","last_undegraded":"2024-03-28T12:42:15.217213+0000","last_fullsized":"2024-03-28T12:42:15.217213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:31:15.643101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216896+0000","last_change":"2024-03-28T12:42:07.870201+0000","last_active":"2024-03-28T12:42:15.216896+0000","last_peered":"2024-03-28T12:42:15.216896+0000","last_clean":"2024-03-28T12:42:15.216896+0000","last_became_active":"2024-03-28T12:42:07.869628+0000","last_became_peered":"2024-03-28T12:42:07.869628+0000","last_unstale":"2024-03-28T12:42:15.216896+0000","last_undegraded":"2024-03-28T12:42:15.216896+0000","last_fullsized":"2024-03-28T12:42:15.216896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228742+0000","last_change":"2024-03-28T12:42:00.146260+0000","last_active":"2024-03-28T12:42:15.228742+0000","last_peered":"2024-03-28T12:42:15.228742+0000","last_clean":"2024-03-28T12:42:15.228742+0000","last_became_active":"2024-03-28T12:42:00.146052+0000","last_became_peered":"2024-03-28T12:42:00.146052+0000","last_unstale":"2024-03-28T12:42:15.228742+0000","last_undegraded":"2024-03-28T12:42:15.228742+0000","last_fullsized":"2024-03-28T12:42:15.228742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:08.118205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352739+0000","last_change":"2024-03-28T12:42:01.966002+0000","last_active":"2024-03-28T12:42:15.352739+0000","last_peered":"2024-03-28T12:42:15.352739+0000","last_clean":"2024-03-28T12:42:15.352739+0000","last_became_active":"2024-03-28T12:42:01.965598+0000","last_became_peered":"2024-03-28T12:42:01.965598+0000","last_unstale":"2024-03-28T12:42:15.352739+0000","last_undegraded":"2024-03-28T12:42:15.352739+0000","last_fullsized":"2024-03-28T12:42:15.352739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:35:50.246850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.363695+0000","last_change":"2024-03-28T12:42:15.361649+0000","last_active":"2024-03-28T12:42:15.363695+0000","last_peered":"2024-03-28T12:42:15.363695+0000","last_clean":"2024-03-28T12:42:15.363695+0000","last_became_active":"2024-03-28T12:42:15.360743+0000","last_became_peered":"2024-03-28T12:42:15.360743+0000","last_unstale":"2024-03-28T12:42:15.363695+0000","last_undegraded":"2024-03-28T12:42:15.363695+0000","last_fullsized":"2024-03-28T12:42:15.363695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:55.701985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.214938+0000","last_change":"2024-03-28T12:42:01.965237+0000","last_active":"2024-03-28T12:42:15.214938+0000","last_peered":"2024-03-28T12:42:15.214938+0000","last_clean":"2024-03-28T12:42:15.214938+0000","last_became_active":"2024-03-28T12:42:01.964468+0000","last_became_peered":"2024-03-28T12:42:01.964468+0000","last_unstale":"2024-03-28T12:42:15.214938+0000","last_undegraded":"2024-03-28T12:42:15.214938+0000","last_fullsized":"2024-03-28T12:42:15.214938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:05.744451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.220849+0000","last_change":"2024-03-28T12:42:01.959553+0000","last_active":"2024-03-28T12:42:15.220849+0000","last_peered":"2024-03-28T12:42:15.220849+0000","last_clean":"2024-03-28T12:42:15.220849+0000","last_became_active":"2024-03-28T12:42:01.958333+0000","last_became_peered":"2024-03-28T12:42:01.958333+0000","last_unstale":"2024-03-28T12:42:15.220849+0000","last_undegraded":"2024-03-28T12:42:15.220849+0000","last_fullsized":"2024-03-28T12:42:15.220849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:05.744451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228041+0000","last_change":"2024-03-28T12:42:01.805452+0000","last_active":"2024-03-28T12:42:15.228041+0000","last_peered":"2024-03-28T12:42:15.228041+0000","last_clean":"2024-03-28T12:42:15.228041+0000","last_became_active":"2024-03-28T12:42:01.805288+0000","last_became_peered":"2024-03-28T12:42:01.805288+0000","last_unstale":"2024-03-28T12:42:15.228041+0000","last_undegraded":"2024-03-28T12:42:15.228041+0000","last_fullsized":"2024-03-28T12:42:15.228041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:17:01.582670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228480+0000","last_change":"2024-03-28T12:42:01.947234+0000","last_active":"2024-03-28T12:42:15.228480+0000","last_peered":"2024-03-28T12:42:15.228480+0000","last_clean":"2024-03-28T12:42:15.228480+0000","last_became_active":"2024-03-28T12:42:01.946859+0000","last_became_peered":"2024-03-28T12:42:01.946859+0000","last_unstale":"2024-03-28T12:42:15.228480+0000","last_undegraded":"2024-03-28T12:42:15.228480+0000","last_fullsized":"2024-03-28T12:42:15.228480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:36:05.320541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361030+0000","last_change":"2024-03-28T12:42:01.935265+0000","last_active":"2024-03-28T12:42:15.361030+0000","last_peered":"2024-03-28T12:42:15.361030+0000","last_clean":"2024-03-28T12:42:15.361030+0000","last_became_active":"2024-03-28T12:42:01.934578+0000","last_became_peered":"2024-03-28T12:42:01.934578+0000","last_unstale":"2024-03-28T12:42:15.361030+0000","last_undegraded":"2024-03-28T12:42:15.361030+0000","last_fullsized":"2024-03-28T12:42:15.361030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:24.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.362422+0000","last_change":"2024-03-28T12:42:01.946191+0000","last_active":"2024-03-28T12:42:15.362422+0000","last_peered":"2024-03-28T12:42:15.362422+0000","last_clean":"2024-03-28T12:42:15.362422+0000","last_became_active":"2024-03-28T12:42:01.945804+0000","last_became_peered":"2024-03-28T12:42:01.945804+0000","last_unstale":"2024-03-28T12:42:15.362422+0000","last_undegraded":"2024-03-28T12:42:15.362422+0000","last_fullsized":"2024-03-28T12:42:15.362422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:40.221005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216237+0000","last_change":"2024-03-28T12:42:01.969416+0000","last_active":"2024-03-28T12:42:15.216237+0000","last_peered":"2024-03-28T12:42:15.216237+0000","last_clean":"2024-03-28T12:42:15.216237+0000","last_became_active":"2024-03-28T12:42:01.969078+0000","last_became_peered":"2024-03-28T12:42:01.969078+0000","last_unstale":"2024-03-28T12:42:15.216237+0000","last_undegraded":"2024-03-28T12:42:15.216237+0000","last_fullsized":"2024-03-28T12:42:15.216237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.231988+0000","last_change":"2024-03-28T12:42:01.958402+0000","last_active":"2024-03-28T12:42:15.231988+0000","last_peered":"2024-03-28T12:42:15.231988+0000","last_clean":"2024-03-28T12:42:15.231988+0000","last_became_active":"2024-03-28T12:42:01.958074+0000","last_became_peered":"2024-03-28T12:42:01.958074+0000","last_unstale":"2024-03-28T12:42:15.231988+0000","last_undegraded":"2024-03-28T12:42:15.231988+0000","last_fullsized":"2024-03-28T12:42:15.231988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:18:04.255456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227744+0000","last_change":"2024-03-28T12:42:01.811823+0000","last_active":"2024-03-28T12:42:15.227744+0000","last_peered":"2024-03-28T12:42:15.227744+0000","last_clean":"2024-03-28T12:42:15.227744+0000","last_became_active":"2024-03-28T12:42:01.811548+0000","last_became_peered":"2024-03-28T12:42:01.811548+0000","last_unstale":"2024-03-28T12:42:15.227744+0000","last_undegraded":"2024-03-28T12:42:15.227744+0000","last_fullsized":"2024-03-28T12:42:15.227744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:00:51.741925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227697+0000","last_change":"2024-03-28T12:42:01.959291+0000","last_active":"2024-03-28T12:42:15.227697+0000","last_peered":"2024-03-28T12:42:15.227697+0000","last_clean":"2024-03-28T12:42:15.227697+0000","last_became_active":"2024-03-28T12:42:01.958942+0000","last_became_peered":"2024-03-28T12:42:01.958942+0000","last_unstale":"2024-03-28T12:42:15.227697+0000","last_undegraded":"2024-03-28T12:42:15.227697+0000","last_fullsized":"2024-03-28T12:42:15.227697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:52:46.128830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352606+0000","last_change":"2024-03-28T12:42:01.965790+0000","last_active":"2024-03-28T12:42:15.352606+0000","last_peered":"2024-03-28T12:42:15.352606+0000","last_clean":"2024-03-28T12:42:15.352606+0000","last_became_active":"2024-03-28T12:42:01.965526+0000","last_became_peered":"2024-03-28T12:42:01.965526+0000","last_unstale":"2024-03-28T12:42:15.352606+0000","last_undegraded":"2024-03-28T12:42:15.352606+0000","last_fullsized":"2024-03-28T12:42:15.352606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216990+0000","last_change":"2024-03-28T12:42:01.960761+0000","last_active":"2024-03-28T12:42:15.216990+0000","last_peered":"2024-03-28T12:42:15.216990+0000","last_clean":"2024-03-28T12:42:15.216990+0000","last_became_active":"2024-03-28T12:42:01.960325+0000","last_became_peered":"2024-03-28T12:42:01.960325+0000","last_unstale":"2024-03-28T12:42:15.216990+0000","last_undegraded":"2024-03-28T12:42:15.216990+0000","last_fullsized":"2024-03-28T12:42:15.216990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:40.221005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359720+0000","last_change":"2024-03-28T12:42:01.960053+0000","last_active":"2024-03-28T12:42:15.359720+0000","last_peered":"2024-03-28T12:42:15.359720+0000","last_clean":"2024-03-28T12:42:15.359720+0000","last_became_active":"2024-03-28T12:42:01.959801+0000","last_became_peered":"2024-03-28T12:42:01.959801+0000","last_unstale":"2024-03-28T12:42:15.359720+0000","last_undegraded":"2024-03-28T12:42:15.359720+0000","last_fullsized":"2024-03-28T12:42:15.359720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:22.285591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229465+0000","last_change":"2024-03-28T12:42:01.788603+0000","last_active":"2024-03-28T12:42:15.229465+0000","last_peered":"2024-03-28T12:42:15.229465+0000","last_clean":"2024-03-28T12:42:15.229465+0000","last_became_active":"2024-03-28T12:42:01.788431+0000","last_became_peered":"2024-03-28T12:42:01.788431+0000","last_unstale":"2024-03-28T12:42:15.229465+0000","last_undegraded":"2024-03-28T12:42:15.229465+0000","last_fullsized":"2024-03-28T12:42:15.229465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:09:59.404128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.221976+0000","last_change":"2024-03-28T12:42:01.960518+0000","last_active":"2024-03-28T12:42:15.221976+0000","last_peered":"2024-03-28T12:42:15.221976+0000","last_clean":"2024-03-28T12:42:15.221976+0000","last_became_active":"2024-03-28T12:42:01.959832+0000","last_became_peered":"2024-03-28T12:42:01.959832+0000","last_unstale":"2024-03-28T12:42:15.221976+0000","last_undegraded":"2024-03-28T12:42:15.221976+0000","last_fullsized":"2024-03-28T12:42:15.221976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229874+0000","last_change":"2024-03-28T12:42:01.936477+0000","last_active":"2024-03-28T12:42:15.229874+0000","last_peered":"2024-03-28T12:42:15.229874+0000","last_clean":"2024-03-28T12:42:15.229874+0000","last_became_active":"2024-03-28T12:42:01.936175+0000","last_became_peered":"2024-03-28T12:42:01.936175+0000","last_unstale":"2024-03-28T12:42:15.229874+0000","last_undegraded":"2024-03-28T12:42:15.229874+0000","last_fullsized":"2024-03-28T12:42:15.229874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:14:14.822668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227742+0000","last_change":"2024-03-28T12:42:01.960054+0000","last_active":"2024-03-28T12:42:15.227742+0000","last_peered":"2024-03-28T12:42:15.227742+0000","last_clean":"2024-03-28T12:42:15.227742+0000","last_became_active":"2024-03-28T12:42:01.959791+0000","last_became_peered":"2024-03-28T12:42:01.959791+0000","last_unstale":"2024-03-28T12:42:15.227742+0000","last_undegraded":"2024-03-28T12:42:15.227742+0000","last_fullsized":"2024-03-28T12:42:15.227742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:06:44.099531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.233310+0000","last_change":"2024-03-28T12:42:15.233310+0000","last_active":"2024-03-28T12:42:15.233310+0000","last_peered":"2024-03-28T12:42:15.233310+0000","last_clean":"2024-03-28T12:42:15.233310+0000","last_became_active":"2024-03-28T12:42:15.232678+0000","last_became_peered":"2024-03-28T12:42:15.232678+0000","last_unstale":"2024-03-28T12:42:15.233310+0000","last_undegraded":"2024-03-28T12:42:15.233310+0000","last_fullsized":"2024-03-28T12:42:15.233310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:11:33.781054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360961+0000","last_change":"2024-03-28T12:42:01.948602+0000","last_active":"2024-03-28T12:42:15.360961+0000","last_peered":"2024-03-28T12:42:15.360961+0000","last_clean":"2024-03-28T12:42:15.360961+0000","last_became_active":"2024-03-28T12:42:01.947869+0000","last_became_peered":"2024-03-28T12:42:01.947869+0000","last_unstale":"2024-03-28T12:42:15.360961+0000","last_undegraded":"2024-03-28T12:42:15.360961+0000","last_fullsized":"2024-03-28T12:42:15.360961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.362751+0000","last_change":"2024-03-28T12:42:01.940521+0000","last_active":"2024-03-28T12:42:15.362751+0000","last_peered":"2024-03-28T12:42:15.362751+0000","last_clean":"2024-03-28T12:42:15.362751+0000","last_became_active":"2024-03-28T12:42:01.939756+0000","last_became_peered":"2024-03-28T12:42:01.939756+0000","last_unstale":"2024-03-28T12:42:15.362751+0000","last_undegraded":"2024-03-28T12:42:15.362751+0000","last_fullsized":"2024-03-28T12:42:15.362751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:53:37.869232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359674+0000","last_change":"2024-03-28T12:42:01.960377+0000","last_active":"2024-03-28T12:42:15.359674+0000","last_peered":"2024-03-28T12:42:15.359674+0000","last_clean":"2024-03-28T12:42:15.359674+0000","last_became_active":"2024-03-28T12:42:01.960012+0000","last_became_peered":"2024-03-28T12:42:01.960012+0000","last_unstale":"2024-03-28T12:42:15.359674+0000","last_undegraded":"2024-03-28T12:42:15.359674+0000","last_fullsized":"2024-03-28T12:42:15.359674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:19:20.801201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359855+0000","last_change":"2024-03-28T12:42:01.937280+0000","last_active":"2024-03-28T12:42:15.359855+0000","last_peered":"2024-03-28T12:42:15.359855+0000","last_clean":"2024-03-28T12:42:15.359855+0000","last_became_active":"2024-03-28T12:42:01.936999+0000","last_became_peered":"2024-03-28T12:42:01.936999+0000","last_unstale":"2024-03-28T12:42:15.359855+0000","last_undegraded":"2024-03-28T12:42:15.359855+0000","last_fullsized":"2024-03-28T12:42:15.359855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:35:01.960186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360045+0000","last_change":"2024-03-28T12:42:01.961991+0000","last_active":"2024-03-28T12:42:15.360045+0000","last_peered":"2024-03-28T12:42:15.360045+0000","last_clean":"2024-03-28T12:42:15.360045+0000","last_became_active":"2024-03-28T12:42:01.961694+0000","last_became_peered":"2024-03-28T12:42:01.961694+0000","last_unstale":"2024-03-28T12:42:15.360045+0000","last_undegraded":"2024-03-28T12:42:15.360045+0000","last_fullsized":"2024-03-28T12:42:15.360045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:12:20.857443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.353767+0000","last_change":"2024-03-28T12:42:01.966943+0000","last_active":"2024-03-28T12:42:15.353767+0000","last_peered":"2024-03-28T12:42:15.353767+0000","last_clean":"2024-03-28T12:42:15.353767+0000","last_became_active":"2024-03-28T12:42:01.966629+0000","last_became_peered":"2024-03-28T12:42:01.966629+0000","last_unstale":"2024-03-28T12:42:15.353767+0000","last_undegraded":"2024-03-28T12:42:15.353767+0000","last_fullsized":"2024-03-28T12:42:15.353767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.225924+0000","last_change":"2024-03-28T12:42:01.934727+0000","last_active":"2024-03-28T12:42:15.225924+0000","last_peered":"2024-03-28T12:42:15.225924+0000","last_clean":"2024-03-28T12:42:15.225924+0000","last_became_active":"2024-03-28T12:42:01.934130+0000","last_became_peered":"2024-03-28T12:42:01.934130+0000","last_unstale":"2024-03-28T12:42:15.225924+0000","last_undegraded":"2024-03-28T12:42:15.225924+0000","last_fullsized":"2024-03-28T12:42:15.225924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:20:32.024373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359366+0000","last_change":"2024-03-28T12:42:01.940164+0000","last_active":"2024-03-28T12:42:15.359366+0000","last_peered":"2024-03-28T12:42:15.359366+0000","last_clean":"2024-03-28T12:42:15.359366+0000","last_became_active":"2024-03-28T12:42:01.939962+0000","last_became_peered":"2024-03-28T12:42:01.939962+0000","last_unstale":"2024-03-28T12:42:15.359366+0000","last_undegraded":"2024-03-28T12:42:15.359366+0000","last_fullsized":"2024-03-28T12:42:15.359366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:31:15.643101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215233+0000","last_change":"2024-03-28T12:42:01.968043+0000","last_active":"2024-03-28T12:42:15.215233+0000","last_peered":"2024-03-28T12:42:15.215233+0000","last_clean":"2024-03-28T12:42:15.215233+0000","last_became_active":"2024-03-28T12:42:01.964888+0000","last_became_peered":"2024-03-28T12:42:01.964888+0000","last_unstale":"2024-03-28T12:42:15.215233+0000","last_undegraded":"2024-03-28T12:42:15.215233+0000","last_fullsized":"2024-03-28T12:42:15.215233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359830+0000","last_change":"2024-03-28T12:42:01.939665+0000","last_active":"2024-03-28T12:42:15.359830+0000","last_peered":"2024-03-28T12:42:15.359830+0000","last_clean":"2024-03-28T12:42:15.359830+0000","last_became_active":"2024-03-28T12:42:01.939448+0000","last_became_peered":"2024-03-28T12:42:01.939448+0000","last_unstale":"2024-03-28T12:42:15.359830+0000","last_undegraded":"2024-03-28T12:42:15.359830+0000","last_fullsized":"2024-03-28T12:42:15.359830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:39.483160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216062+0000","last_change":"2024-03-28T12:42:01.961147+0000","last_active":"2024-03-28T12:42:15.216062+0000","last_peered":"2024-03-28T12:42:15.216062+0000","last_clean":"2024-03-28T12:42:15.216062+0000","last_became_active":"2024-03-28T12:42:01.960511+0000","last_became_peered":"2024-03-28T12:42:01.960511+0000","last_unstale":"2024-03-28T12:42:15.216062+0000","last_undegraded":"2024-03-28T12:42:15.216062+0000","last_fullsized":"2024-03-28T12:42:15.216062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229345+0000","last_change":"2024-03-28T12:42:01.809029+0000","last_active":"2024-03-28T12:42:15.229345+0000","last_peered":"2024-03-28T12:42:15.229345+0000","last_clean":"2024-03-28T12:42:15.229345+0000","last_became_active":"2024-03-28T12:42:01.805168+0000","last_became_peered":"2024-03-28T12:42:01.805168+0000","last_unstale":"2024-03-28T12:42:15.229345+0000","last_undegraded":"2024-03-28T12:42:15.229345+0000","last_fullsized":"2024-03-28T12:42:15.229345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:00:10.281819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229628+0000","last_change":"2024-03-28T12:42:01.809169+0000","last_active":"2024-03-28T12:42:15.229628+0000","last_peered":"2024-03-28T12:42:15.229628+0000","last_clean":"2024-03-28T12:42:15.229628+0000","last_became_active":"2024-03-28T12:42:01.805382+0000","last_became_peered":"2024-03-28T12:42:01.805382+0000","last_unstale":"2024-03-28T12:42:15.229628+0000","last_undegraded":"2024-03-28T12:42:15.229628+0000","last_fullsized":"2024-03-28T12:42:15.229628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:26:32.791857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359741+0000","last_change":"2024-03-28T12:42:01.938613+0000","last_active":"2024-03-28T12:42:15.359741+0000","last_peered":"2024-03-28T12:42:15.359741+0000","last_clean":"2024-03-28T12:42:15.359741+0000","last_became_active":"2024-03-28T12:42:01.938408+0000","last_became_peered":"2024-03-28T12:42:01.938408+0000","last_unstale":"2024-03-28T12:42:15.359741+0000","last_undegraded":"2024-03-28T12:42:15.359741+0000","last_fullsized":"2024-03-28T12:42:15.359741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:36:57.708839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5402,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":11448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66494,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":127101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":127017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":131693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":130237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":716833,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":126541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542163,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":126977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":716855,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T12:42:42.185 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T12:42:42.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.362+0000 7fcfc3200640 1 Processor -- start 2024-03-28T12:42:42.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.362+0000 7fcfc3200640 1 -- start start 2024-03-28T12:42:42.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.362+0000 7fcfc3200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fcfbc070700 0x7fcfbc0734e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:42.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.366+0000 7fcfc3200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcfbc06e9c0 0x7fcfbc06edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:42.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.366+0000 7fcfc3200640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfbc0c7e10 con 0x7fcfbc151830 2024-03-28T12:42:42.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.366+0000 7fcfc3200640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fcfbc0730f0 con 0x7fcfbc070700 2024-03-28T12:42:42.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.366+0000 7fcfc3200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fcfbc0c80f0 con 0x7fcfbc06e9c0 2024-03-28T12:42:42.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.366+0000 7fcfbbe00640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fcfbc151830 0x7fcfbc0729e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:40804/0 (socket says 172.21.15.76:40804) 2024-03-28T12:42:42.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.366+0000 7fcfbbe00640 1 -- 172.21.15.76:0/323492578 learned_addr learned my addr 172.21.15.76:0/323492578 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:42.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.366+0000 7fcfc1200640 1 --2- 172.21.15.76:0/323492578 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcfbc06e9c0 0x7fcfbc06edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:42.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.366+0000 7fcfb3400640 1 --2- 172.21.15.76:0/323492578 >> v2:172.21.15.76:3300/0 conn(0x7fcfbc070700 0x7fcfbc0734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:42.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.370+0000 7fcfc1200640 1 -- 172.21.15.76:0/323492578 >> v2:172.21.15.76:3300/0 conn(0x7fcfbc070700 msgr2=0x7fcfbc0734e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:42.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.370+0000 7fcfc1200640 1 --2- 172.21.15.76:0/323492578 >> v2:172.21.15.76:3300/0 conn(0x7fcfbc070700 0x7fcfbc0734e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:42.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.370+0000 7fcfc1200640 1 -- 172.21.15.76:0/323492578 >> v1:172.21.15.111:6789/0 conn(0x7fcfbc151830 legacy=0x7fcfbc0729e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:42.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.370+0000 7fcfc1200640 1 -- 172.21.15.76:0/323492578 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc0c83d0 con 0x7fcfbc06e9c0 2024-03-28T12:42:42.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.374+0000 7fcfc1200640 1 --2- 172.21.15.76:0/323492578 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcfbc06e9c0 0x7fcfbc06edf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40097c0 tx=0x7fcfb401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d403bdc733355c22 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:42.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.382+0000 7fcfbb400640 1 -- 172.21.15.76:0/323492578 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40b5070 con 0x7fcfbc06e9c0 2024-03-28T12:42:42.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.382+0000 7fcfbb400640 1 -- 172.21.15.76:0/323492578 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb40a8990 con 0x7fcfbc06e9c0 2024-03-28T12:42:42.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.382+0000 7fcfbb400640 1 -- 172.21.15.76:0/323492578 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40a8d60 con 0x7fcfbc06e9c0 2024-03-28T12:42:42.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.382+0000 7fcfc3200640 1 -- 172.21.15.76:0/323492578 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcfbc06e9c0 msgr2=0x7fcfbc06edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:42.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.382+0000 7fcfc3200640 1 --2- 172.21.15.76:0/323492578 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcfbc06e9c0 0x7fcfbc06edf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40097c0 tx=0x7fcfb401ec90 comp rx=0 tx=0).stop 2024-03-28T12:42:42.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.382+0000 7fcfc3200640 1 -- 172.21.15.76:0/323492578 shutdown_connections 2024-03-28T12:42:42.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.382+0000 7fcfc3200640 1 --2- 172.21.15.76:0/323492578 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcfbc06e9c0 0x7fcfbc06edf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:42.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.382+0000 7fcfc3200640 1 --2- 172.21.15.76:0/323492578 >> v2:172.21.15.76:3300/0 conn(0x7fcfbc070700 0x7fcfbc0734e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:42.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.382+0000 7fcfc3200640 1 -- 172.21.15.76:0/323492578 >> 172.21.15.76:0/323492578 conn(0x7fcfbc06fbe0 msgr2=0x7fcfbc06fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:42.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.382+0000 7fcfc3200640 1 -- 172.21.15.76:0/323492578 shutdown_connections 2024-03-28T12:42:42.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.382+0000 7fcfc3200640 1 -- 172.21.15.76:0/323492578 wait complete. 2024-03-28T12:42:42.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.386+0000 7fcfc3200640 1 Processor -- start 2024-03-28T12:42:42.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.386+0000 7fcfc3200640 1 -- start start 2024-03-28T12:42:42.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.386+0000 7fcfc3200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcfbc06e9c0 0x7fcfbc159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:42.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.386+0000 7fcfc3200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcfbc070700 0x7fcfbc15aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:42.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.386+0000 7fcfc3200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcfbc151830 0x7fcfbc155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:42.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.386+0000 7fcfc3200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc0724c0 con 0x7fcfbc151830 2024-03-28T12:42:42.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.386+0000 7fcfc3200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc0721e0 con 0x7fcfbc070700 2024-03-28T12:42:42.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.386+0000 7fcfc3200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fcfbc151c10 con 0x7fcfbc06e9c0 2024-03-28T12:42:42.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.386+0000 7fcfbbe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcfbc06e9c0 0x7fcfbc159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:42.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.386+0000 7fcfb3400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcfbc070700 0x7fcfbc15aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:42.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.386+0000 7fcfbbe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcfbc06e9c0 0x7fcfbc159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:46238/0 (socket says 172.21.15.76:46238) 2024-03-28T12:42:42.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.386+0000 7fcfbbe00640 1 -- 172.21.15.76:0/2348831683 learned_addr learned my addr 172.21.15.76:0/2348831683 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:42.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.394+0000 7fcfbbe00640 1 -- 172.21.15.76:0/2348831683 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcfbc070700 msgr2=0x7fcfbc15aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:42.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.394+0000 7fcfbbe00640 1 --2- 172.21.15.76:0/2348831683 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcfbc070700 0x7fcfbc15aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:42.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.394+0000 7fcfbbe00640 1 -- 172.21.15.76:0/2348831683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcfbc151830 msgr2=0x7fcfbc155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:42.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.394+0000 7fcfbbe00640 1 --2- 172.21.15.76:0/2348831683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcfbc151830 0x7fcfbc155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:42.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.394+0000 7fcfbbe00640 1 -- 172.21.15.76:0/2348831683 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc14abe0 con 0x7fcfbc06e9c0 2024-03-28T12:42:42.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.394+0000 7fcfb3400640 1 --2- 172.21.15.76:0/2348831683 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcfbc070700 0x7fcfbc15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-28T12:42:42.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.398+0000 7fcfbbe00640 1 --2- 172.21.15.76:0/2348831683 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcfbc06e9c0 0x7fcfbc159e50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00cbf0 tx=0x7fcfac00a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:42.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.406+0000 7fcfb8c00640 1 -- 172.21.15.76:0/2348831683 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfac017070 con 0x7fcfbc06e9c0 2024-03-28T12:42:42.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.406+0000 7fcfb8c00640 1 -- 172.21.15.76:0/2348831683 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfac00ac20 con 0x7fcfbc06e9c0 2024-03-28T12:42:42.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.406+0000 7fcfb8c00640 1 -- 172.21.15.76:0/2348831683 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfac012400 con 0x7fcfbc06e9c0 2024-03-28T12:42:42.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.406+0000 7fcfc3200640 1 -- 172.21.15.76:0/2348831683 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfbc1573c0 con 0x7fcfbc06e9c0 2024-03-28T12:42:42.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.406+0000 7fcfc3200640 1 -- 172.21.15.76:0/2348831683 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfbc149b00 con 0x7fcfbc06e9c0 2024-03-28T12:42:42.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.406+0000 7fcfc3200640 1 -- 172.21.15.76:0/2348831683 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfbc0686e0 con 0x7fcfbc06e9c0 2024-03-28T12:42:42.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.734+0000 7fcfb8c00640 1 -- 172.21.15.76:0/2348831683 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fcfac01a070 con 0x7fcfbc06e9c0 2024-03-28T12:42:42.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.734+0000 7fcfb8c00640 1 --2- 172.21.15.76:0/2348831683 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcf98068010 0x7fcf9806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:42.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.734+0000 7fcfb3400640 1 --2- 172.21.15.76:0/2348831683 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcf98068010 0x7fcf9806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:42.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.734+0000 7fcfb3400640 1 --2- 172.21.15.76:0/2348831683 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcf98068010 0x7fcf9806a4d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc147180 tx=0x7fcfa4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:42.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.742+0000 7fcfb8c00640 1 -- 172.21.15.76:0/2348831683 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fcfac054bf0 con 0x7fcfbc06e9c0 2024-03-28T12:42:42.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.770+0000 7fcfb8c00640 1 -- 172.21.15.76:0/2348831683 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fcfac056b50 con 0x7fcfbc06e9c0 2024-03-28T12:42:42.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.934+0000 7fcfc3200640 1 -- 172.21.15.76:0/2348831683 --> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcfbc162c80 con 0x7fcf98068010 2024-03-28T12:42:42.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.942+0000 7fcfb8c00640 1 -- 172.21.15.76:0/2348831683 <== mgr.4107 v2:172.21.15.76:6800/1313648511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332698 (secure 0 0 0) 0x7fcfbc162c80 con 0x7fcf98068010 2024-03-28T12:42:42.945 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:42.946 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-03-28T12:42:42.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.946+0000 7fcfc3200640 1 -- 172.21.15.76:0/2348831683 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcf98068010 msgr2=0x7fcf9806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:42.947 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.946+0000 7fcfc3200640 1 --2- 172.21.15.76:0/2348831683 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcf98068010 0x7fcf9806a4d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc147180 tx=0x7fcfa4008040 comp rx=0 tx=0).stop 2024-03-28T12:42:42.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.946+0000 7fcfc3200640 1 -- 172.21.15.76:0/2348831683 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcfbc06e9c0 msgr2=0x7fcfbc159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:42.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.946+0000 7fcfc3200640 1 --2- 172.21.15.76:0/2348831683 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcfbc06e9c0 0x7fcfbc159e50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00cbf0 tx=0x7fcfac00a060 comp rx=0 tx=0).stop 2024-03-28T12:42:42.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.946+0000 7fcfc3200640 1 -- 172.21.15.76:0/2348831683 shutdown_connections 2024-03-28T12:42:42.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.946+0000 7fcfc3200640 1 --2- 172.21.15.76:0/2348831683 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcf98068010 0x7fcf9806a4d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:42.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.946+0000 7fcfc3200640 1 --2- 172.21.15.76:0/2348831683 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcfbc151830 0x7fcfbc155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:42.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.946+0000 7fcfc3200640 1 --2- 172.21.15.76:0/2348831683 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcfbc070700 0x7fcfbc15aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:42.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.946+0000 7fcfc3200640 1 --2- 172.21.15.76:0/2348831683 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcfbc06e9c0 0x7fcfbc159e50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:42.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.946+0000 7fcfc3200640 1 -- 172.21.15.76:0/2348831683 >> 172.21.15.76:0/2348831683 conn(0x7fcfbc06fbe0 msgr2=0x7fcfbc0c4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:42.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.946+0000 7fcfc3200640 1 -- 172.21.15.76:0/2348831683 shutdown_connections 2024-03-28T12:42:42.948 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:42.946+0000 7fcfc3200640 1 -- 172.21.15.76:0/2348831683 wait complete. 2024-03-28T12:42:42.965 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-03-28T12:42:41.014831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595770,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":237,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":181,"ondisk_log_size":181,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218772,"kb_used_data":2624,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755948,"statfs":{"total":773094113280,"available":772870090752,"internally_reserved":0,"allocated":2686976,"data_stored":2203254,"data_compressed":66494,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":903,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002813"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.218889+0000","last_change":"2024-03-28T12:42:00.080769+0000","last_active":"2024-03-28T12:42:15.218889+0000","last_peered":"2024-03-28T12:42:15.218889+0000","last_clean":"2024-03-28T12:42:15.218889+0000","last_became_active":"2024-03-28T12:42:00.079900+0000","last_became_peered":"2024-03-28T12:42:00.079900+0000","last_unstale":"2024-03-28T12:42:15.218889+0000","last_undegraded":"2024-03-28T12:42:15.218889+0000","last_fullsized":"2024-03-28T12:42:15.218889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:26.156056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229988+0000","last_change":"2024-03-28T12:42:01.960244+0000","last_active":"2024-03-28T12:42:15.229988+0000","last_peered":"2024-03-28T12:42:15.229988+0000","last_clean":"2024-03-28T12:42:15.229988+0000","last_became_active":"2024-03-28T12:42:01.959408+0000","last_became_peered":"2024-03-28T12:42:01.959408+0000","last_unstale":"2024-03-28T12:42:15.229988+0000","last_undegraded":"2024-03-28T12:42:15.229988+0000","last_fullsized":"2024-03-28T12:42:15.229988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:00:51.741925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.218968+0000","last_change":"2024-03-28T12:42:07.880943+0000","last_active":"2024-03-28T12:42:15.218968+0000","last_peered":"2024-03-28T12:42:15.218968+0000","last_clean":"2024-03-28T12:42:15.218968+0000","last_became_active":"2024-03-28T12:42:07.880354+0000","last_became_peered":"2024-03-28T12:42:07.880354+0000","last_unstale":"2024-03-28T12:42:15.218968+0000","last_undegraded":"2024-03-28T12:42:15.218968+0000","last_fullsized":"2024-03-28T12:42:15.218968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:39.078379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.230130+0000","last_change":"2024-03-28T12:42:00.138569+0000","last_active":"2024-03-28T12:42:15.230130+0000","last_peered":"2024-03-28T12:42:15.230130+0000","last_clean":"2024-03-28T12:42:15.230130+0000","last_became_active":"2024-03-28T12:42:00.137978+0000","last_became_peered":"2024-03-28T12:42:00.137978+0000","last_unstale":"2024-03-28T12:42:15.230130+0000","last_undegraded":"2024-03-28T12:42:15.230130+0000","last_fullsized":"2024-03-28T12:42:15.230130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:38:28.575778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.232451+0000","last_change":"2024-03-28T12:42:01.958236+0000","last_active":"2024-03-28T12:42:15.232451+0000","last_peered":"2024-03-28T12:42:15.232451+0000","last_clean":"2024-03-28T12:42:15.232451+0000","last_became_active":"2024-03-28T12:42:01.957875+0000","last_became_peered":"2024-03-28T12:42:01.957875+0000","last_unstale":"2024-03-28T12:42:15.232451+0000","last_undegraded":"2024-03-28T12:42:15.232451+0000","last_fullsized":"2024-03-28T12:42:15.232451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:48:52.933175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.214830+0000","last_change":"2024-03-28T12:42:07.905799+0000","last_active":"2024-03-28T12:42:15.214830+0000","last_peered":"2024-03-28T12:42:15.214830+0000","last_clean":"2024-03-28T12:42:15.214830+0000","last_became_active":"2024-03-28T12:42:07.905350+0000","last_became_peered":"2024-03-28T12:42:07.905350+0000","last_unstale":"2024-03-28T12:42:15.214830+0000","last_undegraded":"2024-03-28T12:42:15.214830+0000","last_fullsized":"2024-03-28T12:42:15.214830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:33:42.281079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360068+0000","last_change":"2024-03-28T12:42:00.150272+0000","last_active":"2024-03-28T12:42:15.360068+0000","last_peered":"2024-03-28T12:42:15.360068+0000","last_clean":"2024-03-28T12:42:15.360068+0000","last_became_active":"2024-03-28T12:42:00.148367+0000","last_became_peered":"2024-03-28T12:42:00.148367+0000","last_unstale":"2024-03-28T12:42:15.360068+0000","last_undegraded":"2024-03-28T12:42:15.360068+0000","last_fullsized":"2024-03-28T12:42:15.360068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:26.156056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352641+0000","last_change":"2024-03-28T12:42:01.965158+0000","last_active":"2024-03-28T12:42:15.352641+0000","last_peered":"2024-03-28T12:42:15.352641+0000","last_clean":"2024-03-28T12:42:15.352641+0000","last_became_active":"2024-03-28T12:42:01.964817+0000","last_became_peered":"2024-03-28T12:42:01.964817+0000","last_unstale":"2024-03-28T12:42:15.352641+0000","last_undegraded":"2024-03-28T12:42:15.352641+0000","last_fullsized":"2024-03-28T12:42:15.352641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215063+0000","last_change":"2024-03-28T12:42:07.906794+0000","last_active":"2024-03-28T12:42:15.215063+0000","last_peered":"2024-03-28T12:42:15.215063+0000","last_clean":"2024-03-28T12:42:15.215063+0000","last_became_active":"2024-03-28T12:42:07.905522+0000","last_became_peered":"2024-03-28T12:42:07.905522+0000","last_unstale":"2024-03-28T12:42:15.215063+0000","last_undegraded":"2024-03-28T12:42:15.215063+0000","last_fullsized":"2024-03-28T12:42:15.215063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:21.970094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359867+0000","last_change":"2024-03-28T12:42:00.149947+0000","last_active":"2024-03-28T12:42:15.359867+0000","last_peered":"2024-03-28T12:42:15.359867+0000","last_clean":"2024-03-28T12:42:15.359867+0000","last_became_active":"2024-03-28T12:42:00.148446+0000","last_became_peered":"2024-03-28T12:42:00.148446+0000","last_unstale":"2024-03-28T12:42:15.359867+0000","last_undegraded":"2024-03-28T12:42:15.359867+0000","last_fullsized":"2024-03-28T12:42:15.359867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:47:28.765823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228727+0000","last_change":"2024-03-28T12:42:01.935596+0000","last_active":"2024-03-28T12:42:15.228727+0000","last_peered":"2024-03-28T12:42:15.228727+0000","last_clean":"2024-03-28T12:42:15.228727+0000","last_became_active":"2024-03-28T12:42:01.935231+0000","last_became_peered":"2024-03-28T12:42:01.935231+0000","last_unstale":"2024-03-28T12:42:15.228727+0000","last_undegraded":"2024-03-28T12:42:15.228727+0000","last_fullsized":"2024-03-28T12:42:15.228727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:17:41.296627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215002+0000","last_change":"2024-03-28T12:42:07.904616+0000","last_active":"2024-03-28T12:42:15.215002+0000","last_peered":"2024-03-28T12:42:15.215002+0000","last_clean":"2024-03-28T12:42:15.215002+0000","last_became_active":"2024-03-28T12:42:07.904240+0000","last_became_peered":"2024-03-28T12:42:07.904240+0000","last_unstale":"2024-03-28T12:42:15.215002+0000","last_undegraded":"2024-03-28T12:42:15.215002+0000","last_fullsized":"2024-03-28T12:42:15.215002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:19:27.175393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228168+0000","last_change":"2024-03-28T12:42:01.963116+0000","last_active":"2024-03-28T12:42:15.228168+0000","last_peered":"2024-03-28T12:42:15.228168+0000","last_clean":"2024-03-28T12:42:15.228168+0000","last_became_active":"2024-03-28T12:42:01.962885+0000","last_became_peered":"2024-03-28T12:42:01.962885+0000","last_unstale":"2024-03-28T12:42:15.228168+0000","last_undegraded":"2024-03-28T12:42:15.228168+0000","last_fullsized":"2024-03-28T12:42:15.228168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:19:06.640780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228968+0000","last_change":"2024-03-28T12:42:00.134353+0000","last_active":"2024-03-28T12:42:15.228968+0000","last_peered":"2024-03-28T12:42:15.228968+0000","last_clean":"2024-03-28T12:42:15.228968+0000","last_became_active":"2024-03-28T12:42:00.133880+0000","last_became_peered":"2024-03-28T12:42:00.133880+0000","last_unstale":"2024-03-28T12:42:15.228968+0000","last_undegraded":"2024-03-28T12:42:15.228968+0000","last_fullsized":"2024-03-28T12:42:15.228968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:45:14.194934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.238142+0000","last_change":"2024-03-28T12:42:15.238142+0000","last_active":"2024-03-28T12:42:15.238142+0000","last_peered":"2024-03-28T12:42:15.238142+0000","last_clean":"2024-03-28T12:42:15.238142+0000","last_became_active":"2024-03-28T12:42:15.237739+0000","last_became_peered":"2024-03-28T12:42:15.237739+0000","last_unstale":"2024-03-28T12:42:15.238142+0000","last_undegraded":"2024-03-28T12:42:15.238142+0000","last_fullsized":"2024-03-28T12:42:15.238142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:41:14.243482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.221374+0000","last_change":"2024-03-28T12:42:01.948688+0000","last_active":"2024-03-28T12:42:15.221374+0000","last_peered":"2024-03-28T12:42:15.221374+0000","last_clean":"2024-03-28T12:42:15.221374+0000","last_became_active":"2024-03-28T12:42:01.948049+0000","last_became_peered":"2024-03-28T12:42:01.948049+0000","last_unstale":"2024-03-28T12:42:15.221374+0000","last_undegraded":"2024-03-28T12:42:15.221374+0000","last_fullsized":"2024-03-28T12:42:15.221374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361477+0000","last_change":"2024-03-28T12:42:00.139208+0000","last_active":"2024-03-28T12:42:15.361477+0000","last_peered":"2024-03-28T12:42:15.361477+0000","last_clean":"2024-03-28T12:42:15.361477+0000","last_became_active":"2024-03-28T12:42:00.138264+0000","last_became_peered":"2024-03-28T12:42:00.138264+0000","last_unstale":"2024-03-28T12:42:15.361477+0000","last_undegraded":"2024-03-28T12:42:15.361477+0000","last_fullsized":"2024-03-28T12:42:15.361477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359578+0000","last_change":"2024-03-28T12:42:07.941636+0000","last_active":"2024-03-28T12:42:15.359578+0000","last_peered":"2024-03-28T12:42:15.359578+0000","last_clean":"2024-03-28T12:42:15.359578+0000","last_became_active":"2024-03-28T12:42:07.941114+0000","last_became_peered":"2024-03-28T12:42:07.941114+0000","last_unstale":"2024-03-28T12:42:15.359578+0000","last_undegraded":"2024-03-28T12:42:15.359578+0000","last_fullsized":"2024-03-28T12:42:15.359578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:00:58.736580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216501+0000","last_change":"2024-03-28T12:42:01.949545+0000","last_active":"2024-03-28T12:42:15.216501+0000","last_peered":"2024-03-28T12:42:15.216501+0000","last_clean":"2024-03-28T12:42:15.216501+0000","last_became_active":"2024-03-28T12:42:01.946576+0000","last_became_peered":"2024-03-28T12:42:01.946576+0000","last_unstale":"2024-03-28T12:42:15.216501+0000","last_undegraded":"2024-03-28T12:42:15.216501+0000","last_fullsized":"2024-03-28T12:42:15.216501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:32.704186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.314300+0000","last_change":"2024-03-28T12:42:00.142804+0000","last_active":"2024-03-28T12:42:38.314300+0000","last_peered":"2024-03-28T12:42:38.314300+0000","last_clean":"2024-03-28T12:42:38.314300+0000","last_became_active":"2024-03-28T12:42:00.142063+0000","last_became_peered":"2024-03-28T12:42:00.142063+0000","last_unstale":"2024-03-28T12:42:38.314300+0000","last_undegraded":"2024-03-28T12:42:38.314300+0000","last_fullsized":"2024-03-28T12:42:38.314300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:20:01.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.234431+0000","last_change":"2024-03-28T12:42:15.234431+0000","last_active":"2024-03-28T12:42:15.234431+0000","last_peered":"2024-03-28T12:42:15.234431+0000","last_clean":"2024-03-28T12:42:15.234431+0000","last_became_active":"2024-03-28T12:42:15.232928+0000","last_became_peered":"2024-03-28T12:42:15.232928+0000","last_unstale":"2024-03-28T12:42:15.234431+0000","last_undegraded":"2024-03-28T12:42:15.234431+0000","last_fullsized":"2024-03-28T12:42:15.234431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:05:19.841176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,5],"acting":[7,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228360+0000","last_change":"2024-03-28T12:42:01.787457+0000","last_active":"2024-03-28T12:42:15.228360+0000","last_peered":"2024-03-28T12:42:15.228360+0000","last_clean":"2024-03-28T12:42:15.228360+0000","last_became_active":"2024-03-28T12:42:01.787253+0000","last_became_peered":"2024-03-28T12:42:01.787253+0000","last_unstale":"2024-03-28T12:42:15.228360+0000","last_undegraded":"2024-03-28T12:42:15.228360+0000","last_fullsized":"2024-03-28T12:42:15.228360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:33.620394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.524652+0000","last_change":"2024-03-28T12:42:00.146723+0000","last_active":"2024-03-28T12:42:38.524652+0000","last_peered":"2024-03-28T12:42:38.524652+0000","last_clean":"2024-03-28T12:42:38.524652+0000","last_became_active":"2024-03-28T12:42:00.146394+0000","last_became_peered":"2024-03-28T12:42:00.146394+0000","last_unstale":"2024-03-28T12:42:38.524652+0000","last_undegraded":"2024-03-28T12:42:38.524652+0000","last_fullsized":"2024-03-28T12:42:38.524652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:20:01.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216137+0000","last_change":"2024-03-28T12:42:07.906623+0000","last_active":"2024-03-28T12:42:15.216137+0000","last_peered":"2024-03-28T12:42:15.216137+0000","last_clean":"2024-03-28T12:42:15.216137+0000","last_became_active":"2024-03-28T12:42:07.906233+0000","last_became_peered":"2024-03-28T12:42:07.906233+0000","last_unstale":"2024-03-28T12:42:15.216137+0000","last_undegraded":"2024-03-28T12:42:15.216137+0000","last_fullsized":"2024-03-28T12:42:15.216137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:45.857353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217128+0000","last_change":"2024-03-28T12:42:01.946498+0000","last_active":"2024-03-28T12:42:15.217128+0000","last_peered":"2024-03-28T12:42:15.217128+0000","last_clean":"2024-03-28T12:42:15.217128+0000","last_became_active":"2024-03-28T12:42:01.946087+0000","last_became_peered":"2024-03-28T12:42:01.946087+0000","last_unstale":"2024-03-28T12:42:15.217128+0000","last_undegraded":"2024-03-28T12:42:15.217128+0000","last_fullsized":"2024-03-28T12:42:15.217128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:05:13.466983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229900+0000","last_change":"2024-03-28T12:42:00.143860+0000","last_active":"2024-03-28T12:42:15.229900+0000","last_peered":"2024-03-28T12:42:15.229900+0000","last_clean":"2024-03-28T12:42:15.229900+0000","last_became_active":"2024-03-28T12:42:00.143537+0000","last_became_peered":"2024-03-28T12:42:00.143537+0000","last_unstale":"2024-03-28T12:42:15.229900+0000","last_undegraded":"2024-03-28T12:42:15.229900+0000","last_fullsized":"2024-03-28T12:42:15.229900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:38:32.416338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.365975+0000","last_change":"2024-03-28T12:42:15.365975+0000","last_active":"2024-03-28T12:42:15.365975+0000","last_peered":"2024-03-28T12:42:15.365975+0000","last_clean":"2024-03-28T12:42:15.365975+0000","last_became_active":"2024-03-28T12:42:15.365535+0000","last_became_peered":"2024-03-28T12:42:15.365535+0000","last_unstale":"2024-03-28T12:42:15.365975+0000","last_undegraded":"2024-03-28T12:42:15.365975+0000","last_fullsized":"2024-03-28T12:42:15.365975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,1],"acting":[2,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.218523+0000","last_change":"2024-03-28T12:42:01.802128+0000","last_active":"2024-03-28T12:42:15.218523+0000","last_peered":"2024-03-28T12:42:15.218523+0000","last_clean":"2024-03-28T12:42:15.218523+0000","last_became_active":"2024-03-28T12:42:01.801492+0000","last_became_peered":"2024-03-28T12:42:01.801492+0000","last_unstale":"2024-03-28T12:42:15.218523+0000","last_undegraded":"2024-03-28T12:42:15.218523+0000","last_fullsized":"2024-03-28T12:42:15.218523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:23:08.932618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:18.177557+0000","last_change":"2024-03-28T12:42:00.145914+0000","last_active":"2024-03-28T12:42:18.177557+0000","last_peered":"2024-03-28T12:42:18.177557+0000","last_clean":"2024-03-28T12:42:18.177557+0000","last_became_active":"2024-03-28T12:42:00.145638+0000","last_became_peered":"2024-03-28T12:42:00.145638+0000","last_unstale":"2024-03-28T12:42:18.177557+0000","last_undegraded":"2024-03-28T12:42:18.177557+0000","last_fullsized":"2024-03-28T12:42:18.177557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:47:28.765823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216394+0000","last_change":"2024-03-28T12:42:07.882697+0000","last_active":"2024-03-28T12:42:15.216394+0000","last_peered":"2024-03-28T12:42:15.216394+0000","last_clean":"2024-03-28T12:42:15.216394+0000","last_became_active":"2024-03-28T12:42:07.881730+0000","last_became_peered":"2024-03-28T12:42:07.881730+0000","last_unstale":"2024-03-28T12:42:15.216394+0000","last_undegraded":"2024-03-28T12:42:15.216394+0000","last_fullsized":"2024-03-28T12:42:15.216394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:12:27.231636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361319+0000","last_change":"2024-03-28T12:42:01.810914+0000","last_active":"2024-03-28T12:42:15.361319+0000","last_peered":"2024-03-28T12:42:15.361319+0000","last_clean":"2024-03-28T12:42:15.361319+0000","last_became_active":"2024-03-28T12:42:01.810207+0000","last_became_peered":"2024-03-28T12:42:01.810207+0000","last_unstale":"2024-03-28T12:42:15.361319+0000","last_undegraded":"2024-03-28T12:42:15.361319+0000","last_fullsized":"2024-03-28T12:42:15.361319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:32.704186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229681+0000","last_change":"2024-03-28T12:42:00.078402+0000","last_active":"2024-03-28T12:42:15.229681+0000","last_peered":"2024-03-28T12:42:15.229681+0000","last_clean":"2024-03-28T12:42:15.229681+0000","last_became_active":"2024-03-28T12:42:00.077988+0000","last_became_peered":"2024-03-28T12:42:00.077988+0000","last_unstale":"2024-03-28T12:42:15.229681+0000","last_undegraded":"2024-03-28T12:42:15.229681+0000","last_fullsized":"2024-03-28T12:42:15.229681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:21:58.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.362387+0000","last_change":"2024-03-28T12:42:07.936419+0000","last_active":"2024-03-28T12:42:15.362387+0000","last_peered":"2024-03-28T12:42:15.362387+0000","last_clean":"2024-03-28T12:42:15.362387+0000","last_became_active":"2024-03-28T12:42:07.935820+0000","last_became_peered":"2024-03-28T12:42:07.935820+0000","last_unstale":"2024-03-28T12:42:15.362387+0000","last_undegraded":"2024-03-28T12:42:15.362387+0000","last_fullsized":"2024-03-28T12:42:15.362387+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:35:08.334379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216161+0000","last_change":"2024-03-28T12:42:01.968887+0000","last_active":"2024-03-28T12:42:15.216161+0000","last_peered":"2024-03-28T12:42:15.216161+0000","last_clean":"2024-03-28T12:42:15.216161+0000","last_became_active":"2024-03-28T12:42:01.965491+0000","last_became_peered":"2024-03-28T12:42:01.965491+0000","last_unstale":"2024-03-28T12:42:15.216161+0000","last_undegraded":"2024-03-28T12:42:15.216161+0000","last_fullsized":"2024-03-28T12:42:15.216161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:35:50.246850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229216+0000","last_change":"2024-03-28T12:42:00.135482+0000","last_active":"2024-03-28T12:42:15.229216+0000","last_peered":"2024-03-28T12:42:15.229216+0000","last_clean":"2024-03-28T12:42:15.229216+0000","last_became_active":"2024-03-28T12:42:00.132939+0000","last_became_peered":"2024-03-28T12:42:00.132939+0000","last_unstale":"2024-03-28T12:42:15.229216+0000","last_undegraded":"2024-03-28T12:42:15.229216+0000","last_fullsized":"2024-03-28T12:42:15.229216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:31:41.407157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360749+0000","last_change":"2024-03-28T12:42:07.865644+0000","last_active":"2024-03-28T12:42:15.360749+0000","last_peered":"2024-03-28T12:42:15.360749+0000","last_clean":"2024-03-28T12:42:15.360749+0000","last_became_active":"2024-03-28T12:42:07.864804+0000","last_became_peered":"2024-03-28T12:42:07.864804+0000","last_unstale":"2024-03-28T12:42:15.360749+0000","last_undegraded":"2024-03-28T12:42:15.360749+0000","last_fullsized":"2024-03-28T12:42:15.360749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:28.659784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359688+0000","last_change":"2024-03-28T12:42:01.966222+0000","last_active":"2024-03-28T12:42:15.359688+0000","last_peered":"2024-03-28T12:42:15.359688+0000","last_clean":"2024-03-28T12:42:15.359688+0000","last_became_active":"2024-03-28T12:42:01.962305+0000","last_became_peered":"2024-03-28T12:42:01.962305+0000","last_unstale":"2024-03-28T12:42:15.359688+0000","last_undegraded":"2024-03-28T12:42:15.359688+0000","last_fullsized":"2024-03-28T12:42:15.359688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:33:35.906886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228509+0000","last_change":"2024-03-28T12:42:00.137406+0000","last_active":"2024-03-28T12:42:15.228509+0000","last_peered":"2024-03-28T12:42:15.228509+0000","last_clean":"2024-03-28T12:42:15.228509+0000","last_became_active":"2024-03-28T12:42:00.137086+0000","last_became_peered":"2024-03-28T12:42:00.137086+0000","last_unstale":"2024-03-28T12:42:15.228509+0000","last_undegraded":"2024-03-28T12:42:15.228509+0000","last_fullsized":"2024-03-28T12:42:15.228509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:44:10.945015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360602+0000","last_change":"2024-03-28T12:42:07.940726+0000","last_active":"2024-03-28T12:42:15.360602+0000","last_peered":"2024-03-28T12:42:15.360602+0000","last_clean":"2024-03-28T12:42:15.360602+0000","last_became_active":"2024-03-28T12:42:07.939926+0000","last_became_peered":"2024-03-28T12:42:07.939926+0000","last_unstale":"2024-03-28T12:42:15.360602+0000","last_undegraded":"2024-03-28T12:42:15.360602+0000","last_fullsized":"2024-03-28T12:42:15.360602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:45.857353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.226194+0000","last_change":"2024-03-28T12:42:01.949510+0000","last_active":"2024-03-28T12:42:15.226194+0000","last_peered":"2024-03-28T12:42:15.226194+0000","last_clean":"2024-03-28T12:42:15.226194+0000","last_became_active":"2024-03-28T12:42:01.949046+0000","last_became_peered":"2024-03-28T12:42:01.949046+0000","last_unstale":"2024-03-28T12:42:15.226194+0000","last_undegraded":"2024-03-28T12:42:15.226194+0000","last_fullsized":"2024-03-28T12:42:15.226194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:50:04.915302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.221135+0000","last_change":"2024-03-28T12:42:00.150734+0000","last_active":"2024-03-28T12:42:15.221135+0000","last_peered":"2024-03-28T12:42:15.221135+0000","last_clean":"2024-03-28T12:42:15.221135+0000","last_became_active":"2024-03-28T12:42:00.150209+0000","last_became_peered":"2024-03-28T12:42:00.150209+0000","last_unstale":"2024-03-28T12:42:15.221135+0000","last_undegraded":"2024-03-28T12:42:15.221135+0000","last_fullsized":"2024-03-28T12:42:15.221135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:01:08.734929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361808+0000","last_change":"2024-03-28T12:42:07.935974+0000","last_active":"2024-03-28T12:42:15.361808+0000","last_peered":"2024-03-28T12:42:15.361808+0000","last_clean":"2024-03-28T12:42:15.361808+0000","last_became_active":"2024-03-28T12:42:07.935342+0000","last_became_peered":"2024-03-28T12:42:07.935342+0000","last_unstale":"2024-03-28T12:42:15.361808+0000","last_undegraded":"2024-03-28T12:42:15.361808+0000","last_fullsized":"2024-03-28T12:42:15.361808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:21.970094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360601+0000","last_change":"2024-03-28T12:42:01.961701+0000","last_active":"2024-03-28T12:42:15.360601+0000","last_peered":"2024-03-28T12:42:15.360601+0000","last_clean":"2024-03-28T12:42:15.360601+0000","last_became_active":"2024-03-28T12:42:01.961228+0000","last_became_peered":"2024-03-28T12:42:01.961228+0000","last_unstale":"2024-03-28T12:42:15.360601+0000","last_undegraded":"2024-03-28T12:42:15.360601+0000","last_fullsized":"2024-03-28T12:42:15.360601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227858+0000","last_change":"2024-03-28T12:42:00.069398+0000","last_active":"2024-03-28T12:42:15.227858+0000","last_peered":"2024-03-28T12:42:15.227858+0000","last_clean":"2024-03-28T12:42:15.227858+0000","last_became_active":"2024-03-28T12:42:00.069134+0000","last_became_peered":"2024-03-28T12:42:00.069134+0000","last_unstale":"2024-03-28T12:42:15.227858+0000","last_undegraded":"2024-03-28T12:42:15.227858+0000","last_fullsized":"2024-03-28T12:42:15.227858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:57:54.776311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.365776+0000","last_change":"2024-03-28T12:42:15.365776+0000","last_active":"2024-03-28T12:42:15.365776+0000","last_peered":"2024-03-28T12:42:15.365776+0000","last_clean":"2024-03-28T12:42:15.365776+0000","last_became_active":"2024-03-28T12:42:15.364496+0000","last_became_peered":"2024-03-28T12:42:15.364496+0000","last_unstale":"2024-03-28T12:42:15.365776+0000","last_undegraded":"2024-03-28T12:42:15.365776+0000","last_fullsized":"2024-03-28T12:42:15.365776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:22:09.948471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217033+0000","last_change":"2024-03-28T12:42:01.959210+0000","last_active":"2024-03-28T12:42:15.217033+0000","last_peered":"2024-03-28T12:42:15.217033+0000","last_clean":"2024-03-28T12:42:15.217033+0000","last_became_active":"2024-03-28T12:42:01.958117+0000","last_became_peered":"2024-03-28T12:42:01.958117+0000","last_unstale":"2024-03-28T12:42:15.217033+0000","last_undegraded":"2024-03-28T12:42:15.217033+0000","last_fullsized":"2024-03-28T12:42:15.217033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:28:17.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229068+0000","last_change":"2024-03-28T12:42:00.134120+0000","last_active":"2024-03-28T12:42:15.229068+0000","last_peered":"2024-03-28T12:42:15.229068+0000","last_clean":"2024-03-28T12:42:15.229068+0000","last_became_active":"2024-03-28T12:42:00.133540+0000","last_became_peered":"2024-03-28T12:42:00.133540+0000","last_unstale":"2024-03-28T12:42:15.229068+0000","last_undegraded":"2024-03-28T12:42:15.229068+0000","last_fullsized":"2024-03-28T12:42:15.229068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:49:47.641947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352740+0000","last_change":"2024-03-28T12:41:26.701485+0000","last_active":"2024-03-28T12:42:15.352740+0000","last_peered":"2024-03-28T12:42:15.352740+0000","last_clean":"2024-03-28T12:42:15.352740+0000","last_became_active":"2024-03-28T12:41:26.700338+0000","last_became_peered":"2024-03-28T12:41:26.700338+0000","last_unstale":"2024-03-28T12:42:15.352740+0000","last_undegraded":"2024-03-28T12:42:15.352740+0000","last_fullsized":"2024-03-28T12:42:15.352740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:24.290713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:24.290713+0000","last_clean_scrub_stamp":"2024-03-28T12:41:24.290713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:58:57.536691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229580+0000","last_change":"2024-03-28T12:42:07.938384+0000","last_active":"2024-03-28T12:42:15.229580+0000","last_peered":"2024-03-28T12:42:15.229580+0000","last_clean":"2024-03-28T12:42:15.229580+0000","last_became_active":"2024-03-28T12:42:07.937553+0000","last_became_peered":"2024-03-28T12:42:07.937553+0000","last_unstale":"2024-03-28T12:42:15.229580+0000","last_undegraded":"2024-03-28T12:42:15.229580+0000","last_fullsized":"2024-03-28T12:42:15.229580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:28:13.502930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228823+0000","last_change":"2024-03-28T12:42:01.960107+0000","last_active":"2024-03-28T12:42:15.228823+0000","last_peered":"2024-03-28T12:42:15.228823+0000","last_clean":"2024-03-28T12:42:15.228823+0000","last_became_active":"2024-03-28T12:42:01.959809+0000","last_became_peered":"2024-03-28T12:42:01.959809+0000","last_unstale":"2024-03-28T12:42:15.228823+0000","last_undegraded":"2024-03-28T12:42:15.228823+0000","last_fullsized":"2024-03-28T12:42:15.228823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:38.797683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361372+0000","last_change":"2024-03-28T12:42:00.144133+0000","last_active":"2024-03-28T12:42:15.361372+0000","last_peered":"2024-03-28T12:42:15.361372+0000","last_clean":"2024-03-28T12:42:15.361372+0000","last_became_active":"2024-03-28T12:42:00.143460+0000","last_became_peered":"2024-03-28T12:42:00.143460+0000","last_unstale":"2024-03-28T12:42:15.361372+0000","last_undegraded":"2024-03-28T12:42:15.361372+0000","last_fullsized":"2024-03-28T12:42:15.361372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215115+0000","last_change":"2024-03-28T12:42:07.902848+0000","last_active":"2024-03-28T12:42:15.215115+0000","last_peered":"2024-03-28T12:42:15.215115+0000","last_clean":"2024-03-28T12:42:15.215115+0000","last_became_active":"2024-03-28T12:42:07.902428+0000","last_became_peered":"2024-03-28T12:42:07.902428+0000","last_unstale":"2024-03-28T12:42:15.215115+0000","last_undegraded":"2024-03-28T12:42:15.215115+0000","last_fullsized":"2024-03-28T12:42:15.215115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:28.659784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359765+0000","last_change":"2024-03-28T12:42:01.950786+0000","last_active":"2024-03-28T12:42:15.359765+0000","last_peered":"2024-03-28T12:42:15.359765+0000","last_clean":"2024-03-28T12:42:15.359765+0000","last_became_active":"2024-03-28T12:42:01.950592+0000","last_became_peered":"2024-03-28T12:42:01.950592+0000","last_unstale":"2024-03-28T12:42:15.359765+0000","last_undegraded":"2024-03-28T12:42:15.359765+0000","last_fullsized":"2024-03-28T12:42:15.359765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:53.224241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229716+0000","last_change":"2024-03-28T12:42:00.148307+0000","last_active":"2024-03-28T12:42:15.229716+0000","last_peered":"2024-03-28T12:42:15.229716+0000","last_clean":"2024-03-28T12:42:15.229716+0000","last_became_active":"2024-03-28T12:42:00.139237+0000","last_became_peered":"2024-03-28T12:42:00.139237+0000","last_unstale":"2024-03-28T12:42:15.229716+0000","last_undegraded":"2024-03-28T12:42:15.229716+0000","last_fullsized":"2024-03-28T12:42:15.229716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:43:33.699843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227129+0000","last_change":"2024-03-28T12:42:07.885520+0000","last_active":"2024-03-28T12:42:15.227129+0000","last_peered":"2024-03-28T12:42:15.227129+0000","last_clean":"2024-03-28T12:42:15.227129+0000","last_became_active":"2024-03-28T12:42:07.880300+0000","last_became_peered":"2024-03-28T12:42:07.880300+0000","last_unstale":"2024-03-28T12:42:15.227129+0000","last_undegraded":"2024-03-28T12:42:15.227129+0000","last_fullsized":"2024-03-28T12:42:15.227129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:17:47.670820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359833+0000","last_change":"2024-03-28T12:42:01.962888+0000","last_active":"2024-03-28T12:42:15.359833+0000","last_peered":"2024-03-28T12:42:15.359833+0000","last_clean":"2024-03-28T12:42:15.359833+0000","last_became_active":"2024-03-28T12:42:01.962604+0000","last_became_peered":"2024-03-28T12:42:01.962604+0000","last_unstale":"2024-03-28T12:42:15.359833+0000","last_undegraded":"2024-03-28T12:42:15.359833+0000","last_fullsized":"2024-03-28T12:42:15.359833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:49.327792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217421+0000","last_change":"2024-03-28T12:42:00.085372+0000","last_active":"2024-03-28T12:42:15.217421+0000","last_peered":"2024-03-28T12:42:15.217421+0000","last_clean":"2024-03-28T12:42:15.217421+0000","last_became_active":"2024-03-28T12:42:00.084866+0000","last_became_peered":"2024-03-28T12:42:00.084866+0000","last_unstale":"2024-03-28T12:42:15.217421+0000","last_undegraded":"2024-03-28T12:42:15.217421+0000","last_fullsized":"2024-03-28T12:42:15.217421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:21:45.688123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227629+0000","last_change":"2024-03-28T12:42:07.899218+0000","last_active":"2024-03-28T12:42:15.227629+0000","last_peered":"2024-03-28T12:42:15.227629+0000","last_clean":"2024-03-28T12:42:15.227629+0000","last_became_active":"2024-03-28T12:42:07.898853+0000","last_became_peered":"2024-03-28T12:42:07.898853+0000","last_unstale":"2024-03-28T12:42:15.227629+0000","last_undegraded":"2024-03-28T12:42:15.227629+0000","last_fullsized":"2024-03-28T12:42:15.227629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:21.240557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216536+0000","last_change":"2024-03-28T12:42:01.965370+0000","last_active":"2024-03-28T12:42:15.216536+0000","last_peered":"2024-03-28T12:42:15.216536+0000","last_clean":"2024-03-28T12:42:15.216536+0000","last_became_active":"2024-03-28T12:42:01.964442+0000","last_became_peered":"2024-03-28T12:42:01.964442+0000","last_unstale":"2024-03-28T12:42:15.216536+0000","last_undegraded":"2024-03-28T12:42:15.216536+0000","last_fullsized":"2024-03-28T12:42:15.216536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:35.775033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359937+0000","last_change":"2024-03-28T12:42:00.153658+0000","last_active":"2024-03-28T12:42:15.359937+0000","last_peered":"2024-03-28T12:42:15.359937+0000","last_clean":"2024-03-28T12:42:15.359937+0000","last_became_active":"2024-03-28T12:42:00.153292+0000","last_became_peered":"2024-03-28T12:42:00.153292+0000","last_unstale":"2024-03-28T12:42:15.359937+0000","last_undegraded":"2024-03-28T12:42:15.359937+0000","last_fullsized":"2024-03-28T12:42:15.359937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:54.524905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.353046+0000","last_change":"2024-03-28T12:42:07.900126+0000","last_active":"2024-03-28T12:42:15.353046+0000","last_peered":"2024-03-28T12:42:15.353046+0000","last_clean":"2024-03-28T12:42:15.353046+0000","last_became_active":"2024-03-28T12:42:07.899780+0000","last_became_peered":"2024-03-28T12:42:07.899780+0000","last_unstale":"2024-03-28T12:42:15.353046+0000","last_undegraded":"2024-03-28T12:42:15.353046+0000","last_fullsized":"2024-03-28T12:42:15.353046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:31.070732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228279+0000","last_change":"2024-03-28T12:42:01.962221+0000","last_active":"2024-03-28T12:42:15.228279+0000","last_peered":"2024-03-28T12:42:15.228279+0000","last_clean":"2024-03-28T12:42:15.228279+0000","last_became_active":"2024-03-28T12:42:01.961938+0000","last_became_peered":"2024-03-28T12:42:01.961938+0000","last_unstale":"2024-03-28T12:42:15.228279+0000","last_undegraded":"2024-03-28T12:42:15.228279+0000","last_fullsized":"2024-03-28T12:42:15.228279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:55:52.354803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'10","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.313359+0000","last_change":"2024-03-28T12:42:00.132287+0000","last_active":"2024-03-28T12:42:38.313359+0000","last_peered":"2024-03-28T12:42:38.313359+0000","last_clean":"2024-03-28T12:42:38.313359+0000","last_became_active":"2024-03-28T12:42:00.131064+0000","last_became_peered":"2024-03-28T12:42:00.131064+0000","last_unstale":"2024-03-28T12:42:38.313359+0000","last_undegraded":"2024-03-28T12:42:38.313359+0000","last_fullsized":"2024-03-28T12:42:38.313359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229667+0000","last_change":"2024-03-28T12:42:07.887453+0000","last_active":"2024-03-28T12:42:15.229667+0000","last_peered":"2024-03-28T12:42:15.229667+0000","last_clean":"2024-03-28T12:42:15.229667+0000","last_became_active":"2024-03-28T12:42:07.886685+0000","last_became_peered":"2024-03-28T12:42:07.886685+0000","last_unstale":"2024-03-28T12:42:15.229667+0000","last_undegraded":"2024-03-28T12:42:15.229667+0000","last_fullsized":"2024-03-28T12:42:15.229667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:10:05.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352581+0000","last_change":"2024-03-28T12:42:01.961318+0000","last_active":"2024-03-28T12:42:15.352581+0000","last_peered":"2024-03-28T12:42:15.352581+0000","last_clean":"2024-03-28T12:42:15.352581+0000","last_became_active":"2024-03-28T12:42:01.960102+0000","last_became_peered":"2024-03-28T12:42:01.960102+0000","last_unstale":"2024-03-28T12:42:15.352581+0000","last_undegraded":"2024-03-28T12:42:15.352581+0000","last_fullsized":"2024-03-28T12:42:15.352581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359413+0000","last_change":"2024-03-28T12:42:00.145117+0000","last_active":"2024-03-28T12:42:15.359413+0000","last_peered":"2024-03-28T12:42:15.359413+0000","last_clean":"2024-03-28T12:42:15.359413+0000","last_became_active":"2024-03-28T12:42:00.144572+0000","last_became_peered":"2024-03-28T12:42:00.144572+0000","last_unstale":"2024-03-28T12:42:15.359413+0000","last_undegraded":"2024-03-28T12:42:15.359413+0000","last_fullsized":"2024-03-28T12:42:15.359413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:21:45.688123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.232187+0000","last_change":"2024-03-28T12:42:07.885727+0000","last_active":"2024-03-28T12:42:15.232187+0000","last_peered":"2024-03-28T12:42:15.232187+0000","last_clean":"2024-03-28T12:42:15.232187+0000","last_became_active":"2024-03-28T12:42:07.884760+0000","last_became_peered":"2024-03-28T12:42:07.884760+0000","last_unstale":"2024-03-28T12:42:15.232187+0000","last_undegraded":"2024-03-28T12:42:15.232187+0000","last_fullsized":"2024-03-28T12:42:15.232187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:45.171876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228766+0000","last_change":"2024-03-28T12:42:01.936371+0000","last_active":"2024-03-28T12:42:15.228766+0000","last_peered":"2024-03-28T12:42:15.228766+0000","last_clean":"2024-03-28T12:42:15.228766+0000","last_became_active":"2024-03-28T12:42:01.936080+0000","last_became_peered":"2024-03-28T12:42:01.936080+0000","last_unstale":"2024-03-28T12:42:15.228766+0000","last_undegraded":"2024-03-28T12:42:15.228766+0000","last_fullsized":"2024-03-28T12:42:15.228766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:36.955339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228493+0000","last_change":"2024-03-28T12:42:00.139149+0000","last_active":"2024-03-28T12:42:15.228493+0000","last_peered":"2024-03-28T12:42:15.228493+0000","last_clean":"2024-03-28T12:42:15.228493+0000","last_became_active":"2024-03-28T12:42:00.138555+0000","last_became_peered":"2024-03-28T12:42:00.138555+0000","last_unstale":"2024-03-28T12:42:15.228493+0000","last_undegraded":"2024-03-28T12:42:15.228493+0000","last_fullsized":"2024-03-28T12:42:15.228493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:44:12.403916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360325+0000","last_change":"2024-03-28T12:42:07.940362+0000","last_active":"2024-03-28T12:42:15.360325+0000","last_peered":"2024-03-28T12:42:15.360325+0000","last_clean":"2024-03-28T12:42:15.360325+0000","last_became_active":"2024-03-28T12:42:07.939396+0000","last_became_peered":"2024-03-28T12:42:07.939396+0000","last_unstale":"2024-03-28T12:42:15.360325+0000","last_undegraded":"2024-03-28T12:42:15.360325+0000","last_fullsized":"2024-03-28T12:42:15.360325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:59.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361226+0000","last_change":"2024-03-28T12:42:01.800361+0000","last_active":"2024-03-28T12:42:15.361226+0000","last_peered":"2024-03-28T12:42:15.361226+0000","last_clean":"2024-03-28T12:42:15.361226+0000","last_became_active":"2024-03-28T12:42:01.799594+0000","last_became_peered":"2024-03-28T12:42:01.799594+0000","last_unstale":"2024-03-28T12:42:15.361226+0000","last_undegraded":"2024-03-28T12:42:15.361226+0000","last_fullsized":"2024-03-28T12:42:15.361226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:35.775033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.314123+0000","last_change":"2024-03-28T12:42:00.143501+0000","last_active":"2024-03-28T12:42:38.314123+0000","last_peered":"2024-03-28T12:42:38.314123+0000","last_clean":"2024-03-28T12:42:38.314123+0000","last_became_active":"2024-03-28T12:42:00.142913+0000","last_became_peered":"2024-03-28T12:42:00.142913+0000","last_unstale":"2024-03-28T12:42:38.314123+0000","last_undegraded":"2024-03-28T12:42:38.314123+0000","last_fullsized":"2024-03-28T12:42:38.314123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228689+0000","last_change":"2024-03-28T12:42:07.938687+0000","last_active":"2024-03-28T12:42:15.228689+0000","last_peered":"2024-03-28T12:42:15.228689+0000","last_clean":"2024-03-28T12:42:15.228689+0000","last_became_active":"2024-03-28T12:42:07.938081+0000","last_became_peered":"2024-03-28T12:42:07.938081+0000","last_unstale":"2024-03-28T12:42:15.228689+0000","last_undegraded":"2024-03-28T12:42:15.228689+0000","last_fullsized":"2024-03-28T12:42:15.228689+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:47.148457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359939+0000","last_change":"2024-03-28T12:42:01.938516+0000","last_active":"2024-03-28T12:42:15.359939+0000","last_peered":"2024-03-28T12:42:15.359939+0000","last_clean":"2024-03-28T12:42:15.359939+0000","last_became_active":"2024-03-28T12:42:01.938251+0000","last_became_peered":"2024-03-28T12:42:01.938251+0000","last_unstale":"2024-03-28T12:42:15.359939+0000","last_undegraded":"2024-03-28T12:42:15.359939+0000","last_fullsized":"2024-03-28T12:42:15.359939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:15.595901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'13","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.470673+0000","last_change":"2024-03-28T12:42:00.141127+0000","last_active":"2024-03-28T12:42:38.470673+0000","last_peered":"2024-03-28T12:42:38.470673+0000","last_clean":"2024-03-28T12:42:38.470673+0000","last_became_active":"2024-03-28T12:42:00.140832+0000","last_became_peered":"2024-03-28T12:42:00.140832+0000","last_unstale":"2024-03-28T12:42:38.470673+0000","last_undegraded":"2024-03-28T12:42:38.470673+0000","last_fullsized":"2024-03-28T12:42:38.470673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:01:04.151858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216619+0000","last_change":"2024-03-28T12:42:07.936963+0000","last_active":"2024-03-28T12:42:15.216619+0000","last_peered":"2024-03-28T12:42:15.216619+0000","last_clean":"2024-03-28T12:42:15.216619+0000","last_became_active":"2024-03-28T12:42:07.936606+0000","last_became_peered":"2024-03-28T12:42:07.936606+0000","last_unstale":"2024-03-28T12:42:15.216619+0000","last_undegraded":"2024-03-28T12:42:15.216619+0000","last_fullsized":"2024-03-28T12:42:15.216619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:37:04.083032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228759+0000","last_change":"2024-03-28T12:42:01.962855+0000","last_active":"2024-03-28T12:42:15.228759+0000","last_peered":"2024-03-28T12:42:15.228759+0000","last_clean":"2024-03-28T12:42:15.228759+0000","last_became_active":"2024-03-28T12:42:01.962546+0000","last_became_peered":"2024-03-28T12:42:01.962546+0000","last_unstale":"2024-03-28T12:42:15.228759+0000","last_undegraded":"2024-03-28T12:42:15.228759+0000","last_fullsized":"2024-03-28T12:42:15.228759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:08.429940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.222908+0000","last_change":"2024-03-28T12:42:00.138923+0000","last_active":"2024-03-28T12:42:15.222908+0000","last_peered":"2024-03-28T12:42:15.222908+0000","last_clean":"2024-03-28T12:42:15.222908+0000","last_became_active":"2024-03-28T12:42:00.138233+0000","last_became_peered":"2024-03-28T12:42:00.138233+0000","last_unstale":"2024-03-28T12:42:15.222908+0000","last_undegraded":"2024-03-28T12:42:15.222908+0000","last_fullsized":"2024-03-28T12:42:15.222908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215066+0000","last_change":"2024-03-28T12:42:07.907163+0000","last_active":"2024-03-28T12:42:15.215066+0000","last_peered":"2024-03-28T12:42:15.215066+0000","last_clean":"2024-03-28T12:42:15.215066+0000","last_became_active":"2024-03-28T12:42:07.906334+0000","last_became_peered":"2024-03-28T12:42:07.906334+0000","last_unstale":"2024-03-28T12:42:15.215066+0000","last_undegraded":"2024-03-28T12:42:15.215066+0000","last_fullsized":"2024-03-28T12:42:15.215066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:59.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.232689+0000","last_change":"2024-03-28T12:42:01.809232+0000","last_active":"2024-03-28T12:42:15.232689+0000","last_peered":"2024-03-28T12:42:15.232689+0000","last_clean":"2024-03-28T12:42:15.232689+0000","last_became_active":"2024-03-28T12:42:01.805284+0000","last_became_peered":"2024-03-28T12:42:01.805284+0000","last_unstale":"2024-03-28T12:42:15.232689+0000","last_undegraded":"2024-03-28T12:42:15.232689+0000","last_fullsized":"2024-03-28T12:42:15.232689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:20:54.180080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.524133+0000","last_change":"2024-03-28T12:42:00.147739+0000","last_active":"2024-03-28T12:42:38.524133+0000","last_peered":"2024-03-28T12:42:38.524133+0000","last_clean":"2024-03-28T12:42:38.524133+0000","last_became_active":"2024-03-28T12:42:00.147407+0000","last_became_peered":"2024-03-28T12:42:00.147407+0000","last_unstale":"2024-03-28T12:42:38.524133+0000","last_undegraded":"2024-03-28T12:42:38.524133+0000","last_fullsized":"2024-03-28T12:42:38.524133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:29.908949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.218877+0000","last_change":"2024-03-28T12:42:07.900662+0000","last_active":"2024-03-28T12:42:15.218877+0000","last_peered":"2024-03-28T12:42:15.218877+0000","last_clean":"2024-03-28T12:42:15.218877+0000","last_became_active":"2024-03-28T12:42:07.899628+0000","last_became_peered":"2024-03-28T12:42:07.899628+0000","last_unstale":"2024-03-28T12:42:15.218877+0000","last_undegraded":"2024-03-28T12:42:15.218877+0000","last_fullsized":"2024-03-28T12:42:15.218877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:31.070732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216320+0000","last_change":"2024-03-28T12:42:01.967776+0000","last_active":"2024-03-28T12:42:15.216320+0000","last_peered":"2024-03-28T12:42:15.216320+0000","last_clean":"2024-03-28T12:42:15.216320+0000","last_became_active":"2024-03-28T12:42:01.964830+0000","last_became_peered":"2024-03-28T12:42:01.964830+0000","last_unstale":"2024-03-28T12:42:15.216320+0000","last_undegraded":"2024-03-28T12:42:15.216320+0000","last_fullsized":"2024-03-28T12:42:15.216320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.454134+0000","last_change":"2024-03-28T12:42:00.142326+0000","last_active":"2024-03-28T12:42:38.454134+0000","last_peered":"2024-03-28T12:42:38.454134+0000","last_clean":"2024-03-28T12:42:38.454134+0000","last_became_active":"2024-03-28T12:42:00.141602+0000","last_became_peered":"2024-03-28T12:42:00.141602+0000","last_unstale":"2024-03-28T12:42:38.454134+0000","last_undegraded":"2024-03-28T12:42:38.454134+0000","last_fullsized":"2024-03-28T12:42:38.454134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217682+0000","last_change":"2024-03-28T12:42:07.935882+0000","last_active":"2024-03-28T12:42:15.217682+0000","last_peered":"2024-03-28T12:42:15.217682+0000","last_clean":"2024-03-28T12:42:15.217682+0000","last_became_active":"2024-03-28T12:42:07.935525+0000","last_became_peered":"2024-03-28T12:42:07.935525+0000","last_unstale":"2024-03-28T12:42:15.217682+0000","last_undegraded":"2024-03-28T12:42:15.217682+0000","last_fullsized":"2024-03-28T12:42:15.217682+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:50:31.463779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216828+0000","last_change":"2024-03-28T12:42:07.882782+0000","last_active":"2024-03-28T12:42:15.216828+0000","last_peered":"2024-03-28T12:42:15.216828+0000","last_clean":"2024-03-28T12:42:15.216828+0000","last_became_active":"2024-03-28T12:42:07.881527+0000","last_became_peered":"2024-03-28T12:42:07.881527+0000","last_unstale":"2024-03-28T12:42:15.216828+0000","last_undegraded":"2024-03-28T12:42:15.216828+0000","last_fullsized":"2024-03-28T12:42:15.216828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:55.701985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217935+0000","last_change":"2024-03-28T12:42:01.958791+0000","last_active":"2024-03-28T12:42:15.217935+0000","last_peered":"2024-03-28T12:42:15.217935+0000","last_clean":"2024-03-28T12:42:15.217935+0000","last_became_active":"2024-03-28T12:42:01.957991+0000","last_became_peered":"2024-03-28T12:42:01.957991+0000","last_unstale":"2024-03-28T12:42:15.217935+0000","last_undegraded":"2024-03-28T12:42:15.217935+0000","last_fullsized":"2024-03-28T12:42:15.217935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:24.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227838+0000","last_change":"2024-03-28T12:42:00.132942+0000","last_active":"2024-03-28T12:42:15.227838+0000","last_peered":"2024-03-28T12:42:15.227838+0000","last_clean":"2024-03-28T12:42:15.227838+0000","last_became_active":"2024-03-28T12:42:00.132663+0000","last_became_peered":"2024-03-28T12:42:00.132663+0000","last_unstale":"2024-03-28T12:42:15.227838+0000","last_undegraded":"2024-03-28T12:42:15.227838+0000","last_fullsized":"2024-03-28T12:42:15.227838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:41.612613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229445+0000","last_change":"2024-03-28T12:42:07.901907+0000","last_active":"2024-03-28T12:42:15.229445+0000","last_peered":"2024-03-28T12:42:15.229445+0000","last_clean":"2024-03-28T12:42:15.229445+0000","last_became_active":"2024-03-28T12:42:07.901398+0000","last_became_peered":"2024-03-28T12:42:07.901398+0000","last_unstale":"2024-03-28T12:42:15.229445+0000","last_undegraded":"2024-03-28T12:42:15.229445+0000","last_fullsized":"2024-03-28T12:42:15.229445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:49:41.408808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.226666+0000","last_change":"2024-03-28T12:42:01.811306+0000","last_active":"2024-03-28T12:42:15.226666+0000","last_peered":"2024-03-28T12:42:15.226666+0000","last_clean":"2024-03-28T12:42:15.226666+0000","last_became_active":"2024-03-28T12:42:01.810142+0000","last_became_peered":"2024-03-28T12:42:01.810142+0000","last_unstale":"2024-03-28T12:42:15.226666+0000","last_undegraded":"2024-03-28T12:42:15.226666+0000","last_fullsized":"2024-03-28T12:42:15.226666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:37:22.386341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360858+0000","last_change":"2024-03-28T12:42:00.142916+0000","last_active":"2024-03-28T12:42:15.360858+0000","last_peered":"2024-03-28T12:42:15.360858+0000","last_clean":"2024-03-28T12:42:15.360858+0000","last_became_active":"2024-03-28T12:42:00.142006+0000","last_became_peered":"2024-03-28T12:42:00.142006+0000","last_unstale":"2024-03-28T12:42:15.360858+0000","last_undegraded":"2024-03-28T12:42:15.360858+0000","last_fullsized":"2024-03-28T12:42:15.360858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:01:08.734929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228344+0000","last_change":"2024-03-28T12:42:00.143738+0000","last_active":"2024-03-28T12:42:15.228344+0000","last_peered":"2024-03-28T12:42:15.228344+0000","last_clean":"2024-03-28T12:42:15.228344+0000","last_became_active":"2024-03-28T12:42:00.143474+0000","last_became_peered":"2024-03-28T12:42:00.143474+0000","last_unstale":"2024-03-28T12:42:15.228344+0000","last_undegraded":"2024-03-28T12:42:15.228344+0000","last_fullsized":"2024-03-28T12:42:15.228344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:43:33.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217213+0000","last_change":"2024-03-28T12:42:01.938147+0000","last_active":"2024-03-28T12:42:15.217213+0000","last_peered":"2024-03-28T12:42:15.217213+0000","last_clean":"2024-03-28T12:42:15.217213+0000","last_became_active":"2024-03-28T12:42:01.937612+0000","last_became_peered":"2024-03-28T12:42:01.937612+0000","last_unstale":"2024-03-28T12:42:15.217213+0000","last_undegraded":"2024-03-28T12:42:15.217213+0000","last_fullsized":"2024-03-28T12:42:15.217213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:31:15.643101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216896+0000","last_change":"2024-03-28T12:42:07.870201+0000","last_active":"2024-03-28T12:42:15.216896+0000","last_peered":"2024-03-28T12:42:15.216896+0000","last_clean":"2024-03-28T12:42:15.216896+0000","last_became_active":"2024-03-28T12:42:07.869628+0000","last_became_peered":"2024-03-28T12:42:07.869628+0000","last_unstale":"2024-03-28T12:42:15.216896+0000","last_undegraded":"2024-03-28T12:42:15.216896+0000","last_fullsized":"2024-03-28T12:42:15.216896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228742+0000","last_change":"2024-03-28T12:42:00.146260+0000","last_active":"2024-03-28T12:42:15.228742+0000","last_peered":"2024-03-28T12:42:15.228742+0000","last_clean":"2024-03-28T12:42:15.228742+0000","last_became_active":"2024-03-28T12:42:00.146052+0000","last_became_peered":"2024-03-28T12:42:00.146052+0000","last_unstale":"2024-03-28T12:42:15.228742+0000","last_undegraded":"2024-03-28T12:42:15.228742+0000","last_fullsized":"2024-03-28T12:42:15.228742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:08.118205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352739+0000","last_change":"2024-03-28T12:42:01.966002+0000","last_active":"2024-03-28T12:42:15.352739+0000","last_peered":"2024-03-28T12:42:15.352739+0000","last_clean":"2024-03-28T12:42:15.352739+0000","last_became_active":"2024-03-28T12:42:01.965598+0000","last_became_peered":"2024-03-28T12:42:01.965598+0000","last_unstale":"2024-03-28T12:42:15.352739+0000","last_undegraded":"2024-03-28T12:42:15.352739+0000","last_fullsized":"2024-03-28T12:42:15.352739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:35:50.246850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.363695+0000","last_change":"2024-03-28T12:42:15.361649+0000","last_active":"2024-03-28T12:42:15.363695+0000","last_peered":"2024-03-28T12:42:15.363695+0000","last_clean":"2024-03-28T12:42:15.363695+0000","last_became_active":"2024-03-28T12:42:15.360743+0000","last_became_peered":"2024-03-28T12:42:15.360743+0000","last_unstale":"2024-03-28T12:42:15.363695+0000","last_undegraded":"2024-03-28T12:42:15.363695+0000","last_fullsized":"2024-03-28T12:42:15.363695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:55.701985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.214938+0000","last_change":"2024-03-28T12:42:01.965237+0000","last_active":"2024-03-28T12:42:15.214938+0000","last_peered":"2024-03-28T12:42:15.214938+0000","last_clean":"2024-03-28T12:42:15.214938+0000","last_became_active":"2024-03-28T12:42:01.964468+0000","last_became_peered":"2024-03-28T12:42:01.964468+0000","last_unstale":"2024-03-28T12:42:15.214938+0000","last_undegraded":"2024-03-28T12:42:15.214938+0000","last_fullsized":"2024-03-28T12:42:15.214938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:05.744451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.220849+0000","last_change":"2024-03-28T12:42:01.959553+0000","last_active":"2024-03-28T12:42:15.220849+0000","last_peered":"2024-03-28T12:42:15.220849+0000","last_clean":"2024-03-28T12:42:15.220849+0000","last_became_active":"2024-03-28T12:42:01.958333+0000","last_became_peered":"2024-03-28T12:42:01.958333+0000","last_unstale":"2024-03-28T12:42:15.220849+0000","last_undegraded":"2024-03-28T12:42:15.220849+0000","last_fullsized":"2024-03-28T12:42:15.220849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:05.744451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228041+0000","last_change":"2024-03-28T12:42:01.805452+0000","last_active":"2024-03-28T12:42:15.228041+0000","last_peered":"2024-03-28T12:42:15.228041+0000","last_clean":"2024-03-28T12:42:15.228041+0000","last_became_active":"2024-03-28T12:42:01.805288+0000","last_became_peered":"2024-03-28T12:42:01.805288+0000","last_unstale":"2024-03-28T12:42:15.228041+0000","last_undegraded":"2024-03-28T12:42:15.228041+0000","last_fullsized":"2024-03-28T12:42:15.228041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:17:01.582670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228480+0000","last_change":"2024-03-28T12:42:01.947234+0000","last_active":"2024-03-28T12:42:15.228480+0000","last_peered":"2024-03-28T12:42:15.228480+0000","last_clean":"2024-03-28T12:42:15.228480+0000","last_became_active":"2024-03-28T12:42:01.946859+0000","last_became_peered":"2024-03-28T12:42:01.946859+0000","last_unstale":"2024-03-28T12:42:15.228480+0000","last_undegraded":"2024-03-28T12:42:15.228480+0000","last_fullsized":"2024-03-28T12:42:15.228480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:36:05.320541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361030+0000","last_change":"2024-03-28T12:42:01.935265+0000","last_active":"2024-03-28T12:42:15.361030+0000","last_peered":"2024-03-28T12:42:15.361030+0000","last_clean":"2024-03-28T12:42:15.361030+0000","last_became_active":"2024-03-28T12:42:01.934578+0000","last_became_peered":"2024-03-28T12:42:01.934578+0000","last_unstale":"2024-03-28T12:42:15.361030+0000","last_undegraded":"2024-03-28T12:42:15.361030+0000","last_fullsized":"2024-03-28T12:42:15.361030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:24.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.362422+0000","last_change":"2024-03-28T12:42:01.946191+0000","last_active":"2024-03-28T12:42:15.362422+0000","last_peered":"2024-03-28T12:42:15.362422+0000","last_clean":"2024-03-28T12:42:15.362422+0000","last_became_active":"2024-03-28T12:42:01.945804+0000","last_became_peered":"2024-03-28T12:42:01.945804+0000","last_unstale":"2024-03-28T12:42:15.362422+0000","last_undegraded":"2024-03-28T12:42:15.362422+0000","last_fullsized":"2024-03-28T12:42:15.362422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:40.221005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216237+0000","last_change":"2024-03-28T12:42:01.969416+0000","last_active":"2024-03-28T12:42:15.216237+0000","last_peered":"2024-03-28T12:42:15.216237+0000","last_clean":"2024-03-28T12:42:15.216237+0000","last_became_active":"2024-03-28T12:42:01.969078+0000","last_became_peered":"2024-03-28T12:42:01.969078+0000","last_unstale":"2024-03-28T12:42:15.216237+0000","last_undegraded":"2024-03-28T12:42:15.216237+0000","last_fullsized":"2024-03-28T12:42:15.216237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.231988+0000","last_change":"2024-03-28T12:42:01.958402+0000","last_active":"2024-03-28T12:42:15.231988+0000","last_peered":"2024-03-28T12:42:15.231988+0000","last_clean":"2024-03-28T12:42:15.231988+0000","last_became_active":"2024-03-28T12:42:01.958074+0000","last_became_peered":"2024-03-28T12:42:01.958074+0000","last_unstale":"2024-03-28T12:42:15.231988+0000","last_undegraded":"2024-03-28T12:42:15.231988+0000","last_fullsized":"2024-03-28T12:42:15.231988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:18:04.255456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227744+0000","last_change":"2024-03-28T12:42:01.811823+0000","last_active":"2024-03-28T12:42:15.227744+0000","last_peered":"2024-03-28T12:42:15.227744+0000","last_clean":"2024-03-28T12:42:15.227744+0000","last_became_active":"2024-03-28T12:42:01.811548+0000","last_became_peered":"2024-03-28T12:42:01.811548+0000","last_unstale":"2024-03-28T12:42:15.227744+0000","last_undegraded":"2024-03-28T12:42:15.227744+0000","last_fullsized":"2024-03-28T12:42:15.227744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:00:51.741925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227697+0000","last_change":"2024-03-28T12:42:01.959291+0000","last_active":"2024-03-28T12:42:15.227697+0000","last_peered":"2024-03-28T12:42:15.227697+0000","last_clean":"2024-03-28T12:42:15.227697+0000","last_became_active":"2024-03-28T12:42:01.958942+0000","last_became_peered":"2024-03-28T12:42:01.958942+0000","last_unstale":"2024-03-28T12:42:15.227697+0000","last_undegraded":"2024-03-28T12:42:15.227697+0000","last_fullsized":"2024-03-28T12:42:15.227697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:52:46.128830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352606+0000","last_change":"2024-03-28T12:42:01.965790+0000","last_active":"2024-03-28T12:42:15.352606+0000","last_peered":"2024-03-28T12:42:15.352606+0000","last_clean":"2024-03-28T12:42:15.352606+0000","last_became_active":"2024-03-28T12:42:01.965526+0000","last_became_peered":"2024-03-28T12:42:01.965526+0000","last_unstale":"2024-03-28T12:42:15.352606+0000","last_undegraded":"2024-03-28T12:42:15.352606+0000","last_fullsized":"2024-03-28T12:42:15.352606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216990+0000","last_change":"2024-03-28T12:42:01.960761+0000","last_active":"2024-03-28T12:42:15.216990+0000","last_peered":"2024-03-28T12:42:15.216990+0000","last_clean":"2024-03-28T12:42:15.216990+0000","last_became_active":"2024-03-28T12:42:01.960325+0000","last_became_peered":"2024-03-28T12:42:01.960325+0000","last_unstale":"2024-03-28T12:42:15.216990+0000","last_undegraded":"2024-03-28T12:42:15.216990+0000","last_fullsized":"2024-03-28T12:42:15.216990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:40.221005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359720+0000","last_change":"2024-03-28T12:42:01.960053+0000","last_active":"2024-03-28T12:42:15.359720+0000","last_peered":"2024-03-28T12:42:15.359720+0000","last_clean":"2024-03-28T12:42:15.359720+0000","last_became_active":"2024-03-28T12:42:01.959801+0000","last_became_peered":"2024-03-28T12:42:01.959801+0000","last_unstale":"2024-03-28T12:42:15.359720+0000","last_undegraded":"2024-03-28T12:42:15.359720+0000","last_fullsized":"2024-03-28T12:42:15.359720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:22.285591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229465+0000","last_change":"2024-03-28T12:42:01.788603+0000","last_active":"2024-03-28T12:42:15.229465+0000","last_peered":"2024-03-28T12:42:15.229465+0000","last_clean":"2024-03-28T12:42:15.229465+0000","last_became_active":"2024-03-28T12:42:01.788431+0000","last_became_peered":"2024-03-28T12:42:01.788431+0000","last_unstale":"2024-03-28T12:42:15.229465+0000","last_undegraded":"2024-03-28T12:42:15.229465+0000","last_fullsized":"2024-03-28T12:42:15.229465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:09:59.404128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.221976+0000","last_change":"2024-03-28T12:42:01.960518+0000","last_active":"2024-03-28T12:42:15.221976+0000","last_peered":"2024-03-28T12:42:15.221976+0000","last_clean":"2024-03-28T12:42:15.221976+0000","last_became_active":"2024-03-28T12:42:01.959832+0000","last_became_peered":"2024-03-28T12:42:01.959832+0000","last_unstale":"2024-03-28T12:42:15.221976+0000","last_undegraded":"2024-03-28T12:42:15.221976+0000","last_fullsized":"2024-03-28T12:42:15.221976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229874+0000","last_change":"2024-03-28T12:42:01.936477+0000","last_active":"2024-03-28T12:42:15.229874+0000","last_peered":"2024-03-28T12:42:15.229874+0000","last_clean":"2024-03-28T12:42:15.229874+0000","last_became_active":"2024-03-28T12:42:01.936175+0000","last_became_peered":"2024-03-28T12:42:01.936175+0000","last_unstale":"2024-03-28T12:42:15.229874+0000","last_undegraded":"2024-03-28T12:42:15.229874+0000","last_fullsized":"2024-03-28T12:42:15.229874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:14:14.822668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227742+0000","last_change":"2024-03-28T12:42:01.960054+0000","last_active":"2024-03-28T12:42:15.227742+0000","last_peered":"2024-03-28T12:42:15.227742+0000","last_clean":"2024-03-28T12:42:15.227742+0000","last_became_active":"2024-03-28T12:42:01.959791+0000","last_became_peered":"2024-03-28T12:42:01.959791+0000","last_unstale":"2024-03-28T12:42:15.227742+0000","last_undegraded":"2024-03-28T12:42:15.227742+0000","last_fullsized":"2024-03-28T12:42:15.227742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:06:44.099531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.233310+0000","last_change":"2024-03-28T12:42:15.233310+0000","last_active":"2024-03-28T12:42:15.233310+0000","last_peered":"2024-03-28T12:42:15.233310+0000","last_clean":"2024-03-28T12:42:15.233310+0000","last_became_active":"2024-03-28T12:42:15.232678+0000","last_became_peered":"2024-03-28T12:42:15.232678+0000","last_unstale":"2024-03-28T12:42:15.233310+0000","last_undegraded":"2024-03-28T12:42:15.233310+0000","last_fullsized":"2024-03-28T12:42:15.233310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:11:33.781054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360961+0000","last_change":"2024-03-28T12:42:01.948602+0000","last_active":"2024-03-28T12:42:15.360961+0000","last_peered":"2024-03-28T12:42:15.360961+0000","last_clean":"2024-03-28T12:42:15.360961+0000","last_became_active":"2024-03-28T12:42:01.947869+0000","last_became_peered":"2024-03-28T12:42:01.947869+0000","last_unstale":"2024-03-28T12:42:15.360961+0000","last_undegraded":"2024-03-28T12:42:15.360961+0000","last_fullsized":"2024-03-28T12:42:15.360961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.362751+0000","last_change":"2024-03-28T12:42:01.940521+0000","last_active":"2024-03-28T12:42:15.362751+0000","last_peered":"2024-03-28T12:42:15.362751+0000","last_clean":"2024-03-28T12:42:15.362751+0000","last_became_active":"2024-03-28T12:42:01.939756+0000","last_became_peered":"2024-03-28T12:42:01.939756+0000","last_unstale":"2024-03-28T12:42:15.362751+0000","last_undegraded":"2024-03-28T12:42:15.362751+0000","last_fullsized":"2024-03-28T12:42:15.362751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:53:37.869232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359674+0000","last_change":"2024-03-28T12:42:01.960377+0000","last_active":"2024-03-28T12:42:15.359674+0000","last_peered":"2024-03-28T12:42:15.359674+0000","last_clean":"2024-03-28T12:42:15.359674+0000","last_became_active":"2024-03-28T12:42:01.960012+0000","last_became_peered":"2024-03-28T12:42:01.960012+0000","last_unstale":"2024-03-28T12:42:15.359674+0000","last_undegraded":"2024-03-28T12:42:15.359674+0000","last_fullsized":"2024-03-28T12:42:15.359674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:19:20.801201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359855+0000","last_change":"2024-03-28T12:42:01.937280+0000","last_active":"2024-03-28T12:42:15.359855+0000","last_peered":"2024-03-28T12:42:15.359855+0000","last_clean":"2024-03-28T12:42:15.359855+0000","last_became_active":"2024-03-28T12:42:01.936999+0000","last_became_peered":"2024-03-28T12:42:01.936999+0000","last_unstale":"2024-03-28T12:42:15.359855+0000","last_undegraded":"2024-03-28T12:42:15.359855+0000","last_fullsized":"2024-03-28T12:42:15.359855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:35:01.960186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360045+0000","last_change":"2024-03-28T12:42:01.961991+0000","last_active":"2024-03-28T12:42:15.360045+0000","last_peered":"2024-03-28T12:42:15.360045+0000","last_clean":"2024-03-28T12:42:15.360045+0000","last_became_active":"2024-03-28T12:42:01.961694+0000","last_became_peered":"2024-03-28T12:42:01.961694+0000","last_unstale":"2024-03-28T12:42:15.360045+0000","last_undegraded":"2024-03-28T12:42:15.360045+0000","last_fullsized":"2024-03-28T12:42:15.360045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:12:20.857443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.353767+0000","last_change":"2024-03-28T12:42:01.966943+0000","last_active":"2024-03-28T12:42:15.353767+0000","last_peered":"2024-03-28T12:42:15.353767+0000","last_clean":"2024-03-28T12:42:15.353767+0000","last_became_active":"2024-03-28T12:42:01.966629+0000","last_became_peered":"2024-03-28T12:42:01.966629+0000","last_unstale":"2024-03-28T12:42:15.353767+0000","last_undegraded":"2024-03-28T12:42:15.353767+0000","last_fullsized":"2024-03-28T12:42:15.353767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.225924+0000","last_change":"2024-03-28T12:42:01.934727+0000","last_active":"2024-03-28T12:42:15.225924+0000","last_peered":"2024-03-28T12:42:15.225924+0000","last_clean":"2024-03-28T12:42:15.225924+0000","last_became_active":"2024-03-28T12:42:01.934130+0000","last_became_peered":"2024-03-28T12:42:01.934130+0000","last_unstale":"2024-03-28T12:42:15.225924+0000","last_undegraded":"2024-03-28T12:42:15.225924+0000","last_fullsized":"2024-03-28T12:42:15.225924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:20:32.024373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359366+0000","last_change":"2024-03-28T12:42:01.940164+0000","last_active":"2024-03-28T12:42:15.359366+0000","last_peered":"2024-03-28T12:42:15.359366+0000","last_clean":"2024-03-28T12:42:15.359366+0000","last_became_active":"2024-03-28T12:42:01.939962+0000","last_became_peered":"2024-03-28T12:42:01.939962+0000","last_unstale":"2024-03-28T12:42:15.359366+0000","last_undegraded":"2024-03-28T12:42:15.359366+0000","last_fullsized":"2024-03-28T12:42:15.359366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:31:15.643101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215233+0000","last_change":"2024-03-28T12:42:01.968043+0000","last_active":"2024-03-28T12:42:15.215233+0000","last_peered":"2024-03-28T12:42:15.215233+0000","last_clean":"2024-03-28T12:42:15.215233+0000","last_became_active":"2024-03-28T12:42:01.964888+0000","last_became_peered":"2024-03-28T12:42:01.964888+0000","last_unstale":"2024-03-28T12:42:15.215233+0000","last_undegraded":"2024-03-28T12:42:15.215233+0000","last_fullsized":"2024-03-28T12:42:15.215233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359830+0000","last_change":"2024-03-28T12:42:01.939665+0000","last_active":"2024-03-28T12:42:15.359830+0000","last_peered":"2024-03-28T12:42:15.359830+0000","last_clean":"2024-03-28T12:42:15.359830+0000","last_became_active":"2024-03-28T12:42:01.939448+0000","last_became_peered":"2024-03-28T12:42:01.939448+0000","last_unstale":"2024-03-28T12:42:15.359830+0000","last_undegraded":"2024-03-28T12:42:15.359830+0000","last_fullsized":"2024-03-28T12:42:15.359830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:39.483160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216062+0000","last_change":"2024-03-28T12:42:01.961147+0000","last_active":"2024-03-28T12:42:15.216062+0000","last_peered":"2024-03-28T12:42:15.216062+0000","last_clean":"2024-03-28T12:42:15.216062+0000","last_became_active":"2024-03-28T12:42:01.960511+0000","last_became_peered":"2024-03-28T12:42:01.960511+0000","last_unstale":"2024-03-28T12:42:15.216062+0000","last_undegraded":"2024-03-28T12:42:15.216062+0000","last_fullsized":"2024-03-28T12:42:15.216062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229345+0000","last_change":"2024-03-28T12:42:01.809029+0000","last_active":"2024-03-28T12:42:15.229345+0000","last_peered":"2024-03-28T12:42:15.229345+0000","last_clean":"2024-03-28T12:42:15.229345+0000","last_became_active":"2024-03-28T12:42:01.805168+0000","last_became_peered":"2024-03-28T12:42:01.805168+0000","last_unstale":"2024-03-28T12:42:15.229345+0000","last_undegraded":"2024-03-28T12:42:15.229345+0000","last_fullsized":"2024-03-28T12:42:15.229345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:00:10.281819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229628+0000","last_change":"2024-03-28T12:42:01.809169+0000","last_active":"2024-03-28T12:42:15.229628+0000","last_peered":"2024-03-28T12:42:15.229628+0000","last_clean":"2024-03-28T12:42:15.229628+0000","last_became_active":"2024-03-28T12:42:01.805382+0000","last_became_peered":"2024-03-28T12:42:01.805382+0000","last_unstale":"2024-03-28T12:42:15.229628+0000","last_undegraded":"2024-03-28T12:42:15.229628+0000","last_fullsized":"2024-03-28T12:42:15.229628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:26:32.791857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359741+0000","last_change":"2024-03-28T12:42:01.938613+0000","last_active":"2024-03-28T12:42:15.359741+0000","last_peered":"2024-03-28T12:42:15.359741+0000","last_clean":"2024-03-28T12:42:15.359741+0000","last_became_active":"2024-03-28T12:42:01.938408+0000","last_became_peered":"2024-03-28T12:42:01.938408+0000","last_unstale":"2024-03-28T12:42:15.359741+0000","last_undegraded":"2024-03-28T12:42:15.359741+0000","last_fullsized":"2024-03-28T12:42:15.359741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:36:57.708839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5402,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":11448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66494,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":127101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":127017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":131693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":130237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":716833,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509459,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":126541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542163,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":126977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":716855,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T12:42:42.970 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-28T12:42:42.970 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-28T12:42:42.970 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-28T12:42:42.970 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-28T12:42:42.971 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-28T12:42:43.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.150+0000 7ff952a00640 1 Processor -- start 2024-03-28T12:42:43.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.150+0000 7ff952a00640 1 -- start start 2024-03-28T12:42:43.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.154+0000 7ff952a00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff94c15e990 0x7ff94c0ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:43.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.154+0000 7ff952a00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff94c15aac0 con 0x7ff94c072440 2024-03-28T12:42:43.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.154+0000 7ff952a00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff94c15ada0 con 0x7ff94c072060 2024-03-28T12:42:43.151 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.154+0000 7ff952a00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7ff94c15b080 con 0x7ff94c15e990 2024-03-28T12:42:43.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.154+0000 7ff950a00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff94c15e990 0x7ff94c0ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:43.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.154+0000 7ff94be00640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7ff94c072060 0x7ff94c15e280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:49914/0 (socket says 172.21.15.76:49914) 2024-03-28T12:42:43.152 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.154+0000 7ff94be00640 1 -- 172.21.15.76:0/1498740699 learned_addr learned my addr 172.21.15.76:0/1498740699 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:43.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.158+0000 7ff950a00640 1 -- 172.21.15.76:0/1498740699 >> v1:172.21.15.111:6789/0 conn(0x7ff94c072060 legacy=0x7ff94c15e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:43.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.158+0000 7ff950a00640 1 -- 172.21.15.76:0/1498740699 >> v1:172.21.15.76:6789/0 conn(0x7ff94c072440 legacy=0x7ff94c154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:43.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.158+0000 7ff950a00640 1 -- 172.21.15.76:0/1498740699 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94c15b360 con 0x7ff94c15e990 2024-03-28T12:42:43.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.162+0000 7ff950a00640 1 --2- 172.21.15.76:0/1498740699 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff94c15e990 0x7ff94c0ca3d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff944009df0 tx=0x7ff94401f140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc7a03958b3127a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:43.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.170+0000 7ff94b400640 1 -- 172.21.15.76:0/1498740699 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9440b4070 con 0x7ff94c15e990 2024-03-28T12:42:43.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.170+0000 7ff94b400640 1 -- 172.21.15.76:0/1498740699 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9440af600 con 0x7ff94c15e990 2024-03-28T12:42:43.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.170+0000 7ff94b400640 1 -- 172.21.15.76:0/1498740699 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9440af9d0 con 0x7ff94c15e990 2024-03-28T12:42:43.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.170+0000 7ff952a00640 1 -- 172.21.15.76:0/1498740699 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff94c15e990 msgr2=0x7ff94c0ca3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:43.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.170+0000 7ff952a00640 1 --2- 172.21.15.76:0/1498740699 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff94c15e990 0x7ff94c0ca3d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff944009df0 tx=0x7ff94401f140 comp rx=0 tx=0).stop 2024-03-28T12:42:43.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.170+0000 7ff952a00640 1 -- 172.21.15.76:0/1498740699 shutdown_connections 2024-03-28T12:42:43.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.170+0000 7ff952a00640 1 --2- 172.21.15.76:0/1498740699 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff94c15e990 0x7ff94c0ca3d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:43.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.170+0000 7ff952a00640 1 -- 172.21.15.76:0/1498740699 >> 172.21.15.76:0/1498740699 conn(0x7ff94c071520 msgr2=0x7ff94c070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:43.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.170+0000 7ff952a00640 1 -- 172.21.15.76:0/1498740699 shutdown_connections 2024-03-28T12:42:43.170 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.170+0000 7ff952a00640 1 -- 172.21.15.76:0/1498740699 wait complete. 2024-03-28T12:42:43.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.174+0000 7ff952a00640 1 Processor -- start 2024-03-28T12:42:43.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.174+0000 7ff952a00640 1 -- start start 2024-03-28T12:42:43.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.174+0000 7ff952a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff94c072060 0x7ff94c150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:43.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.174+0000 7ff952a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff94c072440 0x7ff94c1f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:43.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.174+0000 7ff952a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff94c15e990 0x7ff94c067330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:43.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.174+0000 7ff952a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c0c8fa0 con 0x7ff94c072440 2024-03-28T12:42:43.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.174+0000 7ff952a00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c0c8e20 con 0x7ff94c072060 2024-03-28T12:42:43.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.174+0000 7ff952a00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff94c1f11a0 con 0x7ff94c15e990 2024-03-28T12:42:43.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.178+0000 7ff943e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff94c072440 0x7ff94c1f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:43.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.178+0000 7ff943e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff94c072440 0x7ff94c1f3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45304/0 (socket says 172.21.15.76:45304) 2024-03-28T12:42:43.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.178+0000 7ff943e00640 1 -- 172.21.15.76:0/2145548760 learned_addr learned my addr 172.21.15.76:0/2145548760 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:43.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.178+0000 7ff950a00640 1 --2- 172.21.15.76:0/2145548760 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff94c15e990 0x7ff94c067330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:43.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.178+0000 7ff94be00640 1 --2- 172.21.15.76:0/2145548760 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff94c072060 0x7ff94c150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:43.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.182+0000 7ff943e00640 1 -- 172.21.15.76:0/2145548760 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff94c15e990 msgr2=0x7ff94c067330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:43.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.182+0000 7ff943e00640 1 --2- 172.21.15.76:0/2145548760 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff94c15e990 0x7ff94c067330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:43.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.182+0000 7ff943e00640 1 -- 172.21.15.76:0/2145548760 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff94c072060 msgr2=0x7ff94c150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:43.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.182+0000 7ff943e00640 1 --2- 172.21.15.76:0/2145548760 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff94c072060 0x7ff94c150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:43.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.182+0000 7ff943e00640 1 -- 172.21.15.76:0/2145548760 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94c1f08e0 con 0x7ff94c072440 2024-03-28T12:42:43.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.182+0000 7ff943e00640 1 --2- 172.21.15.76:0/2145548760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff94c072440 0x7ff94c1f3d80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c420 tx=0x7ff93400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:43.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.186+0000 7ff948c00640 1 -- 172.21.15.76:0/2145548760 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9340052d0 con 0x7ff94c072440 2024-03-28T12:42:43.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.186+0000 7ff952a00640 1 -- 172.21.15.76:0/2145548760 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94c0c6700 con 0x7ff94c072440 2024-03-28T12:42:43.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.186+0000 7ff952a00640 1 -- 172.21.15.76:0/2145548760 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff94c1f0e30 con 0x7ff94c072440 2024-03-28T12:42:43.185 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.186+0000 7ff952a00640 1 -- 172.21.15.76:0/2145548760 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff94c0686e0 con 0x7ff94c072440 2024-03-28T12:42:43.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.190+0000 7ff948c00640 1 -- 172.21.15.76:0/2145548760 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff934005470 con 0x7ff94c072440 2024-03-28T12:42:43.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.190+0000 7ff948c00640 1 -- 172.21.15.76:0/2145548760 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff934020060 con 0x7ff94c072440 2024-03-28T12:42:43.502 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.506+0000 7ff948c00640 1 -- 172.21.15.76:0/2145548760 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff934007220 con 0x7ff94c072440 2024-03-28T12:42:43.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.506+0000 7ff948c00640 1 --2- 172.21.15.76:0/2145548760 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff928067fc0 0x7ff92806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:43.503 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.506+0000 7ff94be00640 1 --2- 172.21.15.76:0/2145548760 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff928067fc0 0x7ff92806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:43.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.506+0000 7ff94be00640 1 --2- 172.21.15.76:0/2145548760 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff928067fc0 0x7ff92806a480 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff93c005890 tx=0x7ff93c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:43.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.518+0000 7ff948c00640 1 -- 172.21.15.76:0/2145548760 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7ff9340543e0 con 0x7ff94c072440 2024-03-28T12:42:43.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.518+0000 7ff948c00640 1 -- 172.21.15.76:0/2145548760 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ff934056340 con 0x7ff94c072440 2024-03-28T12:42:43.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.758+0000 7ff952a00640 1 -- 172.21.15.76:0/2145548760 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff94c0c95e0 con 0x7ff94c072440 2024-03-28T12:42:43.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.926+0000 7ff948c00640 1 -- 172.21.15.76:0/2145548760 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+167683 (secure 0 0 0) 0x7ff93405a640 con 0x7ff94c072440 2024-03-28T12:42:43.926 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:43.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.930+0000 7ff952a00640 1 -- 172.21.15.76:0/2145548760 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff928067fc0 msgr2=0x7ff92806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:43.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.930+0000 7ff952a00640 1 --2- 172.21.15.76:0/2145548760 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff928067fc0 0x7ff92806a480 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff93c005890 tx=0x7ff93c009040 comp rx=0 tx=0).stop 2024-03-28T12:42:43.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.930+0000 7ff952a00640 1 -- 172.21.15.76:0/2145548760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff94c072440 msgr2=0x7ff94c1f3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:43.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.930+0000 7ff952a00640 1 --2- 172.21.15.76:0/2145548760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff94c072440 0x7ff94c1f3d80 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c420 tx=0x7ff93400c8e0 comp rx=0 tx=0).stop 2024-03-28T12:42:43.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.930+0000 7ff952a00640 1 -- 172.21.15.76:0/2145548760 shutdown_connections 2024-03-28T12:42:43.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.930+0000 7ff952a00640 1 --2- 172.21.15.76:0/2145548760 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff928067fc0 0x7ff92806a480 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:43.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.930+0000 7ff952a00640 1 --2- 172.21.15.76:0/2145548760 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff94c15e990 0x7ff94c067330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:43.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.930+0000 7ff952a00640 1 --2- 172.21.15.76:0/2145548760 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff94c072440 0x7ff94c1f3d80 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:43.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.930+0000 7ff952a00640 1 --2- 172.21.15.76:0/2145548760 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff94c072060 0x7ff94c150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:43.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.930+0000 7ff952a00640 1 -- 172.21.15.76:0/2145548760 >> 172.21.15.76:0/2145548760 conn(0x7ff94c071520 msgr2=0x7ff94c0c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:43.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.930+0000 7ff952a00640 1 -- 172.21.15.76:0/2145548760 shutdown_connections 2024-03-28T12:42:43.929 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:43.930+0000 7ff952a00640 1 -- 172.21.15.76:0/2145548760 wait complete. 2024-03-28T12:42:43.954 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6800","nonce":1313648511},{"type":"v1","addr":"172.21.15.76:6801","nonce":1313648511}]},"active_addr":"172.21.15.76:6801/1313648511","active_change":"2024-03-28T12:41:12.806262+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.76:0","nonce":3459311513}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.76:0","nonce":3343531421}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.76:0","nonce":2405559438}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.76:0","nonce":3865013697}]}]} 2024-03-28T12:42:43.958 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-28T12:42:43.958 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-28T12:42:43.959 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T12:42:44.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.102+0000 7fade5e00640 1 Processor -- start 2024-03-28T12:42:44.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.102+0000 7fade5e00640 1 -- start start 2024-03-28T12:42:44.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.102+0000 7fade5e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade01592a0 0x7fade00c3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:44.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.102+0000 7fade5e00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade015bf40 con 0x7fade0072440 2024-03-28T12:42:44.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.102+0000 7fade5e00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade015c220 con 0x7fade0072060 2024-03-28T12:42:44.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.102+0000 7fade5e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fade00c31e0 con 0x7fade01592a0 2024-03-28T12:42:44.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.102+0000 7faddf400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade01592a0 0x7fade00c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:44.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.102+0000 7fadd6000640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fade0072440 0x7fade01524b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:55678/0 (socket says 172.21.15.76:55678) 2024-03-28T12:42:44.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.102+0000 7fadd6000640 1 -- 172.21.15.76:0/1519521583 learned_addr learned my addr 172.21.15.76:0/1519521583 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:44.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.106+0000 7fadde000640 1 -- 172.21.15.76:0/1519521583 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1046029243 0 0) 0x7fade015bf40 con 0x7fade0072440 2024-03-28T12:42:44.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.106+0000 7fadde000640 1 -- 172.21.15.76:0/1519521583 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadc4003530 con 0x7fade0072440 2024-03-28T12:42:44.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.110+0000 7faddf400640 1 -- 172.21.15.76:0/1519521583 >> v1:172.21.15.111:6789/0 conn(0x7fade0072060 legacy=0x7fade00cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:44.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.110+0000 7faddf400640 1 -- 172.21.15.76:0/1519521583 >> v1:172.21.15.76:6789/0 conn(0x7fade0072440 legacy=0x7fade01524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:44.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.110+0000 7faddf400640 1 -- 172.21.15.76:0/1519521583 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade015c500 con 0x7fade01592a0 2024-03-28T12:42:44.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.114+0000 7faddf400640 1 --2- 172.21.15.76:0/1519521583 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade01592a0 0x7fade00c3670 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009dc0 tx=0x7fadd801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=440d39adf05802b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:44.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fadde000640 1 -- 172.21.15.76:0/1519521583 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd80b2070 con 0x7fade01592a0 2024-03-28T12:42:44.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fadde000640 1 -- 172.21.15.76:0/1519521583 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadd80a58e0 con 0x7fade01592a0 2024-03-28T12:42:44.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fadde000640 1 -- 172.21.15.76:0/1519521583 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd80a5cb0 con 0x7fade01592a0 2024-03-28T12:42:44.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fade5e00640 1 -- 172.21.15.76:0/1519521583 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade01592a0 msgr2=0x7fade00c3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:44.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fade5e00640 1 --2- 172.21.15.76:0/1519521583 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade01592a0 0x7fade00c3670 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009dc0 tx=0x7fadd801c950 comp rx=0 tx=0).stop 2024-03-28T12:42:44.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fade5e00640 1 -- 172.21.15.76:0/1519521583 shutdown_connections 2024-03-28T12:42:44.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fade5e00640 1 --2- 172.21.15.76:0/1519521583 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade01592a0 0x7fade00c3670 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:44.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fade5e00640 1 -- 172.21.15.76:0/1519521583 >> 172.21.15.76:0/1519521583 conn(0x7fade0071520 msgr2=0x7fade0070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:44.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fade5e00640 1 -- 172.21.15.76:0/1519521583 shutdown_connections 2024-03-28T12:42:44.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fade5e00640 1 -- 172.21.15.76:0/1519521583 wait complete. 2024-03-28T12:42:44.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fade5e00640 1 Processor -- start 2024-03-28T12:42:44.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fade5e00640 1 -- start start 2024-03-28T12:42:44.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fade5e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fade0072060 0x7fade015ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:44.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fade5e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade0072440 0x7fade0147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:44.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fade5e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fade01592a0 0x7fade00ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:44.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fade5e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fade0152d40 con 0x7fade0072060 2024-03-28T12:42:44.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fade5e00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fade0152bc0 con 0x7fade01592a0 2024-03-28T12:42:44.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.122+0000 7fade5e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fade01666f0 con 0x7fade0072440 2024-03-28T12:42:44.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.126+0000 7fadd6000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade0072440 0x7fade0147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:44.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.126+0000 7fadd6000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade0072440 0x7fade0147120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:36126/0 (socket says 172.21.15.76:36126) 2024-03-28T12:42:44.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.126+0000 7fadd6000640 1 -- 172.21.15.76:0/2930830892 learned_addr learned my addr 172.21.15.76:0/2930830892 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:44.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.130+0000 7faddf400640 1 --2- 172.21.15.76:0/2930830892 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fade01592a0 0x7fade00ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:44.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.130+0000 7fadd6000640 1 -- 172.21.15.76:0/2930830892 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fade01592a0 msgr2=0x7fade00ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:44.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.130+0000 7fadd6000640 1 --2- 172.21.15.76:0/2930830892 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fade01592a0 0x7fade00ae130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:44.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.130+0000 7fadd6000640 1 -- 172.21.15.76:0/2930830892 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fade0072060 msgr2=0x7fade015ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:44.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.130+0000 7fadd6000640 1 --2- 172.21.15.76:0/2930830892 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fade0072060 0x7fade015ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:44.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.130+0000 7fadd6000640 1 -- 172.21.15.76:0/2930830892 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade00adc80 con 0x7fade0072440 2024-03-28T12:42:44.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.130+0000 7fadd6000640 1 --2- 172.21.15.76:0/2930830892 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade0072440 0x7fade0147120 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fadc800c3c0 tx=0x7fadc800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:44.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.138+0000 7fadd7e00640 1 -- 172.21.15.76:0/2930830892 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8017070 con 0x7fade0072440 2024-03-28T12:42:44.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.138+0000 7fadd7e00640 1 -- 172.21.15.76:0/2930830892 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc8005d10 con 0x7fade0072440 2024-03-28T12:42:44.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.138+0000 7fade5e00640 1 -- 172.21.15.76:0/2930830892 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade00af490 con 0x7fade0072440 2024-03-28T12:42:44.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.138+0000 7fadd7e00640 1 -- 172.21.15.76:0/2930830892 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc8007310 con 0x7fade0072440 2024-03-28T12:42:44.136 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.138+0000 7fade5e00640 1 -- 172.21.15.76:0/2930830892 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fade0147fe0 con 0x7fade0072440 2024-03-28T12:42:44.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.138+0000 7fade5e00640 1 -- 172.21.15.76:0/2930830892 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade00686e0 con 0x7fade0072440 2024-03-28T12:42:44.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.166+0000 7fadd7e00640 1 -- 172.21.15.76:0/2930830892 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fadc801a070 con 0x7fade0072440 2024-03-28T12:42:44.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.170+0000 7fadd7e00640 1 --2- 172.21.15.76:0/2930830892 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fadbc068010 0x7fadbc06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:44.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.170+0000 7faddea00640 1 --2- 172.21.15.76:0/2930830892 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fadbc068010 0x7fadbc06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:44.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.170+0000 7faddea00640 1 --2- 172.21.15.76:0/2930830892 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fadbc068010 0x7fadbc06a4d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009650 tx=0x7fadd0006bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:44.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.426+0000 7fadd7e00640 1 -- 172.21.15.76:0/2930830892 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fadc8053f60 con 0x7fade0072440 2024-03-28T12:42:44.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.446+0000 7fadd7e00640 1 -- 172.21.15.76:0/2930830892 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fadc8021020 con 0x7fade0072440 2024-03-28T12:42:44.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.606+0000 7fade5e00640 1 -- 172.21.15.76:0/2930830892 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fade00c9270 con 0x7fade0072440 2024-03-28T12:42:44.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.834+0000 7fadd7e00640 1 -- 172.21.15.76:0/2930830892 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18798 (secure 0 0 0) 0x7fadc80565c0 con 0x7fade0072440 2024-03-28T12:42:44.835 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:44.835 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":29,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:42:15.156639+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T12:41:58.010965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T12:41:59.698601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-28T12:42:05.363180+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.1","mappings":[{"from":3,"to":4}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]},{"pgid":"4.d","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":5}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:42:44.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.838+0000 7fade5e00640 1 -- 172.21.15.76:0/2930830892 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fadbc068010 msgr2=0x7fadbc06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:44.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.838+0000 7fade5e00640 1 --2- 172.21.15.76:0/2930830892 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fadbc068010 0x7fadbc06a4d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009650 tx=0x7fadd0006bb0 comp rx=0 tx=0).stop 2024-03-28T12:42:44.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.838+0000 7fade5e00640 1 -- 172.21.15.76:0/2930830892 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade0072440 msgr2=0x7fade0147120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:44.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.838+0000 7fade5e00640 1 --2- 172.21.15.76:0/2930830892 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade0072440 0x7fade0147120 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fadc800c3c0 tx=0x7fadc800c880 comp rx=0 tx=0).stop 2024-03-28T12:42:44.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.838+0000 7fade5e00640 1 -- 172.21.15.76:0/2930830892 shutdown_connections 2024-03-28T12:42:44.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.838+0000 7fade5e00640 1 --2- 172.21.15.76:0/2930830892 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fadbc068010 0x7fadbc06a4d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:44.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.838+0000 7fade5e00640 1 --2- 172.21.15.76:0/2930830892 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fade01592a0 0x7fade00ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:44.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.838+0000 7fade5e00640 1 --2- 172.21.15.76:0/2930830892 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade0072440 0x7fade0147120 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:44.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.838+0000 7fade5e00640 1 --2- 172.21.15.76:0/2930830892 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fade0072060 0x7fade015ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:44.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.838+0000 7fade5e00640 1 -- 172.21.15.76:0/2930830892 >> 172.21.15.76:0/2930830892 conn(0x7fade0071520 msgr2=0x7fade01585d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:44.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.838+0000 7fade5e00640 1 -- 172.21.15.76:0/2930830892 shutdown_connections 2024-03-28T12:42:44.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:44.838+0000 7fade5e00640 1 -- 172.21.15.76:0/2930830892 wait complete. 2024-03-28T12:42:44.862 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-28T12:42:44.862 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T12:42:45.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.038+0000 7f589ae00640 1 Processor -- start 2024-03-28T12:42:45.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.038+0000 7f589ae00640 1 -- start start 2024-03-28T12:42:45.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.042+0000 7f589ae00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f5894154940 0x7f589406fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:45.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.042+0000 7f589ae00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f589406efe0 0x7f589415a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:45.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.042+0000 7f589ae00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5894154d20 con 0x7f589406eb90 2024-03-28T12:42:45.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.042+0000 7f589ae00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f5894070610 con 0x7f5894154940 2024-03-28T12:42:45.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.042+0000 7f589ae00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f58940c4140 con 0x7f589406efe0 2024-03-28T12:42:45.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.042+0000 7f589a400640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f589406efe0 0x7f589415a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:45.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.042+0000 7f5899000640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f589406eb90 0x7f58940c9a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:49940/0 (socket says 172.21.15.76:49940) 2024-03-28T12:42:45.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.042+0000 7f5899000640 1 -- 172.21.15.76:0/2708495448 learned_addr learned my addr 172.21.15.76:0/2708495448 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:45.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.046+0000 7f5899a00640 1 --2- 172.21.15.76:0/2708495448 >> v2:172.21.15.76:3300/0 conn(0x7f5894154940 0x7f589406fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:45.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.046+0000 7f5893e00640 1 -- 172.21.15.76:0/2708495448 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 575412724 0 0) 0x7f5894154d20 con 0x7f589406eb90 2024-03-28T12:42:45.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.046+0000 7f5893e00640 1 -- 172.21.15.76:0/2708495448 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f587c003530 con 0x7f589406eb90 2024-03-28T12:42:45.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.050+0000 7f5899a00640 1 -- 172.21.15.76:0/2708495448 >> v2:172.21.15.111:3300/0 conn(0x7f589406efe0 msgr2=0x7f589415a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:45.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.050+0000 7f5899a00640 1 --2- 172.21.15.76:0/2708495448 >> v2:172.21.15.111:3300/0 conn(0x7f589406efe0 0x7f589415a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:45.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.050+0000 7f5899a00640 1 -- 172.21.15.76:0/2708495448 >> v1:172.21.15.111:6789/0 conn(0x7f589406eb90 legacy=0x7f58940c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:45.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.050+0000 7f5899a00640 1 -- 172.21.15.76:0/2708495448 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5894070380 con 0x7f5894154940 2024-03-28T12:42:45.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.054+0000 7f5899a00640 1 --2- 172.21.15.76:0/2708495448 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5894154940 0x7f589406fe40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f589406fbe0 tx=0x7f588801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8b929f20621cb8 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:45.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.054+0000 7f5893e00640 1 -- 172.21.15.76:0/2708495448 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58880b0070 con 0x7f5894154940 2024-03-28T12:42:45.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.054+0000 7f5893e00640 1 -- 172.21.15.76:0/2708495448 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58880ab600 con 0x7f5894154940 2024-03-28T12:42:45.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.054+0000 7f5893e00640 1 -- 172.21.15.76:0/2708495448 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58880ab9d0 con 0x7f5894154940 2024-03-28T12:42:45.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.058+0000 7f589ae00640 1 -- 172.21.15.76:0/2708495448 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5894154940 msgr2=0x7f589406fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:45.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.058+0000 7f589ae00640 1 --2- 172.21.15.76:0/2708495448 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5894154940 0x7f589406fe40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f589406fbe0 tx=0x7f588801c3f0 comp rx=0 tx=0).stop 2024-03-28T12:42:45.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.058+0000 7f589ae00640 1 -- 172.21.15.76:0/2708495448 shutdown_connections 2024-03-28T12:42:45.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.058+0000 7f589ae00640 1 --2- 172.21.15.76:0/2708495448 >> v2:172.21.15.111:3300/0 conn(0x7f589406efe0 0x7f589415a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:45.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.058+0000 7f589ae00640 1 --2- 172.21.15.76:0/2708495448 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5894154940 0x7f589406fe40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:45.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.058+0000 7f589ae00640 1 -- 172.21.15.76:0/2708495448 >> 172.21.15.76:0/2708495448 conn(0x7f5894070c10 msgr2=0x7f5894071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:45.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.058+0000 7f589ae00640 1 -- 172.21.15.76:0/2708495448 shutdown_connections 2024-03-28T12:42:45.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.058+0000 7f589ae00640 1 -- 172.21.15.76:0/2708495448 wait complete. 2024-03-28T12:42:45.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.058+0000 7f589ae00640 1 Processor -- start 2024-03-28T12:42:45.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.058+0000 7f589ae00640 1 -- start start 2024-03-28T12:42:45.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.058+0000 7f589ae00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f589406eb90 0x7f58940c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:45.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.058+0000 7f589ae00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f589406efe0 0x7f58940cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:45.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.058+0000 7f589ae00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5894154940 0x7f58940c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:45.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.058+0000 7f589ae00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f589415b180 con 0x7f589406efe0 2024-03-28T12:42:45.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.058+0000 7f589ae00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f58940c3dd0 con 0x7f589406eb90 2024-03-28T12:42:45.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.058+0000 7f589ae00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f58940ca160 con 0x7f5894154940 2024-03-28T12:42:45.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.062+0000 7f5899000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f589406efe0 0x7f58940cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:45.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.062+0000 7f5899000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f589406efe0 0x7f58940cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45328/0 (socket says 172.21.15.76:45328) 2024-03-28T12:42:45.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.062+0000 7f5899000640 1 -- 172.21.15.76:0/2969980411 learned_addr learned my addr 172.21.15.76:0/2969980411 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:45.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.062+0000 7f5899a00640 1 --2- 172.21.15.76:0/2969980411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f589406eb90 0x7f58940c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:45.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.062+0000 7f589a400640 1 --2- 172.21.15.76:0/2969980411 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5894154940 0x7f58940c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:45.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.066+0000 7f5899000640 1 -- 172.21.15.76:0/2969980411 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5894154940 msgr2=0x7f58940c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:45.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.066+0000 7f5899000640 1 --2- 172.21.15.76:0/2969980411 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5894154940 0x7f58940c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:45.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.066+0000 7f5899000640 1 -- 172.21.15.76:0/2969980411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f589406eb90 msgr2=0x7f58940c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:45.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.066+0000 7f5899000640 1 --2- 172.21.15.76:0/2969980411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f589406eb90 0x7f58940c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:45.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.066+0000 7f5899000640 1 -- 172.21.15.76:0/2969980411 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589414fbe0 con 0x7f589406efe0 2024-03-28T12:42:45.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.066+0000 7f5899000640 1 --2- 172.21.15.76:0/2969980411 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f589406efe0 0x7f58940cc090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f588000c480 tx=0x7f588000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:45.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.070+0000 7f5891600640 1 -- 172.21.15.76:0/2969980411 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880017070 con 0x7f589406efe0 2024-03-28T12:42:45.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.070+0000 7f5891600640 1 -- 172.21.15.76:0/2969980411 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5880005cf0 con 0x7f589406efe0 2024-03-28T12:42:45.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.070+0000 7f589ae00640 1 -- 172.21.15.76:0/2969980411 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f589414fea0 con 0x7f589406efe0 2024-03-28T12:42:45.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.070+0000 7f5891600640 1 -- 172.21.15.76:0/2969980411 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880007290 con 0x7f589406efe0 2024-03-28T12:42:45.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.070+0000 7f589ae00640 1 -- 172.21.15.76:0/2969980411 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5894151680 con 0x7f589406efe0 2024-03-28T12:42:45.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.074+0000 7f589ae00640 1 -- 172.21.15.76:0/2969980411 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5894068df0 con 0x7f589406efe0 2024-03-28T12:42:45.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.094+0000 7f5891600640 1 -- 172.21.15.76:0/2969980411 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f588001a070 con 0x7f589406efe0 2024-03-28T12:42:45.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.094+0000 7f5891600640 1 --2- 172.21.15.76:0/2969980411 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5874068010 0x7f587406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:45.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.094+0000 7f5899a00640 1 --2- 172.21.15.76:0/2969980411 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5874068010 0x7f587406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:45.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.094+0000 7f5899a00640 1 --2- 172.21.15.76:0/2969980411 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5874068010 0x7f587406a4d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f58880ad000 tx=0x7f5888008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:45.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.366+0000 7f5891600640 1 -- 172.21.15.76:0/2969980411 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f5880053f00 con 0x7f589406efe0 2024-03-28T12:42:45.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.366+0000 7f5891600640 1 -- 172.21.15.76:0/2969980411 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f5880021020 con 0x7f589406efe0 2024-03-28T12:42:45.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.554+0000 7f589ae00640 1 -- 172.21.15.76:0/2969980411 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f589406f6f0 con 0x7f589406efe0 2024-03-28T12:42:45.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.594+0000 7f5891600640 1 -- 172.21.15.76:0/2969980411 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18798 (secure 0 0 0) 0x7f5880055e60 con 0x7f589406efe0 2024-03-28T12:42:45.592 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:45.592 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":29,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:42:15.156639+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T12:41:58.010965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T12:41:59.698601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-28T12:42:05.363180+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.1","mappings":[{"from":3,"to":4}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]},{"pgid":"4.d","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":5}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:42:45.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.598+0000 7f589ae00640 1 -- 172.21.15.76:0/2969980411 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5874068010 msgr2=0x7f587406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:45.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.598+0000 7f589ae00640 1 --2- 172.21.15.76:0/2969980411 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5874068010 0x7f587406a4d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f58880ad000 tx=0x7f5888008040 comp rx=0 tx=0).stop 2024-03-28T12:42:45.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.598+0000 7f589ae00640 1 -- 172.21.15.76:0/2969980411 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f589406efe0 msgr2=0x7f58940cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:45.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.598+0000 7f589ae00640 1 --2- 172.21.15.76:0/2969980411 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f589406efe0 0x7f58940cc090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f588000c480 tx=0x7f588000c940 comp rx=0 tx=0).stop 2024-03-28T12:42:45.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.598+0000 7f589ae00640 1 -- 172.21.15.76:0/2969980411 shutdown_connections 2024-03-28T12:42:45.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.598+0000 7f589ae00640 1 --2- 172.21.15.76:0/2969980411 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5874068010 0x7f587406a4d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:45.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.598+0000 7f589ae00640 1 --2- 172.21.15.76:0/2969980411 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5894154940 0x7f58940c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:45.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.598+0000 7f589ae00640 1 --2- 172.21.15.76:0/2969980411 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f589406efe0 0x7f58940cc090 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:45.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.598+0000 7f589ae00640 1 --2- 172.21.15.76:0/2969980411 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f589406eb90 0x7f58940c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:45.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.598+0000 7f589ae00640 1 -- 172.21.15.76:0/2969980411 >> 172.21.15.76:0/2969980411 conn(0x7f5894070c10 msgr2=0x7f589414efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:45.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.598+0000 7f589ae00640 1 -- 172.21.15.76:0/2969980411 shutdown_connections 2024-03-28T12:42:45.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.598+0000 7f589ae00640 1 -- 172.21.15.76:0/2969980411 wait complete. 2024-03-28T12:42:45.624 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-28T12:42:45.625 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-28T12:42:45.625 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-28T12:42:45.626 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-28T12:42:45.626 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-28T12:42:45.627 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-28T12:42:45.627 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-28T12:42:45.628 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-28T12:42:45.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.906+0000 7f7fb6a00640 1 Processor -- start 2024-03-28T12:42:45.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.906+0000 7f7c8f200640 1 Processor -- start 2024-03-28T12:42:45.904 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.906+0000 7f7fb6a00640 1 -- start start 2024-03-28T12:42:45.904 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.906+0000 7f7c8f200640 1 -- start start 2024-03-28T12:42:45.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.906+0000 7f7c8f200640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7c800e7220 0x7f7c800462d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:45.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.906+0000 7f7c8f200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f7c80046810 0x7f7c8004baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:45.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.906+0000 7f7c8f200640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c8004c6c0 con 0x7f7c800dd2f0 2024-03-28T12:42:45.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.906+0000 7f7c8f200640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f7c80045510 con 0x7f7c80046810 2024-03-28T12:42:45.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.906+0000 7f7c8f200640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f7c800457f0 con 0x7f7c800e7220 2024-03-28T12:42:45.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.906+0000 7f7fb5600640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f7fb0151520 0x7f7fb015a780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:49956/0 (socket says 172.21.15.76:49956) 2024-03-28T12:42:45.909 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.906+0000 7f7fb5600640 1 -- 172.21.15.76:0/2673305554 learned_addr learned my addr 172.21.15.76:0/2673305554 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:45.912 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.914+0000 7f7c8d200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f7c80046810 0x7f7c8004baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:45.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.914+0000 7f7fb6a00640 1 --2- 172.21.15.76:0/2673305554 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7fb006f050 0x7f7fb00c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:45.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.918+0000 7f7fb6a00640 1 --2- 172.21.15.76:0/2673305554 >> v2:172.21.15.111:3300/0 conn(0x7f7fb00c5f40 0x7f7fb006f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:45.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.918+0000 7f7fb6a00640 1 -- 172.21.15.76:0/2673305554 --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb00c7be0 con 0x7f7fb0151520 2024-03-28T12:42:45.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.918+0000 7f7fb6a00640 1 -- 172.21.15.76:0/2673305554 --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f7fb00c63f0 con 0x7f7fb00c5f40 2024-03-28T12:42:45.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.918+0000 7f7fb6a00640 1 -- 172.21.15.76:0/2673305554 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb015ae90 con 0x7f7fb006f050 2024-03-28T12:42:45.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.918+0000 7f7c87400640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7c800e7220 0x7f7c800462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:45.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.922+0000 7f7c8d200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f7c80046810 0x7f7c8004baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45342/0 (socket says 172.21.15.76:45342) 2024-03-28T12:42:45.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.922+0000 7f7c8d200640 1 -- 172.21.15.76:0/1400366718 learned_addr learned my addr 172.21.15.76:0/1400366718 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:45.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.922+0000 7f7fb6000640 1 --2- 172.21.15.76:0/2673305554 >> v2:172.21.15.111:3300/0 conn(0x7f7fb00c5f40 0x7f7fb006f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:45.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.934+0000 7f7fb4c00640 1 --2- 172.21.15.76:0/2673305554 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7fb006f050 0x7f7fb00c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:45.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.938+0000 7f7c8d200640 1 -- 172.21.15.76:0/1400366718 >> v2:172.21.15.111:3300/0 conn(0x7f7c800e7220 msgr2=0x7f7c800462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:45.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.938+0000 7f7c8d200640 1 --2- 172.21.15.76:0/1400366718 >> v2:172.21.15.111:3300/0 conn(0x7f7c800e7220 0x7f7c800462d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:45.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.938+0000 7f7c8d200640 1 -- 172.21.15.76:0/1400366718 >> v1:172.21.15.111:6789/0 conn(0x7f7c800dd2f0 legacy=0x7f7c800e6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:45.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.938+0000 7f7c8d200640 1 -- 172.21.15.76:0/1400366718 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c80045ad0 con 0x7f7c80046810 2024-03-28T12:42:45.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.938+0000 7f7fb6000640 1 -- 172.21.15.76:0/2673305554 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7fb006f050 msgr2=0x7f7fb00c2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:45.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.938+0000 7f7fb6000640 1 --2- 172.21.15.76:0/2673305554 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7fb006f050 0x7f7fb00c2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:45.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.938+0000 7f7fb6000640 1 -- 172.21.15.76:0/2673305554 >> v1:172.21.15.111:6789/0 conn(0x7f7fb0151520 legacy=0x7f7fb015a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:45.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.938+0000 7f7fb6000640 1 -- 172.21.15.76:0/2673305554 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb00c0f40 con 0x7f7fb00c5f40 2024-03-28T12:42:45.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.946+0000 7feb90c00640 1 Processor -- start 2024-03-28T12:42:45.943 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.946+0000 7feb90c00640 1 -- start start 2024-03-28T12:42:45.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.946+0000 7feb90c00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7feb840d5000 0x7feb8404c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:45.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.946+0000 7feb90c00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7feb840db440 0x7feb840e5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:45.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.946+0000 7feb90c00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb8404c820 con 0x7feb840347a0 2024-03-28T12:42:45.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.946+0000 7feb90c00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7feb8404b990 con 0x7feb840d5000 2024-03-28T12:42:45.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.946+0000 7feb90c00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7feb8404bc70 con 0x7feb840db440 2024-03-28T12:42:45.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.950+0000 7feb8b400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7feb840d5000 0x7feb8404c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:45.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.954+0000 7feb8b400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7feb840d5000 0x7feb8404c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45356/0 (socket says 172.21.15.76:45356) 2024-03-28T12:42:45.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.954+0000 7feb8b400640 1 -- 172.21.15.76:0/3703327429 learned_addr learned my addr 172.21.15.76:0/3703327429 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:45.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.954+0000 7f7fb6000640 1 --2- 172.21.15.76:0/2673305554 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fb00c5f40 0x7f7fb006f870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00097c0 tx=0x7f7fa001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=491234d5f04e1969 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:45.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.958+0000 7f7c8d200640 1 --2- 172.21.15.76:0/1400366718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c80046810 0x7f7c8004baa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000dba0 tx=0x7f7c7401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2920ae4e9ca53bad server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:45.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.970+0000 7feb8b400640 1 -- 172.21.15.76:0/3703327429 >> v2:172.21.15.111:3300/0 conn(0x7feb840db440 msgr2=0x7feb840e5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:45.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.970+0000 7feb8b400640 1 --2- 172.21.15.76:0/3703327429 >> v2:172.21.15.111:3300/0 conn(0x7feb840db440 0x7feb840e5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:45.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.970+0000 7feb8b400640 1 -- 172.21.15.76:0/3703327429 >> v1:172.21.15.76:6789/0 conn(0x7feb840347a0 legacy=0x7feb840dad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:45.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.970+0000 7feb8b400640 1 -- 172.21.15.76:0/3703327429 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb84006a50 con 0x7feb840d5000 2024-03-28T12:42:45.982 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.982+0000 7f77a1c00640 1 Processor -- start 2024-03-28T12:42:45.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.982+0000 7f77a1c00640 1 -- start start 2024-03-28T12:42:45.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.986+0000 7f77a1c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c0c7090 0x7f779c073390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:45.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.986+0000 7f77a1c00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f779c0c2620 con 0x7f779c1508d0 2024-03-28T12:42:45.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.986+0000 7f77a1c00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f779c0c2900 con 0x7f779c0c6880 2024-03-28T12:42:45.984 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.986+0000 7f77a1c00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f779c0c6d30 con 0x7f779c0c7090 2024-03-28T12:42:45.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.990+0000 7f00f6600640 1 Processor -- start 2024-03-28T12:42:45.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.990+0000 7f00f6600640 1 -- start start 2024-03-28T12:42:45.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.990+0000 7f00f6600640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f00f00cad20 0x7f00f00cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:45.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.990+0000 7f00f6600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f00f00cc8a0 0x7f00f00ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:45.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.990+0000 7f00f6600640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00f00cd270 con 0x7f00f00c7650 2024-03-28T12:42:45.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.990+0000 7f00f6600640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f00f015aaf0 con 0x7f00f00cad20 2024-03-28T12:42:45.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:45.990+0000 7f00f6600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f00f015add0 con 0x7f00f00cc8a0 2024-03-28T12:42:46.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.010+0000 7feb8b400640 1 --2- 172.21.15.76:0/3703327429 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb840d5000 0x7feb8404c2e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feb8c02d910 tx=0x7feb8c09bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba9a3f0edf073f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.018+0000 7f779a000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c0c7090 0x7f779c073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.018+0000 7f00efe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f00f00cc8a0 0x7f00f00ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.018+0000 7f779a000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c0c7090 0x7f779c073390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:36154/0 (socket says 172.21.15.76:36154) 2024-03-28T12:42:46.018 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.018+0000 7f779a000640 1 -- 172.21.15.76:0/760873219 learned_addr learned my addr 172.21.15.76:0/760873219 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:46.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.022+0000 7f00efe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f00f00cc8a0 0x7f00f00ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:36160/0 (socket says 172.21.15.76:36160) 2024-03-28T12:42:46.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.022+0000 7f00efe00640 1 -- 172.21.15.76:0/4115238949 learned_addr learned my addr 172.21.15.76:0/4115238949 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:46.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.026+0000 7f779a000640 1 -- 172.21.15.76:0/760873219 >> v1:172.21.15.111:6789/0 conn(0x7f779c0c6880 legacy=0x7f779c156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:46.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.026+0000 7f779a000640 1 -- 172.21.15.76:0/760873219 >> v1:172.21.15.76:6789/0 conn(0x7f779c1508d0 legacy=0x7f779c06e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:46.023 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.026+0000 7f779a000640 1 -- 172.21.15.76:0/760873219 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779c0c2be0 con 0x7f779c0c7090 2024-03-28T12:42:46.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.026+0000 7f00efe00640 1 -- 172.21.15.76:0/4115238949 >> v2:172.21.15.76:3300/0 conn(0x7f00f00cad20 msgr2=0x7f00f00cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:46.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.026+0000 7f00efe00640 1 --2- 172.21.15.76:0/4115238949 >> v2:172.21.15.76:3300/0 conn(0x7f00f00cad20 0x7f00f00cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.026+0000 7f00efe00640 1 -- 172.21.15.76:0/4115238949 >> v1:172.21.15.76:6789/0 conn(0x7f00f00c7650 legacy=0x7f00f00cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:46.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.026+0000 7f00efe00640 1 -- 172.21.15.76:0/4115238949 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f015b0b0 con 0x7f00f00cc8a0 2024-03-28T12:42:46.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.030+0000 7f8104600640 1 Processor -- start 2024-03-28T12:42:46.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.030+0000 7f8104600640 1 -- start start 2024-03-28T12:42:46.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.030+0000 7f8104600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80fc162230 0x7f80fc15f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.030+0000 7f8847200640 1 Processor -- start 2024-03-28T12:42:46.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.030+0000 7f8847200640 1 -- start start 2024-03-28T12:42:46.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.030+0000 7f8847200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f88480cb3a0 0x7f884815f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.030+0000 7f8847200640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88480ca960 con 0x7f884806cdc0 2024-03-28T12:42:46.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.030+0000 7f8847200640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88480cabe0 con 0x7f8848158ce0 2024-03-28T12:42:46.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.030+0000 7f8847200640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f884815fa90 con 0x7f88480cb3a0 2024-03-28T12:42:46.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.030+0000 7f8104600640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f80fc0c3640 0x7f80fc0cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.030+0000 7f8104600640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80fc0c3a90 con 0x7f80fc158fd0 2024-03-28T12:42:46.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.030+0000 7f8988200640 1 Processor -- start 2024-03-28T12:42:46.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.030+0000 7f8104600640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f80fc1593b0 con 0x7f80fc0c3640 2024-03-28T12:42:46.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.030+0000 7f8104600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f80fc0c3d10 con 0x7f80fc162230 2024-03-28T12:42:46.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.030+0000 7f8988200640 1 -- start start 2024-03-28T12:42:46.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.034+0000 7f00efe00640 1 --2- 172.21.15.76:0/4115238949 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f00f00cc8a0 0x7f00f00ccd30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009870 tx=0x7f00dc01c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4840218533b21027 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.034+0000 7f8101c00640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f80fc158fd0 0x7f80fc0af9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:49974/0 (socket says 172.21.15.76:49974) 2024-03-28T12:42:46.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.034+0000 7f8101c00640 1 -- 172.21.15.76:0/1557126649 learned_addr learned my addr 172.21.15.76:0/1557126649 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:46.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.034+0000 7f8988200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89801569a0 0x7f89800c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.034+0000 7f8988200640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89800b21d0 con 0x7f89800c1140 2024-03-28T12:42:46.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.034+0000 7f8988200640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89800c2c40 con 0x7f89800b1df0 2024-03-28T12:42:46.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.034+0000 7f8988200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f89800c7080 con 0x7f89801569a0 2024-03-28T12:42:46.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.034+0000 7f779a000640 1 --2- 172.21.15.76:0/760873219 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c0c7090 0x7f779c073390 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f778c009e80 tx=0x7f778c01c9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27caba3fbde900f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.034+0000 7f8845e00640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f8848158ce0 0x7f88480cc5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:49976/0 (socket says 172.21.15.76:49976) 2024-03-28T12:42:46.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.034+0000 7f8845e00640 1 -- 172.21.15.76:0/3755947447 learned_addr learned my addr 172.21.15.76:0/3755947447 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:46.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.034+0000 7f8101200640 1 --2- 172.21.15.76:0/1557126649 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80fc162230 0x7f80fc15f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.038+0000 7f7fafe00640 1 -- 172.21.15.76:0/2673305554 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00b5070 con 0x7f7fb00c5f40 2024-03-28T12:42:46.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.038+0000 7f7fafe00640 1 -- 172.21.15.76:0/2673305554 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa00a8990 con 0x7f7fb00c5f40 2024-03-28T12:42:46.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.038+0000 7f7fafe00640 1 -- 172.21.15.76:0/2673305554 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00a8d60 con 0x7f7fb00c5f40 2024-03-28T12:42:46.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.038+0000 7f7fb6a00640 1 -- 172.21.15.76:0/2673305554 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fb00c5f40 msgr2=0x7f7fb006f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.038+0000 7f7fb6a00640 1 --2- 172.21.15.76:0/2673305554 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fb00c5f40 0x7f7fb006f870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00097c0 tx=0x7f7fa001ec90 comp rx=0 tx=0).stop 2024-03-28T12:42:46.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.038+0000 7f7fb6a00640 1 -- 172.21.15.76:0/2673305554 shutdown_connections 2024-03-28T12:42:46.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.038+0000 7f7fb6a00640 1 --2- 172.21.15.76:0/2673305554 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fb00c5f40 0x7f7fb006f870 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.038+0000 7f7fb6a00640 1 --2- 172.21.15.76:0/2673305554 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7fb006f050 0x7f7fb00c2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.038+0000 7f7fb6a00640 1 -- 172.21.15.76:0/2673305554 >> 172.21.15.76:0/2673305554 conn(0x7f7fb00cbe80 msgr2=0x7f7fb00cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.038+0000 7f7fb6a00640 1 -- 172.21.15.76:0/2673305554 shutdown_connections 2024-03-28T12:42:46.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f8986200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89801569a0 0x7f89800c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.038+0000 7f7fb6a00640 1 -- 172.21.15.76:0/2673305554 wait complete. 2024-03-28T12:42:46.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f8985800640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f89800b1df0 0x7f898015a7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:49988/0 (socket says 172.21.15.76:49988) 2024-03-28T12:42:46.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f8985800640 1 -- 172.21.15.76:0/1503791880 learned_addr learned my addr 172.21.15.76:0/1503791880 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:46.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f00ee000640 1 -- 172.21.15.76:0/4115238949 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0ab5f0 con 0x7f00f00cc8a0 2024-03-28T12:42:46.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f00ee000640 1 -- 172.21.15.76:0/4115238949 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00dc0b0070 con 0x7f00f00cc8a0 2024-03-28T12:42:46.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f00ee000640 1 -- 172.21.15.76:0/4115238949 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0ab9b0 con 0x7f00f00cc8a0 2024-03-28T12:42:46.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f7fb6a00640 1 Processor -- start 2024-03-28T12:42:46.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f00f6600640 1 -- 172.21.15.76:0/4115238949 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f00f00cc8a0 msgr2=0x7f00f00ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f00f6600640 1 --2- 172.21.15.76:0/4115238949 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f00f00cc8a0 0x7f00f00ccd30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009870 tx=0x7f00dc01c520 comp rx=0 tx=0).stop 2024-03-28T12:42:46.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f00f6600640 1 -- 172.21.15.76:0/4115238949 shutdown_connections 2024-03-28T12:42:46.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f00f6600640 1 --2- 172.21.15.76:0/4115238949 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f00f00cc8a0 0x7f00f00ccd30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f00f6600640 1 --2- 172.21.15.76:0/4115238949 >> v2:172.21.15.76:3300/0 conn(0x7f00f00cad20 0x7f00f00cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f00f6600640 1 -- 172.21.15.76:0/4115238949 >> 172.21.15.76:0/4115238949 conn(0x7f00f008bfc0 msgr2=0x7f00f008c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f00f6600640 1 -- 172.21.15.76:0/4115238949 shutdown_connections 2024-03-28T12:42:46.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f00f6600640 1 -- 172.21.15.76:0/4115238949 wait complete. 2024-03-28T12:42:46.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f7fb6a00640 1 -- start start 2024-03-28T12:42:46.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f7fb6a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fb006f050 0x7f7fb0166cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f00f6600640 1 Processor -- start 2024-03-28T12:42:46.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.042+0000 7f7fb6a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7fb00c5f40 0x7f7fb0150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f00f6600640 1 -- start start 2024-03-28T12:42:46.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f7fb6a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fb0151520 0x7f7fb0157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f7fb6a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb00c7ea0 con 0x7f7fb0151520 2024-03-28T12:42:46.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f7fb6a00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb00c1500 con 0x7f7fb006f050 2024-03-28T12:42:46.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f7fb6a00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7fb00c8180 con 0x7f7fb00c5f40 2024-03-28T12:42:46.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f7fb5600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fb006f050 0x7f7fb0166cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f00f6600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00f00c7650 0x7f00f00c2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f7fb5600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fb006f050 0x7f7fb0166cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:58428/0 (socket says 172.21.15.76:58428) 2024-03-28T12:42:46.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f7fb5600640 1 -- 172.21.15.76:0/357995288 learned_addr learned my addr 172.21.15.76:0/357995288 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:46.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f00f6600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00f00cad20 0x7f00f00c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f00f6600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f00f00cc8a0 0x7f00f00c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f00f6600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f00f0154ee0 con 0x7f00f00c7650 2024-03-28T12:42:46.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f00f6600640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f00f0154d60 con 0x7f00f00cad20 2024-03-28T12:42:46.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f00f6600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f00f0167920 con 0x7f00f00cc8a0 2024-03-28T12:42:46.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f8101200640 1 -- 172.21.15.76:0/1557126649 >> v2:172.21.15.76:3300/0 conn(0x7f80fc0c3640 msgr2=0x7f80fc0cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:46.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f8101200640 1 --2- 172.21.15.76:0/1557126649 >> v2:172.21.15.76:3300/0 conn(0x7f80fc0c3640 0x7f80fc0cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f8101200640 1 -- 172.21.15.76:0/1557126649 >> v1:172.21.15.111:6789/0 conn(0x7f80fc158fd0 legacy=0x7f80fc0af9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.046+0000 7f8101200640 1 -- 172.21.15.76:0/1557126649 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80fc0c3ff0 con 0x7f80fc162230 2024-03-28T12:42:46.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f8986200640 1 -- 172.21.15.76:0/1503791880 >> v1:172.21.15.111:6789/0 conn(0x7f89800b1df0 legacy=0x7f898015a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f8986200640 1 -- 172.21.15.76:0/1503791880 >> v1:172.21.15.76:6789/0 conn(0x7f89800c1140 legacy=0x7f89800728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:46.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f7fb4c00640 1 --2- 172.21.15.76:0/357995288 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7fb00c5f40 0x7f7fb0150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f8986200640 1 -- 172.21.15.76:0/1503791880 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89800c2f20 con 0x7f89801569a0 2024-03-28T12:42:46.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f7799600640 1 -- 172.21.15.76:0/760873219 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c0a56e0 con 0x7f779c0c7090 2024-03-28T12:42:46.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f7799600640 1 -- 172.21.15.76:0/760873219 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778c0a5880 con 0x7f779c0c7090 2024-03-28T12:42:46.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f7799600640 1 -- 172.21.15.76:0/760873219 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c0a5c50 con 0x7f779c0c7090 2024-03-28T12:42:46.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f00efe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f00f00cc8a0 0x7f00f00c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f77a1c00640 1 -- 172.21.15.76:0/760873219 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c0c7090 msgr2=0x7f779c073390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f77a1c00640 1 --2- 172.21.15.76:0/760873219 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c0c7090 0x7f779c073390 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f778c009e80 tx=0x7f778c01c9d0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f7fb5600640 1 -- 172.21.15.76:0/357995288 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7fb00c5f40 msgr2=0x7f7fb0150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f77a1c00640 1 -- 172.21.15.76:0/760873219 shutdown_connections 2024-03-28T12:42:46.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f77a1c00640 1 --2- 172.21.15.76:0/760873219 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c0c7090 0x7f779c073390 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f77a1c00640 1 -- 172.21.15.76:0/760873219 >> 172.21.15.76:0/760873219 conn(0x7f779c0c8980 msgr2=0x7f779c0c8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f7fb5600640 1 --2- 172.21.15.76:0/357995288 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7fb00c5f40 0x7f7fb0150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f7fb5600640 1 -- 172.21.15.76:0/357995288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fb0151520 msgr2=0x7f7fb0157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f7fb5600640 1 --2- 172.21.15.76:0/357995288 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7fb0151520 0x7f7fb0157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.050+0000 7f7fb5600640 1 -- 172.21.15.76:0/357995288 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb01f5210 con 0x7f7fb006f050 2024-03-28T12:42:46.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.054+0000 7f00efe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f00f00cc8a0 0x7f00f00c4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:36192/0 (socket says 172.21.15.76:36192) 2024-03-28T12:42:46.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.054+0000 7f00efe00640 1 -- 172.21.15.76:0/3654757206 learned_addr learned my addr 172.21.15.76:0/3654757206 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:46.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.054+0000 7f8101200640 1 --2- 172.21.15.76:0/1557126649 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80fc162230 0x7f80fc15f790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f80f00097c0 tx=0x7f80f001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=525c2ce4f99f8446 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.054+0000 7f77a1c00640 1 -- 172.21.15.76:0/760873219 shutdown_connections 2024-03-28T12:42:46.052 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.054+0000 7f77a1c00640 1 -- 172.21.15.76:0/760873219 wait complete. 2024-03-28T12:42:46.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.054+0000 7f77a1c00640 1 Processor -- start 2024-03-28T12:42:46.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.054+0000 7f77a1c00640 1 -- start start 2024-03-28T12:42:46.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.054+0000 7f77a1c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c0c6880 0x7f779c14d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.054+0000 7f77a1c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f779c0c7090 0x7f779c0caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.054+0000 7f77a1c00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f779c1508d0 0x7f779c140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.054+0000 7f77a1c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f779c06f240 con 0x7f779c0c7090 2024-03-28T12:42:46.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.054+0000 7f77a1c00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f779c06f0c0 con 0x7f779c1508d0 2024-03-28T12:42:46.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.054+0000 7f77a1c00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f779c0c94a0 con 0x7f779c0c6880 2024-03-28T12:42:46.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.058+0000 7f7fb5600640 1 --2- 172.21.15.76:0/357995288 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fb006f050 0x7f7fb0166cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800cc20 tx=0x7f7fa800a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.058+0000 7f8986200640 1 --2- 172.21.15.76:0/1503791880 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89801569a0 0x7f89800c6a40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8978009dc0 tx=0x7f897801f140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96851c179fdc8b3b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.058+0000 7f80fbe00640 1 -- 172.21.15.76:0/1557126649 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f00b0070 con 0x7f80fc162230 2024-03-28T12:42:46.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.058+0000 7f80fbe00640 1 -- 172.21.15.76:0/1557126649 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f00ab600 con 0x7f80fc162230 2024-03-28T12:42:46.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.058+0000 7f80fbe00640 1 -- 172.21.15.76:0/1557126649 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f00ab9d0 con 0x7f80fc162230 2024-03-28T12:42:46.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.058+0000 7f8104600640 1 -- 172.21.15.76:0/1557126649 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80fc162230 msgr2=0x7f80fc15f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.058+0000 7f8104600640 1 --2- 172.21.15.76:0/1557126649 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80fc162230 0x7f80fc15f790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f80f00097c0 tx=0x7f80f001c4c0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f8104600640 1 -- 172.21.15.76:0/1557126649 shutdown_connections 2024-03-28T12:42:46.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f8104600640 1 --2- 172.21.15.76:0/1557126649 >> v2:172.21.15.76:3300/0 conn(0x7f80fc0c3640 0x7f80fc0cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f8104600640 1 --2- 172.21.15.76:0/1557126649 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80fc162230 0x7f80fc15f790 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f8104600640 1 -- 172.21.15.76:0/1557126649 >> 172.21.15.76:0/1557126649 conn(0x7f80fc06f0a0 msgr2=0x7f80fc06f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f8104600640 1 -- 172.21.15.76:0/1557126649 shutdown_connections 2024-03-28T12:42:46.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f00eea00640 1 --2- 172.21.15.76:0/3654757206 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00f00cad20 0x7f00f00c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f8104600640 1 -- 172.21.15.76:0/1557126649 wait complete. 2024-03-28T12:42:46.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f8104600640 1 Processor -- start 2024-03-28T12:42:46.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f8104600640 1 -- start start 2024-03-28T12:42:46.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f8845400640 1 --2- 172.21.15.76:0/3755947447 >> v2:172.21.15.76:3300/0 conn(0x7f88480cb3a0 0x7f884815f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f779b400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f779c1508d0 0x7f779c140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.061 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f8104600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80fc0c3640 0x7f80fc15e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f779b400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f779c1508d0 0x7f779c140640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:58452/0 (socket says 172.21.15.76:58452) 2024-03-28T12:42:46.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f779b400640 1 -- 172.21.15.76:0/933300270 learned_addr learned my addr 172.21.15.76:0/933300270 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:46.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f8104600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80fc158fd0 0x7f80fc158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f8104600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80fc162230 0x7f80fc15d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f8104600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f80fc15ec40 con 0x7f80fc158fd0 2024-03-28T12:42:46.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f8104600640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f80fc0c9420 con 0x7f80fc162230 2024-03-28T12:42:46.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.062+0000 7f8104600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f80fc16bde0 con 0x7f80fc0c3640 2024-03-28T12:42:46.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.066+0000 7f7fad600640 1 -- 172.21.15.76:0/357995288 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8017070 con 0x7f7fb006f050 2024-03-28T12:42:46.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.066+0000 7f7fad600640 1 -- 172.21.15.76:0/357995288 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa800ad40 con 0x7f7fb006f050 2024-03-28T12:42:46.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.066+0000 7f7fad600640 1 -- 172.21.15.76:0/357995288 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8012600 con 0x7f7fb006f050 2024-03-28T12:42:46.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.066+0000 7f7fb6a00640 1 -- 172.21.15.76:0/357995288 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb0166000 con 0x7f7fb006f050 2024-03-28T12:42:46.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.066+0000 7f7fb6a00640 1 -- 172.21.15.76:0/357995288 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb01f4f30 con 0x7f7fb006f050 2024-03-28T12:42:46.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.066+0000 7f7fb6a00640 1 -- 172.21.15.76:0/357995288 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7fb00686e0 con 0x7f7fb006f050 2024-03-28T12:42:46.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.066+0000 7f00efe00640 1 -- 172.21.15.76:0/3654757206 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00f00cad20 msgr2=0x7f00f00c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.066+0000 7f00efe00640 1 --2- 172.21.15.76:0/3654757206 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00f00cad20 0x7f00f00c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.066+0000 7f00efe00640 1 -- 172.21.15.76:0/3654757206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00f00c7650 msgr2=0x7f00f00c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.066+0000 7f00efe00640 1 --2- 172.21.15.76:0/3654757206 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f00f00c7650 0x7f00f00c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.066+0000 7f00efe00640 1 -- 172.21.15.76:0/3654757206 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f00cb620 con 0x7f00f00cc8a0 2024-03-28T12:42:46.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f897fe00640 1 -- 172.21.15.76:0/1503791880 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89780b4070 con 0x7f89801569a0 2024-03-28T12:42:46.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f897fe00640 1 -- 172.21.15.76:0/1503791880 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89780af600 con 0x7f89801569a0 2024-03-28T12:42:46.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f897fe00640 1 -- 172.21.15.76:0/1503791880 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89780af9d0 con 0x7f89801569a0 2024-03-28T12:42:46.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f779b400640 1 -- 172.21.15.76:0/933300270 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c0c6880 msgr2=0x7f779c14d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f779b400640 1 --2- 172.21.15.76:0/933300270 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c0c6880 0x7f779c14d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f779b400640 1 -- 172.21.15.76:0/933300270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f779c0c7090 msgr2=0x7f779c0caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f779b400640 1 --2- 172.21.15.76:0/933300270 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f779c0c7090 0x7f779c0caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f779b400640 1 -- 172.21.15.76:0/933300270 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779c14db30 con 0x7f779c1508d0 2024-03-28T12:42:46.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f8988200640 1 -- 172.21.15.76:0/1503791880 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89801569a0 msgr2=0x7f89800c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f8988200640 1 --2- 172.21.15.76:0/1503791880 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89801569a0 0x7f89800c6a40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8978009dc0 tx=0x7f897801f140 comp rx=0 tx=0).stop 2024-03-28T12:42:46.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f8988200640 1 -- 172.21.15.76:0/1503791880 shutdown_connections 2024-03-28T12:42:46.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f8988200640 1 --2- 172.21.15.76:0/1503791880 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89801569a0 0x7f89800c6a40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f8988200640 1 -- 172.21.15.76:0/1503791880 >> 172.21.15.76:0/1503791880 conn(0x7f898006fd30 msgr2=0x7f8980070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f8988200640 1 -- 172.21.15.76:0/1503791880 shutdown_connections 2024-03-28T12:42:46.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f8988200640 1 -- 172.21.15.76:0/1503791880 wait complete. 2024-03-28T12:42:46.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f8988200640 1 Processor -- start 2024-03-28T12:42:46.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f8988200640 1 -- start start 2024-03-28T12:42:46.074 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.074+0000 7f00efe00640 1 --2- 172.21.15.76:0/3654757206 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f00f00cc8a0 0x7f00f00c4bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009870 tx=0x7f00dc01ad60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.078+0000 7f8988200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f89800b1df0 0x7f8980154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.078+0000 7f8988200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89800c1140 0x7f89801551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.078+0000 7f8988200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89801569a0 0x7f89800cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.078+0000 7f8988200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f898015a290 con 0x7f89800c1140 2024-03-28T12:42:46.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.078+0000 7f8988200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8980159fb0 con 0x7f89800b1df0 2024-03-28T12:42:46.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.078+0000 7f8988200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f8980072ff0 con 0x7f89801569a0 2024-03-28T12:42:46.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.078+0000 7f8101c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80fc0c3640 0x7f80fc15e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.078+0000 7f8845400640 1 -- 172.21.15.76:0/3755947447 >> v1:172.21.15.111:6789/0 conn(0x7f8848158ce0 legacy=0x7f88480cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.078+0000 7f8845400640 1 -- 172.21.15.76:0/3755947447 >> v1:172.21.15.76:6789/0 conn(0x7f884806cdc0 legacy=0x7f884806d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:46.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.078+0000 7f8845400640 1 -- 172.21.15.76:0/3755947447 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88480cbd30 con 0x7f88480cb3a0 2024-03-28T12:42:46.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.082+0000 7f8101c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80fc0c3640 0x7f80fc15e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:36212/0 (socket says 172.21.15.76:36212) 2024-03-28T12:42:46.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.082+0000 7f8101c00640 1 -- 172.21.15.76:0/57724702 learned_addr learned my addr 172.21.15.76:0/57724702 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:46.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.082+0000 7f00e7400640 1 -- 172.21.15.76:0/3654757206 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0be5f0 con 0x7f00f00cc8a0 2024-03-28T12:42:46.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.082+0000 7f00e7400640 1 -- 172.21.15.76:0/3654757206 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00dc0be790 con 0x7f00f00cc8a0 2024-03-28T12:42:46.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.082+0000 7f00f6600640 1 -- 172.21.15.76:0/3654757206 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00f0146c30 con 0x7f00f00cc8a0 2024-03-28T12:42:46.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.082+0000 7f00f6600640 1 -- 172.21.15.76:0/3654757206 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f00f014c720 con 0x7f00f00cc8a0 2024-03-28T12:42:46.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.082+0000 7f779b400640 1 --2- 172.21.15.76:0/933300270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f779c1508d0 0x7f779c140640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f778400c470 tx=0x7f778400c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.086+0000 7f00e7400640 1 -- 172.21.15.76:0/3654757206 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0beb80 con 0x7f00f00cc8a0 2024-03-28T12:42:46.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.086+0000 7f00f6600640 1 -- 172.21.15.76:0/3654757206 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00f0068df0 con 0x7f00f00cc8a0 2024-03-28T12:42:46.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.086+0000 7f8102600640 1 --2- 172.21.15.76:0/57724702 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80fc162230 0x7f80fc15d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.086+0000 7f8101c00640 1 -- 172.21.15.76:0/57724702 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80fc162230 msgr2=0x7f80fc15d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.086+0000 7f8101c00640 1 --2- 172.21.15.76:0/57724702 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80fc162230 0x7f80fc15d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.086+0000 7f8101c00640 1 -- 172.21.15.76:0/57724702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80fc158fd0 msgr2=0x7f80fc158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.086+0000 7f8101c00640 1 --2- 172.21.15.76:0/57724702 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80fc158fd0 0x7f80fc158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.086+0000 7f8101c00640 1 -- 172.21.15.76:0/57724702 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80fc1546a0 con 0x7f80fc0c3640 2024-03-28T12:42:46.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.086+0000 7f7c86a00640 1 -- 172.21.15.76:0/1400366718 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c740b5070 con 0x7f7c80046810 2024-03-28T12:42:46.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.086+0000 7f7c86a00640 1 -- 172.21.15.76:0/1400366718 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c740a89d0 con 0x7f7c80046810 2024-03-28T12:42:46.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.086+0000 7f7c86a00640 1 -- 172.21.15.76:0/1400366718 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c740a8da0 con 0x7f7c80046810 2024-03-28T12:42:46.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.086+0000 7f7c8f200640 1 -- 172.21.15.76:0/1400366718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c80046810 msgr2=0x7f7c8004baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.086+0000 7f7c8f200640 1 --2- 172.21.15.76:0/1400366718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c80046810 0x7f7c8004baa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000dba0 tx=0x7f7c7401ecd0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.090+0000 7f7c8f200640 1 -- 172.21.15.76:0/1400366718 shutdown_connections 2024-03-28T12:42:46.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.090+0000 7f7c8f200640 1 --2- 172.21.15.76:0/1400366718 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c80046810 0x7f7c8004baa0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.090+0000 7f7c8f200640 1 --2- 172.21.15.76:0/1400366718 >> v2:172.21.15.111:3300/0 conn(0x7f7c800e7220 0x7f7c800462d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.090+0000 7f7c8f200640 1 -- 172.21.15.76:0/1400366718 >> 172.21.15.76:0/1400366718 conn(0x7f7c800501c0 msgr2=0x7f7c800505d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.090+0000 7f7c8f200640 1 -- 172.21.15.76:0/1400366718 shutdown_connections 2024-03-28T12:42:46.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.090+0000 7f7c8f200640 1 -- 172.21.15.76:0/1400366718 wait complete. 2024-03-28T12:42:46.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.090+0000 7f8985800640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f89800b1df0 0x7f8980154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.090+0000 7f7c8f200640 1 Processor -- start 2024-03-28T12:42:46.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.090+0000 7f7c8f200640 1 -- start start 2024-03-28T12:42:46.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.090+0000 7f7c8f200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c80046810 0x7f7c80184e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.090+0000 7f7c8f200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c800dd2f0 0x7f7c8016cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.090+0000 7f7c8f200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c800e7220 0x7f7c800dae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.090+0000 7f7c8f200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7c800e6e30 con 0x7f7c800dd2f0 2024-03-28T12:42:46.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.090+0000 7f7c8f200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8004c9a0 con 0x7f7c800e7220 2024-03-28T12:42:46.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.090+0000 7f7c8f200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7c800e6fb0 con 0x7f7c80046810 2024-03-28T12:42:46.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.094+0000 7feb8a000640 1 -- 172.21.15.76:0/3703327429 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c125a80 con 0x7feb840d5000 2024-03-28T12:42:46.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.094+0000 7feb8a000640 1 -- 172.21.15.76:0/3703327429 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb8c125c20 con 0x7feb840d5000 2024-03-28T12:42:46.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.094+0000 7feb8a000640 1 -- 172.21.15.76:0/3703327429 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c12d640 con 0x7feb840d5000 2024-03-28T12:42:46.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.094+0000 7f8845400640 1 --2- 172.21.15.76:0/3755947447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88480cb3a0 0x7f884815f550 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f88340097c0 tx=0x7f883401c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e3c498c374ea82 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.094+0000 7feb90c00640 1 -- 172.21.15.76:0/3703327429 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb840d5000 msgr2=0x7feb8404c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.094+0000 7feb90c00640 1 --2- 172.21.15.76:0/3703327429 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb840d5000 0x7feb8404c2e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feb8c02d910 tx=0x7feb8c09bdf0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.098+0000 7feb90c00640 1 -- 172.21.15.76:0/3703327429 shutdown_connections 2024-03-28T12:42:46.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.098+0000 7feb90c00640 1 --2- 172.21.15.76:0/3703327429 >> v2:172.21.15.111:3300/0 conn(0x7feb840db440 0x7feb840e5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.098+0000 7feb90c00640 1 --2- 172.21.15.76:0/3703327429 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb840d5000 0x7feb8404c2e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.098+0000 7feb90c00640 1 -- 172.21.15.76:0/3703327429 >> 172.21.15.76:0/3703327429 conn(0x7feb84050190 msgr2=0x7feb840505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.098+0000 7feb90c00640 1 -- 172.21.15.76:0/3703327429 shutdown_connections 2024-03-28T12:42:46.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.098+0000 7feb90c00640 1 -- 172.21.15.76:0/3703327429 wait complete. 2024-03-28T12:42:46.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.098+0000 7feb90c00640 1 Processor -- start 2024-03-28T12:42:46.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.098+0000 7feb90c00640 1 -- start start 2024-03-28T12:42:46.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.102+0000 7feb90c00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feb840347a0 0x7feb84178850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.102+0000 7feb90c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb840d5000 0x7feb84176980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.102+0000 7feb90c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feb840db440 0x7feb84176ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.102+0000 7feb90c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7feb84045130 con 0x7feb840d5000 2024-03-28T12:42:46.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.102+0000 7feb90c00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7feb84007010 con 0x7feb840347a0 2024-03-28T12:42:46.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.102+0000 7feb90c00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7feb840d53e0 con 0x7feb840db440 2024-03-28T12:42:46.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.102+0000 7f7c87e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c80046810 0x7f7c80184e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.106+0000 7f8101c00640 1 --2- 172.21.15.76:0/57724702 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80fc0c3640 0x7f80fc15e2c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f80e800c530 tx=0x7f80e800c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.106+0000 7f8844a00640 1 -- 172.21.15.76:0/3755947447 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88340b0070 con 0x7f88480cb3a0 2024-03-28T12:42:46.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.106+0000 7f8844a00640 1 -- 172.21.15.76:0/3755947447 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88340ab400 con 0x7f88480cb3a0 2024-03-28T12:42:46.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.106+0000 7f8844a00640 1 -- 172.21.15.76:0/3755947447 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88340ab7d0 con 0x7f88480cb3a0 2024-03-28T12:42:46.106 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.110+0000 7f8847200640 1 -- 172.21.15.76:0/3755947447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88480cb3a0 msgr2=0x7f884815f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.110+0000 7f8847200640 1 --2- 172.21.15.76:0/3755947447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88480cb3a0 0x7f884815f550 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f88340097c0 tx=0x7f883401c280 comp rx=0 tx=0).stop 2024-03-28T12:42:46.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.110+0000 7f8847200640 1 -- 172.21.15.76:0/3755947447 shutdown_connections 2024-03-28T12:42:46.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.110+0000 7f8847200640 1 --2- 172.21.15.76:0/3755947447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f88480cb3a0 0x7f884815f550 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.110+0000 7f8847200640 1 -- 172.21.15.76:0/3755947447 >> 172.21.15.76:0/3755947447 conn(0x7f884808c640 msgr2=0x7f8848067330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.110+0000 7f8984e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89800c1140 0x7f89801551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.110+0000 7f8847200640 1 -- 172.21.15.76:0/3755947447 shutdown_connections 2024-03-28T12:42:46.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.110+0000 7f8847200640 1 -- 172.21.15.76:0/3755947447 wait complete. 2024-03-28T12:42:46.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.110+0000 7f8984e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89800c1140 0x7f89801551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45438/0 (socket says 172.21.15.76:45438) 2024-03-28T12:42:46.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.110+0000 7f8984e00640 1 -- 172.21.15.76:0/1433649164 learned_addr learned my addr 172.21.15.76:0/1433649164 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:46.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.110+0000 7feb8aa00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb840d5000 0x7feb84176980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.114+0000 7f8847200640 1 Processor -- start 2024-03-28T12:42:46.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.114+0000 7f8984e00640 1 -- 172.21.15.76:0/1433649164 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89801569a0 msgr2=0x7f89800cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.114+0000 7f8984e00640 1 --2- 172.21.15.76:0/1433649164 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89801569a0 0x7f89800cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.114+0000 7f8984e00640 1 -- 172.21.15.76:0/1433649164 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f89800b1df0 msgr2=0x7f8980154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.114+0000 7f8984e00640 1 --2- 172.21.15.76:0/1433649164 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f89800b1df0 0x7f8980154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.114+0000 7f8984e00640 1 -- 172.21.15.76:0/1433649164 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89801f4e50 con 0x7f89800c1140 2024-03-28T12:42:46.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.114+0000 7f8847200640 1 -- start start 2024-03-28T12:42:46.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.114+0000 7f8847200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f884806cdc0 0x7f8848157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.114+0000 7f8847200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f88480cb3a0 0x7f884815c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.114+0000 7f7c87400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c800dd2f0 0x7f7c8016cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.114+0000 7f8847200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8848158ce0 0x7f884815cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.114+0000 7f8847200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f88481590c0 con 0x7f884806cdc0 2024-03-28T12:42:46.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.114+0000 7f8847200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f88480cb7f0 con 0x7f88480cb3a0 2024-03-28T12:42:46.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.114+0000 7f8847200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f8848159240 con 0x7f8848158ce0 2024-03-28T12:42:46.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.118+0000 7feb8aa00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb840d5000 0x7feb84176980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45456/0 (socket says 172.21.15.76:45456) 2024-03-28T12:42:46.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.118+0000 7feb8aa00640 1 -- 172.21.15.76:0/2396559908 learned_addr learned my addr 172.21.15.76:0/2396559908 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:46.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.118+0000 7f8984e00640 1 --2- 172.21.15.76:0/1433649164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89800c1140 0x7f89801551b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f897400c490 tx=0x7f8974001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.118+0000 7f8845e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f884806cdc0 0x7f8848157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.118+0000 7f00e7400640 1 -- 172.21.15.76:0/3654757206 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f00dc0b43f0 con 0x7f00f00cc8a0 2024-03-28T12:42:46.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.118+0000 7f00e7400640 1 --2- 172.21.15.76:0/3654757206 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f00d0068010 0x7f00d006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.118+0000 7f7c87400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c800dd2f0 0x7f7c8016cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45450/0 (socket says 172.21.15.76:45450) 2024-03-28T12:42:46.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.118+0000 7f7c87400640 1 -- 172.21.15.76:0/3413506898 learned_addr learned my addr 172.21.15.76:0/3413506898 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:46.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.122+0000 7f8845e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f884806cdc0 0x7f8848157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45470/0 (socket says 172.21.15.76:45470) 2024-03-28T12:42:46.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.122+0000 7f8845e00640 1 -- 172.21.15.76:0/3850878232 learned_addr learned my addr 172.21.15.76:0/3850878232 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:46.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.122+0000 7f00ef400640 1 --2- 172.21.15.76:0/3654757206 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f00d0068010 0x7f00d006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.122+0000 7f00e7400640 1 -- 172.21.15.76:0/3654757206 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f00dc0ef650 con 0x7f00f00cc8a0 2024-03-28T12:42:46.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.122+0000 7f00ef400640 1 --2- 172.21.15.76:0/3654757206 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f00d0068010 0x7f00d006a4d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009730 tx=0x7f00e0006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.122+0000 7f00e7400640 1 --2- 172.21.15.76:0/3654757206 >> [v2:172.21.15.76:6802/2048416202,v1:172.21.15.76:6803/2048416202] conn(0x7f00d00719a0 0x7f00d0073e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.122+0000 7f00e7400640 1 -- 172.21.15.76:0/3654757206 --> [v2:172.21.15.76:6802/2048416202,v1:172.21.15.76:6803/2048416202] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00dc0a5e90 con 0x7f00d00719a0 2024-03-28T12:42:46.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.122+0000 7feb8be00640 1 --2- 172.21.15.76:0/2396559908 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feb840db440 0x7feb84176ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.122+0000 7f00eea00640 1 --2- 172.21.15.76:0/3654757206 >> [v2:172.21.15.76:6802/2048416202,v1:172.21.15.76:6803/2048416202] conn(0x7f00d00719a0 0x7f00d0073e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.122+0000 7f7792a00640 1 -- 172.21.15.76:0/933300270 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784017070 con 0x7f779c1508d0 2024-03-28T12:42:46.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.122+0000 7f7792a00640 1 -- 172.21.15.76:0/933300270 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7784003600 con 0x7f779c1508d0 2024-03-28T12:42:46.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.122+0000 7f7792a00640 1 -- 172.21.15.76:0/933300270 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77840039f0 con 0x7f779c1508d0 2024-03-28T12:42:46.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.122+0000 7f77a1c00640 1 -- 172.21.15.76:0/933300270 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f779c1f17b0 con 0x7f779c1508d0 2024-03-28T12:42:46.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.122+0000 7f77a1c00640 1 -- 172.21.15.76:0/933300270 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f779c1f1d50 con 0x7f779c1508d0 2024-03-28T12:42:46.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.122+0000 7f00eea00640 1 --2- 172.21.15.76:0/3654757206 >> [v2:172.21.15.76:6802/2048416202,v1:172.21.15.76:6803/2048416202] conn(0x7f00d00719a0 0x7f00d0073e40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.122+0000 7f7fad600640 1 -- 172.21.15.76:0/357995288 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f7fa801a070 con 0x7f7fb006f050 2024-03-28T12:42:46.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.126+0000 7f7fad600640 1 --2- 172.21.15.76:0/357995288 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7f8c068010 0x7f7f8c06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.126+0000 7f778be00640 1 -- 172.21.15.76:0/933300270 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f779c0686e0 con 0x7f779c1508d0 2024-03-28T12:42:46.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.126+0000 7f7fb4c00640 1 --2- 172.21.15.76:0/357995288 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7f8c068010 0x7f7f8c06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.126+0000 7f00e7400640 1 -- 172.21.15.76:0/3654757206 <== osd.2 v2:172.21.15.76:6802/2048416202 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f00dc0a5e90 con 0x7f00d00719a0 2024-03-28T12:42:46.126 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.126+0000 7f7fb4c00640 1 --2- 172.21.15.76:0/357995288 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7f8c068010 0x7f7f8c06a4d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00c5b40 tx=0x7f7f98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.130+0000 7f7fad600640 1 -- 172.21.15.76:0/357995288 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f7fa8054be0 con 0x7f7fb006f050 2024-03-28T12:42:46.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.130+0000 7f7fad600640 1 --2- 172.21.15.76:0/357995288 >> [v2:172.21.15.76:6818/1923047176,v1:172.21.15.76:6819/1923047176] conn(0x7f7f8c071920 0x7f7f8c073dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.130+0000 7f7fad600640 1 -- 172.21.15.76:0/357995288 --> [v2:172.21.15.76:6818/1923047176,v1:172.21.15.76:6819/1923047176] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7fa8016ec0 con 0x7f7f8c071920 2024-03-28T12:42:46.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.130+0000 7feb8aa00640 1 -- 172.21.15.76:0/2396559908 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feb840db440 msgr2=0x7feb84176ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.130+0000 7feb8aa00640 1 --2- 172.21.15.76:0/2396559908 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feb840db440 0x7feb84176ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.130+0000 7feb8aa00640 1 -- 172.21.15.76:0/2396559908 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feb840347a0 msgr2=0x7feb84178850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.130+0000 7feb8aa00640 1 --2- 172.21.15.76:0/2396559908 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feb840347a0 0x7feb84178850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.130+0000 7feb8aa00640 1 -- 172.21.15.76:0/2396559908 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb84179200 con 0x7feb840d5000 2024-03-28T12:42:46.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.130+0000 7f7fb6000640 1 --2- 172.21.15.76:0/357995288 >> [v2:172.21.15.76:6818/1923047176,v1:172.21.15.76:6819/1923047176] conn(0x7f7f8c071920 0x7f7f8c073dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.130+0000 7f7fb6000640 1 --2- 172.21.15.76:0/357995288 >> [v2:172.21.15.76:6818/1923047176,v1:172.21.15.76:6819/1923047176] conn(0x7f7f8c071920 0x7f7f8c073dc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.130+0000 7f7fad600640 1 -- 172.21.15.76:0/357995288 <== osd.0 v2:172.21.15.76:6818/1923047176 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7fa8016ec0 con 0x7f7f8c071920 2024-03-28T12:42:46.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.138+0000 7feb8aa00640 1 --2- 172.21.15.76:0/2396559908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb840d5000 0x7feb84176980 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7feb7800c530 tx=0x7feb7800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.142+0000 7f8845e00640 1 -- 172.21.15.76:0/3850878232 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8848158ce0 msgr2=0x7f884815cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.142+0000 7f8845e00640 1 --2- 172.21.15.76:0/3850878232 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8848158ce0 0x7f884815cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.142+0000 7f8845e00640 1 -- 172.21.15.76:0/3850878232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f88480cb3a0 msgr2=0x7f884815c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.142+0000 7f8845e00640 1 --2- 172.21.15.76:0/3850878232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f88480cb3a0 0x7f884815c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.142+0000 7f8845e00640 1 -- 172.21.15.76:0/3850878232 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884813b2c0 con 0x7f884806cdc0 2024-03-28T12:42:46.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.142+0000 7f7c87e00640 1 -- 172.21.15.76:0/3413506898 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c800e7220 msgr2=0x7f7c800dae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.142+0000 7f7c87e00640 1 --2- 172.21.15.76:0/3413506898 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c800e7220 0x7f7c800dae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.142+0000 7f7c87e00640 1 -- 172.21.15.76:0/3413506898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c800dd2f0 msgr2=0x7f7c8016cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.142+0000 7f7c87e00640 1 --2- 172.21.15.76:0/3413506898 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7c800dd2f0 0x7f7c8016cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.142+0000 7f7c87e00640 1 -- 172.21.15.76:0/3413506898 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c80185350 con 0x7f7c80046810 2024-03-28T12:42:46.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.146+0000 7feb7f400640 1 -- 172.21.15.76:0/2396559908 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb78016020 con 0x7feb840d5000 2024-03-28T12:42:46.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.150+0000 7f80f9600640 1 -- 172.21.15.76:0/57724702 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8017070 con 0x7f80fc0c3640 2024-03-28T12:42:46.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.150+0000 7f80f9600640 1 -- 172.21.15.76:0/57724702 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80e8005cf0 con 0x7f80fc0c3640 2024-03-28T12:42:46.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.150+0000 7f80f9600640 1 -- 172.21.15.76:0/57724702 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e8007270 con 0x7f80fc0c3640 2024-03-28T12:42:46.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.150+0000 7feb90c00640 1 -- 172.21.15.76:0/2396559908 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb841794c0 con 0x7feb840d5000 2024-03-28T12:42:46.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.150+0000 7feb90c00640 1 -- 172.21.15.76:0/2396559908 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb840d6c20 con 0x7feb840d5000 2024-03-28T12:42:46.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.150+0000 7feb7f400640 1 -- 172.21.15.76:0/2396559908 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb78005220 con 0x7feb840d5000 2024-03-28T12:42:46.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.150+0000 7f00e7400640 1 -- 172.21.15.76:0/3654757206 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f00dc0ed850 con 0x7f00f00cc8a0 2024-03-28T12:42:46.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.150+0000 7f7c87e00640 1 --2- 172.21.15.76:0/3413506898 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c80046810 0x7f7c80184e10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c88074070 tx=0x7f7c8806db00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.150+0000 7f8104600640 1 -- 172.21.15.76:0/57724702 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80fc154980 con 0x7f80fc0c3640 2024-03-28T12:42:46.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.150+0000 7f8104600640 1 -- 172.21.15.76:0/57724702 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f80fc157830 con 0x7f80fc0c3640 2024-03-28T12:42:46.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.150+0000 7f8104600640 1 -- 172.21.15.76:0/57724702 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f80fc068df0 con 0x7f80fc0c3640 2024-03-28T12:42:46.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.150+0000 7f8845e00640 1 --2- 172.21.15.76:0/3850878232 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f884806cdc0 0x7f8848157a70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f883800c530 tx=0x7f883800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.150+0000 7feb7f400640 1 -- 172.21.15.76:0/2396559908 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb78007030 con 0x7feb840d5000 2024-03-28T12:42:46.150 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.150+0000 7feb90c00640 1 -- 172.21.15.76:0/2396559908 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb68001040 con 0x7feb840d5000 2024-03-28T12:42:46.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.158+0000 7f00f6600640 1 -- 172.21.15.76:0/3654757206 --> [v2:172.21.15.76:6802/2048416202,v1:172.21.15.76:6803/2048416202] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f00f0154000 con 0x7f00d00719a0 2024-03-28T12:42:46.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.158+0000 7f897d600640 1 -- 172.21.15.76:0/1433649164 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974017070 con 0x7f89800c1140 2024-03-28T12:42:46.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.158+0000 7f897d600640 1 -- 172.21.15.76:0/1433649164 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8974003600 con 0x7f89800c1140 2024-03-28T12:42:46.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.158+0000 7f897d600640 1 -- 172.21.15.76:0/1433649164 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89740039f0 con 0x7f89800c1140 2024-03-28T12:42:46.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.158+0000 7f8988200640 1 -- 172.21.15.76:0/1433649164 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89800ca170 con 0x7f89800c1140 2024-03-28T12:42:46.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.158+0000 7f8988200640 1 -- 172.21.15.76:0/1433649164 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89800ca730 con 0x7f89800c1140 2024-03-28T12:42:46.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.158+0000 7f00e7400640 1 -- 172.21.15.76:0/3654757206 <== osd.2 v2:172.21.15.76:6802/2048416202 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f00f0154000 con 0x7f00d00719a0 2024-03-28T12:42:46.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.158+0000 7f8972a00640 1 -- 172.21.15.76:0/1433649164 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8954001040 con 0x7f89800c1140 2024-03-28T12:42:46.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.162+0000 7f00f6600640 1 -- 172.21.15.76:0/3654757206 >> [v2:172.21.15.76:6802/2048416202,v1:172.21.15.76:6803/2048416202] conn(0x7f00d00719a0 msgr2=0x7f00d0073e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.162+0000 7f00f6600640 1 --2- 172.21.15.76:0/3654757206 >> [v2:172.21.15.76:6802/2048416202,v1:172.21.15.76:6803/2048416202] conn(0x7f00d00719a0 0x7f00d0073e40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.162+0000 7f00f6600640 1 -- 172.21.15.76:0/3654757206 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f00d0068010 msgr2=0x7f00d006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.162+0000 7f00f6600640 1 --2- 172.21.15.76:0/3654757206 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f00d0068010 0x7f00d006a4d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009730 tx=0x7f00e0006ca0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.162+0000 7f00f6600640 1 -- 172.21.15.76:0/3654757206 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f00f00cc8a0 msgr2=0x7f00f00c4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.162+0000 7f00f6600640 1 --2- 172.21.15.76:0/3654757206 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f00f00cc8a0 0x7f00f00c4bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009870 tx=0x7f00dc01ad60 comp rx=0 tx=0).stop 2024-03-28T12:42:46.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.162+0000 7f00efe00640 1 -- 172.21.15.76:0/3654757206 reap_dead start 2024-03-28T12:42:46.160 INFO:tasks.ceph.mds.c.smithi076.stderr:2024-03-28T12:42:46.158+0000 f9f5640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-03-28T12:42:46.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.162+0000 7f00f6600640 1 -- 172.21.15.76:0/3654757206 shutdown_connections 2024-03-28T12:42:46.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.162+0000 7f00f6600640 1 -- 172.21.15.76:0/3654757206 >> 172.21.15.76:0/3654757206 conn(0x7f00f008bfc0 msgr2=0x7f00f0152360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.162+0000 7f00f6600640 1 -- 172.21.15.76:0/3654757206 shutdown_connections 2024-03-28T12:42:46.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.162+0000 7f00f6600640 1 -- 172.21.15.76:0/3654757206 wait complete. 2024-03-28T12:42:46.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.162+0000 7f7fb6a00640 1 -- 172.21.15.76:0/357995288 --> [v2:172.21.15.76:6818/1923047176,v1:172.21.15.76:6819/1923047176] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7fb00b19f0 con 0x7f7f8c071920 2024-03-28T12:42:46.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.162+0000 7f7fad600640 1 -- 172.21.15.76:0/357995288 <== osd.0 v2:172.21.15.76:6818/1923047176 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7fb00b19f0 con 0x7f7f8c071920 2024-03-28T12:42:46.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.162+0000 7f7fb6a00640 1 -- 172.21.15.76:0/357995288 >> [v2:172.21.15.76:6818/1923047176,v1:172.21.15.76:6819/1923047176] conn(0x7f7f8c071920 msgr2=0x7f7f8c073dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.162 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.162+0000 7f7fb6a00640 1 --2- 172.21.15.76:0/357995288 >> [v2:172.21.15.76:6818/1923047176,v1:172.21.15.76:6819/1923047176] conn(0x7f7f8c071920 0x7f7f8c073dc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.166+0000 7f7fb6a00640 1 -- 172.21.15.76:0/357995288 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7f8c068010 msgr2=0x7f7f8c06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.166+0000 7f7fb6a00640 1 --2- 172.21.15.76:0/357995288 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7f8c068010 0x7f7f8c06a4d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00c5b40 tx=0x7f7f98008040 comp rx=0 tx=0).stop 2024-03-28T12:42:46.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.166+0000 7f7fb6a00640 1 -- 172.21.15.76:0/357995288 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fb006f050 msgr2=0x7f7fb0166cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.166+0000 7f7fb6a00640 1 --2- 172.21.15.76:0/357995288 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7fb006f050 0x7f7fb0166cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800cc20 tx=0x7f7fa800a430 comp rx=0 tx=0).stop 2024-03-28T12:42:46.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.166+0000 7f7fb6000640 1 -- 172.21.15.76:0/357995288 reap_dead start 2024-03-28T12:42:46.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.166+0000 7f7fb6a00640 1 -- 172.21.15.76:0/357995288 shutdown_connections 2024-03-28T12:42:46.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.166+0000 7f7fb6a00640 1 -- 172.21.15.76:0/357995288 >> 172.21.15.76:0/357995288 conn(0x7f7fb00cbe80 msgr2=0x7f7fb00cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.166+0000 7f7fb6a00640 1 -- 172.21.15.76:0/357995288 shutdown_connections 2024-03-28T12:42:46.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.166+0000 7f7fb6a00640 1 -- 172.21.15.76:0/357995288 wait complete. 2024-03-28T12:42:46.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.174+0000 7f7792a00640 1 -- 172.21.15.76:0/933300270 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f778401a070 con 0x7f779c1508d0 2024-03-28T12:42:46.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.174+0000 7f7792a00640 1 --2- 172.21.15.76:0/933300270 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7778068010 0x7f777806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.174+0000 7f779aa00640 1 --2- 172.21.15.76:0/933300270 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7778068010 0x7f777806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.174+0000 7f779aa00640 1 --2- 172.21.15.76:0/933300270 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7778068010 0x7f777806a4d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7794009650 tx=0x7f7794006bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.178+0000 7f7792a00640 1 -- 172.21.15.76:0/933300270 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f77840541b0 con 0x7f779c1508d0 2024-03-28T12:42:46.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.178+0000 7f7792a00640 1 --2- 172.21.15.76:0/933300270 >> [v2:172.21.15.76:6810/2409656853,v1:172.21.15.76:6811/2409656853] conn(0x7f7778071930 0x7f7778073dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.178+0000 7f7792a00640 1 -- 172.21.15.76:0/933300270 --> [v2:172.21.15.76:6810/2409656853,v1:172.21.15.76:6811/2409656853] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77780744a0 con 0x7f7778071930 2024-03-28T12:42:46.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.178+0000 7f779a000640 1 --2- 172.21.15.76:0/933300270 >> [v2:172.21.15.76:6810/2409656853,v1:172.21.15.76:6811/2409656853] conn(0x7f7778071930 0x7f7778073dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.178+0000 7f779a000640 1 --2- 172.21.15.76:0/933300270 >> [v2:172.21.15.76:6810/2409656853,v1:172.21.15.76:6811/2409656853] conn(0x7f7778071930 0x7f7778073dd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.182+0000 7f7792a00640 1 -- 172.21.15.76:0/933300270 <== osd.3 v2:172.21.15.76:6810/2409656853 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f77780744a0 con 0x7f7778071930 2024-03-28T12:42:46.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.186+0000 7f80f9600640 1 -- 172.21.15.76:0/57724702 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f80e801a070 con 0x7f80fc0c3640 2024-03-28T12:42:46.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.186+0000 7f80f9600640 1 --2- 172.21.15.76:0/57724702 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f80dc068010 0x7f80dc06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.190+0000 7f80f9600640 1 -- 172.21.15.76:0/57724702 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f80e8054230 con 0x7f80fc0c3640 2024-03-28T12:42:46.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.194+0000 7f883e000640 1 -- 172.21.15.76:0/3850878232 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8838017070 con 0x7f884806cdc0 2024-03-28T12:42:46.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.194+0000 7f883e000640 1 -- 172.21.15.76:0/3850878232 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8838005cf0 con 0x7f884806cdc0 2024-03-28T12:42:46.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.194+0000 7f883e000640 1 -- 172.21.15.76:0/3850878232 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8838007270 con 0x7f884806cdc0 2024-03-28T12:42:46.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.194+0000 7f8847200640 1 -- 172.21.15.76:0/3850878232 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8848154cf0 con 0x7f884806cdc0 2024-03-28T12:42:46.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.194+0000 7f8847200640 1 -- 172.21.15.76:0/3850878232 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f884813b860 con 0x7f884806cdc0 2024-03-28T12:42:46.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.194+0000 7f8101200640 1 --2- 172.21.15.76:0/57724702 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f80dc068010 0x7f80dc06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.194+0000 7f8101200640 1 --2- 172.21.15.76:0/57724702 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f80dc068010 0x7f80dc06a4d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f80f00ad000 tx=0x7f80f0004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.194+0000 7f7c7be00640 1 -- 172.21.15.76:0/3413506898 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88075080 con 0x7f7c80046810 2024-03-28T12:42:46.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.194+0000 7f7c7be00640 1 -- 172.21.15.76:0/3413506898 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c8808f070 con 0x7f7c80046810 2024-03-28T12:42:46.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.194+0000 7f7c7be00640 1 -- 172.21.15.76:0/3413506898 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88075480 con 0x7f7c80046810 2024-03-28T12:42:46.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.194+0000 7f7c8f200640 1 -- 172.21.15.76:0/3413506898 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c8016d330 con 0x7f7c80046810 2024-03-28T12:42:46.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.198+0000 7f7c8f200640 1 -- 172.21.15.76:0/3413506898 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c801858c0 con 0x7f7c80046810 2024-03-28T12:42:46.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.198+0000 7f7c8f200640 1 -- 172.21.15.76:0/3413506898 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7c800053d0 con 0x7f7c80046810 2024-03-28T12:42:46.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.198+0000 7f80f9600640 1 --2- 172.21.15.76:0/57724702 >> [v2:172.21.15.111:6800/189114011,v1:172.21.15.111:6801/189114011] conn(0x7f80dc0719a0 0x7f80dc073e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.198+0000 7f80f9600640 1 -- 172.21.15.76:0/57724702 --> [v2:172.21.15.111:6800/189114011,v1:172.21.15.111:6801/189114011] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80dc074510 con 0x7f80dc0719a0 2024-03-28T12:42:46.197 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.198+0000 7f8102600640 1 --2- 172.21.15.76:0/57724702 >> [v2:172.21.15.111:6800/189114011,v1:172.21.15.111:6801/189114011] conn(0x7f80dc0719a0 0x7f80dc073e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.198+0000 7f8847200640 1 -- 172.21.15.76:0/3850878232 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8820001040 con 0x7f884806cdc0 2024-03-28T12:42:46.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.202+0000 7f8102600640 1 --2- 172.21.15.76:0/57724702 >> [v2:172.21.15.111:6800/189114011,v1:172.21.15.111:6801/189114011] conn(0x7f80dc0719a0 0x7f80dc073e40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.201 INFO:teuthology.orchestra.run.smithi076.stdout:64424509461 2024-03-28T12:42:46.202 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-28T12:42:46.203 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.202+0000 7f80f9600640 1 -- 172.21.15.76:0/57724702 <== osd.5 v2:172.21.15.111:6800/189114011 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f80dc074510 con 0x7f80dc0719a0 2024-03-28T12:42:46.207 INFO:teuthology.orchestra.run.smithi076.stdout:64424509459 2024-03-28T12:42:46.207 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-28T12:42:46.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.218+0000 7f778be00640 1 -- 172.21.15.76:0/933300270 --> [v2:172.21.15.76:6810/2409656853,v1:172.21.15.76:6811/2409656853] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f779c0b1af0 con 0x7f7778071930 2024-03-28T12:42:46.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.218+0000 7f7c7be00640 1 -- 172.21.15.76:0/3413506898 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f7c88075620 con 0x7f7c80046810 2024-03-28T12:42:46.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.218+0000 7f7c7be00640 1 --2- 172.21.15.76:0/3413506898 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7c68068010 0x7f7c6806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.218+0000 7f7792a00640 1 -- 172.21.15.76:0/933300270 <== osd.3 v2:172.21.15.76:6810/2409656853 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f779c0b1af0 con 0x7f7778071930 2024-03-28T12:42:46.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.222+0000 7f778be00640 1 -- 172.21.15.76:0/933300270 >> [v2:172.21.15.76:6810/2409656853,v1:172.21.15.76:6811/2409656853] conn(0x7f7778071930 msgr2=0x7f7778073dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.222+0000 7f778be00640 1 --2- 172.21.15.76:0/933300270 >> [v2:172.21.15.76:6810/2409656853,v1:172.21.15.76:6811/2409656853] conn(0x7f7778071930 0x7f7778073dd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.222+0000 7f7c87400640 1 --2- 172.21.15.76:0/3413506898 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7c68068010 0x7f7c6806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.222+0000 7f7c87400640 1 --2- 172.21.15.76:0/3413506898 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7c68068010 0x7f7c6806a4d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c8004ee70 tx=0x7f7c7c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.222+0000 7f778be00640 1 -- 172.21.15.76:0/933300270 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7778068010 msgr2=0x7f777806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.222+0000 7f778be00640 1 --2- 172.21.15.76:0/933300270 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7778068010 0x7f777806a4d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7794009650 tx=0x7f7794006bb0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.222+0000 7f778be00640 1 -- 172.21.15.76:0/933300270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f779c1508d0 msgr2=0x7f779c140640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.222+0000 7f778be00640 1 --2- 172.21.15.76:0/933300270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f779c1508d0 0x7f779c140640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f778400c470 tx=0x7f778400c930 comp rx=0 tx=0).stop 2024-03-28T12:42:46.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.222+0000 7f779b400640 1 -- 172.21.15.76:0/933300270 reap_dead start 2024-03-28T12:42:46.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.222+0000 7f778be00640 1 -- 172.21.15.76:0/933300270 shutdown_connections 2024-03-28T12:42:46.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.222+0000 7f778be00640 1 -- 172.21.15.76:0/933300270 >> 172.21.15.76:0/933300270 conn(0x7f779c0c8980 msgr2=0x7f779c0c7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.221 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.222+0000 7f778be00640 1 -- 172.21.15.76:0/933300270 shutdown_connections 2024-03-28T12:42:46.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.222+0000 7f7c7be00640 1 -- 172.21.15.76:0/3413506898 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f7c880cff20 con 0x7f7c80046810 2024-03-28T12:42:46.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.222+0000 7f778be00640 1 -- 172.21.15.76:0/933300270 wait complete. 2024-03-28T12:42:46.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.222+0000 7f7c7be00640 1 --2- 172.21.15.76:0/3413506898 >> [v2:172.21.15.76:6826/3991688226,v1:172.21.15.76:6827/3991688226] conn(0x7f7c68072600 0x7f7c68074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.222+0000 7f7c7be00640 1 -- 172.21.15.76:0/3413506898 --> [v2:172.21.15.76:6826/3991688226,v1:172.21.15.76:6827/3991688226] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c68075170 con 0x7f7c68072600 2024-03-28T12:42:46.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.222+0000 7f7c8d200640 1 --2- 172.21.15.76:0/3413506898 >> [v2:172.21.15.76:6826/3991688226,v1:172.21.15.76:6827/3991688226] conn(0x7f7c68072600 0x7f7c68074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.226+0000 7f7c8d200640 1 --2- 172.21.15.76:0/3413506898 >> [v2:172.21.15.76:6826/3991688226,v1:172.21.15.76:6827/3991688226] conn(0x7f7c68072600 0x7f7c68074aa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.230+0000 7f7c7be00640 1 -- 172.21.15.76:0/3413506898 <== osd.1 v2:172.21.15.76:6826/3991688226 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c68075170 con 0x7f7c68072600 2024-03-28T12:42:46.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.238+0000 7f8104600640 1 -- 172.21.15.76:0/57724702 --> [v2:172.21.15.111:6800/189114011,v1:172.21.15.111:6801/189114011] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f80fc06c360 con 0x7f80dc0719a0 2024-03-28T12:42:46.237 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.238+0000 7f80f9600640 1 -- 172.21.15.76:0/57724702 <== osd.5 v2:172.21.15.111:6800/189114011 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f80fc06c360 con 0x7f80dc0719a0 2024-03-28T12:42:46.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.246+0000 7feb7f400640 1 -- 172.21.15.76:0/2396559908 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7feb780071d0 con 0x7feb840d5000 2024-03-28T12:42:46.244 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.246+0000 7feb7f400640 1 --2- 172.21.15.76:0/2396559908 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7feb6c067fc0 0x7feb6c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.246+0000 7feb8b400640 1 --2- 172.21.15.76:0/2396559908 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7feb6c067fc0 0x7feb6c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.250+0000 7f8104600640 1 -- 172.21.15.76:0/57724702 >> [v2:172.21.15.111:6800/189114011,v1:172.21.15.111:6801/189114011] conn(0x7f80dc0719a0 msgr2=0x7f80dc073e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.250+0000 7f8104600640 1 --2- 172.21.15.76:0/57724702 >> [v2:172.21.15.111:6800/189114011,v1:172.21.15.111:6801/189114011] conn(0x7f80dc0719a0 0x7f80dc073e40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.254+0000 7f8104600640 1 -- 172.21.15.76:0/57724702 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f80dc068010 msgr2=0x7f80dc06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.254+0000 7f8104600640 1 --2- 172.21.15.76:0/57724702 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f80dc068010 0x7f80dc06a4d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f80f00ad000 tx=0x7f80f0004740 comp rx=0 tx=0).stop 2024-03-28T12:42:46.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.254+0000 7f8104600640 1 -- 172.21.15.76:0/57724702 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80fc0c3640 msgr2=0x7f80fc15e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.254+0000 7f8104600640 1 --2- 172.21.15.76:0/57724702 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80fc0c3640 0x7f80fc15e2c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f80e800c530 tx=0x7f80e800c9f0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.251 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.254+0000 7f8102600640 1 -- 172.21.15.76:0/57724702 reap_dead start 2024-03-28T12:42:46.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.254+0000 7feb8b400640 1 --2- 172.21.15.76:0/2396559908 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7feb6c067fc0 0x7feb6c06a480 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feb8400dc10 tx=0x7feb8c06a320 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.254+0000 7f8104600640 1 -- 172.21.15.76:0/57724702 shutdown_connections 2024-03-28T12:42:46.252 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.254+0000 7f8104600640 1 -- 172.21.15.76:0/57724702 >> 172.21.15.76:0/57724702 conn(0x7f80fc06f0a0 msgr2=0x7f80fc074e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.254 INFO:teuthology.orchestra.run.smithi076.stdout:60129542165 2024-03-28T12:42:46.254 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-28T12:42:46.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.258+0000 7f8104600640 1 -- 172.21.15.76:0/57724702 shutdown_connections 2024-03-28T12:42:46.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.258+0000 7f8104600640 1 -- 172.21.15.76:0/57724702 wait complete. 2024-03-28T12:42:46.262 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.262+0000 7f897d600640 1 -- 172.21.15.76:0/1433649164 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f897401a070 con 0x7f89800c1140 2024-03-28T12:42:46.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.266+0000 7f897d600640 1 --2- 172.21.15.76:0/1433649164 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8960068010 0x7f896006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.270 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.274+0000 7f7c8f200640 1 -- 172.21.15.76:0/3413506898 --> [v2:172.21.15.76:6826/3991688226,v1:172.21.15.76:6827/3991688226] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7c800053d0 con 0x7f7c68072600 2024-03-28T12:42:46.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.274+0000 7f8985800640 1 --2- 172.21.15.76:0/1433649164 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8960068010 0x7f896006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.272 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.274+0000 7f8985800640 1 --2- 172.21.15.76:0/1433649164 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8960068010 0x7f896006a4d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f896c000f70 tx=0x7f896c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.282+0000 7f7c7be00640 1 -- 172.21.15.76:0/3413506898 <== osd.1 v2:172.21.15.76:6826/3991688226 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7c800053d0 con 0x7f7c68072600 2024-03-28T12:42:46.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.286+0000 7f7c8f200640 1 -- 172.21.15.76:0/3413506898 >> [v2:172.21.15.76:6826/3991688226,v1:172.21.15.76:6827/3991688226] conn(0x7f7c68072600 msgr2=0x7f7c68074aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.286+0000 7f7c8f200640 1 --2- 172.21.15.76:0/3413506898 >> [v2:172.21.15.76:6826/3991688226,v1:172.21.15.76:6827/3991688226] conn(0x7f7c68072600 0x7f7c68074aa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.286+0000 7f7c8f200640 1 -- 172.21.15.76:0/3413506898 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7c68068010 msgr2=0x7f7c6806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.286+0000 7f7c8f200640 1 --2- 172.21.15.76:0/3413506898 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7c68068010 0x7f7c6806a4d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c8004ee70 tx=0x7f7c7c009190 comp rx=0 tx=0).stop 2024-03-28T12:42:46.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.286+0000 7f7c8f200640 1 -- 172.21.15.76:0/3413506898 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c80046810 msgr2=0x7f7c80184e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.286+0000 7f7c8f200640 1 --2- 172.21.15.76:0/3413506898 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c80046810 0x7f7c80184e10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c88074070 tx=0x7f7c8806db00 comp rx=0 tx=0).stop 2024-03-28T12:42:46.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.286+0000 7f7c8d200640 1 -- 172.21.15.76:0/3413506898 reap_dead start 2024-03-28T12:42:46.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.290+0000 7f7c8f200640 1 -- 172.21.15.76:0/3413506898 shutdown_connections 2024-03-28T12:42:46.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.290+0000 7f7c8f200640 1 -- 172.21.15.76:0/3413506898 >> 172.21.15.76:0/3413506898 conn(0x7f7c800501c0 msgr2=0x7f7c800055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.290+0000 7f7c8f200640 1 -- 172.21.15.76:0/3413506898 shutdown_connections 2024-03-28T12:42:46.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.290+0000 7f7c8f200640 1 -- 172.21.15.76:0/3413506898 wait complete. 2024-03-28T12:42:46.304 INFO:teuthology.orchestra.run.smithi076.stdout:55834574868 2024-03-28T12:42:46.304 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-28T12:42:46.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.318+0000 7feb7f400640 1 -- 172.21.15.76:0/2396559908 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7feb78011e60 con 0x7feb840d5000 2024-03-28T12:42:46.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.318+0000 7feb7f400640 1 --2- 172.21.15.76:0/2396559908 >> [v2:172.21.15.111:6824/4275101548,v1:172.21.15.111:6825/4275101548] conn(0x7feb6c071850 0x7feb6c073cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.318+0000 7feb7f400640 1 -- 172.21.15.76:0/2396559908 --> [v2:172.21.15.111:6824/4275101548,v1:172.21.15.111:6825/4275101548] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb7800ae50 con 0x7feb6c071850 2024-03-28T12:42:46.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.322+0000 7feb7f400640 1 -- 172.21.15.76:0/2396559908 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feb78052e90 con 0x7feb840d5000 2024-03-28T12:42:46.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.322+0000 7feb8be00640 1 --2- 172.21.15.76:0/2396559908 >> [v2:172.21.15.111:6824/4275101548,v1:172.21.15.111:6825/4275101548] conn(0x7feb6c071850 0x7feb6c073cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.327 INFO:teuthology.orchestra.run.smithi076.stdout:64424509459 2024-03-28T12:42:46.327 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-28T12:42:46.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.330+0000 7feb8be00640 1 --2- 172.21.15.76:0/2396559908 >> [v2:172.21.15.111:6824/4275101548,v1:172.21.15.111:6825/4275101548] conn(0x7feb6c071850 0x7feb6c073cf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.330+0000 7feb7f400640 1 -- 172.21.15.76:0/2396559908 <== osd.6 v2:172.21.15.111:6824/4275101548 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb7800ae50 con 0x7feb6c071850 2024-03-28T12:42:46.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.342+0000 7f897d600640 1 -- 172.21.15.76:0/1433649164 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f89740541c0 con 0x7f89800c1140 2024-03-28T12:42:46.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.342+0000 7f897d600640 1 --2- 172.21.15.76:0/1433649164 >> [v2:172.21.15.111:6808/3817953131,v1:172.21.15.111:6810/3817953131] conn(0x7f8960071920 0x7f8960073dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.342+0000 7f897d600640 1 -- 172.21.15.76:0/1433649164 --> [v2:172.21.15.111:6808/3817953131,v1:172.21.15.111:6810/3817953131] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8960074490 con 0x7f8960071920 2024-03-28T12:42:46.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.342+0000 7f897d600640 1 -- 172.21.15.76:0/1433649164 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f89740523c0 con 0x7f89800c1140 2024-03-28T12:42:46.342 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.346+0000 7f8986200640 1 --2- 172.21.15.76:0/1433649164 >> [v2:172.21.15.111:6808/3817953131,v1:172.21.15.111:6810/3817953131] conn(0x7f8960071920 0x7f8960073dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.346+0000 7f8986200640 1 --2- 172.21.15.76:0/1433649164 >> [v2:172.21.15.111:6808/3817953131,v1:172.21.15.111:6810/3817953131] conn(0x7f8960071920 0x7f8960073dc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.346+0000 7f897d600640 1 -- 172.21.15.76:0/1433649164 <== osd.4 v2:172.21.15.111:6808/3817953131 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8960074490 con 0x7f8960071920 2024-03-28T12:42:46.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.382+0000 7f8972a00640 1 -- 172.21.15.76:0/1433649164 --> [v2:172.21.15.111:6808/3817953131,v1:172.21.15.111:6810/3817953131] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8954002de0 con 0x7f8960071920 2024-03-28T12:42:46.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.382+0000 7f897d600640 1 -- 172.21.15.76:0/1433649164 <== osd.4 v2:172.21.15.111:6808/3817953131 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8954002de0 con 0x7f8960071920 2024-03-28T12:42:46.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.386+0000 7f8972a00640 1 -- 172.21.15.76:0/1433649164 >> [v2:172.21.15.111:6808/3817953131,v1:172.21.15.111:6810/3817953131] conn(0x7f8960071920 msgr2=0x7f8960073dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.386+0000 7f8972a00640 1 --2- 172.21.15.76:0/1433649164 >> [v2:172.21.15.111:6808/3817953131,v1:172.21.15.111:6810/3817953131] conn(0x7f8960071920 0x7f8960073dc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.390+0000 7f8972a00640 1 -- 172.21.15.76:0/1433649164 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8960068010 msgr2=0x7f896006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.390+0000 7f8972a00640 1 --2- 172.21.15.76:0/1433649164 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8960068010 0x7f896006a4d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f896c000f70 tx=0x7f896c009040 comp rx=0 tx=0).stop 2024-03-28T12:42:46.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.390+0000 7f8972a00640 1 -- 172.21.15.76:0/1433649164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89800c1140 msgr2=0x7f89801551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.390+0000 7f8972a00640 1 --2- 172.21.15.76:0/1433649164 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89800c1140 0x7f89801551b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f897400c490 tx=0x7f8974001e80 comp rx=0 tx=0).stop 2024-03-28T12:42:46.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.390+0000 7f8986200640 1 -- 172.21.15.76:0/1433649164 reap_dead start 2024-03-28T12:42:46.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.398+0000 7f8972a00640 1 -- 172.21.15.76:0/1433649164 shutdown_connections 2024-03-28T12:42:46.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.398+0000 7f8972a00640 1 -- 172.21.15.76:0/1433649164 >> 172.21.15.76:0/1433649164 conn(0x7f898006fd30 msgr2=0x7f8980145910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.402+0000 7f8972a00640 1 -- 172.21.15.76:0/1433649164 shutdown_connections 2024-03-28T12:42:46.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.402+0000 7f8972a00640 1 -- 172.21.15.76:0/1433649164 wait complete. 2024-03-28T12:42:46.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.410+0000 7feb90c00640 1 -- 172.21.15.76:0/2396559908 --> [v2:172.21.15.111:6824/4275101548,v1:172.21.15.111:6825/4275101548] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feb68002de0 con 0x7feb6c071850 2024-03-28T12:42:46.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.418+0000 7feb7f400640 1 -- 172.21.15.76:0/2396559908 <== osd.6 v2:172.21.15.111:6824/4275101548 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7feb68002de0 con 0x7feb6c071850 2024-03-28T12:42:46.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.430+0000 7feb90c00640 1 -- 172.21.15.76:0/2396559908 >> [v2:172.21.15.111:6824/4275101548,v1:172.21.15.111:6825/4275101548] conn(0x7feb6c071850 msgr2=0x7feb6c073cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.430+0000 7feb90c00640 1 --2- 172.21.15.76:0/2396559908 >> [v2:172.21.15.111:6824/4275101548,v1:172.21.15.111:6825/4275101548] conn(0x7feb6c071850 0x7feb6c073cf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.434+0000 7feb90c00640 1 -- 172.21.15.76:0/2396559908 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7feb6c067fc0 msgr2=0x7feb6c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.434+0000 7feb90c00640 1 --2- 172.21.15.76:0/2396559908 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7feb6c067fc0 0x7feb6c06a480 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feb8400dc10 tx=0x7feb8c06a320 comp rx=0 tx=0).stop 2024-03-28T12:42:46.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.434+0000 7feb90c00640 1 -- 172.21.15.76:0/2396559908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb840d5000 msgr2=0x7feb84176980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.434+0000 7feb90c00640 1 --2- 172.21.15.76:0/2396559908 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7feb840d5000 0x7feb84176980 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7feb7800c530 tx=0x7feb7800c9f0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.438+0000 7feb8be00640 1 -- 172.21.15.76:0/2396559908 reap_dead start 2024-03-28T12:42:46.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.438+0000 7feb90c00640 1 -- 172.21.15.76:0/2396559908 shutdown_connections 2024-03-28T12:42:46.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.438+0000 7feb90c00640 1 -- 172.21.15.76:0/2396559908 >> 172.21.15.76:0/2396559908 conn(0x7feb84050190 msgr2=0x7feb840d2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.442+0000 7feb90c00640 1 -- 172.21.15.76:0/2396559908 shutdown_connections 2024-03-28T12:42:46.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.442+0000 7feb90c00640 1 -- 172.21.15.76:0/2396559908 wait complete. 2024-03-28T12:42:46.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.446+0000 7f883e000640 1 -- 172.21.15.76:0/3850878232 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f883801a070 con 0x7f884806cdc0 2024-03-28T12:42:46.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.446+0000 7f883e000640 1 --2- 172.21.15.76:0/3850878232 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8828068040 0x7f882806a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.450+0000 7f8845400640 1 --2- 172.21.15.76:0/3850878232 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8828068040 0x7f882806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.454+0000 7f8845400640 1 --2- 172.21.15.76:0/3850878232 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8828068040 0x7f882806a500 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f88340ad000 tx=0x7f8834004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.466+0000 7f42b2000640 1 Processor -- start 2024-03-28T12:42:46.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.466+0000 7f42b2000640 1 -- start start 2024-03-28T12:42:46.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.470+0000 7f42b2000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f42ac1508d0 0x7f42ac073390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.470+0000 7f42b2000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f42ac0c6880 0x7f42ac156a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.470+0000 7f42b2000640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42ac0c2620 con 0x7f42ac0c7090 2024-03-28T12:42:46.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.470+0000 7f42b2000640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f42ac0c6d30 con 0x7f42ac1508d0 2024-03-28T12:42:46.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.470+0000 7f42b2000640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f42ac0c2900 con 0x7f42ac0c6880 2024-03-28T12:42:46.472 INFO:teuthology.orchestra.run.smithi076.stdout:64424509460 2024-03-28T12:42:46.472 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-28T12:42:46.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.470+0000 7f42aaa00640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f42ac0c7090 0x7f42ac06e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:49996/0 (socket says 172.21.15.76:49996) 2024-03-28T12:42:46.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.478+0000 7f42aaa00640 1 -- 172.21.15.76:0/1707634208 learned_addr learned my addr 172.21.15.76:0/1707634208 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:46.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.478+0000 7f42abe00640 1 --2- 172.21.15.76:0/1707634208 >> v2:172.21.15.111:3300/0 conn(0x7f42ac0c6880 0x7f42ac156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.486+0000 7f42abe00640 1 -- 172.21.15.76:0/1707634208 >> v2:172.21.15.76:3300/0 conn(0x7f42ac1508d0 msgr2=0x7f42ac073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:46.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.486+0000 7f42abe00640 1 --2- 172.21.15.76:0/1707634208 >> v2:172.21.15.76:3300/0 conn(0x7f42ac1508d0 0x7f42ac073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.486+0000 7f42abe00640 1 -- 172.21.15.76:0/1707634208 >> v1:172.21.15.111:6789/0 conn(0x7f42ac0c7090 legacy=0x7f42ac06e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.486+0000 7f42abe00640 1 -- 172.21.15.76:0/1707634208 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac0c2be0 con 0x7f42ac0c6880 2024-03-28T12:42:46.489 INFO:teuthology.orchestra.run.smithi076.stdout:64424509460 2024-03-28T12:42:46.489 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-28T12:42:46.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.494+0000 7f883e000640 1 -- 172.21.15.76:0/3850878232 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f8838054140 con 0x7f884806cdc0 2024-03-28T12:42:46.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.494+0000 7f883e000640 1 --2- 172.21.15.76:0/3850878232 >> [v2:172.21.15.111:6809/1094587541,v1:172.21.15.111:6811/1094587541] conn(0x7f8828071950 0x7f8828073df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.500 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.498+0000 7f42abe00640 1 --2- 172.21.15.76:0/1707634208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42ac0c6880 0x7f42ac156a70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0c3230 tx=0x7f429c01eb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1a1fcdc3d3bb73b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.494+0000 7f883e000640 1 -- 172.21.15.76:0/3850878232 --> [v2:172.21.15.111:6809/1094587541,v1:172.21.15.111:6811/1094587541] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88280744c0 con 0x7f8828071950 2024-03-28T12:42:46.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.506+0000 7f883e000640 1 -- 172.21.15.76:0/3850878232 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8838052340 con 0x7f884806cdc0 2024-03-28T12:42:46.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.506+0000 7f42aa000640 1 -- 172.21.15.76:0/1707634208 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c0ad070 con 0x7f42ac0c6880 2024-03-28T12:42:46.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.506+0000 7f42aa000640 1 -- 172.21.15.76:0/1707634208 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f429c0a7a60 con 0x7f42ac0c6880 2024-03-28T12:42:46.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.506+0000 7f42aa000640 1 -- 172.21.15.76:0/1707634208 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c0a7e30 con 0x7f42ac0c6880 2024-03-28T12:42:46.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.506+0000 7f8846800640 1 --2- 172.21.15.76:0/3850878232 >> [v2:172.21.15.111:6809/1094587541,v1:172.21.15.111:6811/1094587541] conn(0x7f8828071950 0x7f8828073df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.506+0000 7f8846800640 1 --2- 172.21.15.76:0/3850878232 >> [v2:172.21.15.111:6809/1094587541,v1:172.21.15.111:6811/1094587541] conn(0x7f8828071950 0x7f8828073df0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.506 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.506+0000 7f883e000640 1 -- 172.21.15.76:0/3850878232 <== osd.7 v2:172.21.15.111:6809/1094587541 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f88280744c0 con 0x7f8828071950 2024-03-28T12:42:46.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.510+0000 7f42b2000640 1 -- 172.21.15.76:0/1707634208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42ac0c6880 msgr2=0x7f42ac156a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.507 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.510+0000 7f42b2000640 1 --2- 172.21.15.76:0/1707634208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42ac0c6880 0x7f42ac156a70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0c3230 tx=0x7f429c01eb00 comp rx=0 tx=0).stop 2024-03-28T12:42:46.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.510+0000 7f42b2000640 1 -- 172.21.15.76:0/1707634208 shutdown_connections 2024-03-28T12:42:46.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.510+0000 7f42b2000640 1 --2- 172.21.15.76:0/1707634208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42ac0c6880 0x7f42ac156a70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.510+0000 7f42b2000640 1 --2- 172.21.15.76:0/1707634208 >> v2:172.21.15.76:3300/0 conn(0x7f42ac1508d0 0x7f42ac073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.510+0000 7f42b2000640 1 -- 172.21.15.76:0/1707634208 >> 172.21.15.76:0/1707634208 conn(0x7f42ac0c8980 msgr2=0x7f42ac0c8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.510+0000 7f42b2000640 1 -- 172.21.15.76:0/1707634208 shutdown_connections 2024-03-28T12:42:46.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.510+0000 7f42b2000640 1 -- 172.21.15.76:0/1707634208 wait complete. 2024-03-28T12:42:46.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.514+0000 7f42b2000640 1 Processor -- start 2024-03-28T12:42:46.512 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.514+0000 7f42b2000640 1 -- start start 2024-03-28T12:42:46.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.518+0000 7f42b2000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42ac0c6880 0x7f42ac14e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.518+0000 7f42b2000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42ac0c7090 0x7f42ac14e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.518+0000 7f42b2000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42ac1508d0 0x7f42ac1f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.518+0000 7f42b2000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac150e30 con 0x7f42ac1508d0 2024-03-28T12:42:46.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.518+0000 7f42b2000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac150cb0 con 0x7f42ac0c7090 2024-03-28T12:42:46.516 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.518+0000 7f42b2000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f42ac06f0c0 con 0x7f42ac0c6880 2024-03-28T12:42:46.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.518+0000 7f42aaa00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42ac0c7090 0x7f42ac14e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.518+0000 7f42ab400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42ac0c6880 0x7f42ac14e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.518+0000 7f42abe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42ac1508d0 0x7f42ac1f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.518+0000 7f42aaa00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42ac0c7090 0x7f42ac14e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:58522/0 (socket says 172.21.15.76:58522) 2024-03-28T12:42:46.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.518+0000 7f42aaa00640 1 -- 172.21.15.76:0/1369800657 learned_addr learned my addr 172.21.15.76:0/1369800657 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:46.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.526+0000 7fa51ac00640 1 Processor -- start 2024-03-28T12:42:46.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.526+0000 7fa51ac00640 1 -- start start 2024-03-28T12:42:46.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.526+0000 7f42abe00640 1 -- 172.21.15.76:0/1369800657 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42ac0c6880 msgr2=0x7f42ac14e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.526+0000 7f42abe00640 1 --2- 172.21.15.76:0/1369800657 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42ac0c6880 0x7f42ac14e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.526+0000 7fa51ac00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa514154a90 0x7fa5140cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.526+0000 7fa51ac00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa5140cc560 0x7fa5140d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.526+0000 7fa51ac00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa51408cfe0 con 0x7fa5140d0850 2024-03-28T12:42:46.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.526+0000 7fa51ac00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fa5140cafb0 con 0x7fa514154a90 2024-03-28T12:42:46.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.526+0000 7fa51ac00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa51415b360 con 0x7fa5140cc560 2024-03-28T12:42:46.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.526+0000 7f42abe00640 1 -- 172.21.15.76:0/1369800657 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42ac0c7090 msgr2=0x7f42ac14e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.526+0000 7f42abe00640 1 --2- 172.21.15.76:0/1369800657 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42ac0c7090 0x7f42ac14e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.526+0000 7f42abe00640 1 -- 172.21.15.76:0/1369800657 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac14abb0 con 0x7f42ac1508d0 2024-03-28T12:42:46.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.530+0000 7f42abe00640 1 --2- 172.21.15.76:0/1369800657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42ac1508d0 0x7f42ac1f2b00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f429c0af000 tx=0x7f429c01b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.534+0000 7fa513e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa514154a90 0x7fa5140cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.534+0000 7fa518c00640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fa5140d0850 0x7fa51415e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:50006/0 (socket says 172.21.15.76:50006) 2024-03-28T12:42:46.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.534+0000 7fa518c00640 1 -- 172.21.15.76:0/2489268849 learned_addr learned my addr 172.21.15.76:0/2489268849 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:46.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.534+0000 7fa513400640 1 --2- 172.21.15.76:0/2489268849 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa5140cc560 0x7fa5140d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.538+0000 7fa512a00640 1 -- 172.21.15.76:0/2489268849 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1949078309 0 0) 0x7fa51408cfe0 con 0x7fa5140d0850 2024-03-28T12:42:46.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.538+0000 7fa512a00640 1 -- 172.21.15.76:0/2489268849 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4f8003530 con 0x7fa5140d0850 2024-03-28T12:42:46.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.538+0000 7f42a3400640 1 -- 172.21.15.76:0/1369800657 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c0c0070 con 0x7f42ac1508d0 2024-03-28T12:42:46.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.538+0000 7f42a3400640 1 -- 172.21.15.76:0/1369800657 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f429c0bb410 con 0x7f42ac1508d0 2024-03-28T12:42:46.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.538+0000 7f42a3400640 1 -- 172.21.15.76:0/1369800657 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c0ad040 con 0x7f42ac1508d0 2024-03-28T12:42:46.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.542+0000 7f42b2000640 1 -- 172.21.15.76:0/1369800657 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ac14c080 con 0x7f42ac1508d0 2024-03-28T12:42:46.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.542+0000 7f42b2000640 1 -- 172.21.15.76:0/1369800657 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ac14c640 con 0x7f42ac1508d0 2024-03-28T12:42:46.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.542+0000 7fa513400640 1 -- 172.21.15.76:0/2489268849 >> v2:172.21.15.111:3300/0 conn(0x7fa514154a90 msgr2=0x7fa5140cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:46.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.542+0000 7fa513400640 1 --2- 172.21.15.76:0/2489268849 >> v2:172.21.15.111:3300/0 conn(0x7fa514154a90 0x7fa5140cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.542+0000 7fa513400640 1 -- 172.21.15.76:0/2489268849 >> v1:172.21.15.111:6789/0 conn(0x7fa5140d0850 legacy=0x7fa51415e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.542+0000 7fa513400640 1 -- 172.21.15.76:0/2489268849 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51415b600 con 0x7fa5140cc560 2024-03-28T12:42:46.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.546+0000 7f8847200640 1 -- 172.21.15.76:0/3850878232 --> [v2:172.21.15.111:6809/1094587541,v1:172.21.15.111:6811/1094587541] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8820002de0 con 0x7f8828071950 2024-03-28T12:42:46.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.546+0000 7f42a0c00640 1 -- 172.21.15.76:0/1369800657 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42ac0686e0 con 0x7f42ac1508d0 2024-03-28T12:42:46.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.550+0000 7f883e000640 1 -- 172.21.15.76:0/3850878232 <== osd.7 v2:172.21.15.111:6809/1094587541 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8820002de0 con 0x7f8828071950 2024-03-28T12:42:46.549 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.550+0000 7fea12000640 1 Processor -- start 2024-03-28T12:42:46.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.550+0000 7fea12000640 1 -- start start 2024-03-28T12:42:46.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7f8833400640 1 -- 172.21.15.76:0/3850878232 >> [v2:172.21.15.111:6809/1094587541,v1:172.21.15.111:6811/1094587541] conn(0x7f8828071950 msgr2=0x7f8828073df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7f8833400640 1 --2- 172.21.15.76:0/3850878232 >> [v2:172.21.15.111:6809/1094587541,v1:172.21.15.111:6811/1094587541] conn(0x7f8828071950 0x7f8828073df0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7fa513400640 1 --2- 172.21.15.76:0/2489268849 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa5140cc560 0x7fa5140d0310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009d90 tx=0x7fa50c01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a634cd7610697dc9 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7f8833400640 1 -- 172.21.15.76:0/3850878232 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8828068040 msgr2=0x7f882806a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7f8833400640 1 --2- 172.21.15.76:0/3850878232 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8828068040 0x7f882806a500 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f88340ad000 tx=0x7f8834004740 comp rx=0 tx=0).stop 2024-03-28T12:42:46.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7f8833400640 1 -- 172.21.15.76:0/3850878232 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f884806cdc0 msgr2=0x7f8848157a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7f8833400640 1 --2- 172.21.15.76:0/3850878232 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f884806cdc0 0x7f8848157a70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f883800c530 tx=0x7f883800c9f0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7f8846800640 1 -- 172.21.15.76:0/3850878232 reap_dead start 2024-03-28T12:42:46.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7fea12000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fea0c14e1c0 0x7fea0c157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7fea12000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea0c0c8030 0x7fea0c15b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7fea12000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fea0c15b7c0 0x7fea0c0cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7fea12000640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fea0c15ab10 con 0x7fea0c14e1c0 2024-03-28T12:42:46.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7fea12000640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fea0c06cf10 con 0x7fea0c15b7c0 2024-03-28T12:42:46.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7fea12000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fea0c06d1f0 con 0x7fea0c0c8030 2024-03-28T12:42:46.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7f8833400640 1 -- 172.21.15.76:0/3850878232 shutdown_connections 2024-03-28T12:42:46.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7f8833400640 1 -- 172.21.15.76:0/3850878232 >> 172.21.15.76:0/3850878232 conn(0x7f884808c640 msgr2=0x7f88480ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7f8833400640 1 -- 172.21.15.76:0/3850878232 shutdown_connections 2024-03-28T12:42:46.554 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.554+0000 7f8833400640 1 -- 172.21.15.76:0/3850878232 wait complete. 2024-03-28T12:42:46.556 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.558+0000 7fea0aa00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea0c0c8030 0x7fea0c15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.558+0000 7fea0be00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fea0c15b7c0 0x7fea0c0cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.558+0000 7fea0be00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fea0c15b7c0 0x7fea0c0cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:58550/0 (socket says 172.21.15.76:58550) 2024-03-28T12:42:46.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.558+0000 7fea0be00640 1 -- 172.21.15.76:0/1115401426 learned_addr learned my addr 172.21.15.76:0/1115401426 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:46.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.562+0000 7fa512a00640 1 -- 172.21.15.76:0/2489268849 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0b2070 con 0x7fa5140cc560 2024-03-28T12:42:46.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.562+0000 7fa512a00640 1 -- 172.21.15.76:0/2489268849 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa50c0a5880 con 0x7fa5140cc560 2024-03-28T12:42:46.559 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.562+0000 7fa512a00640 1 -- 172.21.15.76:0/2489268849 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0a5c50 con 0x7fa5140cc560 2024-03-28T12:42:46.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.562+0000 7fa51ac00640 1 -- 172.21.15.76:0/2489268849 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa5140cc560 msgr2=0x7fa5140d0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.562+0000 7fa51ac00640 1 --2- 172.21.15.76:0/2489268849 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa5140cc560 0x7fa5140d0310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009d90 tx=0x7fa50c01c8b0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.562+0000 7fea0be00640 1 -- 172.21.15.76:0/1115401426 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea0c0c8030 msgr2=0x7fea0c15b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:46.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.562+0000 7fea0be00640 1 --2- 172.21.15.76:0/1115401426 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea0c0c8030 0x7fea0c15b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.562+0000 7fea0be00640 1 -- 172.21.15.76:0/1115401426 >> v2:172.21.15.76:3300/0 conn(0x7fea0c14e1c0 msgr2=0x7fea0c157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:46.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.562+0000 7fea0be00640 1 --2- 172.21.15.76:0/1115401426 >> v2:172.21.15.76:3300/0 conn(0x7fea0c14e1c0 0x7fea0c157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.562+0000 7fea0be00640 1 -- 172.21.15.76:0/1115401426 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea0c06d4d0 con 0x7fea0c15b7c0 2024-03-28T12:42:46.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.566+0000 7fa51ac00640 1 -- 172.21.15.76:0/2489268849 shutdown_connections 2024-03-28T12:42:46.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.566+0000 7fa51ac00640 1 --2- 172.21.15.76:0/2489268849 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa5140cc560 0x7fa5140d0310 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.566+0000 7fa51ac00640 1 --2- 172.21.15.76:0/2489268849 >> v2:172.21.15.111:3300/0 conn(0x7fa514154a90 0x7fa5140cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.570+0000 7fa51ac00640 1 -- 172.21.15.76:0/2489268849 >> 172.21.15.76:0/2489268849 conn(0x7fa51406db80 msgr2=0x7fa51406df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.570+0000 7fa51ac00640 1 -- 172.21.15.76:0/2489268849 shutdown_connections 2024-03-28T12:42:46.567 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.570+0000 7fa51ac00640 1 -- 172.21.15.76:0/2489268849 wait complete. 2024-03-28T12:42:46.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.570+0000 7fea0be00640 1 --2- 172.21.15.76:0/1115401426 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fea0c15b7c0 0x7fea0c0cd1f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0c3890 tx=0x7fea0401f200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=699f9662321752ea server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.570+0000 7fa51ac00640 1 Processor -- start 2024-03-28T12:42:46.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.574+0000 7fa51ac00640 1 -- start start 2024-03-28T12:42:46.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.574+0000 7fa51ac00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5140cc560 0x7fa51414ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.574+0000 7fa51ac00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa5140d0850 0x7fa5140c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.574+0000 7fa51ac00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa514154a90 0x7fa5141fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.574+0000 7fea0a000640 1 -- 172.21.15.76:0/1115401426 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea040b4070 con 0x7fea0c15b7c0 2024-03-28T12:42:46.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.574+0000 7fa51ac00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa5140b31d0 con 0x7fa5140cc560 2024-03-28T12:42:46.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.574+0000 7fa51ac00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa5140b3050 con 0x7fa514154a90 2024-03-28T12:42:46.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.574+0000 7fa51ac00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa51408cba0 con 0x7fa5140d0850 2024-03-28T12:42:46.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.574+0000 7fa513400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa5140d0850 0x7fa5140c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.579 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.582+0000 7fa513400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa5140d0850 0x7fa5140c91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:36282/0 (socket says 172.21.15.76:36282) 2024-03-28T12:42:46.579 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.582+0000 7fa513400640 1 -- 172.21.15.76:0/836374574 learned_addr learned my addr 172.21.15.76:0/836374574 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:46.579 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.582+0000 7fa518c00640 1 --2- 172.21.15.76:0/836374574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa514154a90 0x7fa5141fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.579 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.582+0000 7fea0a000640 1 -- 172.21.15.76:0/1115401426 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea040af400 con 0x7fea0c15b7c0 2024-03-28T12:42:46.581 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.582+0000 7fea12000640 1 -- 172.21.15.76:0/1115401426 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fea0c15b7c0 msgr2=0x7fea0c0cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.581 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.582+0000 7fea12000640 1 --2- 172.21.15.76:0/1115401426 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fea0c15b7c0 0x7fea0c0cd1f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0c3890 tx=0x7fea0401f200 comp rx=0 tx=0).stop 2024-03-28T12:42:46.582 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.582+0000 7fea12000640 1 -- 172.21.15.76:0/1115401426 shutdown_connections 2024-03-28T12:42:46.582 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.582+0000 7fea12000640 1 --2- 172.21.15.76:0/1115401426 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fea0c15b7c0 0x7fea0c0cd1f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.582 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.582+0000 7fea12000640 1 --2- 172.21.15.76:0/1115401426 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea0c0c8030 0x7fea0c15b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.582 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.582+0000 7fea12000640 1 --2- 172.21.15.76:0/1115401426 >> v2:172.21.15.76:3300/0 conn(0x7fea0c14e1c0 0x7fea0c157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.582 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.582+0000 7fea12000640 1 -- 172.21.15.76:0/1115401426 >> 172.21.15.76:0/1115401426 conn(0x7fea0c06f0a0 msgr2=0x7fea0c06f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.582+0000 7fea12000640 1 -- 172.21.15.76:0/1115401426 shutdown_connections 2024-03-28T12:42:46.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.582+0000 7fea12000640 1 -- 172.21.15.76:0/1115401426 wait complete. 2024-03-28T12:42:46.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.586+0000 7fea12000640 1 Processor -- start 2024-03-28T12:42:46.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.586+0000 7fea12000640 1 -- start start 2024-03-28T12:42:46.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.590+0000 7fea12000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea0c0c8030 0x7fea0c157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.590+0000 7fea12000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea0c15b7c0 0x7fea0c147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.590+0000 7fea12000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fea0c157f20 0x7fea0c1f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.590+0000 7fa513400640 1 -- 172.21.15.76:0/836374574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa514154a90 msgr2=0x7fa5141fb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.590+0000 7fa513400640 1 --2- 172.21.15.76:0/836374574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa514154a90 0x7fa5141fb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.590+0000 7fa513400640 1 -- 172.21.15.76:0/836374574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5140cc560 msgr2=0x7fa51414ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.590+0000 7fa513400640 1 --2- 172.21.15.76:0/836374574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5140cc560 0x7fa51414ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.590+0000 7fa513400640 1 -- 172.21.15.76:0/836374574 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51415b910 con 0x7fa5140d0850 2024-03-28T12:42:46.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.590+0000 7fea12000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c0c8590 con 0x7fea0c15b7c0 2024-03-28T12:42:46.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.590+0000 7fea12000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c0c2280 con 0x7fea0c157f20 2024-03-28T12:42:46.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.590+0000 7fea12000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fea0c0afbe0 con 0x7fea0c0c8030 2024-03-28T12:42:46.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.594+0000 7fea0b400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea0c0c8030 0x7fea0c157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.594+0000 7fea0b400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea0c0c8030 0x7fea0c157340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:36298/0 (socket says 172.21.15.76:36298) 2024-03-28T12:42:46.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.594+0000 7fea0b400640 1 -- 172.21.15.76:0/1883069955 learned_addr learned my addr 172.21.15.76:0/1883069955 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:46.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.598+0000 7fea0be00640 1 --2- 172.21.15.76:0/1883069955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fea0c157f20 0x7fea0c1f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.598+0000 7fa513400640 1 --2- 172.21.15.76:0/836374574 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa5140d0850 0x7fa5140c91e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0b0040 tx=0x7fa50c019650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.598+0000 7f6252e00640 1 Processor -- start 2024-03-28T12:42:46.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.598+0000 7fea0b400640 1 -- 172.21.15.76:0/1883069955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fea0c157f20 msgr2=0x7fea0c1f2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.598+0000 7fea0b400640 1 --2- 172.21.15.76:0/1883069955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fea0c157f20 0x7fea0c1f2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.598+0000 7fea0b400640 1 -- 172.21.15.76:0/1883069955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea0c15b7c0 msgr2=0x7fea0c147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.598+0000 7fea0b400640 1 --2- 172.21.15.76:0/1883069955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea0c15b7c0 0x7fea0c147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.598+0000 7fea0b400640 1 -- 172.21.15.76:0/1883069955 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea0c1f0070 con 0x7fea0c0c8030 2024-03-28T12:42:46.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.598+0000 7f6252e00640 1 -- start start 2024-03-28T12:42:46.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.602+0000 7f6252e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f624c1590f0 0x7f624c0cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.602+0000 7f6252e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f624c0c93f0 0x7f624c0cc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.602+0000 7f6252e00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f624c072be0 con 0x7f624c15f7d0 2024-03-28T12:42:46.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.602+0000 7f6252e00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f624c15fd10 con 0x7f624c1590f0 2024-03-28T12:42:46.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.602+0000 7f6252e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f624c0af040 con 0x7f624c0c93f0 2024-03-28T12:42:46.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.602+0000 7f9352200640 1 Processor -- start 2024-03-28T12:42:46.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.602+0000 7f9352200640 1 -- start start 2024-03-28T12:42:46.601 INFO:teuthology.orchestra.run.smithi076.stdout:64424509460 2024-03-28T12:42:46.601 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-28T12:42:46.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.602+0000 7f9352200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f934c154bc0 0x7f934c0c4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.602+0000 7f9352200640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f934c0c8420 0x7f934c0cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.602+0000 7f9352200640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f934c154fa0 con 0x7f934c0cd730 2024-03-28T12:42:46.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.602+0000 7f9352200640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f934c15aa30 con 0x7f934c154bc0 2024-03-28T12:42:46.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.602+0000 7f9352200640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f934c15acf0 con 0x7f934c0c8420 2024-03-28T12:42:46.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.606+0000 7fea0b400640 1 --2- 172.21.15.76:0/1883069955 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea0c0c8030 0x7fea0c157340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8009f60 tx=0x7fe9f8009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.606+0000 7fa50be00640 1 -- 172.21.15.76:0/836374574 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0b2050 con 0x7fa5140d0850 2024-03-28T12:42:46.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.606+0000 7fa50be00640 1 -- 172.21.15.76:0/836374574 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa50c0be070 con 0x7fa5140d0850 2024-03-28T12:42:46.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.606+0000 7fa50be00640 1 -- 172.21.15.76:0/836374574 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0adc60 con 0x7fa5140d0850 2024-03-28T12:42:46.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.610+0000 7f934aa00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f934c0c8420 0x7f934c0cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.610+0000 7fa51ac00640 1 -- 172.21.15.76:0/836374574 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5140c6d90 con 0x7fa5140d0850 2024-03-28T12:42:46.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.610+0000 7fa51ac00640 1 -- 172.21.15.76:0/836374574 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5141587c0 con 0x7fa5140d0850 2024-03-28T12:42:46.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.610+0000 7f934aa00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f934c0c8420 0x7f934c0cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:58580/0 (socket says 172.21.15.76:58580) 2024-03-28T12:42:46.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.610+0000 7f934be00640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f934c0cd730 0x7f934c15e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:50012/0 (socket says 172.21.15.76:50012) 2024-03-28T12:42:46.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.610+0000 7f934be00640 1 -- 172.21.15.76:0/2520966448 learned_addr learned my addr 172.21.15.76:0/2520966448 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:46.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.610+0000 7fa509600640 1 -- 172.21.15.76:0/836374574 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4e80052a0 con 0x7fa5140d0850 2024-03-28T12:42:46.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.618+0000 7fea03400640 1 -- 172.21.15.76:0/1883069955 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f801d070 con 0x7fea0c0c8030 2024-03-28T12:42:46.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.618+0000 7f934aa00640 1 -- 172.21.15.76:0/2520966448 >> v2:172.21.15.76:3300/0 conn(0x7f934c154bc0 msgr2=0x7f934c0c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:46.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.618+0000 7f934aa00640 1 --2- 172.21.15.76:0/2520966448 >> v2:172.21.15.76:3300/0 conn(0x7f934c154bc0 0x7f934c0c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.618+0000 7f934aa00640 1 -- 172.21.15.76:0/2520966448 >> v1:172.21.15.111:6789/0 conn(0x7f934c0cd730 legacy=0x7f934c15e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.618+0000 7f934aa00640 1 -- 172.21.15.76:0/2520966448 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c15afd0 con 0x7f934c0c8420 2024-03-28T12:42:46.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.622+0000 7fea12000640 1 -- 172.21.15.76:0/1883069955 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea0c156a20 con 0x7fea0c0c8030 2024-03-28T12:42:46.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.622+0000 7fea12000640 1 -- 172.21.15.76:0/1883069955 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fea0c1ef2b0 con 0x7fea0c0c8030 2024-03-28T12:42:46.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.622+0000 7f6252400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f624c0c93f0 0x7f624c0cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.622+0000 7fea03400640 1 -- 172.21.15.76:0/1883069955 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f8010b10 con 0x7fea0c0c8030 2024-03-28T12:42:46.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.622+0000 7fea03400640 1 -- 172.21.15.76:0/1883069955 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8018440 con 0x7fea0c0c8030 2024-03-28T12:42:46.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.622+0000 7fea00c00640 1 -- 172.21.15.76:0/1883069955 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea0c068df0 con 0x7fea0c0c8030 2024-03-28T12:42:46.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.622+0000 7f934aa00640 1 --2- 172.21.15.76:0/2520966448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f934c0c8420 0x7f934c0cd1f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f934c0c45b0 tx=0x7f933801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f453531343b7f9a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.626+0000 7f6251a00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f624c1590f0 0x7f624c0cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.630+0000 7f934a000640 1 -- 172.21.15.76:0/2520966448 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93380b0070 con 0x7f934c0c8420 2024-03-28T12:42:46.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.630+0000 7f934a000640 1 -- 172.21.15.76:0/2520966448 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93380ab600 con 0x7f934c0c8420 2024-03-28T12:42:46.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.630+0000 7f934a000640 1 -- 172.21.15.76:0/2520966448 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93380ab9d0 con 0x7f934c0c8420 2024-03-28T12:42:46.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.630+0000 7f6251a00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f624c1590f0 0x7f624c0cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45510/0 (socket says 172.21.15.76:45510) 2024-03-28T12:42:46.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.630+0000 7f6251a00640 1 -- 172.21.15.76:0/2961619788 learned_addr learned my addr 172.21.15.76:0/2961619788 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:46.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.630+0000 7f9352200640 1 -- 172.21.15.76:0/2520966448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f934c0c8420 msgr2=0x7f934c0cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.630+0000 7f42a3400640 1 -- 172.21.15.76:0/1369800657 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f429c0c3070 con 0x7f42ac1508d0 2024-03-28T12:42:46.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.630+0000 7f42a3400640 1 --2- 172.21.15.76:0/1369800657 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f428c068040 0x7f428c06a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.630+0000 7f9352200640 1 --2- 172.21.15.76:0/2520966448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f934c0c8420 0x7f934c0cd1f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f934c0c45b0 tx=0x7f933801c480 comp rx=0 tx=0).stop 2024-03-28T12:42:46.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.634+0000 7f42ab400640 1 --2- 172.21.15.76:0/1369800657 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f428c068040 0x7f428c06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.634+0000 7f9352200640 1 -- 172.21.15.76:0/2520966448 shutdown_connections 2024-03-28T12:42:46.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.634+0000 7f9352200640 1 --2- 172.21.15.76:0/2520966448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f934c0c8420 0x7f934c0cd1f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.634+0000 7f9352200640 1 --2- 172.21.15.76:0/2520966448 >> v2:172.21.15.76:3300/0 conn(0x7f934c154bc0 0x7f934c0c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.634+0000 7f9352200640 1 -- 172.21.15.76:0/2520966448 >> 172.21.15.76:0/2520966448 conn(0x7f934c06f0a0 msgr2=0x7f934c06f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.634+0000 7f9352200640 1 -- 172.21.15.76:0/2520966448 shutdown_connections 2024-03-28T12:42:46.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.634+0000 7f42ab400640 1 --2- 172.21.15.76:0/1369800657 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f428c068040 0x7f428c06a500 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f42a400a400 tx=0x7f42a400d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.634+0000 7f9352200640 1 -- 172.21.15.76:0/2520966448 wait complete. 2024-03-28T12:42:46.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.638+0000 7f9352200640 1 Processor -- start 2024-03-28T12:42:46.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.638+0000 7f9352200640 1 -- start start 2024-03-28T12:42:46.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.638+0000 7f9352200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f934c0c8420 0x7f934c157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.638+0000 7f9352200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f934c0cd730 0x7f934c15cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.638+0000 7f9352200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f934c154bc0 0x7f934c156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.638+0000 7f9352200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f934c167d70 con 0x7f934c154bc0 2024-03-28T12:42:46.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.638+0000 7f9352200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f934c167bf0 con 0x7f934c0c8420 2024-03-28T12:42:46.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.638+0000 7f9352200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f934c167ef0 con 0x7f934c0cd730 2024-03-28T12:42:46.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.642+0000 7f934b400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f934c0c8420 0x7f934c157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.642+0000 7f934b400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f934c0c8420 0x7f934c157ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:58594/0 (socket says 172.21.15.76:58594) 2024-03-28T12:42:46.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.642+0000 7f934b400640 1 -- 172.21.15.76:0/1921291834 learned_addr learned my addr 172.21.15.76:0/1921291834 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:46.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.646+0000 7f934b400640 1 -- 172.21.15.76:0/1921291834 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f934c0cd730 msgr2=0x7f934c15cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.646+0000 7f934b400640 1 --2- 172.21.15.76:0/1921291834 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f934c0cd730 0x7f934c15cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.646+0000 7f934b400640 1 -- 172.21.15.76:0/1921291834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f934c154bc0 msgr2=0x7f934c156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.646+0000 7f934b400640 1 --2- 172.21.15.76:0/1921291834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f934c154bc0 0x7f934c156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.646+0000 7f934b400640 1 -- 172.21.15.76:0/1921291834 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c0cb060 con 0x7f934c0c8420 2024-03-28T12:42:46.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.650+0000 7f934b400640 1 --2- 172.21.15.76:0/1921291834 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f934c0c8420 0x7f934c157ab0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f933c00b410 tx=0x7f933c00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.658+0000 7f9343400640 1 -- 172.21.15.76:0/1921291834 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c015020 con 0x7f934c0c8420 2024-03-28T12:42:46.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.658+0000 7f9343400640 1 -- 172.21.15.76:0/1921291834 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f933c011830 con 0x7f934c0c8420 2024-03-28T12:42:46.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.658+0000 7f9343400640 1 -- 172.21.15.76:0/1921291834 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c011c20 con 0x7f934c0c8420 2024-03-28T12:42:46.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.658+0000 7f9352200640 1 -- 172.21.15.76:0/1921291834 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934c155920 con 0x7f934c0c8420 2024-03-28T12:42:46.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.658+0000 7f9352200640 1 -- 172.21.15.76:0/1921291834 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934c155ee0 con 0x7f934c0c8420 2024-03-28T12:42:46.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.658+0000 7f9352200640 1 -- 172.21.15.76:0/1921291834 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f934c068df0 con 0x7f934c0c8420 2024-03-28T12:42:46.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.666+0000 7f42a3400640 1 -- 172.21.15.76:0/1369800657 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f429c0a7a00 con 0x7f42ac1508d0 2024-03-28T12:42:46.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.698+0000 7f02d8200640 1 Processor -- start 2024-03-28T12:42:46.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.698+0000 7f02d8200640 1 -- start start 2024-03-28T12:42:46.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.702+0000 7f02d8200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f02d00cea30 0x7f02d0071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.702+0000 7f02d8200640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d0158680 con 0x7f02d0152800 2024-03-28T12:42:46.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.702+0000 7f02d8200640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d0158940 con 0x7f02d0072240 2024-03-28T12:42:46.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.702+0000 7f02d8200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f02d0159550 con 0x7f02d00cea30 2024-03-28T12:42:46.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.734+0000 7f4309600640 1 Processor -- start 2024-03-28T12:42:46.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.734+0000 7f4309600640 1 -- start start 2024-03-28T12:42:46.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.738+0000 7f4309600640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f4304072340 0x7f43040c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.738+0000 7f4309600640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43040cef50 con 0x7f4304071f60 2024-03-28T12:42:46.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.738+0000 7f4309600640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f430406d7f0 con 0x7f43040c8ae0 2024-03-28T12:42:46.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.738+0000 7f4309600640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f430406c750 con 0x7f4304072340 2024-03-28T12:42:46.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.810+0000 7f9aa7e00640 1 Processor -- start 2024-03-28T12:42:46.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.810+0000 7f9aa7e00640 1 -- start start 2024-03-28T12:42:46.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.810+0000 7f9aa7e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9aa8154a10 0x7f9aa815a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.810+0000 7f9aa7e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f9aa80b21e0 0x7f9aa80c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.810+0000 7f9aa7e00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa80c9820 con 0x7f9aa80b1c90 2024-03-28T12:42:46.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.810+0000 7f9aa7e00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f9aa8154df0 con 0x7f9aa80b21e0 2024-03-28T12:42:46.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.810+0000 7f9aa7e00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f9aa806b5a0 con 0x7f9aa8154a10 2024-03-28T12:42:46.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.934+0000 7fea03400640 1 -- 172.21.15.76:0/1883069955 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fe9f8020070 con 0x7fea0c0c8030 2024-03-28T12:42:46.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.938+0000 7fea03400640 1 --2- 172.21.15.76:0/1883069955 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe9ec067fc0 0x7fe9ec06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.938+0000 7fea0aa00640 1 --2- 172.21.15.76:0/1883069955 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe9ec067fc0 0x7fe9ec06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.938+0000 7fea0aa00640 1 --2- 172.21.15.76:0/1883069955 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe9ec067fc0 0x7fe9ec06a480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0ca220 tx=0x7fe9fc009520 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.942+0000 7fea03400640 1 -- 172.21.15.76:0/1883069955 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fe9f80583f0 con 0x7fea0c0c8030 2024-03-28T12:42:46.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.950+0000 7f42a3400640 1 -- 172.21.15.76:0/1369800657 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f429c0186f0 con 0x7f42ac1508d0 2024-03-28T12:42:46.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.954+0000 7f9aa6000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f9aa80b21e0 0x7f9aa80c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.954+0000 7f02d5800640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f02d0152800 0x7f02d00c97e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:55726/0 (socket says 172.21.15.76:55726) 2024-03-28T12:42:46.952 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.954+0000 7f02d5800640 1 -- 172.21.15.76:0/625301783 learned_addr learned my addr 172.21.15.76:0/625301783 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:46.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.958+0000 7f6251a00640 1 -- 172.21.15.76:0/2961619788 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f624c0c93f0 msgr2=0x7f624c0cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:46.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.958+0000 7f6251a00640 1 --2- 172.21.15.76:0/2961619788 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f624c0c93f0 0x7f624c0cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.958+0000 7f6251a00640 1 -- 172.21.15.76:0/2961619788 >> v1:172.21.15.76:6789/0 conn(0x7f624c15f7d0 legacy=0x7f624c0c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.958+0000 7f6251a00640 1 -- 172.21.15.76:0/2961619788 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c1594d0 con 0x7f624c1590f0 2024-03-28T12:42:46.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.958+0000 7f9aa6000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f9aa80b21e0 0x7f9aa80c92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45534/0 (socket says 172.21.15.76:45534) 2024-03-28T12:42:46.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.958+0000 7f9aa6000640 1 -- 172.21.15.76:0/3743011174 learned_addr learned my addr 172.21.15.76:0/3743011174 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:46.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.962+0000 7f9aa6000640 1 -- 172.21.15.76:0/3743011174 >> v2:172.21.15.111:3300/0 conn(0x7f9aa8154a10 msgr2=0x7f9aa815a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:46.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.962+0000 7f9aa6000640 1 --2- 172.21.15.76:0/3743011174 >> v2:172.21.15.111:3300/0 conn(0x7f9aa8154a10 0x7f9aa815a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.962+0000 7f9aa6000640 1 -- 172.21.15.76:0/3743011174 >> v1:172.21.15.76:6789/0 conn(0x7f9aa80b1c90 legacy=0x7f9aa806beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:46.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.962+0000 7f9aa6000640 1 -- 172.21.15.76:0/3743011174 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa80c7d40 con 0x7f9aa80b21e0 2024-03-28T12:42:46.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.966+0000 7f02cfe00640 1 -- 172.21.15.76:0/625301783 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 121760444 0 0) 0x7f02d0158680 con 0x7f02d0152800 2024-03-28T12:42:46.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.966+0000 7f02cfe00640 1 -- 172.21.15.76:0/625301783 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02b8003530 con 0x7f02d0152800 2024-03-28T12:42:46.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.966+0000 7f4302a00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f4304071f60 0x7f430415b2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:55732/0 (socket says 172.21.15.76:55732) 2024-03-28T12:42:46.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.966+0000 7f4302a00640 1 -- 172.21.15.76:0/1527839391 learned_addr learned my addr 172.21.15.76:0/1527839391 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:46.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.974+0000 7f02cfe00640 1 -- 172.21.15.76:0/625301783 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3692092177 0 0) 0x7f02b8003530 con 0x7f02d0152800 2024-03-28T12:42:46.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.974+0000 7f02cfe00640 1 -- 172.21.15.76:0/625301783 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f02d00cea30 msgr2=0x7f02d0071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:46.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.974+0000 7f02cfe00640 1 --2- 172.21.15.76:0/625301783 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f02d00cea30 0x7f02d0071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.974+0000 7f02cfe00640 1 -- 172.21.15.76:0/625301783 >> v1:172.21.15.111:6789/0 conn(0x7f02d0072240 legacy=0x7f02d00cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:46.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.974+0000 7f02cfe00640 1 -- 172.21.15.76:0/625301783 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d0158c20 con 0x7f02d0152800 2024-03-28T12:42:46.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.974+0000 7f02cfe00640 1 -- 172.21.15.76:0/625301783 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7f02c4001680 con 0x7f02d0152800 2024-03-28T12:42:46.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.974+0000 7f02cfe00640 1 -- 172.21.15.76:0/625301783 >> v1:172.21.15.76:6789/0 conn(0x7f02d0152800 legacy=0x7f02d00c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.974+0000 7f02cfe00640 1 --2- 172.21.15.76:0/625301783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f02b8003a60 0x7f02b8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.974+0000 7f02cfe00640 1 --2- 172.21.15.76:0/625301783 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02b8004810 0x7f02b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.974+0000 7f02cfe00640 1 --2- 172.21.15.76:0/625301783 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f02d00cea30 0x7f02b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.974+0000 7f02cfe00640 1 -- 172.21.15.76:0/625301783 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f02b8005550 con 0x7f02b8003a60 2024-03-28T12:42:46.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.974+0000 7f02cfe00640 1 -- 172.21.15.76:0/625301783 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f02b800bf10 con 0x7f02b8004810 2024-03-28T12:42:46.975 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.974+0000 7f02cfe00640 1 -- 172.21.15.76:0/625301783 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f02b800c090 con 0x7f02d00cea30 2024-03-28T12:42:46.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.974+0000 7f9343400640 1 -- 172.21.15.76:0/1921291834 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f933c018020 con 0x7f934c0c8420 2024-03-28T12:42:46.976 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.974+0000 7f4302000640 1 --2- 172.21.15.76:0/1527839391 >> v2:172.21.15.111:3300/0 conn(0x7f4304072340 0x7f43040c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.974+0000 7f9343400640 1 --2- 172.21.15.76:0/1921291834 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f932c068010 0x7f932c06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.978+0000 7f934aa00640 1 --2- 172.21.15.76:0/1921291834 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f932c068010 0x7f932c06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.978+0000 7f934aa00640 1 --2- 172.21.15.76:0/1921291834 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f932c068010 0x7f932c06a4d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f93380ad000 tx=0x7f9338004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.978+0000 7f6251a00640 1 --2- 172.21.15.76:0/2961619788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f624c1590f0 0x7f624c0cc1e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f623c009870 tx=0x7f623c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a822236f92030662 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.982+0000 7f9343400640 1 -- 172.21.15.76:0/1921291834 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f933c054ba0 con 0x7f934c0c8420 2024-03-28T12:42:46.981 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.982+0000 7f9aa6000640 1 --2- 172.21.15.76:0/3743011174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9aa80b21e0 0x7f9aa80c92e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80701e0 tx=0x7f9a9401c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d253dc8db630cd5 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:46.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.986+0000 7f4301600640 1 -- 172.21.15.76:0/1527839391 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 609076924 0 0) 0x7f43040cef50 con 0x7f4304071f60 2024-03-28T12:42:46.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.986+0000 7f4301600640 1 -- 172.21.15.76:0/1527839391 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42e8003530 con 0x7f4304071f60 2024-03-28T12:42:46.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.990+0000 7f624be00640 1 -- 172.21.15.76:0/2961619788 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c0b5070 con 0x7f624c1590f0 2024-03-28T12:42:46.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.990+0000 7f624be00640 1 -- 172.21.15.76:0/2961619788 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f623c0a8a50 con 0x7f624c1590f0 2024-03-28T12:42:46.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.990+0000 7f624be00640 1 -- 172.21.15.76:0/2961619788 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c0a8e20 con 0x7f624c1590f0 2024-03-28T12:42:46.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.990+0000 7f6252e00640 1 -- 172.21.15.76:0/2961619788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f624c1590f0 msgr2=0x7f624c0cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.990+0000 7f6252e00640 1 --2- 172.21.15.76:0/2961619788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f624c1590f0 0x7f624c0cc1e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f623c009870 tx=0x7f623c01ed50 comp rx=0 tx=0).stop 2024-03-28T12:42:46.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.990+0000 7f6252e00640 1 -- 172.21.15.76:0/2961619788 shutdown_connections 2024-03-28T12:42:46.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.990+0000 7f6252e00640 1 --2- 172.21.15.76:0/2961619788 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f624c0c93f0 0x7f624c0cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.990+0000 7f6252e00640 1 --2- 172.21.15.76:0/2961619788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f624c1590f0 0x7f624c0cc1e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.990+0000 7f6252e00640 1 -- 172.21.15.76:0/2961619788 >> 172.21.15.76:0/2961619788 conn(0x7f624c06b5a0 msgr2=0x7f624c06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.990+0000 7f6252e00640 1 -- 172.21.15.76:0/2961619788 shutdown_connections 2024-03-28T12:42:46.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.990+0000 7f6252e00640 1 -- 172.21.15.76:0/2961619788 wait complete. 2024-03-28T12:42:46.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.994+0000 7f6252e00640 1 Processor -- start 2024-03-28T12:42:46.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.994+0000 7f6252e00640 1 -- start start 2024-03-28T12:42:46.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.994+0000 7f6252e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f624c0c93f0 0x7f624c0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.994+0000 7f6252e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f624c1590f0 0x7f624c145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.994+0000 7f6252e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f624c15f7d0 0x7f624c146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:46.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.994+0000 7f6252e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f624c0c2c50 con 0x7f624c1590f0 2024-03-28T12:42:46.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.994+0000 7f6252e00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f624c0c2970 con 0x7f624c0c93f0 2024-03-28T12:42:46.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.994+0000 7f6252e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f624c0c2f30 con 0x7f624c15f7d0 2024-03-28T12:42:46.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.998+0000 7f02d5800640 1 --2- 172.21.15.76:0/625301783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f02b8003a60 0x7f02b8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:46.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.998+0000 7f9aa5600640 1 -- 172.21.15.76:0/3743011174 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a940b0070 con 0x7f9aa80b21e0 2024-03-28T12:42:46.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.998+0000 7f9aa5600640 1 -- 172.21.15.76:0/3743011174 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a940ab600 con 0x7f9aa80b21e0 2024-03-28T12:42:46.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:46.998+0000 7f9aa5600640 1 -- 172.21.15.76:0/3743011174 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a940ab9d0 con 0x7f9aa80b21e0 2024-03-28T12:42:46.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f9aa7e00640 1 -- 172.21.15.76:0/3743011174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9aa80b21e0 msgr2=0x7f9aa80c92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:46.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f9aa7e00640 1 --2- 172.21.15.76:0/3743011174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9aa80b21e0 0x7f9aa80c92e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80701e0 tx=0x7f9a9401c2d0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f9aa7e00640 1 -- 172.21.15.76:0/3743011174 shutdown_connections 2024-03-28T12:42:46.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f9aa7e00640 1 --2- 172.21.15.76:0/3743011174 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9aa80b21e0 0x7f9aa80c92e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f9aa7e00640 1 --2- 172.21.15.76:0/3743011174 >> v2:172.21.15.111:3300/0 conn(0x7f9aa8154a10 0x7f9aa815a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:46.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f9aa7e00640 1 -- 172.21.15.76:0/3743011174 >> 172.21.15.76:0/3743011174 conn(0x7f9aa8073520 msgr2=0x7f9aa80ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:46.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f9aa7e00640 1 -- 172.21.15.76:0/3743011174 shutdown_connections 2024-03-28T12:42:46.999 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f9aa7e00640 1 -- 172.21.15.76:0/3743011174 wait complete. 2024-03-28T12:42:47.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f4301600640 1 -- 172.21.15.76:0/1527839391 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2672853711 0 0) 0x7f42e8003530 con 0x7f4304071f60 2024-03-28T12:42:47.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f4301600640 1 -- 172.21.15.76:0/1527839391 >> v2:172.21.15.111:3300/0 conn(0x7f4304072340 msgr2=0x7f43040c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:47.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f4301600640 1 --2- 172.21.15.76:0/1527839391 >> v2:172.21.15.111:3300/0 conn(0x7f4304072340 0x7f43040c3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f4301600640 1 -- 172.21.15.76:0/1527839391 >> v1:172.21.15.111:6789/0 conn(0x7f43040c8ae0 legacy=0x7f4304154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:47.000 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f6251000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f624c1590f0 0x7f624c145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:47.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f4301600640 1 -- 172.21.15.76:0/1527839391 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430406ca30 con 0x7f4304071f60 2024-03-28T12:42:47.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f4301600640 1 -- 172.21.15.76:0/1527839391 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7f42f4001680 con 0x7f4304071f60 2024-03-28T12:42:47.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f4301600640 1 -- 172.21.15.76:0/1527839391 >> v1:172.21.15.76:6789/0 conn(0x7f4304071f60 legacy=0x7f430415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f4301600640 1 --2- 172.21.15.76:0/1527839391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42e8003a60 0x7f42e8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:47.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f4301600640 1 --2- 172.21.15.76:0/1527839391 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42e8004810 0x7f42e8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:47.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f4301600640 1 --2- 172.21.15.76:0/1527839391 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42e80052f0 0x7f42e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:47.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f4301600640 1 -- 172.21.15.76:0/1527839391 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f430406c750 con 0x7f42e8004810 2024-03-28T12:42:47.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f4301600640 1 -- 172.21.15.76:0/1527839391 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f42e800c190 con 0x7f42e80052f0 2024-03-28T12:42:47.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f4301600640 1 -- 172.21.15.76:0/1527839391 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f42e800c390 con 0x7f42e8003a60 2024-03-28T12:42:47.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f9343400640 1 -- 172.21.15.76:0/1921291834 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f933c01f020 con 0x7f934c0c8420 2024-03-28T12:42:47.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f9aa7e00640 1 Processor -- start 2024-03-28T12:42:47.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.002+0000 7f9aa7e00640 1 -- start start 2024-03-28T12:42:47.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.006+0000 7f6251000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f624c1590f0 0x7f624c145c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45548/0 (socket says 172.21.15.76:45548) 2024-03-28T12:42:47.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.006+0000 7f6251000640 1 -- 172.21.15.76:0/1855662182 learned_addr learned my addr 172.21.15.76:0/1855662182 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:47.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.006+0000 7f9aa7e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9aa80b1c90 0x7f9aa814ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:47.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.006+0000 7f9aa7e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9aa80b21e0 0x7f9aa8152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:47.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.006+0000 7f9aa7e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9aa8154a10 0x7f9aa8152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:47.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.006+0000 7f9aa7e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa80cdd30 con 0x7f9aa8154a10 2024-03-28T12:42:47.003 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.006+0000 7f9aa7e00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa80c8dc0 con 0x7f9aa80b1c90 2024-03-28T12:42:47.004 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.006+0000 7f9aa7e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa80c7900 con 0x7f9aa80b21e0 2024-03-28T12:42:47.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.006+0000 7f02d5800640 1 -- 172.21.15.76:0/625301783 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f02d00cea30 msgr2=0x7f02b800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:47.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.006+0000 7f02d5800640 1 --2- 172.21.15.76:0/625301783 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f02d00cea30 0x7f02b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.006+0000 7f02d5800640 1 -- 172.21.15.76:0/625301783 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02b8004810 msgr2=0x7f02b8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:47.005 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.006+0000 7f02d5800640 1 --2- 172.21.15.76:0/625301783 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02b8004810 0x7f02b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.006+0000 7f02d5800640 1 -- 172.21.15.76:0/625301783 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b8003530 con 0x7f02b8003a60 2024-03-28T12:42:47.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.010+0000 7f4302000640 1 --2- 172.21.15.76:0/1527839391 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42e8004810 0x7f42e8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:47.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.014+0000 7f9aa6a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9aa80b1c90 0x7f9aa814ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:47.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.014+0000 7f4303400640 1 --2- 172.21.15.76:0/1527839391 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42e80052f0 0x7f42e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:47.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.014+0000 7f9aa6a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9aa80b1c90 0x7f9aa814ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:58672/0 (socket says 172.21.15.76:58672) 2024-03-28T12:42:47.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.014+0000 7f9aa6a00640 1 -- 172.21.15.76:0/1666017266 learned_addr learned my addr 172.21.15.76:0/1666017266 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:47.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.018+0000 7f4302000640 1 -- 172.21.15.76:0/1527839391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42e8003a60 msgr2=0x7f42e8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:47.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.018+0000 7f4302000640 1 --2- 172.21.15.76:0/1527839391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42e8003a60 0x7f42e8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.018+0000 7f4302000640 1 -- 172.21.15.76:0/1527839391 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42e80052f0 msgr2=0x7f42e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:47.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.018+0000 7f4302000640 1 --2- 172.21.15.76:0/1527839391 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42e80052f0 0x7f42e800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.018+0000 7f4302000640 1 -- 172.21.15.76:0/1527839391 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430406ca30 con 0x7f42e8004810 2024-03-28T12:42:47.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.018+0000 7f4303400640 1 -- 172.21.15.76:0/1527839391 reap_dead start 2024-03-28T12:42:47.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.030+0000 7f6251000640 1 -- 172.21.15.76:0/1855662182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f624c15f7d0 msgr2=0x7f624c146170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.030+0000 7f6251000640 1 --2- 172.21.15.76:0/1855662182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f624c15f7d0 0x7f624c146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.030+0000 7f6251000640 1 -- 172.21.15.76:0/1855662182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f624c0c93f0 msgr2=0x7f624c0cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.030+0000 7f6251000640 1 --2- 172.21.15.76:0/1855662182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f624c0c93f0 0x7f624c0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.030+0000 7f6251000640 1 -- 172.21.15.76:0/1855662182 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c146de0 con 0x7f624c1590f0 2024-03-28T12:42:47.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.030+0000 7f02d5800640 1 --2- 172.21.15.76:0/625301783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f02b8003a60 0x7f02b8003e60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f02c400c290 tx=0x7f02c401cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc8c28f9798b04d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:47.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.034+0000 7f6251000640 1 --2- 172.21.15.76:0/1855662182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f624c1590f0 0x7f624c145c30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f624000c390 tx=0x7f624000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:47.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.038+0000 7f9aa6a00640 1 -- 172.21.15.76:0/1666017266 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9aa80b21e0 msgr2=0x7f9aa8152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.038+0000 7f9aa6a00640 1 --2- 172.21.15.76:0/1666017266 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9aa80b21e0 0x7f9aa8152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.038+0000 7f9aa6a00640 1 -- 172.21.15.76:0/1666017266 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9aa8154a10 msgr2=0x7f9aa8152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.038+0000 7f9aa6a00640 1 --2- 172.21.15.76:0/1666017266 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9aa8154a10 0x7f9aa8152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.038+0000 7f9aa6a00640 1 -- 172.21.15.76:0/1666017266 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa81f7bd0 con 0x7f9aa80b1c90 2024-03-28T12:42:47.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.050+0000 7f9aa6a00640 1 --2- 172.21.15.76:0/1666017266 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9aa80b1c90 0x7f9aa814ef70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800b550 tx=0x7f9a9800ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:47.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.058+0000 7f9a9ea00640 1 -- 172.21.15.76:0/1666017266 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a98014070 con 0x7f9aa80b1c90 2024-03-28T12:42:47.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.058+0000 7f9a9ea00640 1 -- 172.21.15.76:0/1666017266 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a98010890 con 0x7f9aa80b1c90 2024-03-28T12:42:47.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.058+0000 7f9a9ea00640 1 -- 172.21.15.76:0/1666017266 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a98010c80 con 0x7f9aa80b1c90 2024-03-28T12:42:47.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.058+0000 7f9aa7e00640 1 -- 172.21.15.76:0/1666017266 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa81f7eb0 con 0x7f9aa80b1c90 2024-03-28T12:42:47.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.058+0000 7f9aa7e00640 1 -- 172.21.15.76:0/1666017266 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa81f8470 con 0x7f9aa80b1c90 2024-03-28T12:42:47.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.058+0000 7f9aa7e00640 1 -- 172.21.15.76:0/1666017266 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aa8068df0 con 0x7f9aa80b1c90 2024-03-28T12:42:47.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.066+0000 7f4302000640 1 --2- 172.21.15.76:0/1527839391 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42e8004810 0x7f42e8004c90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f430408c260 tx=0x7f42f001c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176db23e67ebdb40 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:47.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.078+0000 7f02cfe00640 1 -- 172.21.15.76:0/625301783 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4007d20 con 0x7f02b8003a60 2024-03-28T12:42:47.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.078+0000 7f02cfe00640 1 -- 172.21.15.76:0/625301783 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02c40a9070 con 0x7f02b8003a60 2024-03-28T12:42:47.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.078+0000 7f02cfe00640 1 -- 172.21.15.76:0/625301783 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c4005d00 con 0x7f02b8003a60 2024-03-28T12:42:47.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.078+0000 7f02d8200640 1 -- 172.21.15.76:0/625301783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f02b8003a60 msgr2=0x7f02b8003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.078+0000 7f02d8200640 1 --2- 172.21.15.76:0/625301783 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f02b8003a60 0x7f02b8003e60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f02c400c290 tx=0x7f02c401cce0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.078+0000 7f02d6200640 1 -- 172.21.15.76:0/625301783 reap_dead start 2024-03-28T12:42:47.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.078+0000 7f02d8200640 1 -- 172.21.15.76:0/625301783 shutdown_connections 2024-03-28T12:42:47.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.078+0000 7f02d8200640 1 -- 172.21.15.76:0/625301783 >> 172.21.15.76:0/625301783 conn(0x7f02d0071540 msgr2=0x7f02d0070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:47.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.078+0000 7f02d8200640 1 -- 172.21.15.76:0/625301783 shutdown_connections 2024-03-28T12:42:47.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.078+0000 7f02d8200640 1 -- 172.21.15.76:0/625301783 wait complete. 2024-03-28T12:42:47.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.082+0000 7f6249600640 1 -- 172.21.15.76:0/1855662182 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240017070 con 0x7f624c1590f0 2024-03-28T12:42:47.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.082+0000 7f6249600640 1 -- 172.21.15.76:0/1855662182 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62400052f0 con 0x7f624c1590f0 2024-03-28T12:42:47.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.082+0000 7f6249600640 1 -- 172.21.15.76:0/1855662182 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240003840 con 0x7f624c1590f0 2024-03-28T12:42:47.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.082+0000 7f02d8200640 1 Processor -- start 2024-03-28T12:42:47.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.082+0000 7f02d8200640 1 -- start start 2024-03-28T12:42:47.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.082+0000 7f02d8200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02b8003a60 0x7f02d014f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:47.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.082+0000 7f02d8200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f02d014e940 0x7f02d00c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:47.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.086+0000 7f02d8200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f02d00c5b60 0x7f02d01f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:47.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.086+0000 7f4301600640 1 -- 172.21.15.76:0/1527839391 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f000b5e0 con 0x7f42e8004810 2024-03-28T12:42:47.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.086+0000 7f6252e00640 1 -- 172.21.15.76:0/1855662182 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624c1470c0 con 0x7f624c1590f0 2024-03-28T12:42:47.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.086+0000 7f6252e00640 1 -- 172.21.15.76:0/1855662182 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f624c147680 con 0x7f624c1590f0 2024-03-28T12:42:47.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.086+0000 7f02d8200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f02d0152d60 con 0x7f02d00c5b60 2024-03-28T12:42:47.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.086+0000 7f02d8200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f02d0152be0 con 0x7f02b8003a60 2024-03-28T12:42:47.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.086+0000 7f02d8200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f02d0164820 con 0x7f02d014e940 2024-03-28T12:42:47.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.086+0000 7f6252e00640 1 -- 172.21.15.76:0/1855662182 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f624c068df0 con 0x7f624c1590f0 2024-03-28T12:42:47.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.090+0000 7f4301600640 1 -- 172.21.15.76:0/1527839391 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f00b0070 con 0x7f42e8004810 2024-03-28T12:42:47.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.090+0000 7f4301600640 1 -- 172.21.15.76:0/1527839391 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f00ab830 con 0x7f42e8004810 2024-03-28T12:42:47.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.090+0000 7f4309600640 1 -- 172.21.15.76:0/1527839391 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42e8004810 msgr2=0x7f42e8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.090+0000 7f4309600640 1 --2- 172.21.15.76:0/1527839391 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42e8004810 0x7f42e8004c90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f430408c260 tx=0x7f42f001c620 comp rx=0 tx=0).stop 2024-03-28T12:42:47.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.090+0000 7f4309600640 1 -- 172.21.15.76:0/1527839391 shutdown_connections 2024-03-28T12:42:47.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.090+0000 7f4309600640 1 --2- 172.21.15.76:0/1527839391 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42e8004810 0x7f42e8004c90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.090+0000 7f4309600640 1 -- 172.21.15.76:0/1527839391 >> 172.21.15.76:0/1527839391 conn(0x7f4304071540 msgr2=0x7f4304070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:47.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.090+0000 7f4309600640 1 -- 172.21.15.76:0/1527839391 shutdown_connections 2024-03-28T12:42:47.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.090+0000 7f4309600640 1 -- 172.21.15.76:0/1527839391 wait complete. 2024-03-28T12:42:47.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.094+0000 7f4309600640 1 Processor -- start 2024-03-28T12:42:47.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.094+0000 7f4309600640 1 -- start start 2024-03-28T12:42:47.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.094+0000 7f4309600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42e8004810 0x7f43040cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:47.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.094+0000 7f4309600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f43040c79d0 0x7f43040af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:47.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.094+0000 7f4309600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f43040afc10 0x7f43040ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:47.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.094+0000 7f4309600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f43040cea30 con 0x7f43040c79d0 2024-03-28T12:42:47.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.094+0000 7f4309600640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f430406cff0 con 0x7f42e8004810 2024-03-28T12:42:47.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.094+0000 7f4309600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f43040cebb0 con 0x7f43040afc10 2024-03-28T12:42:47.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.198+0000 7f42a0c00640 1 -- 172.21.15.76:0/1369800657 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f42ac1443a0 con 0x7f42ac1508d0 2024-03-28T12:42:47.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.210+0000 7f9352200640 1 -- 172.21.15.76:0/1921291834 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f934c151d80 con 0x7f934c0c8420 2024-03-28T12:42:47.255 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.258+0000 7fa50be00640 1 -- 172.21.15.76:0/836374574 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fa50c0b9450 con 0x7fa5140d0850 2024-03-28T12:42:47.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.258+0000 7fa50be00640 1 --2- 172.21.15.76:0/836374574 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa4f4068040 0x7fa4f406a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:47.256 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.258+0000 7fa513e00640 1 --2- 172.21.15.76:0/836374574 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa4f4068040 0x7fa4f406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:47.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.258+0000 7fa513e00640 1 --2- 172.21.15.76:0/836374574 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa4f4068040 0x7fa4f406a500 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa504006aa0 tx=0x7fa504006a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:47.259 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.262+0000 7fa50be00640 1 -- 172.21.15.76:0/836374574 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fa50c002030 con 0x7fa5140d0850 2024-03-28T12:42:47.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.278+0000 7fa50be00640 1 -- 172.21.15.76:0/836374574 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fa50c0c7060 con 0x7fa5140d0850 2024-03-28T12:42:47.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.302+0000 7fea03400640 1 -- 172.21.15.76:0/1883069955 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fe9f8027020 con 0x7fea0c0c8030 2024-03-28T12:42:47.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.306+0000 7f02d4e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f02d014e940 0x7f02d00c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:47.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.306+0000 7f02d4e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f02d014e940 0x7f02d00c5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:36364/0 (socket says 172.21.15.76:36364) 2024-03-28T12:42:47.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.306+0000 7f02d4e00640 1 -- 172.21.15.76:0/1362297584 learned_addr learned my addr 172.21.15.76:0/1362297584 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:47.305 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.306+0000 7f4303400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f43040afc10 0x7f43040ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:47.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.310+0000 7f4303400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f43040afc10 0x7f43040ae130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:36368/0 (socket says 172.21.15.76:36368) 2024-03-28T12:42:47.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.310+0000 7f4303400640 1 -- 172.21.15.76:0/1345585234 learned_addr learned my addr 172.21.15.76:0/1345585234 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:47.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.314+0000 7f02d4e00640 1 -- 172.21.15.76:0/1362297584 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02b8003a60 msgr2=0x7f02d014f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.314+0000 7f02d4e00640 1 --2- 172.21.15.76:0/1362297584 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02b8003a60 0x7f02d014f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.314+0000 7f02d4e00640 1 -- 172.21.15.76:0/1362297584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f02d00c5b60 msgr2=0x7f02d01f4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.314+0000 7f02d4e00640 1 --2- 172.21.15.76:0/1362297584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f02d00c5b60 0x7f02d01f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.314+0000 7f02d4e00640 1 -- 172.21.15.76:0/1362297584 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d00c5fe0 con 0x7f02d014e940 2024-03-28T12:42:47.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.326+0000 7f4303400640 1 -- 172.21.15.76:0/1345585234 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42e8004810 msgr2=0x7f43040cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.326+0000 7f4303400640 1 --2- 172.21.15.76:0/1345585234 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42e8004810 0x7f43040cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.326+0000 7f4303400640 1 -- 172.21.15.76:0/1345585234 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f43040c79d0 msgr2=0x7f43040af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.326+0000 7f4303400640 1 --2- 172.21.15.76:0/1345585234 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f43040c79d0 0x7f43040af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.326+0000 7f4303400640 1 -- 172.21.15.76:0/1345585234 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43041f0e00 con 0x7f43040afc10 2024-03-28T12:42:47.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.330+0000 7f02d4e00640 1 --2- 172.21.15.76:0/1362297584 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f02d014e940 0x7f02d00c5620 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00b550 tx=0x7f02bc00ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:47.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.334+0000 7f4303400640 1 --2- 172.21.15.76:0/1345585234 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f43040afc10 0x7f43040ae130 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00f7e0 tx=0x7f42fc00fca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:47.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.346+0000 7f42faa00640 1 -- 172.21.15.76:0/1345585234 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42fc019070 con 0x7f43040afc10 2024-03-28T12:42:47.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.346+0000 7f42faa00640 1 -- 172.21.15.76:0/1345585234 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42fc006d50 con 0x7f43040afc10 2024-03-28T12:42:47.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.346+0000 7f42faa00640 1 -- 172.21.15.76:0/1345585234 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42fc003ba0 con 0x7f43040afc10 2024-03-28T12:42:47.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.346+0000 7f4309600640 1 -- 172.21.15.76:0/1345585234 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43040cdee0 con 0x7f43040afc10 2024-03-28T12:42:47.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.350+0000 7f4309600640 1 -- 172.21.15.76:0/1345585234 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f43040b04a0 con 0x7f43040afc10 2024-03-28T12:42:47.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.350+0000 7f4309600640 1 -- 172.21.15.76:0/1345585234 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43040686e0 con 0x7f43040afc10 2024-03-28T12:42:47.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.350+0000 7f02cd600640 1 -- 172.21.15.76:0/1362297584 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc014070 con 0x7f02d014e940 2024-03-28T12:42:47.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.350+0000 7f02cd600640 1 -- 172.21.15.76:0/1362297584 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02bc010890 con 0x7f02d014e940 2024-03-28T12:42:47.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.350+0000 7f02cd600640 1 -- 172.21.15.76:0/1362297584 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc010c80 con 0x7f02d014e940 2024-03-28T12:42:47.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.350+0000 7f02d8200640 1 -- 172.21.15.76:0/1362297584 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d01f1940 con 0x7f02d014e940 2024-03-28T12:42:47.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.350+0000 7f02d8200640 1 -- 172.21.15.76:0/1362297584 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d01f1f00 con 0x7f02d014e940 2024-03-28T12:42:47.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.350+0000 7f02d8200640 1 -- 172.21.15.76:0/1362297584 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d00686e0 con 0x7f02d014e940 2024-03-28T12:42:47.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.378+0000 7f42faa00640 1 -- 172.21.15.76:0/1345585234 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f42fc01c070 con 0x7f43040afc10 2024-03-28T12:42:47.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.378+0000 7f42faa00640 1 --2- 172.21.15.76:0/1345585234 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f42e4068010 0x7f42e406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:47.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.382+0000 7f4302a00640 1 --2- 172.21.15.76:0/1345585234 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f42e4068010 0x7f42e406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:47.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.382+0000 7f4302a00640 1 --2- 172.21.15.76:0/1345585234 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f42e4068010 0x7f42e406a4d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43040741b0 tx=0x7f42f4001520 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:47.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.394+0000 7f6249600640 1 -- 172.21.15.76:0/1855662182 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f624001a070 con 0x7f624c1590f0 2024-03-28T12:42:47.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.394+0000 7f6249600640 1 --2- 172.21.15.76:0/1855662182 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6230068010 0x7f623006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:47.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.394+0000 7f6251a00640 1 --2- 172.21.15.76:0/1855662182 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6230068010 0x7f623006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:47.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.394+0000 7f6251a00640 1 --2- 172.21.15.76:0/1855662182 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6230068010 0x7f623006a4d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f623c0b2000 tx=0x7f623c004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:47.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.398+0000 7f9a9ea00640 1 -- 172.21.15.76:0/1666017266 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f9a98017070 con 0x7f9aa80b1c90 2024-03-28T12:42:47.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.398+0000 7f9a9ea00640 1 --2- 172.21.15.76:0/1666017266 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9a88068010 0x7f9a8806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:47.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.398+0000 7f9aa6000640 1 --2- 172.21.15.76:0/1666017266 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9a88068010 0x7f9a8806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:47.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.402+0000 7f9aa6000640 1 --2- 172.21.15.76:0/1666017266 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9a88068010 0x7f9a8806a4d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9a940ad000 tx=0x7f9a94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:47.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.406+0000 7f9a9ea00640 1 -- 172.21.15.76:0/1666017266 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f9a98054960 con 0x7f9aa80b1c90 2024-03-28T12:42:47.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.414+0000 7f6249600640 1 -- 172.21.15.76:0/1855662182 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f62400541d0 con 0x7f624c1590f0 2024-03-28T12:42:47.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.414+0000 7f6249600640 1 -- 172.21.15.76:0/1855662182 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f6240021070 con 0x7f624c1590f0 2024-03-28T12:42:47.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.426+0000 7f42a3400640 1 -- 172.21.15.76:0/1369800657 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f429c0f0ad0 con 0x7f42ac1508d0 2024-03-28T12:42:47.424 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.426+0000 7f9a9ea00640 1 -- 172.21.15.76:0/1666017266 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f9a98056fc0 con 0x7f9aa80b1c90 2024-03-28T12:42:47.426 INFO:teuthology.orchestra.run.smithi076.stdout:64424509458 2024-03-28T12:42:47.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.430+0000 7f42a0c00640 1 -- 172.21.15.76:0/1369800657 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f428c068040 msgr2=0x7f428c06a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.430+0000 7f42a0c00640 1 --2- 172.21.15.76:0/1369800657 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f428c068040 0x7f428c06a500 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f42a400a400 tx=0x7f42a400d040 comp rx=0 tx=0).stop 2024-03-28T12:42:47.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.430+0000 7f42a0c00640 1 -- 172.21.15.76:0/1369800657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42ac1508d0 msgr2=0x7f42ac1f2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.430+0000 7f42a0c00640 1 --2- 172.21.15.76:0/1369800657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42ac1508d0 0x7f42ac1f2b00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f429c0af000 tx=0x7f429c01b8a0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.430+0000 7f42a0c00640 1 -- 172.21.15.76:0/1369800657 shutdown_connections 2024-03-28T12:42:47.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.430+0000 7f42a0c00640 1 --2- 172.21.15.76:0/1369800657 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f428c068040 0x7f428c06a500 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.430+0000 7f42a0c00640 1 --2- 172.21.15.76:0/1369800657 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42ac1508d0 0x7f42ac1f2b00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.430+0000 7f42a0c00640 1 --2- 172.21.15.76:0/1369800657 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42ac0c7090 0x7f42ac14e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.430+0000 7f42a0c00640 1 --2- 172.21.15.76:0/1369800657 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42ac0c6880 0x7f42ac14e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.430+0000 7f42a0c00640 1 -- 172.21.15.76:0/1369800657 >> 172.21.15.76:0/1369800657 conn(0x7f42ac0c8980 msgr2=0x7f42ac1548a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:47.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.430+0000 7f42a0c00640 1 -- 172.21.15.76:0/1369800657 shutdown_connections 2024-03-28T12:42:47.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.430+0000 7f42a0c00640 1 -- 172.21.15.76:0/1369800657 wait complete. 2024-03-28T12:42:47.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.446+0000 7f9343400640 1 -- 172.21.15.76:0/1921291834 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f933c00f2e0 con 0x7f934c0c8420 2024-03-28T12:42:47.447 INFO:teuthology.orchestra.run.smithi076.stdout:55834574867 2024-03-28T12:42:47.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.450+0000 7f9352200640 1 -- 172.21.15.76:0/1921291834 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f932c068010 msgr2=0x7f932c06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.450+0000 7f9352200640 1 --2- 172.21.15.76:0/1921291834 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f932c068010 0x7f932c06a4d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f93380ad000 tx=0x7f9338004740 comp rx=0 tx=0).stop 2024-03-28T12:42:47.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.450+0000 7f9352200640 1 -- 172.21.15.76:0/1921291834 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f934c0c8420 msgr2=0x7f934c157ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.450+0000 7f9352200640 1 --2- 172.21.15.76:0/1921291834 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f934c0c8420 0x7f934c157ab0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f933c00b410 tx=0x7f933c00b8d0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.450+0000 7f9352200640 1 -- 172.21.15.76:0/1921291834 shutdown_connections 2024-03-28T12:42:47.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.450+0000 7f9352200640 1 --2- 172.21.15.76:0/1921291834 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f932c068010 0x7f932c06a4d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.450+0000 7f9352200640 1 --2- 172.21.15.76:0/1921291834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f934c154bc0 0x7f934c156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.450+0000 7f9352200640 1 --2- 172.21.15.76:0/1921291834 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f934c0cd730 0x7f934c15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.450+0000 7f9352200640 1 --2- 172.21.15.76:0/1921291834 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f934c0c8420 0x7f934c157ab0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.450+0000 7f9352200640 1 -- 172.21.15.76:0/1921291834 >> 172.21.15.76:0/1921291834 conn(0x7f934c06f0a0 msgr2=0x7f934c0c9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:47.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.450+0000 7f9352200640 1 -- 172.21.15.76:0/1921291834 shutdown_connections 2024-03-28T12:42:47.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.450+0000 7f9352200640 1 -- 172.21.15.76:0/1921291834 wait complete. 2024-03-28T12:42:47.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509459 got 64424509458 for osd.2 2024-03-28T12:42:47.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574868 got 55834574867 for osd.5 2024-03-28T12:42:47.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.530+0000 7fa509600640 1 -- 172.21.15.76:0/836374574 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa4e8005860 con 0x7fa5140d0850 2024-03-28T12:42:47.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.554+0000 7fea00c00640 1 -- 172.21.15.76:0/1883069955 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fea0c151b50 con 0x7fea0c0c8030 2024-03-28T12:42:47.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.658+0000 7f6252e00640 1 -- 172.21.15.76:0/1855662182 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f624c0c3200 con 0x7f624c1590f0 2024-03-28T12:42:47.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.662+0000 7f6249600640 1 -- 172.21.15.76:0/1855662182 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f624c072be0 con 0x7f624c1590f0 2024-03-28T12:42:47.662 INFO:teuthology.orchestra.run.smithi076.stdout:64424509458 2024-03-28T12:42:47.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.666+0000 7f9aa7e00640 1 -- 172.21.15.76:0/1666017266 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9aa814a6d0 con 0x7f9aa80b1c90 2024-03-28T12:42:47.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.666+0000 7f6252e00640 1 -- 172.21.15.76:0/1855662182 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6230068010 msgr2=0x7f623006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.666+0000 7f6252e00640 1 --2- 172.21.15.76:0/1855662182 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6230068010 0x7f623006a4d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f623c0b2000 tx=0x7f623c004740 comp rx=0 tx=0).stop 2024-03-28T12:42:47.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.666+0000 7f6252e00640 1 -- 172.21.15.76:0/1855662182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f624c1590f0 msgr2=0x7f624c145c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.666+0000 7f6252e00640 1 --2- 172.21.15.76:0/1855662182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f624c1590f0 0x7f624c145c30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f624000c390 tx=0x7f624000c850 comp rx=0 tx=0).stop 2024-03-28T12:42:47.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.666+0000 7f6252e00640 1 -- 172.21.15.76:0/1855662182 shutdown_connections 2024-03-28T12:42:47.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.666+0000 7f6252e00640 1 --2- 172.21.15.76:0/1855662182 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6230068010 0x7f623006a4d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.666+0000 7f6252e00640 1 --2- 172.21.15.76:0/1855662182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f624c15f7d0 0x7f624c146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.666+0000 7f6252e00640 1 --2- 172.21.15.76:0/1855662182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f624c1590f0 0x7f624c145c30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.666+0000 7f6252e00640 1 --2- 172.21.15.76:0/1855662182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f624c0c93f0 0x7f624c0cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.666+0000 7f6252e00640 1 -- 172.21.15.76:0/1855662182 >> 172.21.15.76:0/1855662182 conn(0x7f624c06b5a0 msgr2=0x7f624c158540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:47.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.666+0000 7f6252e00640 1 -- 172.21.15.76:0/1855662182 shutdown_connections 2024-03-28T12:42:47.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.666+0000 7f6252e00640 1 -- 172.21.15.76:0/1855662182 wait complete. 2024-03-28T12:42:47.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.674+0000 7f9a9ea00640 1 -- 172.21.15.76:0/1666017266 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9a98010e20 con 0x7f9aa80b1c90 2024-03-28T12:42:47.673 INFO:teuthology.orchestra.run.smithi076.stdout:64424509459 2024-03-28T12:42:47.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.678+0000 7f9aa7e00640 1 -- 172.21.15.76:0/1666017266 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9a88068010 msgr2=0x7f9a8806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.678+0000 7f9aa7e00640 1 --2- 172.21.15.76:0/1666017266 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9a88068010 0x7f9a8806a4d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9a940ad000 tx=0x7f9a94008040 comp rx=0 tx=0).stop 2024-03-28T12:42:47.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.678+0000 7f9aa7e00640 1 -- 172.21.15.76:0/1666017266 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9aa80b1c90 msgr2=0x7f9aa814ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:47.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.678+0000 7f9aa7e00640 1 --2- 172.21.15.76:0/1666017266 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9aa80b1c90 0x7f9aa814ef70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9a9800b550 tx=0x7f9a9800ba10 comp rx=0 tx=0).stop 2024-03-28T12:42:47.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.678+0000 7f9aa7e00640 1 -- 172.21.15.76:0/1666017266 shutdown_connections 2024-03-28T12:42:47.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.678+0000 7f9aa7e00640 1 --2- 172.21.15.76:0/1666017266 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9a88068010 0x7f9a8806a4d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.678+0000 7f9aa7e00640 1 --2- 172.21.15.76:0/1666017266 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9aa8154a10 0x7f9aa8152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.678+0000 7f9aa7e00640 1 --2- 172.21.15.76:0/1666017266 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9aa80b21e0 0x7f9aa8152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.678+0000 7f9aa7e00640 1 --2- 172.21.15.76:0/1666017266 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9aa80b1c90 0x7f9aa814ef70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:47.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.678+0000 7f9aa7e00640 1 -- 172.21.15.76:0/1666017266 >> 172.21.15.76:0/1666017266 conn(0x7f9aa8073520 msgr2=0x7f9aa80cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:47.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.678+0000 7f9aa7e00640 1 -- 172.21.15.76:0/1666017266 shutdown_connections 2024-03-28T12:42:47.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.678+0000 7f9aa7e00640 1 -- 172.21.15.76:0/1666017266 wait complete. 2024-03-28T12:42:47.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509459 got 64424509458 for osd.1 2024-03-28T12:42:47.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509460 got 64424509459 for osd.7 2024-03-28T12:42:47.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.934+0000 7f42faa00640 1 -- 172.21.15.76:0/1345585234 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f42fc053d10 con 0x7f43040afc10 2024-03-28T12:42:47.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.994+0000 7f42faa00640 1 -- 172.21.15.76:0/1345585234 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f42fc023080 con 0x7f43040afc10 2024-03-28T12:42:47.992 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.994+0000 7f02cd600640 1 -- 172.21.15.76:0/1362297584 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f02bc017070 con 0x7f02d014e940 2024-03-28T12:42:47.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.994+0000 7f02cd600640 1 --2- 172.21.15.76:0/1362297584 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f02b0068040 0x7f02b006a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:47.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.994+0000 7f02d5800640 1 --2- 172.21.15.76:0/1362297584 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f02b0068040 0x7f02b006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:47.994 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:47.994+0000 7f02d5800640 1 --2- 172.21.15.76:0/1362297584 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f02b0068040 0x7f02b006a500 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f02c40ab000 tx=0x7f02c40019c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:48.002 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.002+0000 7f02cd600640 1 -- 172.21.15.76:0/1362297584 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f02bc0547f0 con 0x7f02d014e940 2024-03-28T12:42:48.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.042+0000 7f02cd600640 1 -- 172.21.15.76:0/1362297584 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f02d00c5fe0 con 0x7f02d014e940 2024-03-28T12:42:48.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.062+0000 7fea03400640 1 -- 172.21.15.76:0/1883069955 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe9f805a350 con 0x7fea0c0c8030 2024-03-28T12:42:48.062 INFO:teuthology.orchestra.run.smithi076.stdout:60129542164 2024-03-28T12:42:48.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.066+0000 7fea00c00640 1 -- 172.21.15.76:0/1883069955 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe9ec067fc0 msgr2=0x7fe9ec06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.066+0000 7fea00c00640 1 --2- 172.21.15.76:0/1883069955 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe9ec067fc0 0x7fe9ec06a480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0ca220 tx=0x7fe9fc009520 comp rx=0 tx=0).stop 2024-03-28T12:42:48.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.066+0000 7fea00c00640 1 -- 172.21.15.76:0/1883069955 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea0c0c8030 msgr2=0x7fea0c157340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.066+0000 7fea00c00640 1 --2- 172.21.15.76:0/1883069955 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea0c0c8030 0x7fea0c157340 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8009f60 tx=0x7fe9f8009f90 comp rx=0 tx=0).stop 2024-03-28T12:42:48.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.066+0000 7fea00c00640 1 -- 172.21.15.76:0/1883069955 shutdown_connections 2024-03-28T12:42:48.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.066+0000 7fea00c00640 1 --2- 172.21.15.76:0/1883069955 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe9ec067fc0 0x7fe9ec06a480 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.066+0000 7fea00c00640 1 --2- 172.21.15.76:0/1883069955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fea0c157f20 0x7fea0c1f2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.066+0000 7fea00c00640 1 --2- 172.21.15.76:0/1883069955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fea0c15b7c0 0x7fea0c147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.066+0000 7fea00c00640 1 --2- 172.21.15.76:0/1883069955 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea0c0c8030 0x7fea0c157340 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.066+0000 7fea00c00640 1 -- 172.21.15.76:0/1883069955 >> 172.21.15.76:0/1883069955 conn(0x7fea0c06f0a0 msgr2=0x7fea0c071570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:48.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.066+0000 7fea00c00640 1 -- 172.21.15.76:0/1883069955 shutdown_connections 2024-03-28T12:42:48.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.066+0000 7fea00c00640 1 -- 172.21.15.76:0/1883069955 wait complete. 2024-03-28T12:42:48.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.082+0000 7fa50be00640 1 -- 172.21.15.76:0/836374574 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa50c0f8070 con 0x7fa5140d0850 2024-03-28T12:42:48.082 INFO:teuthology.orchestra.run.smithi076.stdout:64424509460 2024-03-28T12:42:48.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.086+0000 7fa509600640 1 -- 172.21.15.76:0/836374574 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa4f4068040 msgr2=0x7fa4f406a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.086+0000 7fa509600640 1 --2- 172.21.15.76:0/836374574 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa4f4068040 0x7fa4f406a500 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa504006aa0 tx=0x7fa504006a30 comp rx=0 tx=0).stop 2024-03-28T12:42:48.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.086+0000 7fa509600640 1 -- 172.21.15.76:0/836374574 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa5140d0850 msgr2=0x7fa5140c91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.086+0000 7fa509600640 1 --2- 172.21.15.76:0/836374574 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa5140d0850 0x7fa5140c91e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0b0040 tx=0x7fa50c019650 comp rx=0 tx=0).stop 2024-03-28T12:42:48.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.086+0000 7fa509600640 1 -- 172.21.15.76:0/836374574 shutdown_connections 2024-03-28T12:42:48.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.086+0000 7fa509600640 1 --2- 172.21.15.76:0/836374574 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa4f4068040 0x7fa4f406a500 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.086+0000 7fa509600640 1 --2- 172.21.15.76:0/836374574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa514154a90 0x7fa5141fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.086+0000 7fa509600640 1 --2- 172.21.15.76:0/836374574 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa5140d0850 0x7fa5140c91e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.086+0000 7fa509600640 1 --2- 172.21.15.76:0/836374574 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa5140cc560 0x7fa51414ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.086+0000 7fa509600640 1 -- 172.21.15.76:0/836374574 >> 172.21.15.76:0/836374574 conn(0x7fa51406db80 msgr2=0x7fa514151810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:48.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.086+0000 7fa509600640 1 -- 172.21.15.76:0/836374574 shutdown_connections 2024-03-28T12:42:48.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.086+0000 7fa509600640 1 -- 172.21.15.76:0/836374574 wait complete. 2024-03-28T12:42:48.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542165 got 60129542164 for osd.3 2024-03-28T12:42:48.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509461 got 64424509460 for osd.0 2024-03-28T12:42:48.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.218+0000 7f4309600640 1 -- 172.21.15.76:0/1345585234 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4304159140 con 0x7f43040afc10 2024-03-28T12:42:48.229 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.230+0000 7f42faa00640 1 -- 172.21.15.76:0/1345585234 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f42fc05c030 con 0x7f43040afc10 2024-03-28T12:42:48.229 INFO:teuthology.orchestra.run.smithi076.stdout:64424509459 2024-03-28T12:42:48.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.234+0000 7f4309600640 1 -- 172.21.15.76:0/1345585234 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f42e4068010 msgr2=0x7f42e406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.234+0000 7f4309600640 1 --2- 172.21.15.76:0/1345585234 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f42e4068010 0x7f42e406a4d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43040741b0 tx=0x7f42f4001520 comp rx=0 tx=0).stop 2024-03-28T12:42:48.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.234+0000 7f4309600640 1 -- 172.21.15.76:0/1345585234 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f43040afc10 msgr2=0x7f43040ae130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.234+0000 7f4309600640 1 --2- 172.21.15.76:0/1345585234 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f43040afc10 0x7f43040ae130 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f42fc00f7e0 tx=0x7f42fc00fca0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.234+0000 7f4309600640 1 -- 172.21.15.76:0/1345585234 shutdown_connections 2024-03-28T12:42:48.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.234+0000 7f4309600640 1 --2- 172.21.15.76:0/1345585234 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f42e4068010 0x7f42e406a4d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.234+0000 7f4309600640 1 --2- 172.21.15.76:0/1345585234 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f43040afc10 0x7f43040ae130 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.234+0000 7f4309600640 1 --2- 172.21.15.76:0/1345585234 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f43040c79d0 0x7f43040af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.234+0000 7f4309600640 1 --2- 172.21.15.76:0/1345585234 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42e8004810 0x7f43040cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.234+0000 7f4309600640 1 -- 172.21.15.76:0/1345585234 >> 172.21.15.76:0/1345585234 conn(0x7f4304071540 msgr2=0x7f4304159940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:48.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.234+0000 7f4309600640 1 -- 172.21.15.76:0/1345585234 shutdown_connections 2024-03-28T12:42:48.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.234+0000 7f4309600640 1 -- 172.21.15.76:0/1345585234 wait complete. 2024-03-28T12:42:48.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509460 got 64424509459 for osd.6 2024-03-28T12:42:48.274 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.278+0000 7f02d8200640 1 -- 172.21.15.76:0/1362297584 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f02d00b28e0 con 0x7f02d014e940 2024-03-28T12:42:48.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.330+0000 7f02cd600640 1 -- 172.21.15.76:0/1362297584 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f02bc010e20 con 0x7f02d014e940 2024-03-28T12:42:48.329 INFO:teuthology.orchestra.run.smithi076.stdout:64424509460 2024-03-28T12:42:48.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.334+0000 7f02d8200640 1 -- 172.21.15.76:0/1362297584 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f02b0068040 msgr2=0x7f02b006a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.334+0000 7f02d8200640 1 --2- 172.21.15.76:0/1362297584 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f02b0068040 0x7f02b006a500 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f02c40ab000 tx=0x7f02c40019c0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.334+0000 7f02d8200640 1 -- 172.21.15.76:0/1362297584 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f02d014e940 msgr2=0x7f02d00c5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.334+0000 7f02d8200640 1 --2- 172.21.15.76:0/1362297584 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f02d014e940 0x7f02d00c5620 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00b550 tx=0x7f02bc00ba10 comp rx=0 tx=0).stop 2024-03-28T12:42:48.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.334+0000 7f02d8200640 1 -- 172.21.15.76:0/1362297584 shutdown_connections 2024-03-28T12:42:48.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.334+0000 7f02d8200640 1 --2- 172.21.15.76:0/1362297584 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f02b0068040 0x7f02b006a500 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.334+0000 7f02d8200640 1 --2- 172.21.15.76:0/1362297584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f02d00c5b60 0x7f02d01f4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.334+0000 7f02d8200640 1 --2- 172.21.15.76:0/1362297584 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f02d014e940 0x7f02d00c5620 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.334+0000 7f02d8200640 1 --2- 172.21.15.76:0/1362297584 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f02b8003a60 0x7f02d014f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.334+0000 7f02d8200640 1 -- 172.21.15.76:0/1362297584 >> 172.21.15.76:0/1362297584 conn(0x7f02d0071540 msgr2=0x7f02d00b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:48.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.334+0000 7f02d8200640 1 -- 172.21.15.76:0/1362297584 shutdown_connections 2024-03-28T12:42:48.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.334+0000 7f02d8200640 1 -- 172.21.15.76:0/1362297584 wait complete. 2024-03-28T12:42:48.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509460 got 64424509460 for osd.4 2024-03-28T12:42:48.361 DEBUG:teuthology.parallel:result is None 2024-03-28T12:42:48.459 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-28T12:42:48.475 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-28T12:42:48.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.614+0000 7f262aa00640 1 Processor -- start 2024-03-28T12:42:48.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.614+0000 7f262aa00640 1 -- start start 2024-03-28T12:42:48.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.618+0000 7f262aa00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2624154a00 0x7f262415b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.618+0000 7f262aa00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f26240c6100 0x7f26240c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.618+0000 7f262aa00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2624073430 con 0x7f26240c66c0 2024-03-28T12:42:48.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.618+0000 7f262aa00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f26240731e0 con 0x7f26240c6100 2024-03-28T12:42:48.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.618+0000 7f262aa00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f262415e3d0 con 0x7f2624154a00 2024-03-28T12:42:48.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.618+0000 7f262a000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f26240c6100 0x7f26240c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:48.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.618+0000 7f2629600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2624154a00 0x7f262415b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:48.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.618+0000 7f2628c00640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f26240c66c0 0x7f26240726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:50042/0 (socket says 172.21.15.76:50042) 2024-03-28T12:42:48.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.618+0000 7f2628c00640 1 -- 172.21.15.76:0/2178484944 learned_addr learned my addr 172.21.15.76:0/2178484944 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:48.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.626+0000 7f2629600640 1 -- 172.21.15.76:0/2178484944 >> v2:172.21.15.111:3300/0 conn(0x7f26240c6100 msgr2=0x7f26240c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:48.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.626+0000 7f2629600640 1 --2- 172.21.15.76:0/2178484944 >> v2:172.21.15.111:3300/0 conn(0x7f26240c6100 0x7f26240c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.626+0000 7f2629600640 1 -- 172.21.15.76:0/2178484944 >> v1:172.21.15.111:6789/0 conn(0x7f26240c66c0 legacy=0x7f26240726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.626+0000 7f2629600640 1 -- 172.21.15.76:0/2178484944 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f262415dd80 con 0x7f2624154a00 2024-03-28T12:42:48.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.630+0000 7f2629600640 1 --2- 172.21.15.76:0/2178484944 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2624154a00 0x7f262415b1b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f26180097c0 tx=0x7f261801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ee65dbcb08fe584 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:48.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.638+0000 7f2623e00640 1 -- 172.21.15.76:0/2178484944 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26180b0070 con 0x7f2624154a00 2024-03-28T12:42:48.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.638+0000 7f2623e00640 1 -- 172.21.15.76:0/2178484944 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26180ab600 con 0x7f2624154a00 2024-03-28T12:42:48.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.638+0000 7f2623e00640 1 -- 172.21.15.76:0/2178484944 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26180ab9d0 con 0x7f2624154a00 2024-03-28T12:42:48.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.638+0000 7f262aa00640 1 -- 172.21.15.76:0/2178484944 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2624154a00 msgr2=0x7f262415b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.638+0000 7f262aa00640 1 --2- 172.21.15.76:0/2178484944 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2624154a00 0x7f262415b1b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f26180097c0 tx=0x7f261801c3e0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.638+0000 7f262aa00640 1 -- 172.21.15.76:0/2178484944 shutdown_connections 2024-03-28T12:42:48.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.638+0000 7f262aa00640 1 --2- 172.21.15.76:0/2178484944 >> v2:172.21.15.111:3300/0 conn(0x7f26240c6100 0x7f26240c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.638+0000 7f262aa00640 1 --2- 172.21.15.76:0/2178484944 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2624154a00 0x7f262415b1b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.638+0000 7f262aa00640 1 -- 172.21.15.76:0/2178484944 >> 172.21.15.76:0/2178484944 conn(0x7f26240ccd70 msgr2=0x7f2624070190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:48.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.638+0000 7f262aa00640 1 -- 172.21.15.76:0/2178484944 shutdown_connections 2024-03-28T12:42:48.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.638+0000 7f262aa00640 1 -- 172.21.15.76:0/2178484944 wait complete. 2024-03-28T12:42:48.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.642+0000 7f262aa00640 1 Processor -- start 2024-03-28T12:42:48.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.642+0000 7f262aa00640 1 -- start start 2024-03-28T12:42:48.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.642+0000 7f262aa00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26240c6100 0x7f26240cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.642+0000 7f262aa00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f26240c66c0 0x7f262414c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.642+0000 7f262aa00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2624154a00 0x7f26241f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.642+0000 7f262aa00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2624072db0 con 0x7f26240c66c0 2024-03-28T12:42:48.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.642+0000 7f262aa00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f262415ec70 con 0x7f2624154a00 2024-03-28T12:42:48.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.642+0000 7f262aa00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2624072f30 con 0x7f26240c6100 2024-03-28T12:42:48.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.646+0000 7f262a000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2624154a00 0x7f26241f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:48.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.646+0000 7f2628c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f26240c66c0 0x7f262414c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:48.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.646+0000 7f2629600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26240c6100 0x7f26240cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:48.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.646+0000 7f262a000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2624154a00 0x7f26241f6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:58708/0 (socket says 172.21.15.76:58708) 2024-03-28T12:42:48.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.646+0000 7f262a000640 1 -- 172.21.15.76:0/3166501118 learned_addr learned my addr 172.21.15.76:0/3166501118 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:48.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.650+0000 7f262a000640 1 -- 172.21.15.76:0/3166501118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26240c6100 msgr2=0x7f26240cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.650+0000 7f262a000640 1 --2- 172.21.15.76:0/3166501118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26240c6100 0x7f26240cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.650+0000 7f262a000640 1 -- 172.21.15.76:0/3166501118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f26240c66c0 msgr2=0x7f262414c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.650+0000 7f262a000640 1 --2- 172.21.15.76:0/3166501118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f26240c66c0 0x7f262414c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.650+0000 7f262a000640 1 -- 172.21.15.76:0/3166501118 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f262414c1c0 con 0x7f2624154a00 2024-03-28T12:42:48.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.654+0000 7f262a000640 1 --2- 172.21.15.76:0/3166501118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2624154a00 0x7f26241f6b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f261c009d30 tx=0x7f261c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:48.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.654+0000 7f2621600640 1 -- 172.21.15.76:0/3166501118 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c018020 con 0x7f2624154a00 2024-03-28T12:42:48.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.658+0000 7f262aa00640 1 -- 172.21.15.76:0/3166501118 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2624158760 con 0x7f2624154a00 2024-03-28T12:42:48.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.658+0000 7f262aa00640 1 -- 172.21.15.76:0/3166501118 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2624158d20 con 0x7f2624154a00 2024-03-28T12:42:48.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.658+0000 7f262aa00640 1 -- 172.21.15.76:0/3166501118 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2624068df0 con 0x7f2624154a00 2024-03-28T12:42:48.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.658+0000 7f2621600640 1 -- 172.21.15.76:0/3166501118 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f261c014480 con 0x7f2624154a00 2024-03-28T12:42:48.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.658+0000 7f2621600640 1 -- 172.21.15.76:0/3166501118 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c014830 con 0x7f2624154a00 2024-03-28T12:42:48.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.666+0000 7f3bf9c00640 1 Processor -- start 2024-03-28T12:42:48.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.666+0000 7f3bf9c00640 1 -- start start 2024-03-28T12:42:48.665 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.666+0000 7f3bf9c00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f3bf4154a10 0x7f3bf415a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.666+0000 7f3bf9c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3bf40b21e0 0x7f3bf40c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.666+0000 7f3bf9c00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bf40c9820 con 0x7f3bf40b1c90 2024-03-28T12:42:48.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.666+0000 7f3bf9c00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f3bf4154df0 con 0x7f3bf4154a10 2024-03-28T12:42:48.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.666+0000 7f3bf9c00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf406b5a0 con 0x7f3bf40b21e0 2024-03-28T12:42:48.666 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.670+0000 7f3bf9200640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f3bf40b1c90 0x7f3bf406beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:55752/0 (socket says 172.21.15.76:55752) 2024-03-28T12:42:48.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.670+0000 7f3bf9200640 1 -- 172.21.15.76:0/2217779235 learned_addr learned my addr 172.21.15.76:0/2217779235 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:48.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.670+0000 7f3bf3400640 1 --2- 172.21.15.76:0/2217779235 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3bf40b21e0 0x7f3bf40c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:48.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.674+0000 7f3bf2a00640 1 -- 172.21.15.76:0/2217779235 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2704538473 0 0) 0x7f3bec0014a0 con 0x7f3bf40b1c90 2024-03-28T12:42:48.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.674+0000 7f3bf2a00640 1 -- 172.21.15.76:0/2217779235 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bd8003530 con 0x7f3bf40b1c90 2024-03-28T12:42:48.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.674+0000 7f3bf3400640 1 -- 172.21.15.76:0/2217779235 >> v2:172.21.15.111:3300/0 conn(0x7f3bf4154a10 msgr2=0x7f3bf415a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:48.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.674+0000 7f3bf3400640 1 --2- 172.21.15.76:0/2217779235 >> v2:172.21.15.111:3300/0 conn(0x7f3bf4154a10 0x7f3bf415a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.674+0000 7f3bf3400640 1 -- 172.21.15.76:0/2217779235 >> v1:172.21.15.76:6789/0 conn(0x7f3bf40b1c90 legacy=0x7f3bf406beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.674+0000 7f3bf3400640 1 -- 172.21.15.76:0/2217779235 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf40c7d40 con 0x7f3bf40b21e0 2024-03-28T12:42:48.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.678+0000 7f3bf3400640 1 --2- 172.21.15.76:0/2217779235 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3bf40b21e0 0x7f3bf40c92e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3be00097c0 tx=0x7f3be001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b75610b2896ef458 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:48.686 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-28T12:42:48.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.686+0000 7f3bf2a00640 1 -- 172.21.15.76:0/2217779235 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be00a7070 con 0x7f3bf40b21e0 2024-03-28T12:42:48.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.686+0000 7f3bf2a00640 1 -- 172.21.15.76:0/2217779235 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be00b0070 con 0x7f3bf40b21e0 2024-03-28T12:42:48.687 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.686+0000 7f3bf2a00640 1 -- 172.21.15.76:0/2217779235 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be00ab890 con 0x7f3bf40b21e0 2024-03-28T12:42:48.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.690+0000 7f3bf9c00640 1 -- 172.21.15.76:0/2217779235 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3bf40b21e0 msgr2=0x7f3bf40c92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.690+0000 7f3bf9c00640 1 --2- 172.21.15.76:0/2217779235 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3bf40b21e0 0x7f3bf40c92e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3be00097c0 tx=0x7f3be001c470 comp rx=0 tx=0).stop 2024-03-28T12:42:48.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.690+0000 7f3bf9c00640 1 -- 172.21.15.76:0/2217779235 shutdown_connections 2024-03-28T12:42:48.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.690+0000 7f3bf9c00640 1 --2- 172.21.15.76:0/2217779235 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3bf40b21e0 0x7f3bf40c92e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.690+0000 7f3bf9c00640 1 --2- 172.21.15.76:0/2217779235 >> v2:172.21.15.111:3300/0 conn(0x7f3bf4154a10 0x7f3bf415a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.690+0000 7f3bf9c00640 1 -- 172.21.15.76:0/2217779235 >> 172.21.15.76:0/2217779235 conn(0x7f3bf4073520 msgr2=0x7f3bf40ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:48.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.690+0000 7f3bf9c00640 1 -- 172.21.15.76:0/2217779235 shutdown_connections 2024-03-28T12:42:48.688 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.690+0000 7f3bf9c00640 1 -- 172.21.15.76:0/2217779235 wait complete. 2024-03-28T12:42:48.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.690+0000 7f3bf9c00640 1 Processor -- start 2024-03-28T12:42:48.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.690+0000 7f3bf9c00640 1 -- start start 2024-03-28T12:42:48.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.694+0000 7f3bf9c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bf40b1c90 0x7f3bf414ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.694+0000 7f3bf9c00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bf40b21e0 0x7f3bf41f4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.694+0000 7f3bf9c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3bf4154a10 0x7f3bf4146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.694+0000 7f3bf9c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf40cdd30 con 0x7f3bf40b1c90 2024-03-28T12:42:48.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.694+0000 7f3bf9c00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf40c8dc0 con 0x7f3bf40b21e0 2024-03-28T12:42:48.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.694+0000 7f3bf9c00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf40c7900 con 0x7f3bf4154a10 2024-03-28T12:42:48.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.694+0000 7f3bf3e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bf40b1c90 0x7f3bf414ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:48.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.694+0000 7f3bf9200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3bf4154a10 0x7f3bf4146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:48.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.694+0000 7f3bf3e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bf40b1c90 0x7f3bf414ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45602/0 (socket says 172.21.15.76:45602) 2024-03-28T12:42:48.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.694+0000 7f3bf3e00640 1 -- 172.21.15.76:0/2379349107 learned_addr learned my addr 172.21.15.76:0/2379349107 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:48.698 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-28T12:42:48.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.698+0000 7f3bf3e00640 1 -- 172.21.15.76:0/2379349107 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3bf4154a10 msgr2=0x7f3bf4146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.698+0000 7f3bf3e00640 1 --2- 172.21.15.76:0/2379349107 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3bf4154a10 0x7f3bf4146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.702+0000 7f3bf3e00640 1 -- 172.21.15.76:0/2379349107 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bf40b21e0 msgr2=0x7f3bf41f4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.702+0000 7f3bf3e00640 1 --2- 172.21.15.76:0/2379349107 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bf40b21e0 0x7f3bf41f4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.699 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.702+0000 7f3bf3e00640 1 -- 172.21.15.76:0/2379349107 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf41497d0 con 0x7f3bf40b1c90 2024-03-28T12:42:48.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.702+0000 7f3bf3e00640 1 --2- 172.21.15.76:0/2379349107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bf40b1c90 0x7f3bf414ec40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3be400b550 tx=0x7f3be400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:48.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.710+0000 7f3bebe00640 1 -- 172.21.15.76:0/2379349107 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be4014070 con 0x7f3bf40b1c90 2024-03-28T12:42:48.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.710+0000 7f3bf9c00640 1 -- 172.21.15.76:0/2379349107 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf4149ab0 con 0x7f3bf40b1c90 2024-03-28T12:42:48.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.710+0000 7f3bebe00640 1 -- 172.21.15.76:0/2379349107 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be4010890 con 0x7f3bf40b1c90 2024-03-28T12:42:48.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.710+0000 7f3bf9c00640 1 -- 172.21.15.76:0/2379349107 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf414e440 con 0x7f3bf40b1c90 2024-03-28T12:42:48.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.710+0000 7f3bebe00640 1 -- 172.21.15.76:0/2379349107 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be4010c80 con 0x7f3bf40b1c90 2024-03-28T12:42:48.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.714+0000 7f3bf9c00640 1 -- 172.21.15.76:0/2379349107 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bcc0052a0 con 0x7f3bf40b1c90 2024-03-28T12:42:48.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.842+0000 7fe3ca000640 1 Processor -- start 2024-03-28T12:42:48.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.842+0000 7fe3ca000640 1 -- start start 2024-03-28T12:42:48.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.842+0000 7fe3ca000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fe3c40cea30 0x7fe3c4071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.842+0000 7fe3ca000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe3c4072240 0x7fe3c40cab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.842+0000 7fe3ca000640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3c4158680 con 0x7fe3c4152800 2024-03-28T12:42:48.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.842+0000 7fe3ca000640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fe3c4159550 con 0x7fe3c40cea30 2024-03-28T12:42:48.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.842+0000 7fe3ca000640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fe3c40cee60 con 0x7fe3c4072240 2024-03-28T12:42:48.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.866+0000 7f42d1200640 1 Processor -- start 2024-03-28T12:42:48.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.866+0000 7f42d1200640 1 -- start start 2024-03-28T12:42:48.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.866+0000 7f42d1200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42cc071f60 0x7f42cc15b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.866+0000 7f42d1200640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f42cc072340 0x7f42cc0c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.866+0000 7f42d1200640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42cc15b820 con 0x7f42cc0c8ae0 2024-03-28T12:42:48.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.866+0000 7f42d1200640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f42cc0cef50 con 0x7f42cc072340 2024-03-28T12:42:48.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.866+0000 7f42d1200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f42cc06d7f0 con 0x7f42cc071f60 2024-03-28T12:42:48.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.866+0000 7f42c9e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42cc071f60 0x7f42cc15b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:48.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.870+0000 7f42c9e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42cc071f60 0x7f42cc15b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:36408/0 (socket says 172.21.15.76:36408) 2024-03-28T12:42:48.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.870+0000 7f42c9e00640 1 -- 172.21.15.76:0/4184799143 learned_addr learned my addr 172.21.15.76:0/4184799143 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:48.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.874+0000 7f42c9e00640 1 -- 172.21.15.76:0/4184799143 >> v2:172.21.15.111:3300/0 conn(0x7f42cc072340 msgr2=0x7f42cc0c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:48.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.874+0000 7f42c9e00640 1 --2- 172.21.15.76:0/4184799143 >> v2:172.21.15.111:3300/0 conn(0x7f42cc072340 0x7f42cc0c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.874+0000 7f42c9e00640 1 -- 172.21.15.76:0/4184799143 >> v1:172.21.15.76:6789/0 conn(0x7f42cc0c8ae0 legacy=0x7f42cc154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:48.873 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.874+0000 7f42c9e00640 1 -- 172.21.15.76:0/4184799143 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42cc06c750 con 0x7f42cc071f60 2024-03-28T12:42:48.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.882+0000 7f42c9e00640 1 --2- 172.21.15.76:0/4184799143 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42cc071f60 0x7f42cc15b2e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009e50 tx=0x7f42bc01f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86d6a8945252cca2 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:48.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.886+0000 7f42c9400640 1 -- 172.21.15.76:0/4184799143 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0a8bd0 con 0x7f42cc071f60 2024-03-28T12:42:48.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.886+0000 7f42c9400640 1 -- 172.21.15.76:0/4184799143 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42bc0a8d70 con 0x7f42cc071f60 2024-03-28T12:42:48.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.890+0000 7f42c9400640 1 -- 172.21.15.76:0/4184799143 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0b0610 con 0x7f42cc071f60 2024-03-28T12:42:48.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.890+0000 7f42d1200640 1 -- 172.21.15.76:0/4184799143 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42cc071f60 msgr2=0x7f42cc15b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.890+0000 7f42d1200640 1 --2- 172.21.15.76:0/4184799143 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42cc071f60 0x7f42cc15b2e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009e50 tx=0x7f42bc01f000 comp rx=0 tx=0).stop 2024-03-28T12:42:48.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.890+0000 7f42d1200640 1 -- 172.21.15.76:0/4184799143 shutdown_connections 2024-03-28T12:42:48.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.890+0000 7f42d1200640 1 --2- 172.21.15.76:0/4184799143 >> v2:172.21.15.111:3300/0 conn(0x7f42cc072340 0x7f42cc0c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.890+0000 7f42d1200640 1 --2- 172.21.15.76:0/4184799143 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42cc071f60 0x7f42cc15b2e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.890+0000 7f42d1200640 1 -- 172.21.15.76:0/4184799143 >> 172.21.15.76:0/4184799143 conn(0x7f42cc071540 msgr2=0x7f42cc070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:48.887 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.890+0000 7f42d1200640 1 -- 172.21.15.76:0/4184799143 shutdown_connections 2024-03-28T12:42:48.888 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.890+0000 7f42d1200640 1 -- 172.21.15.76:0/4184799143 wait complete. 2024-03-28T12:42:48.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.890+0000 7f42d1200640 1 Processor -- start 2024-03-28T12:42:48.889 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.890+0000 7f42d1200640 1 -- start start 2024-03-28T12:42:48.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.890+0000 7f42d1200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42cc071f60 0x7f42cc0b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.890+0000 7f42d1200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42cc072340 0x7f42cc0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.890+0000 7f42d1200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42cc0c8ae0 0x7f42cc1f2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.890+0000 7f42d1200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc06cff0 con 0x7f42cc072340 2024-03-28T12:42:48.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.890+0000 7f42d1200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc06cd10 con 0x7f42cc0c8ae0 2024-03-28T12:42:48.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.890+0000 7f42d1200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f42cc154b10 con 0x7f42cc071f60 2024-03-28T12:42:48.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.894+0000 7f42c9e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42cc071f60 0x7f42cc0b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:48.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.894+0000 7f42c9e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42cc071f60 0x7f42cc0b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:36420/0 (socket says 172.21.15.76:36420) 2024-03-28T12:42:48.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.894+0000 7f42c9e00640 1 -- 172.21.15.76:0/1504849313 learned_addr learned my addr 172.21.15.76:0/1504849313 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:48.900 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.902+0000 7f42c9e00640 1 -- 172.21.15.76:0/1504849313 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42cc0c8ae0 msgr2=0x7f42cc1f2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.902+0000 7f42c9e00640 1 --2- 172.21.15.76:0/1504849313 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42cc0c8ae0 0x7f42cc1f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.902+0000 7f42c9e00640 1 -- 172.21.15.76:0/1504849313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42cc072340 msgr2=0x7f42cc0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:48.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.902+0000 7f42c9e00640 1 --2- 172.21.15.76:0/1504849313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42cc072340 0x7f42cc0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:48.901 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.902+0000 7f42c9e00640 1 -- 172.21.15.76:0/1504849313 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42cc156140 con 0x7f42cc071f60 2024-03-28T12:42:48.906 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.906+0000 7f42c9e00640 1 --2- 172.21.15.76:0/1504849313 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42cc071f60 0x7f42cc0b06e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f42bc01d6b0 tx=0x7f42bc01bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:48.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.918+0000 7f42c2a00640 1 -- 172.21.15.76:0/1504849313 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0a8bd0 con 0x7f42cc071f60 2024-03-28T12:42:48.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.918+0000 7f42c2a00640 1 -- 172.21.15.76:0/1504849313 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42bc0090d0 con 0x7f42cc071f60 2024-03-28T12:42:48.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.918+0000 7f42c2a00640 1 -- 172.21.15.76:0/1504849313 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc009510 con 0x7f42cc071f60 2024-03-28T12:42:48.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.918+0000 7f42d1200640 1 -- 172.21.15.76:0/1504849313 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42cc156420 con 0x7f42cc071f60 2024-03-28T12:42:48.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.918+0000 7f42d1200640 1 -- 172.21.15.76:0/1504849313 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42cc1f1f70 con 0x7f42cc071f60 2024-03-28T12:42:48.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.918+0000 7f42d1200640 1 -- 172.21.15.76:0/1504849313 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42cc0686e0 con 0x7f42cc071f60 2024-03-28T12:42:48.961 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.962+0000 7f42c2a00640 1 -- 172.21.15.76:0/1504849313 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f42bc0c3020 con 0x7f42cc071f60 2024-03-28T12:42:48.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.966+0000 7f42c2a00640 1 --2- 172.21.15.76:0/1504849313 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f42a8067fc0 0x7f42a806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.966+0000 7f42c1400640 1 --2- 172.21.15.76:0/1504849313 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f42a8067fc0 0x7f42a806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:48.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.966+0000 7f42c1400640 1 --2- 172.21.15.76:0/1504849313 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f42a8067fc0 0x7f42a806a480 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f42cc1f1700 tx=0x7f42b4006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:48.986 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.986+0000 7f2621600640 1 -- 172.21.15.76:0/3166501118 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f261c01b020 con 0x7f2624154a00 2024-03-28T12:42:48.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.990+0000 7f2621600640 1 --2- 172.21.15.76:0/3166501118 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2604067fc0 0x7f260406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:48.987 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.990+0000 7f2629600640 1 --2- 172.21.15.76:0/3166501118 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2604067fc0 0x7f260406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:48.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.990+0000 7f2629600640 1 --2- 172.21.15.76:0/3166501118 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2604067fc0 0x7f260406a480 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f26180ad000 tx=0x7f26180a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:48.993 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:48.994+0000 7f2621600640 1 -- 172.21.15.76:0/3166501118 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f261c055b50 con 0x7f2624154a00 2024-03-28T12:42:49.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.014+0000 7f2621600640 1 -- 172.21.15.76:0/3166501118 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f261c022070 con 0x7f2624154a00 2024-03-28T12:42:49.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.018+0000 7fe3c3e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe3c4072240 0x7fe3c40cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:49.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.018+0000 7fe3c3e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe3c4072240 0x7fe3c40cab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:58726/0 (socket says 172.21.15.76:58726) 2024-03-28T12:42:49.017 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.018+0000 7fe3c3e00640 1 -- 172.21.15.76:0/2301620826 learned_addr learned my addr 172.21.15.76:0/2301620826 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:49.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.022+0000 7fe3c3e00640 1 -- 172.21.15.76:0/2301620826 >> v2:172.21.15.76:3300/0 conn(0x7fe3c40cea30 msgr2=0x7fe3c4071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:49.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.022+0000 7fe3c3e00640 1 --2- 172.21.15.76:0/2301620826 >> v2:172.21.15.76:3300/0 conn(0x7fe3c40cea30 0x7fe3c4071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.022+0000 7fe3c3e00640 1 -- 172.21.15.76:0/2301620826 >> v1:172.21.15.111:6789/0 conn(0x7fe3c4152800 legacy=0x7fe3c40c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:49.021 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.022+0000 7fe3c3e00640 1 -- 172.21.15.76:0/2301620826 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c4158940 con 0x7fe3c4072240 2024-03-28T12:42:49.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.034+0000 7fe3c3e00640 1 --2- 172.21.15.76:0/2301620826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3c4072240 0x7fe3c40cab80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40c5440 tx=0x7fe3bc01c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1e9396485cc6c5b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:49.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.038+0000 7fe3c2000640 1 -- 172.21.15.76:0/2301620826 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0a5870 con 0x7fe3c4072240 2024-03-28T12:42:49.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.038+0000 7fe3c2000640 1 -- 172.21.15.76:0/2301620826 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3bc0a5a10 con 0x7fe3c4072240 2024-03-28T12:42:49.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.038+0000 7fe3c2000640 1 -- 172.21.15.76:0/2301620826 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0a5de0 con 0x7fe3c4072240 2024-03-28T12:42:49.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.038+0000 7fe3ca000640 1 -- 172.21.15.76:0/2301620826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3c4072240 msgr2=0x7fe3c40cab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.038+0000 7fe3ca000640 1 --2- 172.21.15.76:0/2301620826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3c4072240 0x7fe3c40cab80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40c5440 tx=0x7fe3bc01c9b0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.038+0000 7fe3ca000640 1 -- 172.21.15.76:0/2301620826 shutdown_connections 2024-03-28T12:42:49.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.038+0000 7fe3ca000640 1 --2- 172.21.15.76:0/2301620826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3c4072240 0x7fe3c40cab80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.038+0000 7fe3ca000640 1 --2- 172.21.15.76:0/2301620826 >> v2:172.21.15.76:3300/0 conn(0x7fe3c40cea30 0x7fe3c4071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.038+0000 7fe3ca000640 1 -- 172.21.15.76:0/2301620826 >> 172.21.15.76:0/2301620826 conn(0x7fe3c4071540 msgr2=0x7fe3c4070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:49.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.038+0000 7fe3ca000640 1 -- 172.21.15.76:0/2301620826 shutdown_connections 2024-03-28T12:42:49.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.038+0000 7fe3ca000640 1 -- 172.21.15.76:0/2301620826 wait complete. 2024-03-28T12:42:49.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.042+0000 7fe3ca000640 1 Processor -- start 2024-03-28T12:42:49.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.042+0000 7fe3ca000640 1 -- start start 2024-03-28T12:42:49.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.042+0000 7fe3ca000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe3c4072240 0x7fe3c40b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.042+0000 7fe3ca000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3c40cea30 0x7fe3c40c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.042+0000 7fe3ca000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3c4152800 0x7fe3c414a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.042+0000 7fe3ca000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c40c8d00 con 0x7fe3c40cea30 2024-03-28T12:42:49.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.042+0000 7fe3ca000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe3c40cb4d0 con 0x7fe3c4152800 2024-03-28T12:42:49.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.042+0000 7fe3ca000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe3c4152be0 con 0x7fe3c4072240 2024-03-28T12:42:49.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.042+0000 7fe3c3e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3c4152800 0x7fe3c414a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:49.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.042+0000 7fe3c3e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3c4152800 0x7fe3c414a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:58772/0 (socket says 172.21.15.76:58772) 2024-03-28T12:42:49.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.042+0000 7fe3c3e00640 1 -- 172.21.15.76:0/476857336 learned_addr learned my addr 172.21.15.76:0/476857336 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:49.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.050+0000 7fe3c3e00640 1 -- 172.21.15.76:0/476857336 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe3c4072240 msgr2=0x7fe3c40b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.050+0000 7fe3c3e00640 1 --2- 172.21.15.76:0/476857336 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe3c4072240 0x7fe3c40b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.050+0000 7fe3c3e00640 1 -- 172.21.15.76:0/476857336 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3c40cea30 msgr2=0x7fe3c40c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.050+0000 7fe3c3e00640 1 --2- 172.21.15.76:0/476857336 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3c40cea30 0x7fe3c40c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.050+0000 7fe3c3e00640 1 -- 172.21.15.76:0/476857336 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3c41f71a0 con 0x7fe3c4152800 2024-03-28T12:42:49.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.054+0000 7fe3c3e00640 1 --2- 172.21.15.76:0/476857336 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3c4152800 0x7fe3c414a0c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc01a5e0 tx=0x7fe3bc019750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:49.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.058+0000 7fe3bb400640 1 -- 172.21.15.76:0/476857336 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0b8880 con 0x7fe3c4152800 2024-03-28T12:42:49.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.058+0000 7fe3bb400640 1 -- 172.21.15.76:0/476857336 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3bc0be070 con 0x7fe3c4152800 2024-03-28T12:42:49.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.058+0000 7fe3ca000640 1 -- 172.21.15.76:0/476857336 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3c41f7480 con 0x7fe3c4152800 2024-03-28T12:42:49.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.058+0000 7fe3ca000640 1 -- 172.21.15.76:0/476857336 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3c41f7a40 con 0x7fe3c4152800 2024-03-28T12:42:49.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.058+0000 7fe3bb400640 1 -- 172.21.15.76:0/476857336 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc0b8cc0 con 0x7fe3c4152800 2024-03-28T12:42:49.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.058+0000 7fe3ca000640 1 -- 172.21.15.76:0/476857336 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3c40686e0 con 0x7fe3c4152800 2024-03-28T12:42:49.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.086+0000 7f3bebe00640 1 -- 172.21.15.76:0/2379349107 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f3be4017070 con 0x7f3bf40b1c90 2024-03-28T12:42:49.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.090+0000 7f3bebe00640 1 --2- 172.21.15.76:0/2379349107 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3bd4067fc0 0x7f3bd406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.090+0000 7f3bf3400640 1 --2- 172.21.15.76:0/2379349107 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3bd4067fc0 0x7f3bd406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:49.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.090+0000 7f3bf3400640 1 --2- 172.21.15.76:0/2379349107 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3bd4067fc0 0x7f3bd406a480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3be00af000 tx=0x7f3be0004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:49.089 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-28T12:42:49.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.094+0000 7fe3bb400640 1 -- 172.21.15.76:0/476857336 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fe3bc0c3460 con 0x7fe3c4152800 2024-03-28T12:42:49.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.098+0000 7fe3bb400640 1 --2- 172.21.15.76:0/476857336 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe3a4068010 0x7fe3a406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.098+0000 7fe3c3400640 1 --2- 172.21.15.76:0/476857336 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe3a4068010 0x7fe3a406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:49.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.098+0000 7fe3c3400640 1 --2- 172.21.15.76:0/476857336 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe3a4068010 0x7fe3a406a4d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009650 tx=0x7fe3b4006bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:49.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.110+0000 7f3bebe00640 1 -- 172.21.15.76:0/2379349107 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f3be40548c0 con 0x7f3bf40b1c90 2024-03-28T12:42:49.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.110+0000 7f3bebe00640 1 -- 172.21.15.76:0/2379349107 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f3be4056820 con 0x7f3bf40b1c90 2024-03-28T12:42:49.120 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-28T12:42:49.263 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-28T12:42:49.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.290+0000 7f262aa00640 1 -- 172.21.15.76:0/3166501118 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f262415b4d0 con 0x7f2624154a00 2024-03-28T12:42:49.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.302+0000 7f42c2a00640 1 -- 172.21.15.76:0/1504849313 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f42bc0f30d0 con 0x7f42cc071f60 2024-03-28T12:42:49.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.314+0000 7f42c2a00640 1 -- 172.21.15.76:0/1504849313 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f42bc0ca020 con 0x7f42cc071f60 2024-03-28T12:42:49.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.318+0000 7fd289e00640 1 Processor -- start 2024-03-28T12:42:49.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.318+0000 7fd289e00640 1 -- start start 2024-03-28T12:42:49.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.322+0000 7fd289e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd284150510 0x7fd28406dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.322+0000 7fd289e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd284157090 0x7fd284072e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.322+0000 7fd289e00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2840c2360 con 0x7fd2840733b0 2024-03-28T12:42:49.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.322+0000 7fd289e00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fd2841574f0 con 0x7fd284157090 2024-03-28T12:42:49.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.322+0000 7fd289e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd2840c2620 con 0x7fd284150510 2024-03-28T12:42:49.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.326+0000 7fd288a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd284150510 0x7fd28406dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:49.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.326+0000 7fd288a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd284150510 0x7fd28406dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:36428/0 (socket says 172.21.15.76:36428) 2024-03-28T12:42:49.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.326+0000 7fd288a00640 1 -- 172.21.15.76:0/2553667931 learned_addr learned my addr 172.21.15.76:0/2553667931 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:49.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.330+0000 7fd288a00640 1 -- 172.21.15.76:0/2553667931 >> v2:172.21.15.111:3300/0 conn(0x7fd284157090 msgr2=0x7fd284072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:49.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.330+0000 7fd288a00640 1 --2- 172.21.15.76:0/2553667931 >> v2:172.21.15.111:3300/0 conn(0x7fd284157090 0x7fd284072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.330+0000 7fd288a00640 1 -- 172.21.15.76:0/2553667931 >> v1:172.21.15.111:6789/0 conn(0x7fd2840733b0 legacy=0x7fd284072130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:49.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.330+0000 7fd288a00640 1 -- 172.21.15.76:0/2553667931 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2840c2900 con 0x7fd284150510 2024-03-28T12:42:49.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.342+0000 7fd288a00640 1 --2- 172.21.15.76:0/2553667931 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd284150510 0x7fd28406dd40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00d1e0 tx=0x7fd27c021530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d3b17e0104ddc91 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:49.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.346+0000 7fd283400640 1 -- 172.21.15.76:0/2553667931 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c0b8070 con 0x7fd284150510 2024-03-28T12:42:49.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.346+0000 7fd283400640 1 -- 172.21.15.76:0/2553667931 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd27c0b3410 con 0x7fd284150510 2024-03-28T12:42:49.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.346+0000 7fd283400640 1 -- 172.21.15.76:0/2553667931 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c0b3800 con 0x7fd284150510 2024-03-28T12:42:49.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.354+0000 7fd289e00640 1 -- 172.21.15.76:0/2553667931 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd284150510 msgr2=0x7fd28406dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.354+0000 7fd289e00640 1 --2- 172.21.15.76:0/2553667931 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd284150510 0x7fd28406dd40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00d1e0 tx=0x7fd27c021530 comp rx=0 tx=0).stop 2024-03-28T12:42:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.354+0000 7fd289e00640 1 -- 172.21.15.76:0/2553667931 shutdown_connections 2024-03-28T12:42:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.354+0000 7fd289e00640 1 --2- 172.21.15.76:0/2553667931 >> v2:172.21.15.111:3300/0 conn(0x7fd284157090 0x7fd284072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.354+0000 7fd289e00640 1 --2- 172.21.15.76:0/2553667931 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd284150510 0x7fd28406dd40 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00d1e0 tx=0x7fd27c021530 comp rx=0 tx=0).stop 2024-03-28T12:42:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.354+0000 7fd289e00640 1 -- 172.21.15.76:0/2553667931 >> 172.21.15.76:0/2553667931 conn(0x7fd2840cbe80 msgr2=0x7fd2840cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.354+0000 7fd289e00640 1 -- 172.21.15.76:0/2553667931 shutdown_connections 2024-03-28T12:42:49.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.354+0000 7fd289e00640 1 -- 172.21.15.76:0/2553667931 wait complete. 2024-03-28T12:42:49.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.354+0000 7fd289e00640 1 Processor -- start 2024-03-28T12:42:49.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.354+0000 7fd289e00640 1 -- start start 2024-03-28T12:42:49.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.358+0000 7fd289e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2840733b0 0x7fd2840cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.358+0000 7fd289e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd284157090 0x7fd2841f7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.358+0000 7fd289e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2841ead30 0x7fd2841f84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.358+0000 7fd289e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd284156b70 con 0x7fd2841ead30 2024-03-28T12:42:49.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.358+0000 7fd289e00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd284156890 con 0x7fd2840733b0 2024-03-28T12:42:49.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.358+0000 7fd289e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd284156540 con 0x7fd284157090 2024-03-28T12:42:49.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.358+0000 7fd283e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd284157090 0x7fd2841f7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:49.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.358+0000 7fd289400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2841ead30 0x7fd2841f84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:49.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.358+0000 7fd289400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2841ead30 0x7fd2841f84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45646/0 (socket says 172.21.15.76:45646) 2024-03-28T12:42:49.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.358+0000 7fd289400640 1 -- 172.21.15.76:0/962714882 learned_addr learned my addr 172.21.15.76:0/962714882 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:49.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.366+0000 7fd283e00640 1 -- 172.21.15.76:0/962714882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2840733b0 msgr2=0x7fd2840cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.366+0000 7fd283e00640 1 --2- 172.21.15.76:0/962714882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2840733b0 0x7fd2840cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.366+0000 7fd283e00640 1 -- 172.21.15.76:0/962714882 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2841ead30 msgr2=0x7fd2841f84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.366+0000 7fd283e00640 1 --2- 172.21.15.76:0/962714882 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2841ead30 0x7fd2841f84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.366+0000 7fd283e00640 1 -- 172.21.15.76:0/962714882 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2841e9f30 con 0x7fd284157090 2024-03-28T12:42:49.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.366+0000 7fd283e00640 1 --2- 172.21.15.76:0/962714882 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd284157090 0x7fd2841f7f80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd27000b410 tx=0x7fd27000b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:49.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.374+0000 7fd280c00640 1 -- 172.21.15.76:0/962714882 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270015020 con 0x7fd284157090 2024-03-28T12:42:49.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.374+0000 7fd280c00640 1 -- 172.21.15.76:0/962714882 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd270011830 con 0x7fd284157090 2024-03-28T12:42:49.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.374+0000 7fd280c00640 1 -- 172.21.15.76:0/962714882 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270011c20 con 0x7fd284157090 2024-03-28T12:42:49.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.374+0000 7f609ce00640 1 Processor -- start 2024-03-28T12:42:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.374+0000 7fd289e00640 1 -- 172.21.15.76:0/962714882 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2841e9980 con 0x7fd284157090 2024-03-28T12:42:49.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.374+0000 7fd289e00640 1 -- 172.21.15.76:0/962714882 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2840c9f30 con 0x7fd284157090 2024-03-28T12:42:49.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.374+0000 7f609ce00640 1 -- start start 2024-03-28T12:42:49.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.378+0000 7fd27a000640 1 -- 172.21.15.76:0/962714882 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2840ca920 con 0x7fd284157090 2024-03-28T12:42:49.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.378+0000 7f609ce00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f609815f9e0 0x7f60980c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.378+0000 7f609ce00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6098073310 0x7f60980c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.378+0000 7f609ce00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f609815ec60 con 0x7f6098159110 2024-03-28T12:42:49.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.378+0000 7f609ce00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f60980b2240 con 0x7f609815f9e0 2024-03-28T12:42:49.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.378+0000 7f609ce00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f60980c2b30 con 0x7f6098073310 2024-03-28T12:42:49.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.378+0000 7f6095400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f609815f9e0 0x7f60980c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:49.379 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.378+0000 7f6095400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f609815f9e0 0x7f60980c25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45650/0 (socket says 172.21.15.76:45650) 2024-03-28T12:42:49.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.378+0000 7f6095400640 1 -- 172.21.15.76:0/199112671 learned_addr learned my addr 172.21.15.76:0/199112671 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:49.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.382+0000 7f6095400640 1 -- 172.21.15.76:0/199112671 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6098073310 msgr2=0x7f60980c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:49.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.382+0000 7f6095400640 1 --2- 172.21.15.76:0/199112671 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6098073310 0x7f60980c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.382+0000 7f6095400640 1 -- 172.21.15.76:0/199112671 >> v1:172.21.15.111:6789/0 conn(0x7f6098159110 legacy=0x7f6098162250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:49.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.382+0000 7f6095400640 1 -- 172.21.15.76:0/199112671 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60980c2d80 con 0x7f609815f9e0 2024-03-28T12:42:49.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.390+0000 7f6095400640 1 --2- 172.21.15.76:0/199112671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f609815f9e0 0x7f60980c25f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6084009870 tx=0x7f608401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5830363629e612c server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:49.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.394+0000 7f6094a00640 1 -- 172.21.15.76:0/199112671 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60840b5070 con 0x7f609815f9e0 2024-03-28T12:42:49.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.394+0000 7f6094a00640 1 -- 172.21.15.76:0/199112671 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60840a89d0 con 0x7f609815f9e0 2024-03-28T12:42:49.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.394+0000 7f6094a00640 1 -- 172.21.15.76:0/199112671 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60840a8da0 con 0x7f609815f9e0 2024-03-28T12:42:49.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.398+0000 7f609ce00640 1 -- 172.21.15.76:0/199112671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f609815f9e0 msgr2=0x7f60980c25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.398+0000 7f609ce00640 1 --2- 172.21.15.76:0/199112671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f609815f9e0 0x7f60980c25f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6084009870 tx=0x7f608401ed10 comp rx=0 tx=0).stop 2024-03-28T12:42:49.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.398+0000 7f609ce00640 1 -- 172.21.15.76:0/199112671 shutdown_connections 2024-03-28T12:42:49.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.398+0000 7f609ce00640 1 --2- 172.21.15.76:0/199112671 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6098073310 0x7f60980c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.398+0000 7f609ce00640 1 --2- 172.21.15.76:0/199112671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f609815f9e0 0x7f60980c25f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.398+0000 7f609ce00640 1 -- 172.21.15.76:0/199112671 >> 172.21.15.76:0/199112671 conn(0x7f609806fd30 msgr2=0x7f6098070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:49.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.398+0000 7f609ce00640 1 -- 172.21.15.76:0/199112671 shutdown_connections 2024-03-28T12:42:49.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.398+0000 7f609ce00640 1 -- 172.21.15.76:0/199112671 wait complete. 2024-03-28T12:42:49.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.398+0000 7f609ce00640 1 Processor -- start 2024-03-28T12:42:49.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.402+0000 7f609ce00640 1 -- start start 2024-03-28T12:42:49.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.402+0000 7f609ce00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6098073310 0x7f609814c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.402+0000 7f609ce00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6098159110 0x7f6098156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.402+0000 7f609ce00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f609815f9e0 0x7f60980cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.402+0000 7f609ce00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f609815f1e0 con 0x7f6098073310 2024-03-28T12:42:49.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.402+0000 7f609ce00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f609815ef00 con 0x7f609815f9e0 2024-03-28T12:42:49.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.402+0000 7f609ce00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f609815f4c0 con 0x7f6098159110 2024-03-28T12:42:49.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.402+0000 7f6095e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6098073310 0x7f609814c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:49.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.402+0000 7f6095e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6098073310 0x7f609814c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45660/0 (socket says 172.21.15.76:45660) 2024-03-28T12:42:49.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.402+0000 7f6095e00640 1 -- 172.21.15.76:0/4199217801 learned_addr learned my addr 172.21.15.76:0/4199217801 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:49.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.410+0000 7f6095e00640 1 -- 172.21.15.76:0/4199217801 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6098159110 msgr2=0x7f6098156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.410+0000 7f6095e00640 1 --2- 172.21.15.76:0/4199217801 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6098159110 0x7f6098156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.410+0000 7f6095e00640 1 -- 172.21.15.76:0/4199217801 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f609815f9e0 msgr2=0x7f60980cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.410+0000 7f6095e00640 1 --2- 172.21.15.76:0/4199217801 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f609815f9e0 0x7f60980cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.410+0000 7f6095e00640 1 -- 172.21.15.76:0/4199217801 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60980cbb20 con 0x7f6098073310 2024-03-28T12:42:49.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.414+0000 7f6095e00640 1 --2- 172.21.15.76:0/4199217801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6098073310 0x7f609814c0d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f608800c490 tx=0x7f6088001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:49.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.414+0000 7fe3bb400640 1 -- 172.21.15.76:0/476857336 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fe3bc0f0470 con 0x7fe3c4152800 2024-03-28T12:42:49.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.414+0000 7f3bf9c00640 1 -- 172.21.15.76:0/2379349107 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f3bcc005860 con 0x7f3bf40b1c90 2024-03-28T12:42:49.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.418+0000 7f608e000640 1 -- 172.21.15.76:0/4199217801 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088017070 con 0x7f6098073310 2024-03-28T12:42:49.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.418+0000 7f609ce00640 1 -- 172.21.15.76:0/4199217801 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609814c610 con 0x7f6098073310 2024-03-28T12:42:49.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.418+0000 7f609ce00640 1 -- 172.21.15.76:0/4199217801 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60981f8af0 con 0x7f6098073310 2024-03-28T12:42:49.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.418+0000 7f609ce00640 1 -- 172.21.15.76:0/4199217801 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60980686e0 con 0x7f6098073310 2024-03-28T12:42:49.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.418+0000 7fd280c00640 1 -- 172.21.15.76:0/962714882 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fd270018020 con 0x7fd284157090 2024-03-28T12:42:49.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.422+0000 7fd280c00640 1 --2- 172.21.15.76:0/962714882 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd264068010 0x7fd26406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.422+0000 7fd288a00640 1 --2- 172.21.15.76:0/962714882 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd264068010 0x7fd26406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:49.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.422+0000 7fd288a00640 1 --2- 172.21.15.76:0/962714882 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd264068010 0x7fd26406a4d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd28415abd0 tx=0x7fd27c004ac0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:49.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.438+0000 7fe3bb400640 1 -- 172.21.15.76:0/476857336 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fe3bc0165a0 con 0x7fe3c4152800 2024-03-28T12:42:49.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.446+0000 7f2621600640 1 -- 172.21.15.76:0/3166501118 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f261c010040 con 0x7f2624154a00 2024-03-28T12:42:49.444 INFO:teuthology.orchestra.run.smithi076.stdout:64424509459 2024-03-28T12:42:49.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.450+0000 7f262aa00640 1 -- 172.21.15.76:0/3166501118 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2604067fc0 msgr2=0x7f260406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.450+0000 7f262aa00640 1 --2- 172.21.15.76:0/3166501118 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2604067fc0 0x7f260406a480 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f26180ad000 tx=0x7f26180a6000 comp rx=0 tx=0).stop 2024-03-28T12:42:49.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.450+0000 7f262aa00640 1 -- 172.21.15.76:0/3166501118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2624154a00 msgr2=0x7f26241f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.450+0000 7f262aa00640 1 --2- 172.21.15.76:0/3166501118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2624154a00 0x7f26241f6b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f261c009d30 tx=0x7f261c00c490 comp rx=0 tx=0).stop 2024-03-28T12:42:49.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.450+0000 7f262aa00640 1 -- 172.21.15.76:0/3166501118 shutdown_connections 2024-03-28T12:42:49.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.450+0000 7f262aa00640 1 --2- 172.21.15.76:0/3166501118 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2604067fc0 0x7f260406a480 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f26180ad000 tx=0x7f26180a6000 comp rx=0 tx=0).stop 2024-03-28T12:42:49.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.450+0000 7f262aa00640 1 --2- 172.21.15.76:0/3166501118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2624154a00 0x7f26241f6b10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.450+0000 7f262aa00640 1 --2- 172.21.15.76:0/3166501118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f26240c66c0 0x7f262414c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.450+0000 7f262aa00640 1 --2- 172.21.15.76:0/3166501118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f26240c6100 0x7f26240cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.450+0000 7f262aa00640 1 -- 172.21.15.76:0/3166501118 >> 172.21.15.76:0/3166501118 conn(0x7f26240ccd70 msgr2=0x7f2624151c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:49.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.458+0000 7f262aa00640 1 -- 172.21.15.76:0/3166501118 shutdown_connections 2024-03-28T12:42:49.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.458+0000 7f608e000640 1 -- 172.21.15.76:0/4199217801 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6088003600 con 0x7f6098073310 2024-03-28T12:42:49.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.458+0000 7f608e000640 1 -- 172.21.15.76:0/4199217801 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088021060 con 0x7f6098073310 2024-03-28T12:42:49.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.458+0000 7f262aa00640 1 -- 172.21.15.76:0/3166501118 wait complete. 2024-03-28T12:42:49.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.458+0000 7f608e000640 1 -- 172.21.15.76:0/4199217801 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f608801a070 con 0x7f6098073310 2024-03-28T12:42:49.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.462+0000 7f608e000640 1 --2- 172.21.15.76:0/4199217801 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f60780683c0 0x7f607806a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.462+0000 7f6095400640 1 --2- 172.21.15.76:0/4199217801 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f60780683c0 0x7f607806a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:49.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.462+0000 7f6095400640 1 --2- 172.21.15.76:0/4199217801 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f60780683c0 0x7f607806a880 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f60840b2000 tx=0x7f6084004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:49.474 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.478+0000 7f3bebe00640 1 -- 172.21.15.76:0/2379349107 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3be4010e20 con 0x7f3bf40b1c90 2024-03-28T12:42:49.478 INFO:teuthology.orchestra.run.smithi076.stdout:55834574869 2024-03-28T12:42:49.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.490+0000 7f3bf9c00640 1 -- 172.21.15.76:0/2379349107 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3bd4067fc0 msgr2=0x7f3bd406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.490+0000 7f3bf9c00640 1 --2- 172.21.15.76:0/2379349107 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3bd4067fc0 0x7f3bd406a480 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3be00af000 tx=0x7f3be0004740 comp rx=0 tx=0).stop 2024-03-28T12:42:49.489 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.490+0000 7f5b7c600640 1 Processor -- start 2024-03-28T12:42:49.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.490+0000 7f3bf9c00640 1 -- 172.21.15.76:0/2379349107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bf40b1c90 msgr2=0x7f3bf414ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.490+0000 7f3bf9c00640 1 --2- 172.21.15.76:0/2379349107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bf40b1c90 0x7f3bf414ec40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3be400b550 tx=0x7f3be400ba10 comp rx=0 tx=0).stop 2024-03-28T12:42:49.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.490+0000 7f5b7c600640 1 -- start start 2024-03-28T12:42:49.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.494+0000 7f5b7c600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b6c0347a0 0x7f5b6c0dad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.494+0000 7f5b7c600640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b6c04b990 con 0x7f5b6c0db270 2024-03-28T12:42:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.494+0000 7f3bf9c00640 1 -- 172.21.15.76:0/2379349107 shutdown_connections 2024-03-28T12:42:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.494+0000 7f3bf9c00640 1 --2- 172.21.15.76:0/2379349107 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3bd4067fc0 0x7f3bd406a480 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.494+0000 7f3bf9c00640 1 --2- 172.21.15.76:0/2379349107 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3bf4154a10 0x7f3bf4146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.494+0000 7f3bf9c00640 1 --2- 172.21.15.76:0/2379349107 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bf40b21e0 0x7f3bf41f4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.494+0000 7f3bf9c00640 1 --2- 172.21.15.76:0/2379349107 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3bf40b1c90 0x7f3bf414ec40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.494+0000 7f3bf9c00640 1 -- 172.21.15.76:0/2379349107 >> 172.21.15.76:0/2379349107 conn(0x7f3bf4073520 msgr2=0x7f3bf40cc340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.494+0000 7f3bf9c00640 1 -- 172.21.15.76:0/2379349107 shutdown_connections 2024-03-28T12:42:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.494+0000 7f3bf9c00640 1 -- 172.21.15.76:0/2379349107 wait complete. 2024-03-28T12:42:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.494+0000 7f5b7c600640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b6c04bc70 con 0x7f5b6c0d5000 2024-03-28T12:42:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.494+0000 7f5b79c00640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f5b6c0d5000 0x7f5b6c04c2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:50066/0 (socket says 172.21.15.76:50066) 2024-03-28T12:42:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.494+0000 7f5b79c00640 1 -- 172.21.15.76:0/1549796538 learned_addr learned my addr 172.21.15.76:0/1549796538 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:49.495 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.494+0000 7f5b7c600640 1 -- 172.21.15.76:0/1549796538 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5b6c006a50 con 0x7f5b6c0347a0 2024-03-28T12:42:49.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509459 got 64424509459 for osd.2 2024-03-28T12:42:49.496 DEBUG:teuthology.parallel:result is None 2024-03-28T12:42:49.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574868 got 55834574869 for osd.5 2024-03-28T12:42:49.527 DEBUG:teuthology.parallel:result is None 2024-03-28T12:42:49.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.598+0000 7f42d1200640 1 -- 172.21.15.76:0/1504849313 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f42cc1521e0 con 0x7f42cc071f60 2024-03-28T12:42:49.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.610+0000 7f608e000640 1 -- 172.21.15.76:0/4199217801 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f60880052e0 con 0x7f6098073310 2024-03-28T12:42:49.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.650+0000 7fe3ca000640 1 -- 172.21.15.76:0/476857336 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe3c4162de0 con 0x7fe3c4152800 2024-03-28T12:42:49.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.654+0000 7fe3bb400640 1 -- 172.21.15.76:0/476857336 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe3bc0f2ad0 con 0x7fe3c4152800 2024-03-28T12:42:49.652 INFO:teuthology.orchestra.run.smithi076.stdout:64424509459 2024-03-28T12:42:49.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.654+0000 7fe3ca000640 1 -- 172.21.15.76:0/476857336 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe3a4068010 msgr2=0x7fe3a406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.654+0000 7fe3ca000640 1 --2- 172.21.15.76:0/476857336 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe3a4068010 0x7fe3a406a4d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009650 tx=0x7fe3b4006bb0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.654+0000 7fe3ca000640 1 -- 172.21.15.76:0/476857336 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3c4152800 msgr2=0x7fe3c414a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.654+0000 7fe3ca000640 1 --2- 172.21.15.76:0/476857336 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3c4152800 0x7fe3c414a0c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc01a5e0 tx=0x7fe3bc019750 comp rx=0 tx=0).stop 2024-03-28T12:42:49.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.658+0000 7fe3ca000640 1 -- 172.21.15.76:0/476857336 shutdown_connections 2024-03-28T12:42:49.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.658+0000 7fe3ca000640 1 --2- 172.21.15.76:0/476857336 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fe3a4068010 0x7fe3a406a4d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.658+0000 7fe3ca000640 1 --2- 172.21.15.76:0/476857336 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3c4152800 0x7fe3c414a0c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.658+0000 7fe3ca000640 1 --2- 172.21.15.76:0/476857336 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fe3c40cea30 0x7fe3c40c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.658+0000 7fe3ca000640 1 --2- 172.21.15.76:0/476857336 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe3c4072240 0x7fe3c40b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.658+0000 7fe3ca000640 1 -- 172.21.15.76:0/476857336 >> 172.21.15.76:0/476857336 conn(0x7fe3c4071540 msgr2=0x7fe3c40cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:49.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.658+0000 7fe3ca000640 1 -- 172.21.15.76:0/476857336 shutdown_connections 2024-03-28T12:42:49.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.658+0000 7fe3ca000640 1 -- 172.21.15.76:0/476857336 wait complete. 2024-03-28T12:42:49.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509459 got 64424509459 for osd.1 2024-03-28T12:42:49.675 DEBUG:teuthology.parallel:result is None 2024-03-28T12:42:49.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.710+0000 7fd280c00640 1 -- 172.21.15.76:0/962714882 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fd270054a20 con 0x7fd284157090 2024-03-28T12:42:49.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.734+0000 7fd280c00640 1 -- 172.21.15.76:0/962714882 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fd27001f020 con 0x7fd284157090 2024-03-28T12:42:49.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.734+0000 7f42c2a00640 1 -- 172.21.15.76:0/1504849313 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f42cc15b820 con 0x7f42cc071f60 2024-03-28T12:42:49.734 INFO:teuthology.orchestra.run.smithi076.stdout:64424509460 2024-03-28T12:42:49.735 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.738+0000 7f5b79200640 1 --2- 172.21.15.76:0/1549796538 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b6c0347a0 0x7f5b6c0dad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:49.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.738+0000 7f42d1200640 1 -- 172.21.15.76:0/1504849313 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f42a8067fc0 msgr2=0x7f42a806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.738+0000 7f42d1200640 1 --2- 172.21.15.76:0/1504849313 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f42a8067fc0 0x7f42a806a480 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f42cc1f1700 tx=0x7f42b4006ca0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.738+0000 7f42d1200640 1 -- 172.21.15.76:0/1504849313 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42cc071f60 msgr2=0x7f42cc0b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.738+0000 7f42d1200640 1 --2- 172.21.15.76:0/1504849313 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42cc071f60 0x7f42cc0b06e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f42bc01d6b0 tx=0x7f42bc01bda0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.738+0000 7f42d1200640 1 -- 172.21.15.76:0/1504849313 shutdown_connections 2024-03-28T12:42:49.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.738+0000 7f42d1200640 1 --2- 172.21.15.76:0/1504849313 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f42a8067fc0 0x7f42a806a480 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.738+0000 7f42d1200640 1 --2- 172.21.15.76:0/1504849313 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42cc0c8ae0 0x7f42cc1f2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.738+0000 7f42d1200640 1 --2- 172.21.15.76:0/1504849313 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f42cc072340 0x7f42cc0cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.738+0000 7f42d1200640 1 --2- 172.21.15.76:0/1504849313 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42cc071f60 0x7f42cc0b06e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.738+0000 7f42d1200640 1 -- 172.21.15.76:0/1504849313 >> 172.21.15.76:0/1504849313 conn(0x7f42cc071540 msgr2=0x7f42cc153280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:49.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.738+0000 7f42d1200640 1 -- 172.21.15.76:0/1504849313 shutdown_connections 2024-03-28T12:42:49.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.738+0000 7f42d1200640 1 -- 172.21.15.76:0/1504849313 wait complete. 2024-03-28T12:42:49.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.742+0000 7f5b79200640 1 -- 172.21.15.76:0/1549796538 >> v1:172.21.15.111:6789/0 conn(0x7f5b6c0d5000 legacy=0x7f5b6c04c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.742+0000 7f5b79200640 1 -- 172.21.15.76:0/1549796538 >> v1:172.21.15.76:6789/0 conn(0x7f5b6c0db270 legacy=0x7f5b6c0e5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:49.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.742+0000 7f5b79200640 1 -- 172.21.15.76:0/1549796538 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6c006d30 con 0x7f5b6c0347a0 2024-03-28T12:42:49.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.746+0000 7f5b79200640 1 --2- 172.21.15.76:0/1549796538 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b6c0347a0 0x7f5b6c0dad30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b600097f0 tx=0x7f5b6001ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=728b92520839ff71 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:49.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.754+0000 7f5b73e00640 1 -- 172.21.15.76:0/1549796538 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b600b5070 con 0x7f5b6c0347a0 2024-03-28T12:42:49.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.754+0000 7f5b73e00640 1 -- 172.21.15.76:0/1549796538 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b600a8990 con 0x7f5b6c0347a0 2024-03-28T12:42:49.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.754+0000 7f5b73e00640 1 -- 172.21.15.76:0/1549796538 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b600a8d60 con 0x7f5b6c0347a0 2024-03-28T12:42:49.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.754+0000 7f5b7c600640 1 -- 172.21.15.76:0/1549796538 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b6c0347a0 msgr2=0x7f5b6c0dad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.754+0000 7f5b7c600640 1 --2- 172.21.15.76:0/1549796538 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b6c0347a0 0x7f5b6c0dad30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5b600097f0 tx=0x7f5b6001ecb0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.754+0000 7f5b7c600640 1 -- 172.21.15.76:0/1549796538 shutdown_connections 2024-03-28T12:42:49.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.754+0000 7f5b7c600640 1 --2- 172.21.15.76:0/1549796538 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b6c0347a0 0x7f5b6c0dad30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.754+0000 7f5b7c600640 1 -- 172.21.15.76:0/1549796538 >> 172.21.15.76:0/1549796538 conn(0x7f5b6c050190 msgr2=0x7f5b6c0505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:49.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.754+0000 7f5b7c600640 1 -- 172.21.15.76:0/1549796538 shutdown_connections 2024-03-28T12:42:49.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.754+0000 7f5b7c600640 1 -- 172.21.15.76:0/1549796538 wait complete. 2024-03-28T12:42:49.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.758+0000 7f5b7c600640 1 Processor -- start 2024-03-28T12:42:49.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.758+0000 7f5b7c600640 1 -- start start 2024-03-28T12:42:49.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.758+0000 7f5b7c600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b6c0347a0 0x7f5b6c047c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.758+0000 7f5b7c600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b6c0d5000 0x7f5b6c048170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.758+0000 7f5b7c600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b6c0db270 0x7f5b6c048d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.758+0000 7f5b7c600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c0d53e0 con 0x7f5b6c0d5000 2024-03-28T12:42:49.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.758+0000 7f5b7c600640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c045130 con 0x7f5b6c0db270 2024-03-28T12:42:49.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.758+0000 7f5b7c600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5b6c034c10 con 0x7f5b6c0347a0 2024-03-28T12:42:49.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.758+0000 7f5b79c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b6c0347a0 0x7f5b6c047c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:49.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.758+0000 7f5b79c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b6c0347a0 0x7f5b6c047c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:36450/0 (socket says 172.21.15.76:36450) 2024-03-28T12:42:49.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.758+0000 7f5b79c00640 1 -- 172.21.15.76:0/4125372816 learned_addr learned my addr 172.21.15.76:0/4125372816 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:49.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.758+0000 7f5b7a600640 1 --2- 172.21.15.76:0/4125372816 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b6c0db270 0x7f5b6c048d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:49.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.762+0000 7f5b79c00640 1 -- 172.21.15.76:0/4125372816 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b6c0db270 msgr2=0x7f5b6c048d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.762+0000 7f5b79c00640 1 --2- 172.21.15.76:0/4125372816 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b6c0db270 0x7f5b6c048d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.762+0000 7f5b79c00640 1 -- 172.21.15.76:0/4125372816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b6c0d5000 msgr2=0x7f5b6c048170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:49.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.762+0000 7f5b79c00640 1 --2- 172.21.15.76:0/4125372816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b6c0d5000 0x7f5b6c048170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:49.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.762+0000 7f5b79c00640 1 -- 172.21.15.76:0/4125372816 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6c179e10 con 0x7f5b6c0347a0 2024-03-28T12:42:49.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.766+0000 7f5b79c00640 1 --2- 172.21.15.76:0/4125372816 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b6c0347a0 0x7f5b6c047c30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800c450 tx=0x7f5b6800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:49.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509460 got 64424509460 for osd.7 2024-03-28T12:42:49.768 DEBUG:teuthology.parallel:result is None 2024-03-28T12:42:49.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.770+0000 7f5b71600640 1 -- 172.21.15.76:0/4125372816 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b68017070 con 0x7f5b6c0347a0 2024-03-28T12:42:49.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.770+0000 7f5b71600640 1 -- 172.21.15.76:0/4125372816 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b68005cf0 con 0x7f5b6c0347a0 2024-03-28T12:42:49.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.770+0000 7f5b71600640 1 -- 172.21.15.76:0/4125372816 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b68007290 con 0x7f5b6c0347a0 2024-03-28T12:42:49.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.770+0000 7f5b7c600640 1 -- 172.21.15.76:0/4125372816 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b6c17a0d0 con 0x7f5b6c0347a0 2024-03-28T12:42:49.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.770+0000 7f5b7c600640 1 -- 172.21.15.76:0/4125372816 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b6c1701f0 con 0x7f5b6c0347a0 2024-03-28T12:42:49.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.774+0000 7f5b7c600640 1 -- 172.21.15.76:0/4125372816 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b6c032e70 con 0x7f5b6c0347a0 2024-03-28T12:42:49.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.806+0000 7f5b71600640 1 -- 172.21.15.76:0/4125372816 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f5b6801a070 con 0x7f5b6c0347a0 2024-03-28T12:42:49.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.806+0000 7f608e000640 1 -- 172.21.15.76:0/4199217801 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f6088055c10 con 0x7f6098073310 2024-03-28T12:42:49.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.806+0000 7f5b71600640 1 --2- 172.21.15.76:0/4125372816 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5b54068040 0x7f5b5406a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:49.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.810+0000 7f5b79200640 1 --2- 172.21.15.76:0/4125372816 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5b54068040 0x7f5b5406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:49.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.810+0000 7f5b79200640 1 --2- 172.21.15.76:0/4125372816 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5b54068040 0x7f5b5406a500 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5b600b2000 tx=0x7f5b60004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:49.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.810+0000 7f5b71600640 1 -- 172.21.15.76:0/4125372816 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f5b68053e50 con 0x7f5b6c0347a0 2024-03-28T12:42:49.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:49.990+0000 7fd27a000640 1 -- 172.21.15.76:0/962714882 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd2840686e0 con 0x7fd284157090 2024-03-28T12:42:50.001 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.002+0000 7f609ce00640 1 -- 172.21.15.76:0/4199217801 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f609814f940 con 0x7f6098073310 2024-03-28T12:42:50.006 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.010+0000 7f608e000640 1 -- 172.21.15.76:0/4199217801 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6088059f10 con 0x7f6098073310 2024-03-28T12:42:50.007 INFO:teuthology.orchestra.run.smithi076.stdout:64424509461 2024-03-28T12:42:50.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.010+0000 7f609ce00640 1 -- 172.21.15.76:0/4199217801 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f60780683c0 msgr2=0x7f607806a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:50.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.010+0000 7f609ce00640 1 --2- 172.21.15.76:0/4199217801 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f60780683c0 0x7f607806a880 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f60840b2000 tx=0x7f6084004740 comp rx=0 tx=0).stop 2024-03-28T12:42:50.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.010+0000 7f609ce00640 1 -- 172.21.15.76:0/4199217801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6098073310 msgr2=0x7f609814c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:50.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.010+0000 7f609ce00640 1 --2- 172.21.15.76:0/4199217801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6098073310 0x7f609814c0d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f608800c490 tx=0x7f6088001e80 comp rx=0 tx=0).stop 2024-03-28T12:42:50.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.010+0000 7f609ce00640 1 -- 172.21.15.76:0/4199217801 shutdown_connections 2024-03-28T12:42:50.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.010+0000 7f609ce00640 1 --2- 172.21.15.76:0/4199217801 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f60780683c0 0x7f607806a880 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.010+0000 7f609ce00640 1 --2- 172.21.15.76:0/4199217801 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f609815f9e0 0x7f60980cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.010+0000 7f609ce00640 1 --2- 172.21.15.76:0/4199217801 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6098159110 0x7f6098156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.010+0000 7f609ce00640 1 --2- 172.21.15.76:0/4199217801 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6098073310 0x7f609814c0d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.010+0000 7f609ce00640 1 -- 172.21.15.76:0/4199217801 >> 172.21.15.76:0/4199217801 conn(0x7f609806fd30 msgr2=0x7f6098070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:50.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.010+0000 7f609ce00640 1 -- 172.21.15.76:0/4199217801 shutdown_connections 2024-03-28T12:42:50.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.014+0000 7f609ce00640 1 -- 172.21.15.76:0/4199217801 wait complete. 2024-03-28T12:42:50.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509461 got 64424509461 for osd.0 2024-03-28T12:42:50.030 DEBUG:teuthology.parallel:result is None 2024-03-28T12:42:50.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.098+0000 7fd280c00640 1 -- 172.21.15.76:0/962714882 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd270057080 con 0x7fd284157090 2024-03-28T12:42:50.095 INFO:teuthology.orchestra.run.smithi076.stdout:60129542165 2024-03-28T12:42:50.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.098+0000 7fd27a000640 1 -- 172.21.15.76:0/962714882 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd264068010 msgr2=0x7fd26406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:50.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.098+0000 7fd27a000640 1 --2- 172.21.15.76:0/962714882 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd264068010 0x7fd26406a4d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd28415abd0 tx=0x7fd27c004ac0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.098+0000 7fd27a000640 1 -- 172.21.15.76:0/962714882 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd284157090 msgr2=0x7fd2841f7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:50.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.098+0000 7fd27a000640 1 --2- 172.21.15.76:0/962714882 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd284157090 0x7fd2841f7f80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd27000b410 tx=0x7fd27000b810 comp rx=0 tx=0).stop 2024-03-28T12:42:50.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.098+0000 7fd27a000640 1 -- 172.21.15.76:0/962714882 shutdown_connections 2024-03-28T12:42:50.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.098+0000 7fd27a000640 1 --2- 172.21.15.76:0/962714882 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd264068010 0x7fd26406a4d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.098+0000 7fd27a000640 1 --2- 172.21.15.76:0/962714882 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd2841ead30 0x7fd2841f84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.098+0000 7fd27a000640 1 --2- 172.21.15.76:0/962714882 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd284157090 0x7fd2841f7f80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.098+0000 7fd27a000640 1 --2- 172.21.15.76:0/962714882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2840733b0 0x7fd2840cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.098+0000 7fd27a000640 1 -- 172.21.15.76:0/962714882 >> 172.21.15.76:0/962714882 conn(0x7fd2840cbe80 msgr2=0x7fd284154200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:50.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.098+0000 7fd27a000640 1 -- 172.21.15.76:0/962714882 shutdown_connections 2024-03-28T12:42:50.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.098+0000 7fd27a000640 1 -- 172.21.15.76:0/962714882 wait complete. 2024-03-28T12:42:50.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542165 got 60129542165 for osd.3 2024-03-28T12:42:50.116 DEBUG:teuthology.parallel:result is None 2024-03-28T12:42:50.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.138+0000 7f5b71600640 1 -- 172.21.15.76:0/4125372816 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f5b68021020 con 0x7f5b6c0347a0 2024-03-28T12:42:50.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.306+0000 7f5b7c600640 1 -- 172.21.15.76:0/4125372816 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5b6c04c0c0 con 0x7f5b6c0347a0 2024-03-28T12:42:50.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.322+0000 7f5b71600640 1 -- 172.21.15.76:0/4125372816 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5b68055db0 con 0x7f5b6c0347a0 2024-03-28T12:42:50.322 INFO:teuthology.orchestra.run.smithi076.stdout:64424509460 2024-03-28T12:42:50.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.326+0000 7f5b7c600640 1 -- 172.21.15.76:0/4125372816 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5b54068040 msgr2=0x7f5b5406a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:50.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.326+0000 7f5b7c600640 1 --2- 172.21.15.76:0/4125372816 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5b54068040 0x7f5b5406a500 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5b600b2000 tx=0x7f5b60004740 comp rx=0 tx=0).stop 2024-03-28T12:42:50.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.326+0000 7f5b7c600640 1 -- 172.21.15.76:0/4125372816 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b6c0347a0 msgr2=0x7f5b6c047c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:50.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.326+0000 7f5b7c600640 1 --2- 172.21.15.76:0/4125372816 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b6c0347a0 0x7f5b6c047c30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800c450 tx=0x7f5b6800c910 comp rx=0 tx=0).stop 2024-03-28T12:42:50.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.326+0000 7f5b7c600640 1 -- 172.21.15.76:0/4125372816 shutdown_connections 2024-03-28T12:42:50.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.326+0000 7f5b7c600640 1 --2- 172.21.15.76:0/4125372816 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5b54068040 0x7f5b5406a500 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.326+0000 7f5b7c600640 1 --2- 172.21.15.76:0/4125372816 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5b6c0db270 0x7f5b6c048d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.326+0000 7f5b7c600640 1 --2- 172.21.15.76:0/4125372816 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5b6c0d5000 0x7f5b6c048170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.326+0000 7f5b7c600640 1 --2- 172.21.15.76:0/4125372816 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5b6c0347a0 0x7f5b6c047c30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.326+0000 7f5b7c600640 1 -- 172.21.15.76:0/4125372816 >> 172.21.15.76:0/4125372816 conn(0x7f5b6c050190 msgr2=0x7f5b6c04cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:50.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.326+0000 7f5b7c600640 1 -- 172.21.15.76:0/4125372816 shutdown_connections 2024-03-28T12:42:50.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.326+0000 7f5b7c600640 1 -- 172.21.15.76:0/4125372816 wait complete. 2024-03-28T12:42:50.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509460 got 64424509460 for osd.6 2024-03-28T12:42:50.344 DEBUG:teuthology.parallel:result is None 2024-03-28T12:42:50.344 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-28T12:42:50.345 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T12:42:50.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.530+0000 7f6c83000640 1 Processor -- start 2024-03-28T12:42:50.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.530+0000 7f6c83000640 1 -- start start 2024-03-28T12:42:50.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.530+0000 7f6c83000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6c7c152ad0 0x7f6c7c0c3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:50.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.530+0000 7f6c83000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f6c7c0ca1f0 0x7f6c7c0c3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:50.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.530+0000 7f6c83000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c7c0ce080 0x7f6c7c0ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:50.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.530+0000 7f6c83000640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f6c7c158680 con 0x7f6c7c0ca1f0 2024-03-28T12:42:50.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.530+0000 7f6c83000640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f6c7c1594e0 con 0x7f6c7c152ad0 2024-03-28T12:42:50.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.530+0000 7f6c83000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7c0ce9d0 con 0x7f6c7c0ce080 2024-03-28T12:42:50.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.534+0000 7f6c73400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f6c7c0ca1f0 0x7f6c7c0c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:50.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.534+0000 7f6c73400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f6c7c0ca1f0 0x7f6c7c0c3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45682/0 (socket says 172.21.15.76:45682) 2024-03-28T12:42:50.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.534+0000 7f6c73400640 1 -- 172.21.15.76:0/2735288834 learned_addr learned my addr 172.21.15.76:0/2735288834 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:50.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.534+0000 7f6c7be00640 1 --2- 172.21.15.76:0/2735288834 >> v2:172.21.15.111:3300/0 conn(0x7f6c7c152ad0 0x7f6c7c0c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:50.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.534+0000 7f6c81000640 1 --2- 172.21.15.76:0/2735288834 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c7c0ce080 0x7f6c7c0ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:50.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.534+0000 7f6c73400640 1 -- 172.21.15.76:0/2735288834 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c7c0ce080 msgr2=0x7f6c7c0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:50.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.534+0000 7f6c73400640 1 --2- 172.21.15.76:0/2735288834 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c7c0ce080 0x7f6c7c0ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.534+0000 7f6c73400640 1 -- 172.21.15.76:0/2735288834 >> v2:172.21.15.111:3300/0 conn(0x7f6c7c152ad0 msgr2=0x7f6c7c0c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:50.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.534+0000 7f6c73400640 1 --2- 172.21.15.76:0/2735288834 >> v2:172.21.15.111:3300/0 conn(0x7f6c7c152ad0 0x7f6c7c0c3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.534+0000 7f6c73400640 1 -- 172.21.15.76:0/2735288834 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7c1588d0 con 0x7f6c7c0ca1f0 2024-03-28T12:42:50.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.538+0000 7f6c73400640 1 --2- 172.21.15.76:0/2735288834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c7c0ca1f0 0x7f6c7c0c3670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c159660 tx=0x7f6c6401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3fc02517c0b25de server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:50.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.542+0000 7f6c7b400640 1 -- 172.21.15.76:0/2735288834 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c640b5070 con 0x7f6c7c0ca1f0 2024-03-28T12:42:50.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.542+0000 7f6c7b400640 1 -- 172.21.15.76:0/2735288834 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c640a89d0 con 0x7f6c7c0ca1f0 2024-03-28T12:42:50.541 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.542+0000 7f6c7b400640 1 -- 172.21.15.76:0/2735288834 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c640a8da0 con 0x7f6c7c0ca1f0 2024-03-28T12:42:50.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.546+0000 7f6c83000640 1 -- 172.21.15.76:0/2735288834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c7c0ca1f0 msgr2=0x7f6c7c0c3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:50.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.546+0000 7f6c83000640 1 --2- 172.21.15.76:0/2735288834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c7c0ca1f0 0x7f6c7c0c3670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c159660 tx=0x7f6c6401ed10 comp rx=0 tx=0).stop 2024-03-28T12:42:50.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.546+0000 7f6c83000640 1 -- 172.21.15.76:0/2735288834 shutdown_connections 2024-03-28T12:42:50.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.546+0000 7f6c83000640 1 --2- 172.21.15.76:0/2735288834 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c7c0ce080 0x7f6c7c0ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.546+0000 7f6c83000640 1 --2- 172.21.15.76:0/2735288834 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c7c0ca1f0 0x7f6c7c0c3670 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.546+0000 7f6c83000640 1 --2- 172.21.15.76:0/2735288834 >> v2:172.21.15.111:3300/0 conn(0x7f6c7c152ad0 0x7f6c7c0c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.546+0000 7f6c83000640 1 -- 172.21.15.76:0/2735288834 >> 172.21.15.76:0/2735288834 conn(0x7f6c7c067330 msgr2=0x7f6c7c067740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:50.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.546+0000 7f6c83000640 1 -- 172.21.15.76:0/2735288834 shutdown_connections 2024-03-28T12:42:50.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.546+0000 7f6c83000640 1 -- 172.21.15.76:0/2735288834 wait complete. 2024-03-28T12:42:50.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.546+0000 7f6c83000640 1 Processor -- start 2024-03-28T12:42:50.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.546+0000 7f6c83000640 1 -- start start 2024-03-28T12:42:50.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.546+0000 7f6c83000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c7c0ca1f0 0x7f6c7c15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:50.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.546+0000 7f6c83000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c7c0ce080 0x7f6c7c156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:50.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.546+0000 7f6c83000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c7c152ad0 0x7f6c7c1e4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:50.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.546+0000 7f6c83000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c159170 con 0x7f6c7c152ad0 2024-03-28T12:42:50.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.546+0000 7f6c83000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7c158e90 con 0x7f6c7c0ca1f0 2024-03-28T12:42:50.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.546+0000 7f6c83000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6c7c15be20 con 0x7f6c7c0ce080 2024-03-28T12:42:50.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.550+0000 7f6c7be00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c7c0ca1f0 0x7f6c7c15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:50.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.550+0000 7f6c81000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c7c152ad0 0x7f6c7c1e4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:50.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.550+0000 7f6c81000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c7c152ad0 0x7f6c7c1e4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45690/0 (socket says 172.21.15.76:45690) 2024-03-28T12:42:50.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.550+0000 7f6c81000640 1 -- 172.21.15.76:0/809530306 learned_addr learned my addr 172.21.15.76:0/809530306 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:50.547 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.550+0000 7f6c73400640 1 --2- 172.21.15.76:0/809530306 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c7c0ce080 0x7f6c7c156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:50.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.554+0000 7f6c81000640 1 -- 172.21.15.76:0/809530306 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c7c0ce080 msgr2=0x7f6c7c156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:50.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.554+0000 7f6c81000640 1 --2- 172.21.15.76:0/809530306 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c7c0ce080 0x7f6c7c156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.554+0000 7f6c81000640 1 -- 172.21.15.76:0/809530306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c7c0ca1f0 msgr2=0x7f6c7c15ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:50.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.554+0000 7f6c81000640 1 --2- 172.21.15.76:0/809530306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c7c0ca1f0 0x7f6c7c15ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:50.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.554+0000 7f6c81000640 1 -- 172.21.15.76:0/809530306 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7c147b50 con 0x7f6c7c152ad0 2024-03-28T12:42:50.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.554+0000 7f6c81000640 1 --2- 172.21.15.76:0/809530306 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c7c152ad0 0x7f6c7c1e4d10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6c74007d10 tx=0x7f6c7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:50.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.558+0000 7f6c78c00640 1 -- 172.21.15.76:0/809530306 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c74014420 con 0x7f6c7c152ad0 2024-03-28T12:42:50.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.558+0000 7f6c78c00640 1 -- 172.21.15.76:0/809530306 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c74019070 con 0x7f6c7c152ad0 2024-03-28T12:42:50.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.558+0000 7f6c83000640 1 -- 172.21.15.76:0/809530306 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7c15ba20 con 0x7f6c7c152ad0 2024-03-28T12:42:50.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.558+0000 7f6c78c00640 1 -- 172.21.15.76:0/809530306 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c74014820 con 0x7f6c7c152ad0 2024-03-28T12:42:50.557 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.558+0000 7f6c83000640 1 -- 172.21.15.76:0/809530306 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c7c0cc450 con 0x7f6c7c152ad0 2024-03-28T12:42:50.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.558+0000 7f6c83000640 1 -- 172.21.15.76:0/809530306 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c7c0686e0 con 0x7f6c7c152ad0 2024-03-28T12:42:50.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.578+0000 7f6c78c00640 1 -- 172.21.15.76:0/809530306 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f6c740149c0 con 0x7f6c7c152ad0 2024-03-28T12:42:50.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.578+0000 7f6c78c00640 1 --2- 172.21.15.76:0/809530306 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6c58068010 0x7f6c5806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:50.578 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.582+0000 7f6c7be00640 1 --2- 172.21.15.76:0/809530306 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6c58068010 0x7f6c5806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:50.579 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.582+0000 7f6c7be00640 1 --2- 172.21.15.76:0/809530306 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6c58068010 0x7f6c5806a4d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009ac0 tx=0x7f6c6c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:50.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.582+0000 7f6c78c00640 1 -- 172.21.15.76:0/809530306 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f6c74055870 con 0x7f6c7c152ad0 2024-03-28T12:42:50.957 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:50.958+0000 7f6c78c00640 1 -- 172.21.15.76:0/809530306 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f6c740577d0 con 0x7f6c7c152ad0 2024-03-28T12:42:51.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.234+0000 7f6c83000640 1 -- 172.21.15.76:0/809530306 --> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c7c14cb60 con 0x7f6c58068010 2024-03-28T12:42:51.242 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.242+0000 7f6c78c00640 1 -- 172.21.15.76:0/809530306 <== mgr.4107 v2:172.21.15.76:6800/1313648511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332787 (secure 0 0 0) 0x7f6c7c14cb60 con 0x7f6c58068010 2024-03-28T12:42:51.246 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:51.248 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-03-28T12:42:51.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.250+0000 7f6c83000640 1 -- 172.21.15.76:0/809530306 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6c58068010 msgr2=0x7f6c5806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:51.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.250+0000 7f6c83000640 1 --2- 172.21.15.76:0/809530306 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6c58068010 0x7f6c5806a4d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009ac0 tx=0x7f6c6c009190 comp rx=0 tx=0).stop 2024-03-28T12:42:51.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.250+0000 7f6c83000640 1 -- 172.21.15.76:0/809530306 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c7c152ad0 msgr2=0x7f6c7c1e4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:51.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.250+0000 7f6c83000640 1 --2- 172.21.15.76:0/809530306 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c7c152ad0 0x7f6c7c1e4d10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6c74007d10 tx=0x7f6c7400e4b0 comp rx=0 tx=0).stop 2024-03-28T12:42:51.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.250+0000 7f6c83000640 1 -- 172.21.15.76:0/809530306 shutdown_connections 2024-03-28T12:42:51.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.250+0000 7f6c83000640 1 --2- 172.21.15.76:0/809530306 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6c58068010 0x7f6c5806a4d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:51.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.250+0000 7f6c83000640 1 --2- 172.21.15.76:0/809530306 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6c7c152ad0 0x7f6c7c1e4d10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:51.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.250+0000 7f6c83000640 1 --2- 172.21.15.76:0/809530306 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c7c0ce080 0x7f6c7c156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:51.249 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.250+0000 7f6c83000640 1 --2- 172.21.15.76:0/809530306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c7c0ca1f0 0x7f6c7c15ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:51.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.250+0000 7f6c83000640 1 -- 172.21.15.76:0/809530306 >> 172.21.15.76:0/809530306 conn(0x7f6c7c067330 msgr2=0x7f6c7c0c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:51.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.250+0000 7f6c83000640 1 -- 172.21.15.76:0/809530306 shutdown_connections 2024-03-28T12:42:51.250 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.250+0000 7f6c83000640 1 -- 172.21.15.76:0/809530306 wait complete. 2024-03-28T12:42:51.270 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-03-28T12:42:51.017669+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600632,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":373,"num_write_kb":2484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218912,"kb_used_data":2784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755808,"statfs":{"total":773094113280,"available":772869947392,"internally_reserved":0,"allocated":2850816,"data_stored":2212424,"data_compressed":66494,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5624,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003234"},"pg_stats":[{"pgid":"2.1f","version":"29'13","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.199293+0000","last_change":"2024-03-28T12:42:00.080769+0000","last_active":"2024-03-28T12:42:46.199293+0000","last_peered":"2024-03-28T12:42:46.199293+0000","last_clean":"2024-03-28T12:42:46.199293+0000","last_became_active":"2024-03-28T12:42:00.079900+0000","last_became_peered":"2024-03-28T12:42:00.079900+0000","last_unstale":"2024-03-28T12:42:46.199293+0000","last_undegraded":"2024-03-28T12:42:46.199293+0000","last_fullsized":"2024-03-28T12:42:46.199293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:26.156056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229988+0000","last_change":"2024-03-28T12:42:01.960244+0000","last_active":"2024-03-28T12:42:15.229988+0000","last_peered":"2024-03-28T12:42:15.229988+0000","last_clean":"2024-03-28T12:42:15.229988+0000","last_became_active":"2024-03-28T12:42:01.959408+0000","last_became_peered":"2024-03-28T12:42:01.959408+0000","last_unstale":"2024-03-28T12:42:15.229988+0000","last_undegraded":"2024-03-28T12:42:15.229988+0000","last_fullsized":"2024-03-28T12:42:15.229988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:00:51.741925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.218968+0000","last_change":"2024-03-28T12:42:07.880943+0000","last_active":"2024-03-28T12:42:15.218968+0000","last_peered":"2024-03-28T12:42:15.218968+0000","last_clean":"2024-03-28T12:42:15.218968+0000","last_became_active":"2024-03-28T12:42:07.880354+0000","last_became_peered":"2024-03-28T12:42:07.880354+0000","last_unstale":"2024-03-28T12:42:15.218968+0000","last_undegraded":"2024-03-28T12:42:15.218968+0000","last_fullsized":"2024-03-28T12:42:15.218968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:39.078379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.230194+0000","last_change":"2024-03-28T12:42:00.138569+0000","last_active":"2024-03-28T12:42:15.230194+0000","last_peered":"2024-03-28T12:42:15.230194+0000","last_clean":"2024-03-28T12:42:15.230194+0000","last_became_active":"2024-03-28T12:42:00.137978+0000","last_became_peered":"2024-03-28T12:42:00.137978+0000","last_unstale":"2024-03-28T12:42:15.230194+0000","last_undegraded":"2024-03-28T12:42:15.230194+0000","last_fullsized":"2024-03-28T12:42:15.230194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:38:28.575778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.232451+0000","last_change":"2024-03-28T12:42:01.958236+0000","last_active":"2024-03-28T12:42:15.232451+0000","last_peered":"2024-03-28T12:42:15.232451+0000","last_clean":"2024-03-28T12:42:15.232451+0000","last_became_active":"2024-03-28T12:42:01.957875+0000","last_became_peered":"2024-03-28T12:42:01.957875+0000","last_unstale":"2024-03-28T12:42:15.232451+0000","last_undegraded":"2024-03-28T12:42:15.232451+0000","last_fullsized":"2024-03-28T12:42:15.232451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:48:52.933175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.214830+0000","last_change":"2024-03-28T12:42:07.905799+0000","last_active":"2024-03-28T12:42:15.214830+0000","last_peered":"2024-03-28T12:42:15.214830+0000","last_clean":"2024-03-28T12:42:15.214830+0000","last_became_active":"2024-03-28T12:42:07.905350+0000","last_became_peered":"2024-03-28T12:42:07.905350+0000","last_unstale":"2024-03-28T12:42:15.214830+0000","last_undegraded":"2024-03-28T12:42:15.214830+0000","last_fullsized":"2024-03-28T12:42:15.214830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:33:42.281079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'12","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.210357+0000","last_change":"2024-03-28T12:42:00.150272+0000","last_active":"2024-03-28T12:42:46.210357+0000","last_peered":"2024-03-28T12:42:46.210357+0000","last_clean":"2024-03-28T12:42:46.210357+0000","last_became_active":"2024-03-28T12:42:00.148367+0000","last_became_peered":"2024-03-28T12:42:00.148367+0000","last_unstale":"2024-03-28T12:42:46.210357+0000","last_undegraded":"2024-03-28T12:42:46.210357+0000","last_fullsized":"2024-03-28T12:42:46.210357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:26.156056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352641+0000","last_change":"2024-03-28T12:42:01.965158+0000","last_active":"2024-03-28T12:42:15.352641+0000","last_peered":"2024-03-28T12:42:15.352641+0000","last_clean":"2024-03-28T12:42:15.352641+0000","last_became_active":"2024-03-28T12:42:01.964817+0000","last_became_peered":"2024-03-28T12:42:01.964817+0000","last_unstale":"2024-03-28T12:42:15.352641+0000","last_undegraded":"2024-03-28T12:42:15.352641+0000","last_fullsized":"2024-03-28T12:42:15.352641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215063+0000","last_change":"2024-03-28T12:42:07.906794+0000","last_active":"2024-03-28T12:42:15.215063+0000","last_peered":"2024-03-28T12:42:15.215063+0000","last_clean":"2024-03-28T12:42:15.215063+0000","last_became_active":"2024-03-28T12:42:07.905522+0000","last_became_peered":"2024-03-28T12:42:07.905522+0000","last_unstale":"2024-03-28T12:42:15.215063+0000","last_undegraded":"2024-03-28T12:42:15.215063+0000","last_fullsized":"2024-03-28T12:42:15.215063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:21.970094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.210247+0000","last_change":"2024-03-28T12:42:00.149947+0000","last_active":"2024-03-28T12:42:46.210247+0000","last_peered":"2024-03-28T12:42:46.210247+0000","last_clean":"2024-03-28T12:42:46.210247+0000","last_became_active":"2024-03-28T12:42:00.148446+0000","last_became_peered":"2024-03-28T12:42:00.148446+0000","last_unstale":"2024-03-28T12:42:46.210247+0000","last_undegraded":"2024-03-28T12:42:46.210247+0000","last_fullsized":"2024-03-28T12:42:46.210247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:47:28.765823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228727+0000","last_change":"2024-03-28T12:42:01.935596+0000","last_active":"2024-03-28T12:42:15.228727+0000","last_peered":"2024-03-28T12:42:15.228727+0000","last_clean":"2024-03-28T12:42:15.228727+0000","last_became_active":"2024-03-28T12:42:01.935231+0000","last_became_peered":"2024-03-28T12:42:01.935231+0000","last_unstale":"2024-03-28T12:42:15.228727+0000","last_undegraded":"2024-03-28T12:42:15.228727+0000","last_fullsized":"2024-03-28T12:42:15.228727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:17:41.296627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215002+0000","last_change":"2024-03-28T12:42:07.904616+0000","last_active":"2024-03-28T12:42:15.215002+0000","last_peered":"2024-03-28T12:42:15.215002+0000","last_clean":"2024-03-28T12:42:15.215002+0000","last_became_active":"2024-03-28T12:42:07.904240+0000","last_became_peered":"2024-03-28T12:42:07.904240+0000","last_unstale":"2024-03-28T12:42:15.215002+0000","last_undegraded":"2024-03-28T12:42:15.215002+0000","last_fullsized":"2024-03-28T12:42:15.215002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:19:27.175393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228168+0000","last_change":"2024-03-28T12:42:01.963116+0000","last_active":"2024-03-28T12:42:15.228168+0000","last_peered":"2024-03-28T12:42:15.228168+0000","last_clean":"2024-03-28T12:42:15.228168+0000","last_became_active":"2024-03-28T12:42:01.962885+0000","last_became_peered":"2024-03-28T12:42:01.962885+0000","last_unstale":"2024-03-28T12:42:15.228168+0000","last_undegraded":"2024-03-28T12:42:15.228168+0000","last_fullsized":"2024-03-28T12:42:15.228168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:19:06.640780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.461605+0000","last_change":"2024-03-28T12:42:00.134353+0000","last_active":"2024-03-28T12:42:38.461605+0000","last_peered":"2024-03-28T12:42:38.461605+0000","last_clean":"2024-03-28T12:42:38.461605+0000","last_became_active":"2024-03-28T12:42:00.133880+0000","last_became_peered":"2024-03-28T12:42:00.133880+0000","last_unstale":"2024-03-28T12:42:38.461605+0000","last_undegraded":"2024-03-28T12:42:38.461605+0000","last_fullsized":"2024-03-28T12:42:38.461605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:45:14.194934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.238142+0000","last_change":"2024-03-28T12:42:15.238142+0000","last_active":"2024-03-28T12:42:15.238142+0000","last_peered":"2024-03-28T12:42:15.238142+0000","last_clean":"2024-03-28T12:42:15.238142+0000","last_became_active":"2024-03-28T12:42:15.237739+0000","last_became_peered":"2024-03-28T12:42:15.237739+0000","last_unstale":"2024-03-28T12:42:15.238142+0000","last_undegraded":"2024-03-28T12:42:15.238142+0000","last_fullsized":"2024-03-28T12:42:15.238142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:41:14.243482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.221374+0000","last_change":"2024-03-28T12:42:01.948688+0000","last_active":"2024-03-28T12:42:15.221374+0000","last_peered":"2024-03-28T12:42:15.221374+0000","last_clean":"2024-03-28T12:42:15.221374+0000","last_became_active":"2024-03-28T12:42:01.948049+0000","last_became_peered":"2024-03-28T12:42:01.948049+0000","last_unstale":"2024-03-28T12:42:15.221374+0000","last_undegraded":"2024-03-28T12:42:15.221374+0000","last_fullsized":"2024-03-28T12:42:15.221374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.990094+0000","last_change":"2024-03-28T12:42:00.139208+0000","last_active":"2024-03-28T12:42:43.990094+0000","last_peered":"2024-03-28T12:42:43.990094+0000","last_clean":"2024-03-28T12:42:43.990094+0000","last_became_active":"2024-03-28T12:42:00.138264+0000","last_became_peered":"2024-03-28T12:42:00.138264+0000","last_unstale":"2024-03-28T12:42:43.990094+0000","last_undegraded":"2024-03-28T12:42:43.990094+0000","last_fullsized":"2024-03-28T12:42:43.990094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359578+0000","last_change":"2024-03-28T12:42:07.941636+0000","last_active":"2024-03-28T12:42:15.359578+0000","last_peered":"2024-03-28T12:42:15.359578+0000","last_clean":"2024-03-28T12:42:15.359578+0000","last_became_active":"2024-03-28T12:42:07.941114+0000","last_became_peered":"2024-03-28T12:42:07.941114+0000","last_unstale":"2024-03-28T12:42:15.359578+0000","last_undegraded":"2024-03-28T12:42:15.359578+0000","last_fullsized":"2024-03-28T12:42:15.359578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:00:58.736580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216501+0000","last_change":"2024-03-28T12:42:01.949545+0000","last_active":"2024-03-28T12:42:15.216501+0000","last_peered":"2024-03-28T12:42:15.216501+0000","last_clean":"2024-03-28T12:42:15.216501+0000","last_became_active":"2024-03-28T12:42:01.946576+0000","last_became_peered":"2024-03-28T12:42:01.946576+0000","last_unstale":"2024-03-28T12:42:15.216501+0000","last_undegraded":"2024-03-28T12:42:15.216501+0000","last_fullsized":"2024-03-28T12:42:15.216501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:32.704186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.187397+0000","last_change":"2024-03-28T12:42:00.142804+0000","last_active":"2024-03-28T12:42:46.187397+0000","last_peered":"2024-03-28T12:42:46.187397+0000","last_clean":"2024-03-28T12:42:46.187397+0000","last_became_active":"2024-03-28T12:42:00.142063+0000","last_became_peered":"2024-03-28T12:42:00.142063+0000","last_unstale":"2024-03-28T12:42:46.187397+0000","last_undegraded":"2024-03-28T12:42:46.187397+0000","last_fullsized":"2024-03-28T12:42:46.187397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:20:01.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.234431+0000","last_change":"2024-03-28T12:42:15.234431+0000","last_active":"2024-03-28T12:42:15.234431+0000","last_peered":"2024-03-28T12:42:15.234431+0000","last_clean":"2024-03-28T12:42:15.234431+0000","last_became_active":"2024-03-28T12:42:15.232928+0000","last_became_peered":"2024-03-28T12:42:15.232928+0000","last_unstale":"2024-03-28T12:42:15.234431+0000","last_undegraded":"2024-03-28T12:42:15.234431+0000","last_fullsized":"2024-03-28T12:42:15.234431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:05:19.841176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,5],"acting":[7,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228360+0000","last_change":"2024-03-28T12:42:01.787457+0000","last_active":"2024-03-28T12:42:15.228360+0000","last_peered":"2024-03-28T12:42:15.228360+0000","last_clean":"2024-03-28T12:42:15.228360+0000","last_became_active":"2024-03-28T12:42:01.787253+0000","last_became_peered":"2024-03-28T12:42:01.787253+0000","last_unstale":"2024-03-28T12:42:15.228360+0000","last_undegraded":"2024-03-28T12:42:15.228360+0000","last_fullsized":"2024-03-28T12:42:15.228360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:33.620394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.524652+0000","last_change":"2024-03-28T12:42:00.146723+0000","last_active":"2024-03-28T12:42:38.524652+0000","last_peered":"2024-03-28T12:42:38.524652+0000","last_clean":"2024-03-28T12:42:38.524652+0000","last_became_active":"2024-03-28T12:42:00.146394+0000","last_became_peered":"2024-03-28T12:42:00.146394+0000","last_unstale":"2024-03-28T12:42:38.524652+0000","last_undegraded":"2024-03-28T12:42:38.524652+0000","last_fullsized":"2024-03-28T12:42:38.524652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:20:01.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216137+0000","last_change":"2024-03-28T12:42:07.906623+0000","last_active":"2024-03-28T12:42:15.216137+0000","last_peered":"2024-03-28T12:42:15.216137+0000","last_clean":"2024-03-28T12:42:15.216137+0000","last_became_active":"2024-03-28T12:42:07.906233+0000","last_became_peered":"2024-03-28T12:42:07.906233+0000","last_unstale":"2024-03-28T12:42:15.216137+0000","last_undegraded":"2024-03-28T12:42:15.216137+0000","last_fullsized":"2024-03-28T12:42:15.216137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:45.857353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217128+0000","last_change":"2024-03-28T12:42:01.946498+0000","last_active":"2024-03-28T12:42:15.217128+0000","last_peered":"2024-03-28T12:42:15.217128+0000","last_clean":"2024-03-28T12:42:15.217128+0000","last_became_active":"2024-03-28T12:42:01.946087+0000","last_became_peered":"2024-03-28T12:42:01.946087+0000","last_unstale":"2024-03-28T12:42:15.217128+0000","last_undegraded":"2024-03-28T12:42:15.217128+0000","last_fullsized":"2024-03-28T12:42:15.217128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:05:13.466983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.397189+0000","last_change":"2024-03-28T12:42:00.143860+0000","last_active":"2024-03-28T12:42:46.397189+0000","last_peered":"2024-03-28T12:42:46.397189+0000","last_clean":"2024-03-28T12:42:46.397189+0000","last_became_active":"2024-03-28T12:42:00.143537+0000","last_became_peered":"2024-03-28T12:42:00.143537+0000","last_unstale":"2024-03-28T12:42:46.397189+0000","last_undegraded":"2024-03-28T12:42:46.397189+0000","last_fullsized":"2024-03-28T12:42:46.397189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:38:32.416338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.365975+0000","last_change":"2024-03-28T12:42:15.365975+0000","last_active":"2024-03-28T12:42:15.365975+0000","last_peered":"2024-03-28T12:42:15.365975+0000","last_clean":"2024-03-28T12:42:15.365975+0000","last_became_active":"2024-03-28T12:42:15.365535+0000","last_became_peered":"2024-03-28T12:42:15.365535+0000","last_unstale":"2024-03-28T12:42:15.365975+0000","last_undegraded":"2024-03-28T12:42:15.365975+0000","last_fullsized":"2024-03-28T12:42:15.365975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,1],"acting":[2,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.218523+0000","last_change":"2024-03-28T12:42:01.802128+0000","last_active":"2024-03-28T12:42:15.218523+0000","last_peered":"2024-03-28T12:42:15.218523+0000","last_clean":"2024-03-28T12:42:15.218523+0000","last_became_active":"2024-03-28T12:42:01.801492+0000","last_became_peered":"2024-03-28T12:42:01.801492+0000","last_unstale":"2024-03-28T12:42:15.218523+0000","last_undegraded":"2024-03-28T12:42:15.218523+0000","last_fullsized":"2024-03-28T12:42:15.218523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:23:08.932618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'9","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.940441+0000","last_change":"2024-03-28T12:42:00.145914+0000","last_active":"2024-03-28T12:42:43.940441+0000","last_peered":"2024-03-28T12:42:43.940441+0000","last_clean":"2024-03-28T12:42:43.940441+0000","last_became_active":"2024-03-28T12:42:00.145638+0000","last_became_peered":"2024-03-28T12:42:00.145638+0000","last_unstale":"2024-03-28T12:42:43.940441+0000","last_undegraded":"2024-03-28T12:42:43.940441+0000","last_fullsized":"2024-03-28T12:42:43.940441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:47:28.765823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216394+0000","last_change":"2024-03-28T12:42:07.882697+0000","last_active":"2024-03-28T12:42:15.216394+0000","last_peered":"2024-03-28T12:42:15.216394+0000","last_clean":"2024-03-28T12:42:15.216394+0000","last_became_active":"2024-03-28T12:42:07.881730+0000","last_became_peered":"2024-03-28T12:42:07.881730+0000","last_unstale":"2024-03-28T12:42:15.216394+0000","last_undegraded":"2024-03-28T12:42:15.216394+0000","last_fullsized":"2024-03-28T12:42:15.216394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:12:27.231636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361319+0000","last_change":"2024-03-28T12:42:01.810914+0000","last_active":"2024-03-28T12:42:15.361319+0000","last_peered":"2024-03-28T12:42:15.361319+0000","last_clean":"2024-03-28T12:42:15.361319+0000","last_became_active":"2024-03-28T12:42:01.810207+0000","last_became_peered":"2024-03-28T12:42:01.810207+0000","last_unstale":"2024-03-28T12:42:15.361319+0000","last_undegraded":"2024-03-28T12:42:15.361319+0000","last_fullsized":"2024-03-28T12:42:15.361319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:32.704186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.873676+0000","last_change":"2024-03-28T12:42:00.078402+0000","last_active":"2024-03-28T12:42:43.873676+0000","last_peered":"2024-03-28T12:42:43.873676+0000","last_clean":"2024-03-28T12:42:43.873676+0000","last_became_active":"2024-03-28T12:42:00.077988+0000","last_became_peered":"2024-03-28T12:42:00.077988+0000","last_unstale":"2024-03-28T12:42:43.873676+0000","last_undegraded":"2024-03-28T12:42:43.873676+0000","last_fullsized":"2024-03-28T12:42:43.873676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:21:58.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.362387+0000","last_change":"2024-03-28T12:42:07.936419+0000","last_active":"2024-03-28T12:42:15.362387+0000","last_peered":"2024-03-28T12:42:15.362387+0000","last_clean":"2024-03-28T12:42:15.362387+0000","last_became_active":"2024-03-28T12:42:07.935820+0000","last_became_peered":"2024-03-28T12:42:07.935820+0000","last_unstale":"2024-03-28T12:42:15.362387+0000","last_undegraded":"2024-03-28T12:42:15.362387+0000","last_fullsized":"2024-03-28T12:42:15.362387+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:35:08.334379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216161+0000","last_change":"2024-03-28T12:42:01.968887+0000","last_active":"2024-03-28T12:42:15.216161+0000","last_peered":"2024-03-28T12:42:15.216161+0000","last_clean":"2024-03-28T12:42:15.216161+0000","last_became_active":"2024-03-28T12:42:01.965491+0000","last_became_peered":"2024-03-28T12:42:01.965491+0000","last_unstale":"2024-03-28T12:42:15.216161+0000","last_undegraded":"2024-03-28T12:42:15.216161+0000","last_fullsized":"2024-03-28T12:42:15.216161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:35:50.246850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229341+0000","last_change":"2024-03-28T12:42:00.135482+0000","last_active":"2024-03-28T12:42:15.229341+0000","last_peered":"2024-03-28T12:42:15.229341+0000","last_clean":"2024-03-28T12:42:15.229341+0000","last_became_active":"2024-03-28T12:42:00.132939+0000","last_became_peered":"2024-03-28T12:42:00.132939+0000","last_unstale":"2024-03-28T12:42:15.229341+0000","last_undegraded":"2024-03-28T12:42:15.229341+0000","last_fullsized":"2024-03-28T12:42:15.229341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:31:41.407157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360749+0000","last_change":"2024-03-28T12:42:07.865644+0000","last_active":"2024-03-28T12:42:15.360749+0000","last_peered":"2024-03-28T12:42:15.360749+0000","last_clean":"2024-03-28T12:42:15.360749+0000","last_became_active":"2024-03-28T12:42:07.864804+0000","last_became_peered":"2024-03-28T12:42:07.864804+0000","last_unstale":"2024-03-28T12:42:15.360749+0000","last_undegraded":"2024-03-28T12:42:15.360749+0000","last_fullsized":"2024-03-28T12:42:15.360749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:28.659784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359688+0000","last_change":"2024-03-28T12:42:01.966222+0000","last_active":"2024-03-28T12:42:15.359688+0000","last_peered":"2024-03-28T12:42:15.359688+0000","last_clean":"2024-03-28T12:42:15.359688+0000","last_became_active":"2024-03-28T12:42:01.962305+0000","last_became_peered":"2024-03-28T12:42:01.962305+0000","last_unstale":"2024-03-28T12:42:15.359688+0000","last_undegraded":"2024-03-28T12:42:15.359688+0000","last_fullsized":"2024-03-28T12:42:15.359688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:33:35.906886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.396614+0000","last_change":"2024-03-28T12:42:00.137406+0000","last_active":"2024-03-28T12:42:46.396614+0000","last_peered":"2024-03-28T12:42:46.396614+0000","last_clean":"2024-03-28T12:42:46.396614+0000","last_became_active":"2024-03-28T12:42:00.137086+0000","last_became_peered":"2024-03-28T12:42:00.137086+0000","last_unstale":"2024-03-28T12:42:46.396614+0000","last_undegraded":"2024-03-28T12:42:46.396614+0000","last_fullsized":"2024-03-28T12:42:46.396614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:44:10.945015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360602+0000","last_change":"2024-03-28T12:42:07.940726+0000","last_active":"2024-03-28T12:42:15.360602+0000","last_peered":"2024-03-28T12:42:15.360602+0000","last_clean":"2024-03-28T12:42:15.360602+0000","last_became_active":"2024-03-28T12:42:07.939926+0000","last_became_peered":"2024-03-28T12:42:07.939926+0000","last_unstale":"2024-03-28T12:42:15.360602+0000","last_undegraded":"2024-03-28T12:42:15.360602+0000","last_fullsized":"2024-03-28T12:42:15.360602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:45.857353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.226194+0000","last_change":"2024-03-28T12:42:01.949510+0000","last_active":"2024-03-28T12:42:15.226194+0000","last_peered":"2024-03-28T12:42:15.226194+0000","last_clean":"2024-03-28T12:42:15.226194+0000","last_became_active":"2024-03-28T12:42:01.949046+0000","last_became_peered":"2024-03-28T12:42:01.949046+0000","last_unstale":"2024-03-28T12:42:15.226194+0000","last_undegraded":"2024-03-28T12:42:15.226194+0000","last_fullsized":"2024-03-28T12:42:15.226194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:50:04.915302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'5","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:41.566508+0000","last_change":"2024-03-28T12:42:00.150734+0000","last_active":"2024-03-28T12:42:41.566508+0000","last_peered":"2024-03-28T12:42:41.566508+0000","last_clean":"2024-03-28T12:42:41.566508+0000","last_became_active":"2024-03-28T12:42:00.150209+0000","last_became_peered":"2024-03-28T12:42:00.150209+0000","last_unstale":"2024-03-28T12:42:41.566508+0000","last_undegraded":"2024-03-28T12:42:41.566508+0000","last_fullsized":"2024-03-28T12:42:41.566508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:01:08.734929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361808+0000","last_change":"2024-03-28T12:42:07.935974+0000","last_active":"2024-03-28T12:42:15.361808+0000","last_peered":"2024-03-28T12:42:15.361808+0000","last_clean":"2024-03-28T12:42:15.361808+0000","last_became_active":"2024-03-28T12:42:07.935342+0000","last_became_peered":"2024-03-28T12:42:07.935342+0000","last_unstale":"2024-03-28T12:42:15.361808+0000","last_undegraded":"2024-03-28T12:42:15.361808+0000","last_fullsized":"2024-03-28T12:42:15.361808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:21.970094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360601+0000","last_change":"2024-03-28T12:42:01.961701+0000","last_active":"2024-03-28T12:42:15.360601+0000","last_peered":"2024-03-28T12:42:15.360601+0000","last_clean":"2024-03-28T12:42:15.360601+0000","last_became_active":"2024-03-28T12:42:01.961228+0000","last_became_peered":"2024-03-28T12:42:01.961228+0000","last_unstale":"2024-03-28T12:42:15.360601+0000","last_undegraded":"2024-03-28T12:42:15.360601+0000","last_fullsized":"2024-03-28T12:42:15.360601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:41.599066+0000","last_change":"2024-03-28T12:42:00.069398+0000","last_active":"2024-03-28T12:42:41.599066+0000","last_peered":"2024-03-28T12:42:41.599066+0000","last_clean":"2024-03-28T12:42:41.599066+0000","last_became_active":"2024-03-28T12:42:00.069134+0000","last_became_peered":"2024-03-28T12:42:00.069134+0000","last_unstale":"2024-03-28T12:42:41.599066+0000","last_undegraded":"2024-03-28T12:42:41.599066+0000","last_fullsized":"2024-03-28T12:42:41.599066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:57:54.776311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.365776+0000","last_change":"2024-03-28T12:42:15.365776+0000","last_active":"2024-03-28T12:42:15.365776+0000","last_peered":"2024-03-28T12:42:15.365776+0000","last_clean":"2024-03-28T12:42:15.365776+0000","last_became_active":"2024-03-28T12:42:15.364496+0000","last_became_peered":"2024-03-28T12:42:15.364496+0000","last_unstale":"2024-03-28T12:42:15.365776+0000","last_undegraded":"2024-03-28T12:42:15.365776+0000","last_fullsized":"2024-03-28T12:42:15.365776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:22:09.948471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217033+0000","last_change":"2024-03-28T12:42:01.959210+0000","last_active":"2024-03-28T12:42:15.217033+0000","last_peered":"2024-03-28T12:42:15.217033+0000","last_clean":"2024-03-28T12:42:15.217033+0000","last_became_active":"2024-03-28T12:42:01.958117+0000","last_became_peered":"2024-03-28T12:42:01.958117+0000","last_unstale":"2024-03-28T12:42:15.217033+0000","last_undegraded":"2024-03-28T12:42:15.217033+0000","last_fullsized":"2024-03-28T12:42:15.217033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:28:17.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.873561+0000","last_change":"2024-03-28T12:42:00.134120+0000","last_active":"2024-03-28T12:42:43.873561+0000","last_peered":"2024-03-28T12:42:43.873561+0000","last_clean":"2024-03-28T12:42:43.873561+0000","last_became_active":"2024-03-28T12:42:00.133540+0000","last_became_peered":"2024-03-28T12:42:00.133540+0000","last_unstale":"2024-03-28T12:42:43.873561+0000","last_undegraded":"2024-03-28T12:42:43.873561+0000","last_fullsized":"2024-03-28T12:42:43.873561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:49:47.641947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352740+0000","last_change":"2024-03-28T12:41:26.701485+0000","last_active":"2024-03-28T12:42:15.352740+0000","last_peered":"2024-03-28T12:42:15.352740+0000","last_clean":"2024-03-28T12:42:15.352740+0000","last_became_active":"2024-03-28T12:41:26.700338+0000","last_became_peered":"2024-03-28T12:41:26.700338+0000","last_unstale":"2024-03-28T12:42:15.352740+0000","last_undegraded":"2024-03-28T12:42:15.352740+0000","last_fullsized":"2024-03-28T12:42:15.352740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:24.290713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:24.290713+0000","last_clean_scrub_stamp":"2024-03-28T12:41:24.290713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:58:57.536691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229580+0000","last_change":"2024-03-28T12:42:07.938384+0000","last_active":"2024-03-28T12:42:15.229580+0000","last_peered":"2024-03-28T12:42:15.229580+0000","last_clean":"2024-03-28T12:42:15.229580+0000","last_became_active":"2024-03-28T12:42:07.937553+0000","last_became_peered":"2024-03-28T12:42:07.937553+0000","last_unstale":"2024-03-28T12:42:15.229580+0000","last_undegraded":"2024-03-28T12:42:15.229580+0000","last_fullsized":"2024-03-28T12:42:15.229580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:28:13.502930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228823+0000","last_change":"2024-03-28T12:42:01.960107+0000","last_active":"2024-03-28T12:42:15.228823+0000","last_peered":"2024-03-28T12:42:15.228823+0000","last_clean":"2024-03-28T12:42:15.228823+0000","last_became_active":"2024-03-28T12:42:01.959809+0000","last_became_peered":"2024-03-28T12:42:01.959809+0000","last_unstale":"2024-03-28T12:42:15.228823+0000","last_undegraded":"2024-03-28T12:42:15.228823+0000","last_fullsized":"2024-03-28T12:42:15.228823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:38.797683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.990171+0000","last_change":"2024-03-28T12:42:00.144133+0000","last_active":"2024-03-28T12:42:43.990171+0000","last_peered":"2024-03-28T12:42:43.990171+0000","last_clean":"2024-03-28T12:42:43.990171+0000","last_became_active":"2024-03-28T12:42:00.143460+0000","last_became_peered":"2024-03-28T12:42:00.143460+0000","last_unstale":"2024-03-28T12:42:43.990171+0000","last_undegraded":"2024-03-28T12:42:43.990171+0000","last_fullsized":"2024-03-28T12:42:43.990171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215115+0000","last_change":"2024-03-28T12:42:07.902848+0000","last_active":"2024-03-28T12:42:15.215115+0000","last_peered":"2024-03-28T12:42:15.215115+0000","last_clean":"2024-03-28T12:42:15.215115+0000","last_became_active":"2024-03-28T12:42:07.902428+0000","last_became_peered":"2024-03-28T12:42:07.902428+0000","last_unstale":"2024-03-28T12:42:15.215115+0000","last_undegraded":"2024-03-28T12:42:15.215115+0000","last_fullsized":"2024-03-28T12:42:15.215115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:28.659784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359765+0000","last_change":"2024-03-28T12:42:01.950786+0000","last_active":"2024-03-28T12:42:15.359765+0000","last_peered":"2024-03-28T12:42:15.359765+0000","last_clean":"2024-03-28T12:42:15.359765+0000","last_became_active":"2024-03-28T12:42:01.950592+0000","last_became_peered":"2024-03-28T12:42:01.950592+0000","last_unstale":"2024-03-28T12:42:15.359765+0000","last_undegraded":"2024-03-28T12:42:15.359765+0000","last_fullsized":"2024-03-28T12:42:15.359765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:53.224241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.865960+0000","last_change":"2024-03-28T12:42:00.148307+0000","last_active":"2024-03-28T12:42:43.865960+0000","last_peered":"2024-03-28T12:42:43.865960+0000","last_clean":"2024-03-28T12:42:43.865960+0000","last_became_active":"2024-03-28T12:42:00.139237+0000","last_became_peered":"2024-03-28T12:42:00.139237+0000","last_unstale":"2024-03-28T12:42:43.865960+0000","last_undegraded":"2024-03-28T12:42:43.865960+0000","last_fullsized":"2024-03-28T12:42:43.865960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:43:33.699843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227129+0000","last_change":"2024-03-28T12:42:07.885520+0000","last_active":"2024-03-28T12:42:15.227129+0000","last_peered":"2024-03-28T12:42:15.227129+0000","last_clean":"2024-03-28T12:42:15.227129+0000","last_became_active":"2024-03-28T12:42:07.880300+0000","last_became_peered":"2024-03-28T12:42:07.880300+0000","last_unstale":"2024-03-28T12:42:15.227129+0000","last_undegraded":"2024-03-28T12:42:15.227129+0000","last_fullsized":"2024-03-28T12:42:15.227129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:17:47.670820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359833+0000","last_change":"2024-03-28T12:42:01.962888+0000","last_active":"2024-03-28T12:42:15.359833+0000","last_peered":"2024-03-28T12:42:15.359833+0000","last_clean":"2024-03-28T12:42:15.359833+0000","last_became_active":"2024-03-28T12:42:01.962604+0000","last_became_peered":"2024-03-28T12:42:01.962604+0000","last_unstale":"2024-03-28T12:42:15.359833+0000","last_undegraded":"2024-03-28T12:42:15.359833+0000","last_fullsized":"2024-03-28T12:42:15.359833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:49.327792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.185566+0000","last_change":"2024-03-28T12:42:00.085372+0000","last_active":"2024-03-28T12:42:46.185566+0000","last_peered":"2024-03-28T12:42:46.185566+0000","last_clean":"2024-03-28T12:42:46.185566+0000","last_became_active":"2024-03-28T12:42:00.084866+0000","last_became_peered":"2024-03-28T12:42:00.084866+0000","last_unstale":"2024-03-28T12:42:46.185566+0000","last_undegraded":"2024-03-28T12:42:46.185566+0000","last_fullsized":"2024-03-28T12:42:46.185566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:21:45.688123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227629+0000","last_change":"2024-03-28T12:42:07.899218+0000","last_active":"2024-03-28T12:42:15.227629+0000","last_peered":"2024-03-28T12:42:15.227629+0000","last_clean":"2024-03-28T12:42:15.227629+0000","last_became_active":"2024-03-28T12:42:07.898853+0000","last_became_peered":"2024-03-28T12:42:07.898853+0000","last_unstale":"2024-03-28T12:42:15.227629+0000","last_undegraded":"2024-03-28T12:42:15.227629+0000","last_fullsized":"2024-03-28T12:42:15.227629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:21.240557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216536+0000","last_change":"2024-03-28T12:42:01.965370+0000","last_active":"2024-03-28T12:42:15.216536+0000","last_peered":"2024-03-28T12:42:15.216536+0000","last_clean":"2024-03-28T12:42:15.216536+0000","last_became_active":"2024-03-28T12:42:01.964442+0000","last_became_peered":"2024-03-28T12:42:01.964442+0000","last_unstale":"2024-03-28T12:42:15.216536+0000","last_undegraded":"2024-03-28T12:42:15.216536+0000","last_fullsized":"2024-03-28T12:42:15.216536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:35.775033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359990+0000","last_change":"2024-03-28T12:42:00.153658+0000","last_active":"2024-03-28T12:42:15.359990+0000","last_peered":"2024-03-28T12:42:15.359990+0000","last_clean":"2024-03-28T12:42:15.359990+0000","last_became_active":"2024-03-28T12:42:00.153292+0000","last_became_peered":"2024-03-28T12:42:00.153292+0000","last_unstale":"2024-03-28T12:42:15.359990+0000","last_undegraded":"2024-03-28T12:42:15.359990+0000","last_fullsized":"2024-03-28T12:42:15.359990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:54.524905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.353046+0000","last_change":"2024-03-28T12:42:07.900126+0000","last_active":"2024-03-28T12:42:15.353046+0000","last_peered":"2024-03-28T12:42:15.353046+0000","last_clean":"2024-03-28T12:42:15.353046+0000","last_became_active":"2024-03-28T12:42:07.899780+0000","last_became_peered":"2024-03-28T12:42:07.899780+0000","last_unstale":"2024-03-28T12:42:15.353046+0000","last_undegraded":"2024-03-28T12:42:15.353046+0000","last_fullsized":"2024-03-28T12:42:15.353046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:31.070732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228279+0000","last_change":"2024-03-28T12:42:01.962221+0000","last_active":"2024-03-28T12:42:15.228279+0000","last_peered":"2024-03-28T12:42:15.228279+0000","last_clean":"2024-03-28T12:42:15.228279+0000","last_became_active":"2024-03-28T12:42:01.961938+0000","last_became_peered":"2024-03-28T12:42:01.961938+0000","last_unstale":"2024-03-28T12:42:15.228279+0000","last_undegraded":"2024-03-28T12:42:15.228279+0000","last_fullsized":"2024-03-28T12:42:15.228279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:55:52.354803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'17","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.971223+0000","last_change":"2024-03-28T12:42:00.132287+0000","last_active":"2024-03-28T12:42:43.971223+0000","last_peered":"2024-03-28T12:42:43.971223+0000","last_clean":"2024-03-28T12:42:43.971223+0000","last_became_active":"2024-03-28T12:42:00.131064+0000","last_became_peered":"2024-03-28T12:42:00.131064+0000","last_unstale":"2024-03-28T12:42:43.971223+0000","last_undegraded":"2024-03-28T12:42:43.971223+0000","last_fullsized":"2024-03-28T12:42:43.971223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229667+0000","last_change":"2024-03-28T12:42:07.887453+0000","last_active":"2024-03-28T12:42:15.229667+0000","last_peered":"2024-03-28T12:42:15.229667+0000","last_clean":"2024-03-28T12:42:15.229667+0000","last_became_active":"2024-03-28T12:42:07.886685+0000","last_became_peered":"2024-03-28T12:42:07.886685+0000","last_unstale":"2024-03-28T12:42:15.229667+0000","last_undegraded":"2024-03-28T12:42:15.229667+0000","last_fullsized":"2024-03-28T12:42:15.229667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:10:05.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352581+0000","last_change":"2024-03-28T12:42:01.961318+0000","last_active":"2024-03-28T12:42:15.352581+0000","last_peered":"2024-03-28T12:42:15.352581+0000","last_clean":"2024-03-28T12:42:15.352581+0000","last_became_active":"2024-03-28T12:42:01.960102+0000","last_became_peered":"2024-03-28T12:42:01.960102+0000","last_unstale":"2024-03-28T12:42:15.352581+0000","last_undegraded":"2024-03-28T12:42:15.352581+0000","last_fullsized":"2024-03-28T12:42:15.352581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.870663+0000","last_change":"2024-03-28T12:42:00.145117+0000","last_active":"2024-03-28T12:42:43.870663+0000","last_peered":"2024-03-28T12:42:43.870663+0000","last_clean":"2024-03-28T12:42:43.870663+0000","last_became_active":"2024-03-28T12:42:00.144572+0000","last_became_peered":"2024-03-28T12:42:00.144572+0000","last_unstale":"2024-03-28T12:42:43.870663+0000","last_undegraded":"2024-03-28T12:42:43.870663+0000","last_fullsized":"2024-03-28T12:42:43.870663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:21:45.688123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.232187+0000","last_change":"2024-03-28T12:42:07.885727+0000","last_active":"2024-03-28T12:42:15.232187+0000","last_peered":"2024-03-28T12:42:15.232187+0000","last_clean":"2024-03-28T12:42:15.232187+0000","last_became_active":"2024-03-28T12:42:07.884760+0000","last_became_peered":"2024-03-28T12:42:07.884760+0000","last_unstale":"2024-03-28T12:42:15.232187+0000","last_undegraded":"2024-03-28T12:42:15.232187+0000","last_fullsized":"2024-03-28T12:42:15.232187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:45.171876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228766+0000","last_change":"2024-03-28T12:42:01.936371+0000","last_active":"2024-03-28T12:42:15.228766+0000","last_peered":"2024-03-28T12:42:15.228766+0000","last_clean":"2024-03-28T12:42:15.228766+0000","last_became_active":"2024-03-28T12:42:01.936080+0000","last_became_peered":"2024-03-28T12:42:01.936080+0000","last_unstale":"2024-03-28T12:42:15.228766+0000","last_undegraded":"2024-03-28T12:42:15.228766+0000","last_fullsized":"2024-03-28T12:42:15.228766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:36.955339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.873539+0000","last_change":"2024-03-28T12:42:00.139149+0000","last_active":"2024-03-28T12:42:43.873539+0000","last_peered":"2024-03-28T12:42:43.873539+0000","last_clean":"2024-03-28T12:42:43.873539+0000","last_became_active":"2024-03-28T12:42:00.138555+0000","last_became_peered":"2024-03-28T12:42:00.138555+0000","last_unstale":"2024-03-28T12:42:43.873539+0000","last_undegraded":"2024-03-28T12:42:43.873539+0000","last_fullsized":"2024-03-28T12:42:43.873539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:44:12.403916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360325+0000","last_change":"2024-03-28T12:42:07.940362+0000","last_active":"2024-03-28T12:42:15.360325+0000","last_peered":"2024-03-28T12:42:15.360325+0000","last_clean":"2024-03-28T12:42:15.360325+0000","last_became_active":"2024-03-28T12:42:07.939396+0000","last_became_peered":"2024-03-28T12:42:07.939396+0000","last_unstale":"2024-03-28T12:42:15.360325+0000","last_undegraded":"2024-03-28T12:42:15.360325+0000","last_fullsized":"2024-03-28T12:42:15.360325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:59.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361226+0000","last_change":"2024-03-28T12:42:01.800361+0000","last_active":"2024-03-28T12:42:15.361226+0000","last_peered":"2024-03-28T12:42:15.361226+0000","last_clean":"2024-03-28T12:42:15.361226+0000","last_became_active":"2024-03-28T12:42:01.799594+0000","last_became_peered":"2024-03-28T12:42:01.799594+0000","last_unstale":"2024-03-28T12:42:15.361226+0000","last_undegraded":"2024-03-28T12:42:15.361226+0000","last_fullsized":"2024-03-28T12:42:15.361226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:35.775033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'9","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.195411+0000","last_change":"2024-03-28T12:42:00.143501+0000","last_active":"2024-03-28T12:42:46.195411+0000","last_peered":"2024-03-28T12:42:46.195411+0000","last_clean":"2024-03-28T12:42:46.195411+0000","last_became_active":"2024-03-28T12:42:00.142913+0000","last_became_peered":"2024-03-28T12:42:00.142913+0000","last_unstale":"2024-03-28T12:42:46.195411+0000","last_undegraded":"2024-03-28T12:42:46.195411+0000","last_fullsized":"2024-03-28T12:42:46.195411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228689+0000","last_change":"2024-03-28T12:42:07.938687+0000","last_active":"2024-03-28T12:42:15.228689+0000","last_peered":"2024-03-28T12:42:15.228689+0000","last_clean":"2024-03-28T12:42:15.228689+0000","last_became_active":"2024-03-28T12:42:07.938081+0000","last_became_peered":"2024-03-28T12:42:07.938081+0000","last_unstale":"2024-03-28T12:42:15.228689+0000","last_undegraded":"2024-03-28T12:42:15.228689+0000","last_fullsized":"2024-03-28T12:42:15.228689+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:47.148457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359939+0000","last_change":"2024-03-28T12:42:01.938516+0000","last_active":"2024-03-28T12:42:15.359939+0000","last_peered":"2024-03-28T12:42:15.359939+0000","last_clean":"2024-03-28T12:42:15.359939+0000","last_became_active":"2024-03-28T12:42:01.938251+0000","last_became_peered":"2024-03-28T12:42:01.938251+0000","last_unstale":"2024-03-28T12:42:15.359939+0000","last_undegraded":"2024-03-28T12:42:15.359939+0000","last_fullsized":"2024-03-28T12:42:15.359939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:15.595901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'15","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.302999+0000","last_change":"2024-03-28T12:42:00.141127+0000","last_active":"2024-03-28T12:42:46.302999+0000","last_peered":"2024-03-28T12:42:46.302999+0000","last_clean":"2024-03-28T12:42:46.302999+0000","last_became_active":"2024-03-28T12:42:00.140832+0000","last_became_peered":"2024-03-28T12:42:00.140832+0000","last_unstale":"2024-03-28T12:42:46.302999+0000","last_undegraded":"2024-03-28T12:42:46.302999+0000","last_fullsized":"2024-03-28T12:42:46.302999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:01:04.151858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216619+0000","last_change":"2024-03-28T12:42:07.936963+0000","last_active":"2024-03-28T12:42:15.216619+0000","last_peered":"2024-03-28T12:42:15.216619+0000","last_clean":"2024-03-28T12:42:15.216619+0000","last_became_active":"2024-03-28T12:42:07.936606+0000","last_became_peered":"2024-03-28T12:42:07.936606+0000","last_unstale":"2024-03-28T12:42:15.216619+0000","last_undegraded":"2024-03-28T12:42:15.216619+0000","last_fullsized":"2024-03-28T12:42:15.216619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:37:04.083032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228759+0000","last_change":"2024-03-28T12:42:01.962855+0000","last_active":"2024-03-28T12:42:15.228759+0000","last_peered":"2024-03-28T12:42:15.228759+0000","last_clean":"2024-03-28T12:42:15.228759+0000","last_became_active":"2024-03-28T12:42:01.962546+0000","last_became_peered":"2024-03-28T12:42:01.962546+0000","last_unstale":"2024-03-28T12:42:15.228759+0000","last_undegraded":"2024-03-28T12:42:15.228759+0000","last_fullsized":"2024-03-28T12:42:15.228759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:08.429940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'5","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.315966+0000","last_change":"2024-03-28T12:42:00.138923+0000","last_active":"2024-03-28T12:42:38.315966+0000","last_peered":"2024-03-28T12:42:38.315966+0000","last_clean":"2024-03-28T12:42:38.315966+0000","last_became_active":"2024-03-28T12:42:00.138233+0000","last_became_peered":"2024-03-28T12:42:00.138233+0000","last_unstale":"2024-03-28T12:42:38.315966+0000","last_undegraded":"2024-03-28T12:42:38.315966+0000","last_fullsized":"2024-03-28T12:42:38.315966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215066+0000","last_change":"2024-03-28T12:42:07.907163+0000","last_active":"2024-03-28T12:42:15.215066+0000","last_peered":"2024-03-28T12:42:15.215066+0000","last_clean":"2024-03-28T12:42:15.215066+0000","last_became_active":"2024-03-28T12:42:07.906334+0000","last_became_peered":"2024-03-28T12:42:07.906334+0000","last_unstale":"2024-03-28T12:42:15.215066+0000","last_undegraded":"2024-03-28T12:42:15.215066+0000","last_fullsized":"2024-03-28T12:42:15.215066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:59.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.232689+0000","last_change":"2024-03-28T12:42:01.809232+0000","last_active":"2024-03-28T12:42:15.232689+0000","last_peered":"2024-03-28T12:42:15.232689+0000","last_clean":"2024-03-28T12:42:15.232689+0000","last_became_active":"2024-03-28T12:42:01.805284+0000","last_became_peered":"2024-03-28T12:42:01.805284+0000","last_unstale":"2024-03-28T12:42:15.232689+0000","last_undegraded":"2024-03-28T12:42:15.232689+0000","last_fullsized":"2024-03-28T12:42:15.232689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:20:54.180080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.209315+0000","last_change":"2024-03-28T12:42:00.147739+0000","last_active":"2024-03-28T12:42:46.209315+0000","last_peered":"2024-03-28T12:42:46.209315+0000","last_clean":"2024-03-28T12:42:46.209315+0000","last_became_active":"2024-03-28T12:42:00.147407+0000","last_became_peered":"2024-03-28T12:42:00.147407+0000","last_unstale":"2024-03-28T12:42:46.209315+0000","last_undegraded":"2024-03-28T12:42:46.209315+0000","last_fullsized":"2024-03-28T12:42:46.209315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:29.908949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.218877+0000","last_change":"2024-03-28T12:42:07.900662+0000","last_active":"2024-03-28T12:42:15.218877+0000","last_peered":"2024-03-28T12:42:15.218877+0000","last_clean":"2024-03-28T12:42:15.218877+0000","last_became_active":"2024-03-28T12:42:07.899628+0000","last_became_peered":"2024-03-28T12:42:07.899628+0000","last_unstale":"2024-03-28T12:42:15.218877+0000","last_undegraded":"2024-03-28T12:42:15.218877+0000","last_fullsized":"2024-03-28T12:42:15.218877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:31.070732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216320+0000","last_change":"2024-03-28T12:42:01.967776+0000","last_active":"2024-03-28T12:42:15.216320+0000","last_peered":"2024-03-28T12:42:15.216320+0000","last_clean":"2024-03-28T12:42:15.216320+0000","last_became_active":"2024-03-28T12:42:01.964830+0000","last_became_peered":"2024-03-28T12:42:01.964830+0000","last_unstale":"2024-03-28T12:42:15.216320+0000","last_undegraded":"2024-03-28T12:42:15.216320+0000","last_fullsized":"2024-03-28T12:42:15.216320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.454635+0000","last_change":"2024-03-28T12:42:00.142326+0000","last_active":"2024-03-28T12:42:38.454635+0000","last_peered":"2024-03-28T12:42:38.454635+0000","last_clean":"2024-03-28T12:42:38.454635+0000","last_became_active":"2024-03-28T12:42:00.141602+0000","last_became_peered":"2024-03-28T12:42:00.141602+0000","last_unstale":"2024-03-28T12:42:38.454635+0000","last_undegraded":"2024-03-28T12:42:38.454635+0000","last_fullsized":"2024-03-28T12:42:38.454635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217682+0000","last_change":"2024-03-28T12:42:07.935882+0000","last_active":"2024-03-28T12:42:15.217682+0000","last_peered":"2024-03-28T12:42:15.217682+0000","last_clean":"2024-03-28T12:42:15.217682+0000","last_became_active":"2024-03-28T12:42:07.935525+0000","last_became_peered":"2024-03-28T12:42:07.935525+0000","last_unstale":"2024-03-28T12:42:15.217682+0000","last_undegraded":"2024-03-28T12:42:15.217682+0000","last_fullsized":"2024-03-28T12:42:15.217682+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:50:31.463779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216828+0000","last_change":"2024-03-28T12:42:07.882782+0000","last_active":"2024-03-28T12:42:15.216828+0000","last_peered":"2024-03-28T12:42:15.216828+0000","last_clean":"2024-03-28T12:42:15.216828+0000","last_became_active":"2024-03-28T12:42:07.881527+0000","last_became_peered":"2024-03-28T12:42:07.881527+0000","last_unstale":"2024-03-28T12:42:15.216828+0000","last_undegraded":"2024-03-28T12:42:15.216828+0000","last_fullsized":"2024-03-28T12:42:15.216828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:55.701985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217935+0000","last_change":"2024-03-28T12:42:01.958791+0000","last_active":"2024-03-28T12:42:15.217935+0000","last_peered":"2024-03-28T12:42:15.217935+0000","last_clean":"2024-03-28T12:42:15.217935+0000","last_became_active":"2024-03-28T12:42:01.957991+0000","last_became_peered":"2024-03-28T12:42:01.957991+0000","last_unstale":"2024-03-28T12:42:15.217935+0000","last_undegraded":"2024-03-28T12:42:15.217935+0000","last_fullsized":"2024-03-28T12:42:15.217935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:24.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.873623+0000","last_change":"2024-03-28T12:42:00.132942+0000","last_active":"2024-03-28T12:42:43.873623+0000","last_peered":"2024-03-28T12:42:43.873623+0000","last_clean":"2024-03-28T12:42:43.873623+0000","last_became_active":"2024-03-28T12:42:00.132663+0000","last_became_peered":"2024-03-28T12:42:00.132663+0000","last_unstale":"2024-03-28T12:42:43.873623+0000","last_undegraded":"2024-03-28T12:42:43.873623+0000","last_fullsized":"2024-03-28T12:42:43.873623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:41.612613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229445+0000","last_change":"2024-03-28T12:42:07.901907+0000","last_active":"2024-03-28T12:42:15.229445+0000","last_peered":"2024-03-28T12:42:15.229445+0000","last_clean":"2024-03-28T12:42:15.229445+0000","last_became_active":"2024-03-28T12:42:07.901398+0000","last_became_peered":"2024-03-28T12:42:07.901398+0000","last_unstale":"2024-03-28T12:42:15.229445+0000","last_undegraded":"2024-03-28T12:42:15.229445+0000","last_fullsized":"2024-03-28T12:42:15.229445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:49:41.408808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.226666+0000","last_change":"2024-03-28T12:42:01.811306+0000","last_active":"2024-03-28T12:42:15.226666+0000","last_peered":"2024-03-28T12:42:15.226666+0000","last_clean":"2024-03-28T12:42:15.226666+0000","last_became_active":"2024-03-28T12:42:01.810142+0000","last_became_peered":"2024-03-28T12:42:01.810142+0000","last_unstale":"2024-03-28T12:42:15.226666+0000","last_undegraded":"2024-03-28T12:42:15.226666+0000","last_fullsized":"2024-03-28T12:42:15.226666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:37:22.386341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:41.328659+0000","last_change":"2024-03-28T12:42:00.142916+0000","last_active":"2024-03-28T12:42:41.328659+0000","last_peered":"2024-03-28T12:42:41.328659+0000","last_clean":"2024-03-28T12:42:41.328659+0000","last_became_active":"2024-03-28T12:42:00.142006+0000","last_became_peered":"2024-03-28T12:42:00.142006+0000","last_unstale":"2024-03-28T12:42:41.328659+0000","last_undegraded":"2024-03-28T12:42:41.328659+0000","last_fullsized":"2024-03-28T12:42:41.328659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:01:08.734929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.874594+0000","last_change":"2024-03-28T12:42:00.143738+0000","last_active":"2024-03-28T12:42:43.874594+0000","last_peered":"2024-03-28T12:42:43.874594+0000","last_clean":"2024-03-28T12:42:43.874594+0000","last_became_active":"2024-03-28T12:42:00.143474+0000","last_became_peered":"2024-03-28T12:42:00.143474+0000","last_unstale":"2024-03-28T12:42:43.874594+0000","last_undegraded":"2024-03-28T12:42:43.874594+0000","last_fullsized":"2024-03-28T12:42:43.874594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:43:33.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217213+0000","last_change":"2024-03-28T12:42:01.938147+0000","last_active":"2024-03-28T12:42:15.217213+0000","last_peered":"2024-03-28T12:42:15.217213+0000","last_clean":"2024-03-28T12:42:15.217213+0000","last_became_active":"2024-03-28T12:42:01.937612+0000","last_became_peered":"2024-03-28T12:42:01.937612+0000","last_unstale":"2024-03-28T12:42:15.217213+0000","last_undegraded":"2024-03-28T12:42:15.217213+0000","last_fullsized":"2024-03-28T12:42:15.217213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:31:15.643101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216896+0000","last_change":"2024-03-28T12:42:07.870201+0000","last_active":"2024-03-28T12:42:15.216896+0000","last_peered":"2024-03-28T12:42:15.216896+0000","last_clean":"2024-03-28T12:42:15.216896+0000","last_became_active":"2024-03-28T12:42:07.869628+0000","last_became_peered":"2024-03-28T12:42:07.869628+0000","last_unstale":"2024-03-28T12:42:15.216896+0000","last_undegraded":"2024-03-28T12:42:15.216896+0000","last_fullsized":"2024-03-28T12:42:15.216896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.525365+0000","last_change":"2024-03-28T12:42:00.146260+0000","last_active":"2024-03-28T12:42:38.525365+0000","last_peered":"2024-03-28T12:42:38.525365+0000","last_clean":"2024-03-28T12:42:38.525365+0000","last_became_active":"2024-03-28T12:42:00.146052+0000","last_became_peered":"2024-03-28T12:42:00.146052+0000","last_unstale":"2024-03-28T12:42:38.525365+0000","last_undegraded":"2024-03-28T12:42:38.525365+0000","last_fullsized":"2024-03-28T12:42:38.525365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:08.118205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352739+0000","last_change":"2024-03-28T12:42:01.966002+0000","last_active":"2024-03-28T12:42:15.352739+0000","last_peered":"2024-03-28T12:42:15.352739+0000","last_clean":"2024-03-28T12:42:15.352739+0000","last_became_active":"2024-03-28T12:42:01.965598+0000","last_became_peered":"2024-03-28T12:42:01.965598+0000","last_unstale":"2024-03-28T12:42:15.352739+0000","last_undegraded":"2024-03-28T12:42:15.352739+0000","last_fullsized":"2024-03-28T12:42:15.352739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:35:50.246850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.363695+0000","last_change":"2024-03-28T12:42:15.361649+0000","last_active":"2024-03-28T12:42:15.363695+0000","last_peered":"2024-03-28T12:42:15.363695+0000","last_clean":"2024-03-28T12:42:15.363695+0000","last_became_active":"2024-03-28T12:42:15.360743+0000","last_became_peered":"2024-03-28T12:42:15.360743+0000","last_unstale":"2024-03-28T12:42:15.363695+0000","last_undegraded":"2024-03-28T12:42:15.363695+0000","last_fullsized":"2024-03-28T12:42:15.363695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:55.701985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.214938+0000","last_change":"2024-03-28T12:42:01.965237+0000","last_active":"2024-03-28T12:42:15.214938+0000","last_peered":"2024-03-28T12:42:15.214938+0000","last_clean":"2024-03-28T12:42:15.214938+0000","last_became_active":"2024-03-28T12:42:01.964468+0000","last_became_peered":"2024-03-28T12:42:01.964468+0000","last_unstale":"2024-03-28T12:42:15.214938+0000","last_undegraded":"2024-03-28T12:42:15.214938+0000","last_fullsized":"2024-03-28T12:42:15.214938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:05.744451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.220849+0000","last_change":"2024-03-28T12:42:01.959553+0000","last_active":"2024-03-28T12:42:15.220849+0000","last_peered":"2024-03-28T12:42:15.220849+0000","last_clean":"2024-03-28T12:42:15.220849+0000","last_became_active":"2024-03-28T12:42:01.958333+0000","last_became_peered":"2024-03-28T12:42:01.958333+0000","last_unstale":"2024-03-28T12:42:15.220849+0000","last_undegraded":"2024-03-28T12:42:15.220849+0000","last_fullsized":"2024-03-28T12:42:15.220849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:05.744451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228041+0000","last_change":"2024-03-28T12:42:01.805452+0000","last_active":"2024-03-28T12:42:15.228041+0000","last_peered":"2024-03-28T12:42:15.228041+0000","last_clean":"2024-03-28T12:42:15.228041+0000","last_became_active":"2024-03-28T12:42:01.805288+0000","last_became_peered":"2024-03-28T12:42:01.805288+0000","last_unstale":"2024-03-28T12:42:15.228041+0000","last_undegraded":"2024-03-28T12:42:15.228041+0000","last_fullsized":"2024-03-28T12:42:15.228041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:17:01.582670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228480+0000","last_change":"2024-03-28T12:42:01.947234+0000","last_active":"2024-03-28T12:42:15.228480+0000","last_peered":"2024-03-28T12:42:15.228480+0000","last_clean":"2024-03-28T12:42:15.228480+0000","last_became_active":"2024-03-28T12:42:01.946859+0000","last_became_peered":"2024-03-28T12:42:01.946859+0000","last_unstale":"2024-03-28T12:42:15.228480+0000","last_undegraded":"2024-03-28T12:42:15.228480+0000","last_fullsized":"2024-03-28T12:42:15.228480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:36:05.320541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361030+0000","last_change":"2024-03-28T12:42:01.935265+0000","last_active":"2024-03-28T12:42:15.361030+0000","last_peered":"2024-03-28T12:42:15.361030+0000","last_clean":"2024-03-28T12:42:15.361030+0000","last_became_active":"2024-03-28T12:42:01.934578+0000","last_became_peered":"2024-03-28T12:42:01.934578+0000","last_unstale":"2024-03-28T12:42:15.361030+0000","last_undegraded":"2024-03-28T12:42:15.361030+0000","last_fullsized":"2024-03-28T12:42:15.361030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:24.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.362422+0000","last_change":"2024-03-28T12:42:01.946191+0000","last_active":"2024-03-28T12:42:15.362422+0000","last_peered":"2024-03-28T12:42:15.362422+0000","last_clean":"2024-03-28T12:42:15.362422+0000","last_became_active":"2024-03-28T12:42:01.945804+0000","last_became_peered":"2024-03-28T12:42:01.945804+0000","last_unstale":"2024-03-28T12:42:15.362422+0000","last_undegraded":"2024-03-28T12:42:15.362422+0000","last_fullsized":"2024-03-28T12:42:15.362422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:40.221005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216237+0000","last_change":"2024-03-28T12:42:01.969416+0000","last_active":"2024-03-28T12:42:15.216237+0000","last_peered":"2024-03-28T12:42:15.216237+0000","last_clean":"2024-03-28T12:42:15.216237+0000","last_became_active":"2024-03-28T12:42:01.969078+0000","last_became_peered":"2024-03-28T12:42:01.969078+0000","last_unstale":"2024-03-28T12:42:15.216237+0000","last_undegraded":"2024-03-28T12:42:15.216237+0000","last_fullsized":"2024-03-28T12:42:15.216237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.231988+0000","last_change":"2024-03-28T12:42:01.958402+0000","last_active":"2024-03-28T12:42:15.231988+0000","last_peered":"2024-03-28T12:42:15.231988+0000","last_clean":"2024-03-28T12:42:15.231988+0000","last_became_active":"2024-03-28T12:42:01.958074+0000","last_became_peered":"2024-03-28T12:42:01.958074+0000","last_unstale":"2024-03-28T12:42:15.231988+0000","last_undegraded":"2024-03-28T12:42:15.231988+0000","last_fullsized":"2024-03-28T12:42:15.231988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:18:04.255456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227744+0000","last_change":"2024-03-28T12:42:01.811823+0000","last_active":"2024-03-28T12:42:15.227744+0000","last_peered":"2024-03-28T12:42:15.227744+0000","last_clean":"2024-03-28T12:42:15.227744+0000","last_became_active":"2024-03-28T12:42:01.811548+0000","last_became_peered":"2024-03-28T12:42:01.811548+0000","last_unstale":"2024-03-28T12:42:15.227744+0000","last_undegraded":"2024-03-28T12:42:15.227744+0000","last_fullsized":"2024-03-28T12:42:15.227744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:00:51.741925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227697+0000","last_change":"2024-03-28T12:42:01.959291+0000","last_active":"2024-03-28T12:42:15.227697+0000","last_peered":"2024-03-28T12:42:15.227697+0000","last_clean":"2024-03-28T12:42:15.227697+0000","last_became_active":"2024-03-28T12:42:01.958942+0000","last_became_peered":"2024-03-28T12:42:01.958942+0000","last_unstale":"2024-03-28T12:42:15.227697+0000","last_undegraded":"2024-03-28T12:42:15.227697+0000","last_fullsized":"2024-03-28T12:42:15.227697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:52:46.128830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352606+0000","last_change":"2024-03-28T12:42:01.965790+0000","last_active":"2024-03-28T12:42:15.352606+0000","last_peered":"2024-03-28T12:42:15.352606+0000","last_clean":"2024-03-28T12:42:15.352606+0000","last_became_active":"2024-03-28T12:42:01.965526+0000","last_became_peered":"2024-03-28T12:42:01.965526+0000","last_unstale":"2024-03-28T12:42:15.352606+0000","last_undegraded":"2024-03-28T12:42:15.352606+0000","last_fullsized":"2024-03-28T12:42:15.352606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216990+0000","last_change":"2024-03-28T12:42:01.960761+0000","last_active":"2024-03-28T12:42:15.216990+0000","last_peered":"2024-03-28T12:42:15.216990+0000","last_clean":"2024-03-28T12:42:15.216990+0000","last_became_active":"2024-03-28T12:42:01.960325+0000","last_became_peered":"2024-03-28T12:42:01.960325+0000","last_unstale":"2024-03-28T12:42:15.216990+0000","last_undegraded":"2024-03-28T12:42:15.216990+0000","last_fullsized":"2024-03-28T12:42:15.216990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:40.221005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359720+0000","last_change":"2024-03-28T12:42:01.960053+0000","last_active":"2024-03-28T12:42:15.359720+0000","last_peered":"2024-03-28T12:42:15.359720+0000","last_clean":"2024-03-28T12:42:15.359720+0000","last_became_active":"2024-03-28T12:42:01.959801+0000","last_became_peered":"2024-03-28T12:42:01.959801+0000","last_unstale":"2024-03-28T12:42:15.359720+0000","last_undegraded":"2024-03-28T12:42:15.359720+0000","last_fullsized":"2024-03-28T12:42:15.359720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:22.285591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229465+0000","last_change":"2024-03-28T12:42:01.788603+0000","last_active":"2024-03-28T12:42:15.229465+0000","last_peered":"2024-03-28T12:42:15.229465+0000","last_clean":"2024-03-28T12:42:15.229465+0000","last_became_active":"2024-03-28T12:42:01.788431+0000","last_became_peered":"2024-03-28T12:42:01.788431+0000","last_unstale":"2024-03-28T12:42:15.229465+0000","last_undegraded":"2024-03-28T12:42:15.229465+0000","last_fullsized":"2024-03-28T12:42:15.229465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:09:59.404128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.221976+0000","last_change":"2024-03-28T12:42:01.960518+0000","last_active":"2024-03-28T12:42:15.221976+0000","last_peered":"2024-03-28T12:42:15.221976+0000","last_clean":"2024-03-28T12:42:15.221976+0000","last_became_active":"2024-03-28T12:42:01.959832+0000","last_became_peered":"2024-03-28T12:42:01.959832+0000","last_unstale":"2024-03-28T12:42:15.221976+0000","last_undegraded":"2024-03-28T12:42:15.221976+0000","last_fullsized":"2024-03-28T12:42:15.221976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229874+0000","last_change":"2024-03-28T12:42:01.936477+0000","last_active":"2024-03-28T12:42:15.229874+0000","last_peered":"2024-03-28T12:42:15.229874+0000","last_clean":"2024-03-28T12:42:15.229874+0000","last_became_active":"2024-03-28T12:42:01.936175+0000","last_became_peered":"2024-03-28T12:42:01.936175+0000","last_unstale":"2024-03-28T12:42:15.229874+0000","last_undegraded":"2024-03-28T12:42:15.229874+0000","last_fullsized":"2024-03-28T12:42:15.229874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:14:14.822668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227742+0000","last_change":"2024-03-28T12:42:01.960054+0000","last_active":"2024-03-28T12:42:15.227742+0000","last_peered":"2024-03-28T12:42:15.227742+0000","last_clean":"2024-03-28T12:42:15.227742+0000","last_became_active":"2024-03-28T12:42:01.959791+0000","last_became_peered":"2024-03-28T12:42:01.959791+0000","last_unstale":"2024-03-28T12:42:15.227742+0000","last_undegraded":"2024-03-28T12:42:15.227742+0000","last_fullsized":"2024-03-28T12:42:15.227742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:06:44.099531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.233310+0000","last_change":"2024-03-28T12:42:15.233310+0000","last_active":"2024-03-28T12:42:15.233310+0000","last_peered":"2024-03-28T12:42:15.233310+0000","last_clean":"2024-03-28T12:42:15.233310+0000","last_became_active":"2024-03-28T12:42:15.232678+0000","last_became_peered":"2024-03-28T12:42:15.232678+0000","last_unstale":"2024-03-28T12:42:15.233310+0000","last_undegraded":"2024-03-28T12:42:15.233310+0000","last_fullsized":"2024-03-28T12:42:15.233310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:11:33.781054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360961+0000","last_change":"2024-03-28T12:42:01.948602+0000","last_active":"2024-03-28T12:42:15.360961+0000","last_peered":"2024-03-28T12:42:15.360961+0000","last_clean":"2024-03-28T12:42:15.360961+0000","last_became_active":"2024-03-28T12:42:01.947869+0000","last_became_peered":"2024-03-28T12:42:01.947869+0000","last_unstale":"2024-03-28T12:42:15.360961+0000","last_undegraded":"2024-03-28T12:42:15.360961+0000","last_fullsized":"2024-03-28T12:42:15.360961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.362751+0000","last_change":"2024-03-28T12:42:01.940521+0000","last_active":"2024-03-28T12:42:15.362751+0000","last_peered":"2024-03-28T12:42:15.362751+0000","last_clean":"2024-03-28T12:42:15.362751+0000","last_became_active":"2024-03-28T12:42:01.939756+0000","last_became_peered":"2024-03-28T12:42:01.939756+0000","last_unstale":"2024-03-28T12:42:15.362751+0000","last_undegraded":"2024-03-28T12:42:15.362751+0000","last_fullsized":"2024-03-28T12:42:15.362751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:53:37.869232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359674+0000","last_change":"2024-03-28T12:42:01.960377+0000","last_active":"2024-03-28T12:42:15.359674+0000","last_peered":"2024-03-28T12:42:15.359674+0000","last_clean":"2024-03-28T12:42:15.359674+0000","last_became_active":"2024-03-28T12:42:01.960012+0000","last_became_peered":"2024-03-28T12:42:01.960012+0000","last_unstale":"2024-03-28T12:42:15.359674+0000","last_undegraded":"2024-03-28T12:42:15.359674+0000","last_fullsized":"2024-03-28T12:42:15.359674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:19:20.801201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359855+0000","last_change":"2024-03-28T12:42:01.937280+0000","last_active":"2024-03-28T12:42:15.359855+0000","last_peered":"2024-03-28T12:42:15.359855+0000","last_clean":"2024-03-28T12:42:15.359855+0000","last_became_active":"2024-03-28T12:42:01.936999+0000","last_became_peered":"2024-03-28T12:42:01.936999+0000","last_unstale":"2024-03-28T12:42:15.359855+0000","last_undegraded":"2024-03-28T12:42:15.359855+0000","last_fullsized":"2024-03-28T12:42:15.359855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:35:01.960186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360045+0000","last_change":"2024-03-28T12:42:01.961991+0000","last_active":"2024-03-28T12:42:15.360045+0000","last_peered":"2024-03-28T12:42:15.360045+0000","last_clean":"2024-03-28T12:42:15.360045+0000","last_became_active":"2024-03-28T12:42:01.961694+0000","last_became_peered":"2024-03-28T12:42:01.961694+0000","last_unstale":"2024-03-28T12:42:15.360045+0000","last_undegraded":"2024-03-28T12:42:15.360045+0000","last_fullsized":"2024-03-28T12:42:15.360045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:12:20.857443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.353767+0000","last_change":"2024-03-28T12:42:01.966943+0000","last_active":"2024-03-28T12:42:15.353767+0000","last_peered":"2024-03-28T12:42:15.353767+0000","last_clean":"2024-03-28T12:42:15.353767+0000","last_became_active":"2024-03-28T12:42:01.966629+0000","last_became_peered":"2024-03-28T12:42:01.966629+0000","last_unstale":"2024-03-28T12:42:15.353767+0000","last_undegraded":"2024-03-28T12:42:15.353767+0000","last_fullsized":"2024-03-28T12:42:15.353767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.225924+0000","last_change":"2024-03-28T12:42:01.934727+0000","last_active":"2024-03-28T12:42:15.225924+0000","last_peered":"2024-03-28T12:42:15.225924+0000","last_clean":"2024-03-28T12:42:15.225924+0000","last_became_active":"2024-03-28T12:42:01.934130+0000","last_became_peered":"2024-03-28T12:42:01.934130+0000","last_unstale":"2024-03-28T12:42:15.225924+0000","last_undegraded":"2024-03-28T12:42:15.225924+0000","last_fullsized":"2024-03-28T12:42:15.225924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:20:32.024373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359366+0000","last_change":"2024-03-28T12:42:01.940164+0000","last_active":"2024-03-28T12:42:15.359366+0000","last_peered":"2024-03-28T12:42:15.359366+0000","last_clean":"2024-03-28T12:42:15.359366+0000","last_became_active":"2024-03-28T12:42:01.939962+0000","last_became_peered":"2024-03-28T12:42:01.939962+0000","last_unstale":"2024-03-28T12:42:15.359366+0000","last_undegraded":"2024-03-28T12:42:15.359366+0000","last_fullsized":"2024-03-28T12:42:15.359366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:31:15.643101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215233+0000","last_change":"2024-03-28T12:42:01.968043+0000","last_active":"2024-03-28T12:42:15.215233+0000","last_peered":"2024-03-28T12:42:15.215233+0000","last_clean":"2024-03-28T12:42:15.215233+0000","last_became_active":"2024-03-28T12:42:01.964888+0000","last_became_peered":"2024-03-28T12:42:01.964888+0000","last_unstale":"2024-03-28T12:42:15.215233+0000","last_undegraded":"2024-03-28T12:42:15.215233+0000","last_fullsized":"2024-03-28T12:42:15.215233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359830+0000","last_change":"2024-03-28T12:42:01.939665+0000","last_active":"2024-03-28T12:42:15.359830+0000","last_peered":"2024-03-28T12:42:15.359830+0000","last_clean":"2024-03-28T12:42:15.359830+0000","last_became_active":"2024-03-28T12:42:01.939448+0000","last_became_peered":"2024-03-28T12:42:01.939448+0000","last_unstale":"2024-03-28T12:42:15.359830+0000","last_undegraded":"2024-03-28T12:42:15.359830+0000","last_fullsized":"2024-03-28T12:42:15.359830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:39.483160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216062+0000","last_change":"2024-03-28T12:42:01.961147+0000","last_active":"2024-03-28T12:42:15.216062+0000","last_peered":"2024-03-28T12:42:15.216062+0000","last_clean":"2024-03-28T12:42:15.216062+0000","last_became_active":"2024-03-28T12:42:01.960511+0000","last_became_peered":"2024-03-28T12:42:01.960511+0000","last_unstale":"2024-03-28T12:42:15.216062+0000","last_undegraded":"2024-03-28T12:42:15.216062+0000","last_fullsized":"2024-03-28T12:42:15.216062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229345+0000","last_change":"2024-03-28T12:42:01.809029+0000","last_active":"2024-03-28T12:42:15.229345+0000","last_peered":"2024-03-28T12:42:15.229345+0000","last_clean":"2024-03-28T12:42:15.229345+0000","last_became_active":"2024-03-28T12:42:01.805168+0000","last_became_peered":"2024-03-28T12:42:01.805168+0000","last_unstale":"2024-03-28T12:42:15.229345+0000","last_undegraded":"2024-03-28T12:42:15.229345+0000","last_fullsized":"2024-03-28T12:42:15.229345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:00:10.281819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229628+0000","last_change":"2024-03-28T12:42:01.809169+0000","last_active":"2024-03-28T12:42:15.229628+0000","last_peered":"2024-03-28T12:42:15.229628+0000","last_clean":"2024-03-28T12:42:15.229628+0000","last_became_active":"2024-03-28T12:42:01.805382+0000","last_became_peered":"2024-03-28T12:42:01.805382+0000","last_unstale":"2024-03-28T12:42:15.229628+0000","last_undegraded":"2024-03-28T12:42:15.229628+0000","last_fullsized":"2024-03-28T12:42:15.229628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:26:32.791857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359741+0000","last_change":"2024-03-28T12:42:01.938613+0000","last_active":"2024-03-28T12:42:15.359741+0000","last_peered":"2024-03-28T12:42:15.359741+0000","last_clean":"2024-03-28T12:42:15.359741+0000","last_became_active":"2024-03-28T12:42:01.938408+0000","last_became_peered":"2024-03-28T12:42:01.938408+0000","last_unstale":"2024-03-28T12:42:15.359741+0000","last_undegraded":"2024-03-28T12:42:15.359741+0000","last_fullsized":"2024-03-28T12:42:15.359741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:36:57.708839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10264,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":20528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":186,"ondisk_log_size":186,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66494,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":127449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":128775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":132075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":130305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":718177,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":128937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":129117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":397312,"data_stored":717589,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T12:42:51.275 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T12:42:51.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.466+0000 7f8963e00640 1 Processor -- start 2024-03-28T12:42:51.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.466+0000 7f8963e00640 1 -- start start 2024-03-28T12:42:51.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.470+0000 7f8963e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f8964071e80 0x7f89641582a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:51.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.470+0000 7f8963e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8964072260 0x7f89640cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:51.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.470+0000 7f8963e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f896415c090 0x7f8964152140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:51.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.470+0000 7f8963e00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f896415bc00 con 0x7f8964071e80 2024-03-28T12:42:51.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.470+0000 7f8963e00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f89640c8240 con 0x7f896415c090 2024-03-28T12:42:51.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.470+0000 7f8963e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f89641588c0 con 0x7f8964072260 2024-03-28T12:42:51.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.470+0000 7f8962a00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f8964071e80 0x7f89641582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:51.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.470+0000 7f8963400640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f896415c090 0x7f8964152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:51.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.470+0000 7f8962000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8964072260 0x7f89640cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:51.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.470+0000 7f8962a00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f8964071e80 0x7f89641582a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45692/0 (socket says 172.21.15.76:45692) 2024-03-28T12:42:51.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.470+0000 7f8962a00640 1 -- 172.21.15.76:0/1499120528 learned_addr learned my addr 172.21.15.76:0/1499120528 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:51.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.474+0000 7f8962a00640 1 -- 172.21.15.76:0/1499120528 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8964072260 msgr2=0x7f89640cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:51.470 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.474+0000 7f8962a00640 1 --2- 172.21.15.76:0/1499120528 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8964072260 0x7f89640cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:51.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.474+0000 7f8962a00640 1 -- 172.21.15.76:0/1499120528 >> v2:172.21.15.111:3300/0 conn(0x7f896415c090 msgr2=0x7f8964152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:51.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.474+0000 7f8962a00640 1 --2- 172.21.15.76:0/1499120528 >> v2:172.21.15.111:3300/0 conn(0x7f896415c090 0x7f8964152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:51.471 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.474+0000 7f8962a00640 1 -- 172.21.15.76:0/1499120528 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8964158ba0 con 0x7f8964071e80 2024-03-28T12:42:51.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.478+0000 7f8962a00640 1 --2- 172.21.15.76:0/1499120528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8964071e80 0x7f89641582a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8964072660 tx=0x7f895401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff0c758f19d93bc server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:51.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.482+0000 7f8961600640 1 -- 172.21.15.76:0/1499120528 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89540b5070 con 0x7f8964071e80 2024-03-28T12:42:51.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.482+0000 7f8961600640 1 -- 172.21.15.76:0/1499120528 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89540a89d0 con 0x7f8964071e80 2024-03-28T12:42:51.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.482+0000 7f8961600640 1 -- 172.21.15.76:0/1499120528 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89540a8da0 con 0x7f8964071e80 2024-03-28T12:42:51.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.486+0000 7f8963e00640 1 -- 172.21.15.76:0/1499120528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8964071e80 msgr2=0x7f89641582a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:51.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.486+0000 7f8963e00640 1 --2- 172.21.15.76:0/1499120528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8964071e80 0x7f89641582a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8964072660 tx=0x7f895401ed10 comp rx=0 tx=0).stop 2024-03-28T12:42:51.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.486+0000 7f8963e00640 1 -- 172.21.15.76:0/1499120528 shutdown_connections 2024-03-28T12:42:51.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.486+0000 7f8963e00640 1 --2- 172.21.15.76:0/1499120528 >> v2:172.21.15.111:3300/0 conn(0x7f896415c090 0x7f8964152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:51.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.486+0000 7f8963e00640 1 --2- 172.21.15.76:0/1499120528 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8964072260 0x7f89640cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:51.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.486+0000 7f8963e00640 1 --2- 172.21.15.76:0/1499120528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8964071e80 0x7f89641582a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:51.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.486+0000 7f8963e00640 1 -- 172.21.15.76:0/1499120528 >> 172.21.15.76:0/1499120528 conn(0x7f896406b770 msgr2=0x7f8964070330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:51.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.486+0000 7f8963e00640 1 -- 172.21.15.76:0/1499120528 shutdown_connections 2024-03-28T12:42:51.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.486+0000 7f8963e00640 1 -- 172.21.15.76:0/1499120528 wait complete. 2024-03-28T12:42:51.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.486+0000 7f8963e00640 1 Processor -- start 2024-03-28T12:42:51.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.486+0000 7f8963e00640 1 -- start start 2024-03-28T12:42:51.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.486+0000 7f8963e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8964071e80 0x7f89640b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:51.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.486+0000 7f8963e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8964072260 0x7f89641e5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:51.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.486+0000 7f8963e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f896415c090 0x7f89640c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:51.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.486+0000 7f8963e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f896415b890 con 0x7f896415c090 2024-03-28T12:42:51.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.486+0000 7f8963e00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8964159160 con 0x7f8964071e80 2024-03-28T12:42:51.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.486+0000 7f8963e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f89640c2d30 con 0x7f8964072260 2024-03-28T12:42:51.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.490+0000 7f8963400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f896415c090 0x7f89640c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:51.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.490+0000 7f8962a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8964071e80 0x7f89640b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:51.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.490+0000 7f8963400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f896415c090 0x7f89640c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:45694/0 (socket says 172.21.15.76:45694) 2024-03-28T12:42:51.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.490+0000 7f8963400640 1 -- 172.21.15.76:0/3797138568 learned_addr learned my addr 172.21.15.76:0/3797138568 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:51.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.490+0000 7f8962000640 1 --2- 172.21.15.76:0/3797138568 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8964072260 0x7f89641e5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:51.490 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.494+0000 7f8963400640 1 -- 172.21.15.76:0/3797138568 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8964072260 msgr2=0x7f89641e5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:51.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.494+0000 7f8963400640 1 --2- 172.21.15.76:0/3797138568 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8964072260 0x7f89641e5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:51.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.494+0000 7f8963400640 1 -- 172.21.15.76:0/3797138568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8964071e80 msgr2=0x7f89640b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:51.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.494+0000 7f8963400640 1 --2- 172.21.15.76:0/3797138568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8964071e80 0x7f89640b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:51.491 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.494+0000 7f8963400640 1 -- 172.21.15.76:0/3797138568 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89641e5f80 con 0x7f896415c090 2024-03-28T12:42:51.493 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.494+0000 7f8963400640 1 --2- 172.21.15.76:0/3797138568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f896415c090 0x7f89640c8ed0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f895c00efc0 tx=0x7f895c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:51.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.498+0000 7f895aa00640 1 -- 172.21.15.76:0/3797138568 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c018020 con 0x7f896415c090 2024-03-28T12:42:51.498 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.498+0000 7f895aa00640 1 -- 172.21.15.76:0/3797138568 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f895c014480 con 0x7f896415c090 2024-03-28T12:42:51.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.498+0000 7f8963e00640 1 -- 172.21.15.76:0/3797138568 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89641f0300 con 0x7f896415c090 2024-03-28T12:42:51.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.498+0000 7f895aa00640 1 -- 172.21.15.76:0/3797138568 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f895c014870 con 0x7f896415c090 2024-03-28T12:42:51.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.498+0000 7f8963e00640 1 -- 172.21.15.76:0/3797138568 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89641e64d0 con 0x7f896415c090 2024-03-28T12:42:51.499 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.502+0000 7f8963e00640 1 -- 172.21.15.76:0/3797138568 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8964068df0 con 0x7f896415c090 2024-03-28T12:42:51.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.526+0000 7f895aa00640 1 -- 172.21.15.76:0/3797138568 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f895c01b020 con 0x7f896415c090 2024-03-28T12:42:51.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.526+0000 7f895aa00640 1 --2- 172.21.15.76:0/3797138568 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8944067fc0 0x7f894406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:51.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.526+0000 7f8962a00640 1 --2- 172.21.15.76:0/3797138568 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8944067fc0 0x7f894406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:51.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.526+0000 7f8962a00640 1 --2- 172.21.15.76:0/3797138568 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8944067fc0 0x7f894406a480 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f89540b2000 tx=0x7f8954009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:51.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.530+0000 7f895aa00640 1 -- 172.21.15.76:0/3797138568 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f895c055950 con 0x7f896415c090 2024-03-28T12:42:51.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:51.866+0000 7f895aa00640 1 -- 172.21.15.76:0/3797138568 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f895c022030 con 0x7f896415c090 2024-03-28T12:42:52.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.070+0000 7f8963e00640 1 -- 172.21.15.76:0/3797138568 --> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f89640c6240 con 0x7f8944067fc0 2024-03-28T12:42:52.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.086+0000 7f895aa00640 1 -- 172.21.15.76:0/3797138568 <== mgr.4107 v2:172.21.15.76:6800/1313648511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332787 (secure 0 0 0) 0x7f89640c6240 con 0x7f8944067fc0 2024-03-28T12:42:52.089 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:52.091 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-03-28T12:42:52.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.090+0000 7f8963e00640 1 -- 172.21.15.76:0/3797138568 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8944067fc0 msgr2=0x7f894406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:52.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.090+0000 7f8963e00640 1 --2- 172.21.15.76:0/3797138568 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8944067fc0 0x7f894406a480 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f89540b2000 tx=0x7f8954009040 comp rx=0 tx=0).stop 2024-03-28T12:42:52.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.090+0000 7f8963e00640 1 -- 172.21.15.76:0/3797138568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f896415c090 msgr2=0x7f89640c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:52.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.090+0000 7f8963e00640 1 --2- 172.21.15.76:0/3797138568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f896415c090 0x7f89640c8ed0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f895c00efc0 tx=0x7f895c00c490 comp rx=0 tx=0).stop 2024-03-28T12:42:52.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.090+0000 7f8963e00640 1 -- 172.21.15.76:0/3797138568 shutdown_connections 2024-03-28T12:42:52.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.090+0000 7f8963e00640 1 --2- 172.21.15.76:0/3797138568 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8944067fc0 0x7f894406a480 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:52.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.090+0000 7f8963e00640 1 --2- 172.21.15.76:0/3797138568 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f896415c090 0x7f89640c8ed0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:52.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.090+0000 7f8963e00640 1 --2- 172.21.15.76:0/3797138568 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8964072260 0x7f89641e5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:52.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.090+0000 7f8963e00640 1 --2- 172.21.15.76:0/3797138568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8964071e80 0x7f89640b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:52.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.090+0000 7f8963e00640 1 -- 172.21.15.76:0/3797138568 >> 172.21.15.76:0/3797138568 conn(0x7f896406b770 msgr2=0x7f8964159800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:52.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.090+0000 7f8963e00640 1 -- 172.21.15.76:0/3797138568 shutdown_connections 2024-03-28T12:42:52.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.090+0000 7f8963e00640 1 -- 172.21.15.76:0/3797138568 wait complete. 2024-03-28T12:42:52.110 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-03-28T12:42:51.017669+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600632,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":373,"num_write_kb":2484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":303,"ondisk_log_size":303,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218912,"kb_used_data":2784,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755808,"statfs":{"total":773094113280,"available":772869947392,"internally_reserved":0,"allocated":2850816,"data_stored":2212424,"data_compressed":66494,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5624,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":160,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003234"},"pg_stats":[{"pgid":"2.1f","version":"29'13","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.199293+0000","last_change":"2024-03-28T12:42:00.080769+0000","last_active":"2024-03-28T12:42:46.199293+0000","last_peered":"2024-03-28T12:42:46.199293+0000","last_clean":"2024-03-28T12:42:46.199293+0000","last_became_active":"2024-03-28T12:42:00.079900+0000","last_became_peered":"2024-03-28T12:42:00.079900+0000","last_unstale":"2024-03-28T12:42:46.199293+0000","last_undegraded":"2024-03-28T12:42:46.199293+0000","last_fullsized":"2024-03-28T12:42:46.199293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:26.156056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229988+0000","last_change":"2024-03-28T12:42:01.960244+0000","last_active":"2024-03-28T12:42:15.229988+0000","last_peered":"2024-03-28T12:42:15.229988+0000","last_clean":"2024-03-28T12:42:15.229988+0000","last_became_active":"2024-03-28T12:42:01.959408+0000","last_became_peered":"2024-03-28T12:42:01.959408+0000","last_unstale":"2024-03-28T12:42:15.229988+0000","last_undegraded":"2024-03-28T12:42:15.229988+0000","last_fullsized":"2024-03-28T12:42:15.229988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:00:51.741925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.218968+0000","last_change":"2024-03-28T12:42:07.880943+0000","last_active":"2024-03-28T12:42:15.218968+0000","last_peered":"2024-03-28T12:42:15.218968+0000","last_clean":"2024-03-28T12:42:15.218968+0000","last_became_active":"2024-03-28T12:42:07.880354+0000","last_became_peered":"2024-03-28T12:42:07.880354+0000","last_unstale":"2024-03-28T12:42:15.218968+0000","last_undegraded":"2024-03-28T12:42:15.218968+0000","last_fullsized":"2024-03-28T12:42:15.218968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:39.078379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.230194+0000","last_change":"2024-03-28T12:42:00.138569+0000","last_active":"2024-03-28T12:42:15.230194+0000","last_peered":"2024-03-28T12:42:15.230194+0000","last_clean":"2024-03-28T12:42:15.230194+0000","last_became_active":"2024-03-28T12:42:00.137978+0000","last_became_peered":"2024-03-28T12:42:00.137978+0000","last_unstale":"2024-03-28T12:42:15.230194+0000","last_undegraded":"2024-03-28T12:42:15.230194+0000","last_fullsized":"2024-03-28T12:42:15.230194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:38:28.575778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.232451+0000","last_change":"2024-03-28T12:42:01.958236+0000","last_active":"2024-03-28T12:42:15.232451+0000","last_peered":"2024-03-28T12:42:15.232451+0000","last_clean":"2024-03-28T12:42:15.232451+0000","last_became_active":"2024-03-28T12:42:01.957875+0000","last_became_peered":"2024-03-28T12:42:01.957875+0000","last_unstale":"2024-03-28T12:42:15.232451+0000","last_undegraded":"2024-03-28T12:42:15.232451+0000","last_fullsized":"2024-03-28T12:42:15.232451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:48:52.933175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.214830+0000","last_change":"2024-03-28T12:42:07.905799+0000","last_active":"2024-03-28T12:42:15.214830+0000","last_peered":"2024-03-28T12:42:15.214830+0000","last_clean":"2024-03-28T12:42:15.214830+0000","last_became_active":"2024-03-28T12:42:07.905350+0000","last_became_peered":"2024-03-28T12:42:07.905350+0000","last_unstale":"2024-03-28T12:42:15.214830+0000","last_undegraded":"2024-03-28T12:42:15.214830+0000","last_fullsized":"2024-03-28T12:42:15.214830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:33:42.281079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'12","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.210357+0000","last_change":"2024-03-28T12:42:00.150272+0000","last_active":"2024-03-28T12:42:46.210357+0000","last_peered":"2024-03-28T12:42:46.210357+0000","last_clean":"2024-03-28T12:42:46.210357+0000","last_became_active":"2024-03-28T12:42:00.148367+0000","last_became_peered":"2024-03-28T12:42:00.148367+0000","last_unstale":"2024-03-28T12:42:46.210357+0000","last_undegraded":"2024-03-28T12:42:46.210357+0000","last_fullsized":"2024-03-28T12:42:46.210357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:26.156056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352641+0000","last_change":"2024-03-28T12:42:01.965158+0000","last_active":"2024-03-28T12:42:15.352641+0000","last_peered":"2024-03-28T12:42:15.352641+0000","last_clean":"2024-03-28T12:42:15.352641+0000","last_became_active":"2024-03-28T12:42:01.964817+0000","last_became_peered":"2024-03-28T12:42:01.964817+0000","last_unstale":"2024-03-28T12:42:15.352641+0000","last_undegraded":"2024-03-28T12:42:15.352641+0000","last_fullsized":"2024-03-28T12:42:15.352641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215063+0000","last_change":"2024-03-28T12:42:07.906794+0000","last_active":"2024-03-28T12:42:15.215063+0000","last_peered":"2024-03-28T12:42:15.215063+0000","last_clean":"2024-03-28T12:42:15.215063+0000","last_became_active":"2024-03-28T12:42:07.905522+0000","last_became_peered":"2024-03-28T12:42:07.905522+0000","last_unstale":"2024-03-28T12:42:15.215063+0000","last_undegraded":"2024-03-28T12:42:15.215063+0000","last_fullsized":"2024-03-28T12:42:15.215063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:21.970094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.210247+0000","last_change":"2024-03-28T12:42:00.149947+0000","last_active":"2024-03-28T12:42:46.210247+0000","last_peered":"2024-03-28T12:42:46.210247+0000","last_clean":"2024-03-28T12:42:46.210247+0000","last_became_active":"2024-03-28T12:42:00.148446+0000","last_became_peered":"2024-03-28T12:42:00.148446+0000","last_unstale":"2024-03-28T12:42:46.210247+0000","last_undegraded":"2024-03-28T12:42:46.210247+0000","last_fullsized":"2024-03-28T12:42:46.210247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:47:28.765823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228727+0000","last_change":"2024-03-28T12:42:01.935596+0000","last_active":"2024-03-28T12:42:15.228727+0000","last_peered":"2024-03-28T12:42:15.228727+0000","last_clean":"2024-03-28T12:42:15.228727+0000","last_became_active":"2024-03-28T12:42:01.935231+0000","last_became_peered":"2024-03-28T12:42:01.935231+0000","last_unstale":"2024-03-28T12:42:15.228727+0000","last_undegraded":"2024-03-28T12:42:15.228727+0000","last_fullsized":"2024-03-28T12:42:15.228727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:17:41.296627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215002+0000","last_change":"2024-03-28T12:42:07.904616+0000","last_active":"2024-03-28T12:42:15.215002+0000","last_peered":"2024-03-28T12:42:15.215002+0000","last_clean":"2024-03-28T12:42:15.215002+0000","last_became_active":"2024-03-28T12:42:07.904240+0000","last_became_peered":"2024-03-28T12:42:07.904240+0000","last_unstale":"2024-03-28T12:42:15.215002+0000","last_undegraded":"2024-03-28T12:42:15.215002+0000","last_fullsized":"2024-03-28T12:42:15.215002+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:19:27.175393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228168+0000","last_change":"2024-03-28T12:42:01.963116+0000","last_active":"2024-03-28T12:42:15.228168+0000","last_peered":"2024-03-28T12:42:15.228168+0000","last_clean":"2024-03-28T12:42:15.228168+0000","last_became_active":"2024-03-28T12:42:01.962885+0000","last_became_peered":"2024-03-28T12:42:01.962885+0000","last_unstale":"2024-03-28T12:42:15.228168+0000","last_undegraded":"2024-03-28T12:42:15.228168+0000","last_fullsized":"2024-03-28T12:42:15.228168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:19:06.640780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.461605+0000","last_change":"2024-03-28T12:42:00.134353+0000","last_active":"2024-03-28T12:42:38.461605+0000","last_peered":"2024-03-28T12:42:38.461605+0000","last_clean":"2024-03-28T12:42:38.461605+0000","last_became_active":"2024-03-28T12:42:00.133880+0000","last_became_peered":"2024-03-28T12:42:00.133880+0000","last_unstale":"2024-03-28T12:42:38.461605+0000","last_undegraded":"2024-03-28T12:42:38.461605+0000","last_fullsized":"2024-03-28T12:42:38.461605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:45:14.194934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.238142+0000","last_change":"2024-03-28T12:42:15.238142+0000","last_active":"2024-03-28T12:42:15.238142+0000","last_peered":"2024-03-28T12:42:15.238142+0000","last_clean":"2024-03-28T12:42:15.238142+0000","last_became_active":"2024-03-28T12:42:15.237739+0000","last_became_peered":"2024-03-28T12:42:15.237739+0000","last_unstale":"2024-03-28T12:42:15.238142+0000","last_undegraded":"2024-03-28T12:42:15.238142+0000","last_fullsized":"2024-03-28T12:42:15.238142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:41:14.243482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.221374+0000","last_change":"2024-03-28T12:42:01.948688+0000","last_active":"2024-03-28T12:42:15.221374+0000","last_peered":"2024-03-28T12:42:15.221374+0000","last_clean":"2024-03-28T12:42:15.221374+0000","last_became_active":"2024-03-28T12:42:01.948049+0000","last_became_peered":"2024-03-28T12:42:01.948049+0000","last_unstale":"2024-03-28T12:42:15.221374+0000","last_undegraded":"2024-03-28T12:42:15.221374+0000","last_fullsized":"2024-03-28T12:42:15.221374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.990094+0000","last_change":"2024-03-28T12:42:00.139208+0000","last_active":"2024-03-28T12:42:43.990094+0000","last_peered":"2024-03-28T12:42:43.990094+0000","last_clean":"2024-03-28T12:42:43.990094+0000","last_became_active":"2024-03-28T12:42:00.138264+0000","last_became_peered":"2024-03-28T12:42:00.138264+0000","last_unstale":"2024-03-28T12:42:43.990094+0000","last_undegraded":"2024-03-28T12:42:43.990094+0000","last_fullsized":"2024-03-28T12:42:43.990094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359578+0000","last_change":"2024-03-28T12:42:07.941636+0000","last_active":"2024-03-28T12:42:15.359578+0000","last_peered":"2024-03-28T12:42:15.359578+0000","last_clean":"2024-03-28T12:42:15.359578+0000","last_became_active":"2024-03-28T12:42:07.941114+0000","last_became_peered":"2024-03-28T12:42:07.941114+0000","last_unstale":"2024-03-28T12:42:15.359578+0000","last_undegraded":"2024-03-28T12:42:15.359578+0000","last_fullsized":"2024-03-28T12:42:15.359578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:00:58.736580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216501+0000","last_change":"2024-03-28T12:42:01.949545+0000","last_active":"2024-03-28T12:42:15.216501+0000","last_peered":"2024-03-28T12:42:15.216501+0000","last_clean":"2024-03-28T12:42:15.216501+0000","last_became_active":"2024-03-28T12:42:01.946576+0000","last_became_peered":"2024-03-28T12:42:01.946576+0000","last_unstale":"2024-03-28T12:42:15.216501+0000","last_undegraded":"2024-03-28T12:42:15.216501+0000","last_fullsized":"2024-03-28T12:42:15.216501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:32.704186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.187397+0000","last_change":"2024-03-28T12:42:00.142804+0000","last_active":"2024-03-28T12:42:46.187397+0000","last_peered":"2024-03-28T12:42:46.187397+0000","last_clean":"2024-03-28T12:42:46.187397+0000","last_became_active":"2024-03-28T12:42:00.142063+0000","last_became_peered":"2024-03-28T12:42:00.142063+0000","last_unstale":"2024-03-28T12:42:46.187397+0000","last_undegraded":"2024-03-28T12:42:46.187397+0000","last_fullsized":"2024-03-28T12:42:46.187397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:20:01.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.234431+0000","last_change":"2024-03-28T12:42:15.234431+0000","last_active":"2024-03-28T12:42:15.234431+0000","last_peered":"2024-03-28T12:42:15.234431+0000","last_clean":"2024-03-28T12:42:15.234431+0000","last_became_active":"2024-03-28T12:42:15.232928+0000","last_became_peered":"2024-03-28T12:42:15.232928+0000","last_unstale":"2024-03-28T12:42:15.234431+0000","last_undegraded":"2024-03-28T12:42:15.234431+0000","last_fullsized":"2024-03-28T12:42:15.234431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:05:19.841176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,5],"acting":[7,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228360+0000","last_change":"2024-03-28T12:42:01.787457+0000","last_active":"2024-03-28T12:42:15.228360+0000","last_peered":"2024-03-28T12:42:15.228360+0000","last_clean":"2024-03-28T12:42:15.228360+0000","last_became_active":"2024-03-28T12:42:01.787253+0000","last_became_peered":"2024-03-28T12:42:01.787253+0000","last_unstale":"2024-03-28T12:42:15.228360+0000","last_undegraded":"2024-03-28T12:42:15.228360+0000","last_fullsized":"2024-03-28T12:42:15.228360+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:33.620394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.524652+0000","last_change":"2024-03-28T12:42:00.146723+0000","last_active":"2024-03-28T12:42:38.524652+0000","last_peered":"2024-03-28T12:42:38.524652+0000","last_clean":"2024-03-28T12:42:38.524652+0000","last_became_active":"2024-03-28T12:42:00.146394+0000","last_became_peered":"2024-03-28T12:42:00.146394+0000","last_unstale":"2024-03-28T12:42:38.524652+0000","last_undegraded":"2024-03-28T12:42:38.524652+0000","last_fullsized":"2024-03-28T12:42:38.524652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:20:01.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216137+0000","last_change":"2024-03-28T12:42:07.906623+0000","last_active":"2024-03-28T12:42:15.216137+0000","last_peered":"2024-03-28T12:42:15.216137+0000","last_clean":"2024-03-28T12:42:15.216137+0000","last_became_active":"2024-03-28T12:42:07.906233+0000","last_became_peered":"2024-03-28T12:42:07.906233+0000","last_unstale":"2024-03-28T12:42:15.216137+0000","last_undegraded":"2024-03-28T12:42:15.216137+0000","last_fullsized":"2024-03-28T12:42:15.216137+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:45.857353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217128+0000","last_change":"2024-03-28T12:42:01.946498+0000","last_active":"2024-03-28T12:42:15.217128+0000","last_peered":"2024-03-28T12:42:15.217128+0000","last_clean":"2024-03-28T12:42:15.217128+0000","last_became_active":"2024-03-28T12:42:01.946087+0000","last_became_peered":"2024-03-28T12:42:01.946087+0000","last_unstale":"2024-03-28T12:42:15.217128+0000","last_undegraded":"2024-03-28T12:42:15.217128+0000","last_fullsized":"2024-03-28T12:42:15.217128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:05:13.466983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.397189+0000","last_change":"2024-03-28T12:42:00.143860+0000","last_active":"2024-03-28T12:42:46.397189+0000","last_peered":"2024-03-28T12:42:46.397189+0000","last_clean":"2024-03-28T12:42:46.397189+0000","last_became_active":"2024-03-28T12:42:00.143537+0000","last_became_peered":"2024-03-28T12:42:00.143537+0000","last_unstale":"2024-03-28T12:42:46.397189+0000","last_undegraded":"2024-03-28T12:42:46.397189+0000","last_fullsized":"2024-03-28T12:42:46.397189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:38:32.416338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.365975+0000","last_change":"2024-03-28T12:42:15.365975+0000","last_active":"2024-03-28T12:42:15.365975+0000","last_peered":"2024-03-28T12:42:15.365975+0000","last_clean":"2024-03-28T12:42:15.365975+0000","last_became_active":"2024-03-28T12:42:15.365535+0000","last_became_peered":"2024-03-28T12:42:15.365535+0000","last_unstale":"2024-03-28T12:42:15.365975+0000","last_undegraded":"2024-03-28T12:42:15.365975+0000","last_fullsized":"2024-03-28T12:42:15.365975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,1],"acting":[2,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.218523+0000","last_change":"2024-03-28T12:42:01.802128+0000","last_active":"2024-03-28T12:42:15.218523+0000","last_peered":"2024-03-28T12:42:15.218523+0000","last_clean":"2024-03-28T12:42:15.218523+0000","last_became_active":"2024-03-28T12:42:01.801492+0000","last_became_peered":"2024-03-28T12:42:01.801492+0000","last_unstale":"2024-03-28T12:42:15.218523+0000","last_undegraded":"2024-03-28T12:42:15.218523+0000","last_fullsized":"2024-03-28T12:42:15.218523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:23:08.932618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'9","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.940441+0000","last_change":"2024-03-28T12:42:00.145914+0000","last_active":"2024-03-28T12:42:43.940441+0000","last_peered":"2024-03-28T12:42:43.940441+0000","last_clean":"2024-03-28T12:42:43.940441+0000","last_became_active":"2024-03-28T12:42:00.145638+0000","last_became_peered":"2024-03-28T12:42:00.145638+0000","last_unstale":"2024-03-28T12:42:43.940441+0000","last_undegraded":"2024-03-28T12:42:43.940441+0000","last_fullsized":"2024-03-28T12:42:43.940441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:47:28.765823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216394+0000","last_change":"2024-03-28T12:42:07.882697+0000","last_active":"2024-03-28T12:42:15.216394+0000","last_peered":"2024-03-28T12:42:15.216394+0000","last_clean":"2024-03-28T12:42:15.216394+0000","last_became_active":"2024-03-28T12:42:07.881730+0000","last_became_peered":"2024-03-28T12:42:07.881730+0000","last_unstale":"2024-03-28T12:42:15.216394+0000","last_undegraded":"2024-03-28T12:42:15.216394+0000","last_fullsized":"2024-03-28T12:42:15.216394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:12:27.231636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361319+0000","last_change":"2024-03-28T12:42:01.810914+0000","last_active":"2024-03-28T12:42:15.361319+0000","last_peered":"2024-03-28T12:42:15.361319+0000","last_clean":"2024-03-28T12:42:15.361319+0000","last_became_active":"2024-03-28T12:42:01.810207+0000","last_became_peered":"2024-03-28T12:42:01.810207+0000","last_unstale":"2024-03-28T12:42:15.361319+0000","last_undegraded":"2024-03-28T12:42:15.361319+0000","last_fullsized":"2024-03-28T12:42:15.361319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:32.704186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.873676+0000","last_change":"2024-03-28T12:42:00.078402+0000","last_active":"2024-03-28T12:42:43.873676+0000","last_peered":"2024-03-28T12:42:43.873676+0000","last_clean":"2024-03-28T12:42:43.873676+0000","last_became_active":"2024-03-28T12:42:00.077988+0000","last_became_peered":"2024-03-28T12:42:00.077988+0000","last_unstale":"2024-03-28T12:42:43.873676+0000","last_undegraded":"2024-03-28T12:42:43.873676+0000","last_fullsized":"2024-03-28T12:42:43.873676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:21:58.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.362387+0000","last_change":"2024-03-28T12:42:07.936419+0000","last_active":"2024-03-28T12:42:15.362387+0000","last_peered":"2024-03-28T12:42:15.362387+0000","last_clean":"2024-03-28T12:42:15.362387+0000","last_became_active":"2024-03-28T12:42:07.935820+0000","last_became_peered":"2024-03-28T12:42:07.935820+0000","last_unstale":"2024-03-28T12:42:15.362387+0000","last_undegraded":"2024-03-28T12:42:15.362387+0000","last_fullsized":"2024-03-28T12:42:15.362387+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:35:08.334379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216161+0000","last_change":"2024-03-28T12:42:01.968887+0000","last_active":"2024-03-28T12:42:15.216161+0000","last_peered":"2024-03-28T12:42:15.216161+0000","last_clean":"2024-03-28T12:42:15.216161+0000","last_became_active":"2024-03-28T12:42:01.965491+0000","last_became_peered":"2024-03-28T12:42:01.965491+0000","last_unstale":"2024-03-28T12:42:15.216161+0000","last_undegraded":"2024-03-28T12:42:15.216161+0000","last_fullsized":"2024-03-28T12:42:15.216161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:35:50.246850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229341+0000","last_change":"2024-03-28T12:42:00.135482+0000","last_active":"2024-03-28T12:42:15.229341+0000","last_peered":"2024-03-28T12:42:15.229341+0000","last_clean":"2024-03-28T12:42:15.229341+0000","last_became_active":"2024-03-28T12:42:00.132939+0000","last_became_peered":"2024-03-28T12:42:00.132939+0000","last_unstale":"2024-03-28T12:42:15.229341+0000","last_undegraded":"2024-03-28T12:42:15.229341+0000","last_fullsized":"2024-03-28T12:42:15.229341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:31:41.407157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360749+0000","last_change":"2024-03-28T12:42:07.865644+0000","last_active":"2024-03-28T12:42:15.360749+0000","last_peered":"2024-03-28T12:42:15.360749+0000","last_clean":"2024-03-28T12:42:15.360749+0000","last_became_active":"2024-03-28T12:42:07.864804+0000","last_became_peered":"2024-03-28T12:42:07.864804+0000","last_unstale":"2024-03-28T12:42:15.360749+0000","last_undegraded":"2024-03-28T12:42:15.360749+0000","last_fullsized":"2024-03-28T12:42:15.360749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:28.659784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359688+0000","last_change":"2024-03-28T12:42:01.966222+0000","last_active":"2024-03-28T12:42:15.359688+0000","last_peered":"2024-03-28T12:42:15.359688+0000","last_clean":"2024-03-28T12:42:15.359688+0000","last_became_active":"2024-03-28T12:42:01.962305+0000","last_became_peered":"2024-03-28T12:42:01.962305+0000","last_unstale":"2024-03-28T12:42:15.359688+0000","last_undegraded":"2024-03-28T12:42:15.359688+0000","last_fullsized":"2024-03-28T12:42:15.359688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:33:35.906886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.396614+0000","last_change":"2024-03-28T12:42:00.137406+0000","last_active":"2024-03-28T12:42:46.396614+0000","last_peered":"2024-03-28T12:42:46.396614+0000","last_clean":"2024-03-28T12:42:46.396614+0000","last_became_active":"2024-03-28T12:42:00.137086+0000","last_became_peered":"2024-03-28T12:42:00.137086+0000","last_unstale":"2024-03-28T12:42:46.396614+0000","last_undegraded":"2024-03-28T12:42:46.396614+0000","last_fullsized":"2024-03-28T12:42:46.396614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:44:10.945015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360602+0000","last_change":"2024-03-28T12:42:07.940726+0000","last_active":"2024-03-28T12:42:15.360602+0000","last_peered":"2024-03-28T12:42:15.360602+0000","last_clean":"2024-03-28T12:42:15.360602+0000","last_became_active":"2024-03-28T12:42:07.939926+0000","last_became_peered":"2024-03-28T12:42:07.939926+0000","last_unstale":"2024-03-28T12:42:15.360602+0000","last_undegraded":"2024-03-28T12:42:15.360602+0000","last_fullsized":"2024-03-28T12:42:15.360602+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:45.857353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.226194+0000","last_change":"2024-03-28T12:42:01.949510+0000","last_active":"2024-03-28T12:42:15.226194+0000","last_peered":"2024-03-28T12:42:15.226194+0000","last_clean":"2024-03-28T12:42:15.226194+0000","last_became_active":"2024-03-28T12:42:01.949046+0000","last_became_peered":"2024-03-28T12:42:01.949046+0000","last_unstale":"2024-03-28T12:42:15.226194+0000","last_undegraded":"2024-03-28T12:42:15.226194+0000","last_fullsized":"2024-03-28T12:42:15.226194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:50:04.915302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'5","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:41.566508+0000","last_change":"2024-03-28T12:42:00.150734+0000","last_active":"2024-03-28T12:42:41.566508+0000","last_peered":"2024-03-28T12:42:41.566508+0000","last_clean":"2024-03-28T12:42:41.566508+0000","last_became_active":"2024-03-28T12:42:00.150209+0000","last_became_peered":"2024-03-28T12:42:00.150209+0000","last_unstale":"2024-03-28T12:42:41.566508+0000","last_undegraded":"2024-03-28T12:42:41.566508+0000","last_fullsized":"2024-03-28T12:42:41.566508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:01:08.734929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361808+0000","last_change":"2024-03-28T12:42:07.935974+0000","last_active":"2024-03-28T12:42:15.361808+0000","last_peered":"2024-03-28T12:42:15.361808+0000","last_clean":"2024-03-28T12:42:15.361808+0000","last_became_active":"2024-03-28T12:42:07.935342+0000","last_became_peered":"2024-03-28T12:42:07.935342+0000","last_unstale":"2024-03-28T12:42:15.361808+0000","last_undegraded":"2024-03-28T12:42:15.361808+0000","last_fullsized":"2024-03-28T12:42:15.361808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:21.970094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360601+0000","last_change":"2024-03-28T12:42:01.961701+0000","last_active":"2024-03-28T12:42:15.360601+0000","last_peered":"2024-03-28T12:42:15.360601+0000","last_clean":"2024-03-28T12:42:15.360601+0000","last_became_active":"2024-03-28T12:42:01.961228+0000","last_became_peered":"2024-03-28T12:42:01.961228+0000","last_unstale":"2024-03-28T12:42:15.360601+0000","last_undegraded":"2024-03-28T12:42:15.360601+0000","last_fullsized":"2024-03-28T12:42:15.360601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:41.599066+0000","last_change":"2024-03-28T12:42:00.069398+0000","last_active":"2024-03-28T12:42:41.599066+0000","last_peered":"2024-03-28T12:42:41.599066+0000","last_clean":"2024-03-28T12:42:41.599066+0000","last_became_active":"2024-03-28T12:42:00.069134+0000","last_became_peered":"2024-03-28T12:42:00.069134+0000","last_unstale":"2024-03-28T12:42:41.599066+0000","last_undegraded":"2024-03-28T12:42:41.599066+0000","last_fullsized":"2024-03-28T12:42:41.599066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:57:54.776311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.365776+0000","last_change":"2024-03-28T12:42:15.365776+0000","last_active":"2024-03-28T12:42:15.365776+0000","last_peered":"2024-03-28T12:42:15.365776+0000","last_clean":"2024-03-28T12:42:15.365776+0000","last_became_active":"2024-03-28T12:42:15.364496+0000","last_became_peered":"2024-03-28T12:42:15.364496+0000","last_unstale":"2024-03-28T12:42:15.365776+0000","last_undegraded":"2024-03-28T12:42:15.365776+0000","last_fullsized":"2024-03-28T12:42:15.365776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:22:09.948471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217033+0000","last_change":"2024-03-28T12:42:01.959210+0000","last_active":"2024-03-28T12:42:15.217033+0000","last_peered":"2024-03-28T12:42:15.217033+0000","last_clean":"2024-03-28T12:42:15.217033+0000","last_became_active":"2024-03-28T12:42:01.958117+0000","last_became_peered":"2024-03-28T12:42:01.958117+0000","last_unstale":"2024-03-28T12:42:15.217033+0000","last_undegraded":"2024-03-28T12:42:15.217033+0000","last_fullsized":"2024-03-28T12:42:15.217033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:28:17.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.873561+0000","last_change":"2024-03-28T12:42:00.134120+0000","last_active":"2024-03-28T12:42:43.873561+0000","last_peered":"2024-03-28T12:42:43.873561+0000","last_clean":"2024-03-28T12:42:43.873561+0000","last_became_active":"2024-03-28T12:42:00.133540+0000","last_became_peered":"2024-03-28T12:42:00.133540+0000","last_unstale":"2024-03-28T12:42:43.873561+0000","last_undegraded":"2024-03-28T12:42:43.873561+0000","last_fullsized":"2024-03-28T12:42:43.873561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:49:47.641947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":182,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352740+0000","last_change":"2024-03-28T12:41:26.701485+0000","last_active":"2024-03-28T12:42:15.352740+0000","last_peered":"2024-03-28T12:42:15.352740+0000","last_clean":"2024-03-28T12:42:15.352740+0000","last_became_active":"2024-03-28T12:41:26.700338+0000","last_became_peered":"2024-03-28T12:41:26.700338+0000","last_unstale":"2024-03-28T12:42:15.352740+0000","last_undegraded":"2024-03-28T12:42:15.352740+0000","last_fullsized":"2024-03-28T12:42:15.352740+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:24.290713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:24.290713+0000","last_clean_scrub_stamp":"2024-03-28T12:41:24.290713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:58:57.536691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229580+0000","last_change":"2024-03-28T12:42:07.938384+0000","last_active":"2024-03-28T12:42:15.229580+0000","last_peered":"2024-03-28T12:42:15.229580+0000","last_clean":"2024-03-28T12:42:15.229580+0000","last_became_active":"2024-03-28T12:42:07.937553+0000","last_became_peered":"2024-03-28T12:42:07.937553+0000","last_unstale":"2024-03-28T12:42:15.229580+0000","last_undegraded":"2024-03-28T12:42:15.229580+0000","last_fullsized":"2024-03-28T12:42:15.229580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:28:13.502930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228823+0000","last_change":"2024-03-28T12:42:01.960107+0000","last_active":"2024-03-28T12:42:15.228823+0000","last_peered":"2024-03-28T12:42:15.228823+0000","last_clean":"2024-03-28T12:42:15.228823+0000","last_became_active":"2024-03-28T12:42:01.959809+0000","last_became_peered":"2024-03-28T12:42:01.959809+0000","last_unstale":"2024-03-28T12:42:15.228823+0000","last_undegraded":"2024-03-28T12:42:15.228823+0000","last_fullsized":"2024-03-28T12:42:15.228823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:38.797683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.990171+0000","last_change":"2024-03-28T12:42:00.144133+0000","last_active":"2024-03-28T12:42:43.990171+0000","last_peered":"2024-03-28T12:42:43.990171+0000","last_clean":"2024-03-28T12:42:43.990171+0000","last_became_active":"2024-03-28T12:42:00.143460+0000","last_became_peered":"2024-03-28T12:42:00.143460+0000","last_unstale":"2024-03-28T12:42:43.990171+0000","last_undegraded":"2024-03-28T12:42:43.990171+0000","last_fullsized":"2024-03-28T12:42:43.990171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215115+0000","last_change":"2024-03-28T12:42:07.902848+0000","last_active":"2024-03-28T12:42:15.215115+0000","last_peered":"2024-03-28T12:42:15.215115+0000","last_clean":"2024-03-28T12:42:15.215115+0000","last_became_active":"2024-03-28T12:42:07.902428+0000","last_became_peered":"2024-03-28T12:42:07.902428+0000","last_unstale":"2024-03-28T12:42:15.215115+0000","last_undegraded":"2024-03-28T12:42:15.215115+0000","last_fullsized":"2024-03-28T12:42:15.215115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:28.659784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359765+0000","last_change":"2024-03-28T12:42:01.950786+0000","last_active":"2024-03-28T12:42:15.359765+0000","last_peered":"2024-03-28T12:42:15.359765+0000","last_clean":"2024-03-28T12:42:15.359765+0000","last_became_active":"2024-03-28T12:42:01.950592+0000","last_became_peered":"2024-03-28T12:42:01.950592+0000","last_unstale":"2024-03-28T12:42:15.359765+0000","last_undegraded":"2024-03-28T12:42:15.359765+0000","last_fullsized":"2024-03-28T12:42:15.359765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:53.224241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.865960+0000","last_change":"2024-03-28T12:42:00.148307+0000","last_active":"2024-03-28T12:42:43.865960+0000","last_peered":"2024-03-28T12:42:43.865960+0000","last_clean":"2024-03-28T12:42:43.865960+0000","last_became_active":"2024-03-28T12:42:00.139237+0000","last_became_peered":"2024-03-28T12:42:00.139237+0000","last_unstale":"2024-03-28T12:42:43.865960+0000","last_undegraded":"2024-03-28T12:42:43.865960+0000","last_fullsized":"2024-03-28T12:42:43.865960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:43:33.699843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227129+0000","last_change":"2024-03-28T12:42:07.885520+0000","last_active":"2024-03-28T12:42:15.227129+0000","last_peered":"2024-03-28T12:42:15.227129+0000","last_clean":"2024-03-28T12:42:15.227129+0000","last_became_active":"2024-03-28T12:42:07.880300+0000","last_became_peered":"2024-03-28T12:42:07.880300+0000","last_unstale":"2024-03-28T12:42:15.227129+0000","last_undegraded":"2024-03-28T12:42:15.227129+0000","last_fullsized":"2024-03-28T12:42:15.227129+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:17:47.670820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359833+0000","last_change":"2024-03-28T12:42:01.962888+0000","last_active":"2024-03-28T12:42:15.359833+0000","last_peered":"2024-03-28T12:42:15.359833+0000","last_clean":"2024-03-28T12:42:15.359833+0000","last_became_active":"2024-03-28T12:42:01.962604+0000","last_became_peered":"2024-03-28T12:42:01.962604+0000","last_unstale":"2024-03-28T12:42:15.359833+0000","last_undegraded":"2024-03-28T12:42:15.359833+0000","last_fullsized":"2024-03-28T12:42:15.359833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:49.327792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.185566+0000","last_change":"2024-03-28T12:42:00.085372+0000","last_active":"2024-03-28T12:42:46.185566+0000","last_peered":"2024-03-28T12:42:46.185566+0000","last_clean":"2024-03-28T12:42:46.185566+0000","last_became_active":"2024-03-28T12:42:00.084866+0000","last_became_peered":"2024-03-28T12:42:00.084866+0000","last_unstale":"2024-03-28T12:42:46.185566+0000","last_undegraded":"2024-03-28T12:42:46.185566+0000","last_fullsized":"2024-03-28T12:42:46.185566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:21:45.688123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227629+0000","last_change":"2024-03-28T12:42:07.899218+0000","last_active":"2024-03-28T12:42:15.227629+0000","last_peered":"2024-03-28T12:42:15.227629+0000","last_clean":"2024-03-28T12:42:15.227629+0000","last_became_active":"2024-03-28T12:42:07.898853+0000","last_became_peered":"2024-03-28T12:42:07.898853+0000","last_unstale":"2024-03-28T12:42:15.227629+0000","last_undegraded":"2024-03-28T12:42:15.227629+0000","last_fullsized":"2024-03-28T12:42:15.227629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:21.240557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216536+0000","last_change":"2024-03-28T12:42:01.965370+0000","last_active":"2024-03-28T12:42:15.216536+0000","last_peered":"2024-03-28T12:42:15.216536+0000","last_clean":"2024-03-28T12:42:15.216536+0000","last_became_active":"2024-03-28T12:42:01.964442+0000","last_became_peered":"2024-03-28T12:42:01.964442+0000","last_unstale":"2024-03-28T12:42:15.216536+0000","last_undegraded":"2024-03-28T12:42:15.216536+0000","last_fullsized":"2024-03-28T12:42:15.216536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:35.775033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359990+0000","last_change":"2024-03-28T12:42:00.153658+0000","last_active":"2024-03-28T12:42:15.359990+0000","last_peered":"2024-03-28T12:42:15.359990+0000","last_clean":"2024-03-28T12:42:15.359990+0000","last_became_active":"2024-03-28T12:42:00.153292+0000","last_became_peered":"2024-03-28T12:42:00.153292+0000","last_unstale":"2024-03-28T12:42:15.359990+0000","last_undegraded":"2024-03-28T12:42:15.359990+0000","last_fullsized":"2024-03-28T12:42:15.359990+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:54.524905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.353046+0000","last_change":"2024-03-28T12:42:07.900126+0000","last_active":"2024-03-28T12:42:15.353046+0000","last_peered":"2024-03-28T12:42:15.353046+0000","last_clean":"2024-03-28T12:42:15.353046+0000","last_became_active":"2024-03-28T12:42:07.899780+0000","last_became_peered":"2024-03-28T12:42:07.899780+0000","last_unstale":"2024-03-28T12:42:15.353046+0000","last_undegraded":"2024-03-28T12:42:15.353046+0000","last_fullsized":"2024-03-28T12:42:15.353046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:31.070732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228279+0000","last_change":"2024-03-28T12:42:01.962221+0000","last_active":"2024-03-28T12:42:15.228279+0000","last_peered":"2024-03-28T12:42:15.228279+0000","last_clean":"2024-03-28T12:42:15.228279+0000","last_became_active":"2024-03-28T12:42:01.961938+0000","last_became_peered":"2024-03-28T12:42:01.961938+0000","last_unstale":"2024-03-28T12:42:15.228279+0000","last_undegraded":"2024-03-28T12:42:15.228279+0000","last_fullsized":"2024-03-28T12:42:15.228279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:55:52.354803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'17","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.971223+0000","last_change":"2024-03-28T12:42:00.132287+0000","last_active":"2024-03-28T12:42:43.971223+0000","last_peered":"2024-03-28T12:42:43.971223+0000","last_clean":"2024-03-28T12:42:43.971223+0000","last_became_active":"2024-03-28T12:42:00.131064+0000","last_became_peered":"2024-03-28T12:42:00.131064+0000","last_unstale":"2024-03-28T12:42:43.971223+0000","last_undegraded":"2024-03-28T12:42:43.971223+0000","last_fullsized":"2024-03-28T12:42:43.971223+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229667+0000","last_change":"2024-03-28T12:42:07.887453+0000","last_active":"2024-03-28T12:42:15.229667+0000","last_peered":"2024-03-28T12:42:15.229667+0000","last_clean":"2024-03-28T12:42:15.229667+0000","last_became_active":"2024-03-28T12:42:07.886685+0000","last_became_peered":"2024-03-28T12:42:07.886685+0000","last_unstale":"2024-03-28T12:42:15.229667+0000","last_undegraded":"2024-03-28T12:42:15.229667+0000","last_fullsized":"2024-03-28T12:42:15.229667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:10:05.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352581+0000","last_change":"2024-03-28T12:42:01.961318+0000","last_active":"2024-03-28T12:42:15.352581+0000","last_peered":"2024-03-28T12:42:15.352581+0000","last_clean":"2024-03-28T12:42:15.352581+0000","last_became_active":"2024-03-28T12:42:01.960102+0000","last_became_peered":"2024-03-28T12:42:01.960102+0000","last_unstale":"2024-03-28T12:42:15.352581+0000","last_undegraded":"2024-03-28T12:42:15.352581+0000","last_fullsized":"2024-03-28T12:42:15.352581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.870663+0000","last_change":"2024-03-28T12:42:00.145117+0000","last_active":"2024-03-28T12:42:43.870663+0000","last_peered":"2024-03-28T12:42:43.870663+0000","last_clean":"2024-03-28T12:42:43.870663+0000","last_became_active":"2024-03-28T12:42:00.144572+0000","last_became_peered":"2024-03-28T12:42:00.144572+0000","last_unstale":"2024-03-28T12:42:43.870663+0000","last_undegraded":"2024-03-28T12:42:43.870663+0000","last_fullsized":"2024-03-28T12:42:43.870663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:21:45.688123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.232187+0000","last_change":"2024-03-28T12:42:07.885727+0000","last_active":"2024-03-28T12:42:15.232187+0000","last_peered":"2024-03-28T12:42:15.232187+0000","last_clean":"2024-03-28T12:42:15.232187+0000","last_became_active":"2024-03-28T12:42:07.884760+0000","last_became_peered":"2024-03-28T12:42:07.884760+0000","last_unstale":"2024-03-28T12:42:15.232187+0000","last_undegraded":"2024-03-28T12:42:15.232187+0000","last_fullsized":"2024-03-28T12:42:15.232187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:45.171876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228766+0000","last_change":"2024-03-28T12:42:01.936371+0000","last_active":"2024-03-28T12:42:15.228766+0000","last_peered":"2024-03-28T12:42:15.228766+0000","last_clean":"2024-03-28T12:42:15.228766+0000","last_became_active":"2024-03-28T12:42:01.936080+0000","last_became_peered":"2024-03-28T12:42:01.936080+0000","last_unstale":"2024-03-28T12:42:15.228766+0000","last_undegraded":"2024-03-28T12:42:15.228766+0000","last_fullsized":"2024-03-28T12:42:15.228766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:36.955339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.873539+0000","last_change":"2024-03-28T12:42:00.139149+0000","last_active":"2024-03-28T12:42:43.873539+0000","last_peered":"2024-03-28T12:42:43.873539+0000","last_clean":"2024-03-28T12:42:43.873539+0000","last_became_active":"2024-03-28T12:42:00.138555+0000","last_became_peered":"2024-03-28T12:42:00.138555+0000","last_unstale":"2024-03-28T12:42:43.873539+0000","last_undegraded":"2024-03-28T12:42:43.873539+0000","last_fullsized":"2024-03-28T12:42:43.873539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:44:12.403916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360325+0000","last_change":"2024-03-28T12:42:07.940362+0000","last_active":"2024-03-28T12:42:15.360325+0000","last_peered":"2024-03-28T12:42:15.360325+0000","last_clean":"2024-03-28T12:42:15.360325+0000","last_became_active":"2024-03-28T12:42:07.939396+0000","last_became_peered":"2024-03-28T12:42:07.939396+0000","last_unstale":"2024-03-28T12:42:15.360325+0000","last_undegraded":"2024-03-28T12:42:15.360325+0000","last_fullsized":"2024-03-28T12:42:15.360325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:59.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361226+0000","last_change":"2024-03-28T12:42:01.800361+0000","last_active":"2024-03-28T12:42:15.361226+0000","last_peered":"2024-03-28T12:42:15.361226+0000","last_clean":"2024-03-28T12:42:15.361226+0000","last_became_active":"2024-03-28T12:42:01.799594+0000","last_became_peered":"2024-03-28T12:42:01.799594+0000","last_unstale":"2024-03-28T12:42:15.361226+0000","last_undegraded":"2024-03-28T12:42:15.361226+0000","last_fullsized":"2024-03-28T12:42:15.361226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:35.775033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'9","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.195411+0000","last_change":"2024-03-28T12:42:00.143501+0000","last_active":"2024-03-28T12:42:46.195411+0000","last_peered":"2024-03-28T12:42:46.195411+0000","last_clean":"2024-03-28T12:42:46.195411+0000","last_became_active":"2024-03-28T12:42:00.142913+0000","last_became_peered":"2024-03-28T12:42:00.142913+0000","last_unstale":"2024-03-28T12:42:46.195411+0000","last_undegraded":"2024-03-28T12:42:46.195411+0000","last_fullsized":"2024-03-28T12:42:46.195411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228689+0000","last_change":"2024-03-28T12:42:07.938687+0000","last_active":"2024-03-28T12:42:15.228689+0000","last_peered":"2024-03-28T12:42:15.228689+0000","last_clean":"2024-03-28T12:42:15.228689+0000","last_became_active":"2024-03-28T12:42:07.938081+0000","last_became_peered":"2024-03-28T12:42:07.938081+0000","last_unstale":"2024-03-28T12:42:15.228689+0000","last_undegraded":"2024-03-28T12:42:15.228689+0000","last_fullsized":"2024-03-28T12:42:15.228689+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:47.148457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359939+0000","last_change":"2024-03-28T12:42:01.938516+0000","last_active":"2024-03-28T12:42:15.359939+0000","last_peered":"2024-03-28T12:42:15.359939+0000","last_clean":"2024-03-28T12:42:15.359939+0000","last_became_active":"2024-03-28T12:42:01.938251+0000","last_became_peered":"2024-03-28T12:42:01.938251+0000","last_unstale":"2024-03-28T12:42:15.359939+0000","last_undegraded":"2024-03-28T12:42:15.359939+0000","last_fullsized":"2024-03-28T12:42:15.359939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:15.595901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'15","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.302999+0000","last_change":"2024-03-28T12:42:00.141127+0000","last_active":"2024-03-28T12:42:46.302999+0000","last_peered":"2024-03-28T12:42:46.302999+0000","last_clean":"2024-03-28T12:42:46.302999+0000","last_became_active":"2024-03-28T12:42:00.140832+0000","last_became_peered":"2024-03-28T12:42:00.140832+0000","last_unstale":"2024-03-28T12:42:46.302999+0000","last_undegraded":"2024-03-28T12:42:46.302999+0000","last_fullsized":"2024-03-28T12:42:46.302999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:01:04.151858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216619+0000","last_change":"2024-03-28T12:42:07.936963+0000","last_active":"2024-03-28T12:42:15.216619+0000","last_peered":"2024-03-28T12:42:15.216619+0000","last_clean":"2024-03-28T12:42:15.216619+0000","last_became_active":"2024-03-28T12:42:07.936606+0000","last_became_peered":"2024-03-28T12:42:07.936606+0000","last_unstale":"2024-03-28T12:42:15.216619+0000","last_undegraded":"2024-03-28T12:42:15.216619+0000","last_fullsized":"2024-03-28T12:42:15.216619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:37:04.083032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228759+0000","last_change":"2024-03-28T12:42:01.962855+0000","last_active":"2024-03-28T12:42:15.228759+0000","last_peered":"2024-03-28T12:42:15.228759+0000","last_clean":"2024-03-28T12:42:15.228759+0000","last_became_active":"2024-03-28T12:42:01.962546+0000","last_became_peered":"2024-03-28T12:42:01.962546+0000","last_unstale":"2024-03-28T12:42:15.228759+0000","last_undegraded":"2024-03-28T12:42:15.228759+0000","last_fullsized":"2024-03-28T12:42:15.228759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:08.429940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'5","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.315966+0000","last_change":"2024-03-28T12:42:00.138923+0000","last_active":"2024-03-28T12:42:38.315966+0000","last_peered":"2024-03-28T12:42:38.315966+0000","last_clean":"2024-03-28T12:42:38.315966+0000","last_became_active":"2024-03-28T12:42:00.138233+0000","last_became_peered":"2024-03-28T12:42:00.138233+0000","last_unstale":"2024-03-28T12:42:38.315966+0000","last_undegraded":"2024-03-28T12:42:38.315966+0000","last_fullsized":"2024-03-28T12:42:38.315966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215066+0000","last_change":"2024-03-28T12:42:07.907163+0000","last_active":"2024-03-28T12:42:15.215066+0000","last_peered":"2024-03-28T12:42:15.215066+0000","last_clean":"2024-03-28T12:42:15.215066+0000","last_became_active":"2024-03-28T12:42:07.906334+0000","last_became_peered":"2024-03-28T12:42:07.906334+0000","last_unstale":"2024-03-28T12:42:15.215066+0000","last_undegraded":"2024-03-28T12:42:15.215066+0000","last_fullsized":"2024-03-28T12:42:15.215066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:59.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.232689+0000","last_change":"2024-03-28T12:42:01.809232+0000","last_active":"2024-03-28T12:42:15.232689+0000","last_peered":"2024-03-28T12:42:15.232689+0000","last_clean":"2024-03-28T12:42:15.232689+0000","last_became_active":"2024-03-28T12:42:01.805284+0000","last_became_peered":"2024-03-28T12:42:01.805284+0000","last_unstale":"2024-03-28T12:42:15.232689+0000","last_undegraded":"2024-03-28T12:42:15.232689+0000","last_fullsized":"2024-03-28T12:42:15.232689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:20:54.180080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:46.209315+0000","last_change":"2024-03-28T12:42:00.147739+0000","last_active":"2024-03-28T12:42:46.209315+0000","last_peered":"2024-03-28T12:42:46.209315+0000","last_clean":"2024-03-28T12:42:46.209315+0000","last_became_active":"2024-03-28T12:42:00.147407+0000","last_became_peered":"2024-03-28T12:42:00.147407+0000","last_unstale":"2024-03-28T12:42:46.209315+0000","last_undegraded":"2024-03-28T12:42:46.209315+0000","last_fullsized":"2024-03-28T12:42:46.209315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:29.908949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.218877+0000","last_change":"2024-03-28T12:42:07.900662+0000","last_active":"2024-03-28T12:42:15.218877+0000","last_peered":"2024-03-28T12:42:15.218877+0000","last_clean":"2024-03-28T12:42:15.218877+0000","last_became_active":"2024-03-28T12:42:07.899628+0000","last_became_peered":"2024-03-28T12:42:07.899628+0000","last_unstale":"2024-03-28T12:42:15.218877+0000","last_undegraded":"2024-03-28T12:42:15.218877+0000","last_fullsized":"2024-03-28T12:42:15.218877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:31.070732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216320+0000","last_change":"2024-03-28T12:42:01.967776+0000","last_active":"2024-03-28T12:42:15.216320+0000","last_peered":"2024-03-28T12:42:15.216320+0000","last_clean":"2024-03-28T12:42:15.216320+0000","last_became_active":"2024-03-28T12:42:01.964830+0000","last_became_peered":"2024-03-28T12:42:01.964830+0000","last_unstale":"2024-03-28T12:42:15.216320+0000","last_undegraded":"2024-03-28T12:42:15.216320+0000","last_fullsized":"2024-03-28T12:42:15.216320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.454635+0000","last_change":"2024-03-28T12:42:00.142326+0000","last_active":"2024-03-28T12:42:38.454635+0000","last_peered":"2024-03-28T12:42:38.454635+0000","last_clean":"2024-03-28T12:42:38.454635+0000","last_became_active":"2024-03-28T12:42:00.141602+0000","last_became_peered":"2024-03-28T12:42:00.141602+0000","last_unstale":"2024-03-28T12:42:38.454635+0000","last_undegraded":"2024-03-28T12:42:38.454635+0000","last_fullsized":"2024-03-28T12:42:38.454635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217682+0000","last_change":"2024-03-28T12:42:07.935882+0000","last_active":"2024-03-28T12:42:15.217682+0000","last_peered":"2024-03-28T12:42:15.217682+0000","last_clean":"2024-03-28T12:42:15.217682+0000","last_became_active":"2024-03-28T12:42:07.935525+0000","last_became_peered":"2024-03-28T12:42:07.935525+0000","last_unstale":"2024-03-28T12:42:15.217682+0000","last_undegraded":"2024-03-28T12:42:15.217682+0000","last_fullsized":"2024-03-28T12:42:15.217682+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:50:31.463779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216828+0000","last_change":"2024-03-28T12:42:07.882782+0000","last_active":"2024-03-28T12:42:15.216828+0000","last_peered":"2024-03-28T12:42:15.216828+0000","last_clean":"2024-03-28T12:42:15.216828+0000","last_became_active":"2024-03-28T12:42:07.881527+0000","last_became_peered":"2024-03-28T12:42:07.881527+0000","last_unstale":"2024-03-28T12:42:15.216828+0000","last_undegraded":"2024-03-28T12:42:15.216828+0000","last_fullsized":"2024-03-28T12:42:15.216828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:55.701985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217935+0000","last_change":"2024-03-28T12:42:01.958791+0000","last_active":"2024-03-28T12:42:15.217935+0000","last_peered":"2024-03-28T12:42:15.217935+0000","last_clean":"2024-03-28T12:42:15.217935+0000","last_became_active":"2024-03-28T12:42:01.957991+0000","last_became_peered":"2024-03-28T12:42:01.957991+0000","last_unstale":"2024-03-28T12:42:15.217935+0000","last_undegraded":"2024-03-28T12:42:15.217935+0000","last_fullsized":"2024-03-28T12:42:15.217935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:24.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'3","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.873623+0000","last_change":"2024-03-28T12:42:00.132942+0000","last_active":"2024-03-28T12:42:43.873623+0000","last_peered":"2024-03-28T12:42:43.873623+0000","last_clean":"2024-03-28T12:42:43.873623+0000","last_became_active":"2024-03-28T12:42:00.132663+0000","last_became_peered":"2024-03-28T12:42:00.132663+0000","last_unstale":"2024-03-28T12:42:43.873623+0000","last_undegraded":"2024-03-28T12:42:43.873623+0000","last_fullsized":"2024-03-28T12:42:43.873623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:41.612613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229445+0000","last_change":"2024-03-28T12:42:07.901907+0000","last_active":"2024-03-28T12:42:15.229445+0000","last_peered":"2024-03-28T12:42:15.229445+0000","last_clean":"2024-03-28T12:42:15.229445+0000","last_became_active":"2024-03-28T12:42:07.901398+0000","last_became_peered":"2024-03-28T12:42:07.901398+0000","last_unstale":"2024-03-28T12:42:15.229445+0000","last_undegraded":"2024-03-28T12:42:15.229445+0000","last_fullsized":"2024-03-28T12:42:15.229445+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:49:41.408808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.226666+0000","last_change":"2024-03-28T12:42:01.811306+0000","last_active":"2024-03-28T12:42:15.226666+0000","last_peered":"2024-03-28T12:42:15.226666+0000","last_clean":"2024-03-28T12:42:15.226666+0000","last_became_active":"2024-03-28T12:42:01.810142+0000","last_became_peered":"2024-03-28T12:42:01.810142+0000","last_unstale":"2024-03-28T12:42:15.226666+0000","last_undegraded":"2024-03-28T12:42:15.226666+0000","last_fullsized":"2024-03-28T12:42:15.226666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:37:22.386341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:41.328659+0000","last_change":"2024-03-28T12:42:00.142916+0000","last_active":"2024-03-28T12:42:41.328659+0000","last_peered":"2024-03-28T12:42:41.328659+0000","last_clean":"2024-03-28T12:42:41.328659+0000","last_became_active":"2024-03-28T12:42:00.142006+0000","last_became_peered":"2024-03-28T12:42:00.142006+0000","last_unstale":"2024-03-28T12:42:41.328659+0000","last_undegraded":"2024-03-28T12:42:41.328659+0000","last_fullsized":"2024-03-28T12:42:41.328659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:01:08.734929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:43.874594+0000","last_change":"2024-03-28T12:42:00.143738+0000","last_active":"2024-03-28T12:42:43.874594+0000","last_peered":"2024-03-28T12:42:43.874594+0000","last_clean":"2024-03-28T12:42:43.874594+0000","last_became_active":"2024-03-28T12:42:00.143474+0000","last_became_peered":"2024-03-28T12:42:00.143474+0000","last_unstale":"2024-03-28T12:42:43.874594+0000","last_undegraded":"2024-03-28T12:42:43.874594+0000","last_fullsized":"2024-03-28T12:42:43.874594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:43:33.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.217213+0000","last_change":"2024-03-28T12:42:01.938147+0000","last_active":"2024-03-28T12:42:15.217213+0000","last_peered":"2024-03-28T12:42:15.217213+0000","last_clean":"2024-03-28T12:42:15.217213+0000","last_became_active":"2024-03-28T12:42:01.937612+0000","last_became_peered":"2024-03-28T12:42:01.937612+0000","last_unstale":"2024-03-28T12:42:15.217213+0000","last_undegraded":"2024-03-28T12:42:15.217213+0000","last_fullsized":"2024-03-28T12:42:15.217213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:31:15.643101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216896+0000","last_change":"2024-03-28T12:42:07.870201+0000","last_active":"2024-03-28T12:42:15.216896+0000","last_peered":"2024-03-28T12:42:15.216896+0000","last_clean":"2024-03-28T12:42:15.216896+0000","last_became_active":"2024-03-28T12:42:07.869628+0000","last_became_peered":"2024-03-28T12:42:07.869628+0000","last_unstale":"2024-03-28T12:42:15.216896+0000","last_undegraded":"2024-03-28T12:42:15.216896+0000","last_fullsized":"2024-03-28T12:42:15.216896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:38.525365+0000","last_change":"2024-03-28T12:42:00.146260+0000","last_active":"2024-03-28T12:42:38.525365+0000","last_peered":"2024-03-28T12:42:38.525365+0000","last_clean":"2024-03-28T12:42:38.525365+0000","last_became_active":"2024-03-28T12:42:00.146052+0000","last_became_peered":"2024-03-28T12:42:00.146052+0000","last_unstale":"2024-03-28T12:42:38.525365+0000","last_undegraded":"2024-03-28T12:42:38.525365+0000","last_fullsized":"2024-03-28T12:42:38.525365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:08.118205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352739+0000","last_change":"2024-03-28T12:42:01.966002+0000","last_active":"2024-03-28T12:42:15.352739+0000","last_peered":"2024-03-28T12:42:15.352739+0000","last_clean":"2024-03-28T12:42:15.352739+0000","last_became_active":"2024-03-28T12:42:01.965598+0000","last_became_peered":"2024-03-28T12:42:01.965598+0000","last_unstale":"2024-03-28T12:42:15.352739+0000","last_undegraded":"2024-03-28T12:42:15.352739+0000","last_fullsized":"2024-03-28T12:42:15.352739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:35:50.246850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.363695+0000","last_change":"2024-03-28T12:42:15.361649+0000","last_active":"2024-03-28T12:42:15.363695+0000","last_peered":"2024-03-28T12:42:15.363695+0000","last_clean":"2024-03-28T12:42:15.363695+0000","last_became_active":"2024-03-28T12:42:15.360743+0000","last_became_peered":"2024-03-28T12:42:15.360743+0000","last_unstale":"2024-03-28T12:42:15.363695+0000","last_undegraded":"2024-03-28T12:42:15.363695+0000","last_fullsized":"2024-03-28T12:42:15.363695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:55.701985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.214938+0000","last_change":"2024-03-28T12:42:01.965237+0000","last_active":"2024-03-28T12:42:15.214938+0000","last_peered":"2024-03-28T12:42:15.214938+0000","last_clean":"2024-03-28T12:42:15.214938+0000","last_became_active":"2024-03-28T12:42:01.964468+0000","last_became_peered":"2024-03-28T12:42:01.964468+0000","last_unstale":"2024-03-28T12:42:15.214938+0000","last_undegraded":"2024-03-28T12:42:15.214938+0000","last_fullsized":"2024-03-28T12:42:15.214938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:05.744451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.220849+0000","last_change":"2024-03-28T12:42:01.959553+0000","last_active":"2024-03-28T12:42:15.220849+0000","last_peered":"2024-03-28T12:42:15.220849+0000","last_clean":"2024-03-28T12:42:15.220849+0000","last_became_active":"2024-03-28T12:42:01.958333+0000","last_became_peered":"2024-03-28T12:42:01.958333+0000","last_unstale":"2024-03-28T12:42:15.220849+0000","last_undegraded":"2024-03-28T12:42:15.220849+0000","last_fullsized":"2024-03-28T12:42:15.220849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:05.744451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228041+0000","last_change":"2024-03-28T12:42:01.805452+0000","last_active":"2024-03-28T12:42:15.228041+0000","last_peered":"2024-03-28T12:42:15.228041+0000","last_clean":"2024-03-28T12:42:15.228041+0000","last_became_active":"2024-03-28T12:42:01.805288+0000","last_became_peered":"2024-03-28T12:42:01.805288+0000","last_unstale":"2024-03-28T12:42:15.228041+0000","last_undegraded":"2024-03-28T12:42:15.228041+0000","last_fullsized":"2024-03-28T12:42:15.228041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:17:01.582670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.228480+0000","last_change":"2024-03-28T12:42:01.947234+0000","last_active":"2024-03-28T12:42:15.228480+0000","last_peered":"2024-03-28T12:42:15.228480+0000","last_clean":"2024-03-28T12:42:15.228480+0000","last_became_active":"2024-03-28T12:42:01.946859+0000","last_became_peered":"2024-03-28T12:42:01.946859+0000","last_unstale":"2024-03-28T12:42:15.228480+0000","last_undegraded":"2024-03-28T12:42:15.228480+0000","last_fullsized":"2024-03-28T12:42:15.228480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:36:05.320541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.361030+0000","last_change":"2024-03-28T12:42:01.935265+0000","last_active":"2024-03-28T12:42:15.361030+0000","last_peered":"2024-03-28T12:42:15.361030+0000","last_clean":"2024-03-28T12:42:15.361030+0000","last_became_active":"2024-03-28T12:42:01.934578+0000","last_became_peered":"2024-03-28T12:42:01.934578+0000","last_unstale":"2024-03-28T12:42:15.361030+0000","last_undegraded":"2024-03-28T12:42:15.361030+0000","last_fullsized":"2024-03-28T12:42:15.361030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:24.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.362422+0000","last_change":"2024-03-28T12:42:01.946191+0000","last_active":"2024-03-28T12:42:15.362422+0000","last_peered":"2024-03-28T12:42:15.362422+0000","last_clean":"2024-03-28T12:42:15.362422+0000","last_became_active":"2024-03-28T12:42:01.945804+0000","last_became_peered":"2024-03-28T12:42:01.945804+0000","last_unstale":"2024-03-28T12:42:15.362422+0000","last_undegraded":"2024-03-28T12:42:15.362422+0000","last_fullsized":"2024-03-28T12:42:15.362422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:40.221005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216237+0000","last_change":"2024-03-28T12:42:01.969416+0000","last_active":"2024-03-28T12:42:15.216237+0000","last_peered":"2024-03-28T12:42:15.216237+0000","last_clean":"2024-03-28T12:42:15.216237+0000","last_became_active":"2024-03-28T12:42:01.969078+0000","last_became_peered":"2024-03-28T12:42:01.969078+0000","last_unstale":"2024-03-28T12:42:15.216237+0000","last_undegraded":"2024-03-28T12:42:15.216237+0000","last_fullsized":"2024-03-28T12:42:15.216237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.231988+0000","last_change":"2024-03-28T12:42:01.958402+0000","last_active":"2024-03-28T12:42:15.231988+0000","last_peered":"2024-03-28T12:42:15.231988+0000","last_clean":"2024-03-28T12:42:15.231988+0000","last_became_active":"2024-03-28T12:42:01.958074+0000","last_became_peered":"2024-03-28T12:42:01.958074+0000","last_unstale":"2024-03-28T12:42:15.231988+0000","last_undegraded":"2024-03-28T12:42:15.231988+0000","last_fullsized":"2024-03-28T12:42:15.231988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:18:04.255456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227744+0000","last_change":"2024-03-28T12:42:01.811823+0000","last_active":"2024-03-28T12:42:15.227744+0000","last_peered":"2024-03-28T12:42:15.227744+0000","last_clean":"2024-03-28T12:42:15.227744+0000","last_became_active":"2024-03-28T12:42:01.811548+0000","last_became_peered":"2024-03-28T12:42:01.811548+0000","last_unstale":"2024-03-28T12:42:15.227744+0000","last_undegraded":"2024-03-28T12:42:15.227744+0000","last_fullsized":"2024-03-28T12:42:15.227744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:00:51.741925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227697+0000","last_change":"2024-03-28T12:42:01.959291+0000","last_active":"2024-03-28T12:42:15.227697+0000","last_peered":"2024-03-28T12:42:15.227697+0000","last_clean":"2024-03-28T12:42:15.227697+0000","last_became_active":"2024-03-28T12:42:01.958942+0000","last_became_peered":"2024-03-28T12:42:01.958942+0000","last_unstale":"2024-03-28T12:42:15.227697+0000","last_undegraded":"2024-03-28T12:42:15.227697+0000","last_fullsized":"2024-03-28T12:42:15.227697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:52:46.128830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.352606+0000","last_change":"2024-03-28T12:42:01.965790+0000","last_active":"2024-03-28T12:42:15.352606+0000","last_peered":"2024-03-28T12:42:15.352606+0000","last_clean":"2024-03-28T12:42:15.352606+0000","last_became_active":"2024-03-28T12:42:01.965526+0000","last_became_peered":"2024-03-28T12:42:01.965526+0000","last_unstale":"2024-03-28T12:42:15.352606+0000","last_undegraded":"2024-03-28T12:42:15.352606+0000","last_fullsized":"2024-03-28T12:42:15.352606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216990+0000","last_change":"2024-03-28T12:42:01.960761+0000","last_active":"2024-03-28T12:42:15.216990+0000","last_peered":"2024-03-28T12:42:15.216990+0000","last_clean":"2024-03-28T12:42:15.216990+0000","last_became_active":"2024-03-28T12:42:01.960325+0000","last_became_peered":"2024-03-28T12:42:01.960325+0000","last_unstale":"2024-03-28T12:42:15.216990+0000","last_undegraded":"2024-03-28T12:42:15.216990+0000","last_fullsized":"2024-03-28T12:42:15.216990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:40.221005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359720+0000","last_change":"2024-03-28T12:42:01.960053+0000","last_active":"2024-03-28T12:42:15.359720+0000","last_peered":"2024-03-28T12:42:15.359720+0000","last_clean":"2024-03-28T12:42:15.359720+0000","last_became_active":"2024-03-28T12:42:01.959801+0000","last_became_peered":"2024-03-28T12:42:01.959801+0000","last_unstale":"2024-03-28T12:42:15.359720+0000","last_undegraded":"2024-03-28T12:42:15.359720+0000","last_fullsized":"2024-03-28T12:42:15.359720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:22.285591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229465+0000","last_change":"2024-03-28T12:42:01.788603+0000","last_active":"2024-03-28T12:42:15.229465+0000","last_peered":"2024-03-28T12:42:15.229465+0000","last_clean":"2024-03-28T12:42:15.229465+0000","last_became_active":"2024-03-28T12:42:01.788431+0000","last_became_peered":"2024-03-28T12:42:01.788431+0000","last_unstale":"2024-03-28T12:42:15.229465+0000","last_undegraded":"2024-03-28T12:42:15.229465+0000","last_fullsized":"2024-03-28T12:42:15.229465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:09:59.404128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.221976+0000","last_change":"2024-03-28T12:42:01.960518+0000","last_active":"2024-03-28T12:42:15.221976+0000","last_peered":"2024-03-28T12:42:15.221976+0000","last_clean":"2024-03-28T12:42:15.221976+0000","last_became_active":"2024-03-28T12:42:01.959832+0000","last_became_peered":"2024-03-28T12:42:01.959832+0000","last_unstale":"2024-03-28T12:42:15.221976+0000","last_undegraded":"2024-03-28T12:42:15.221976+0000","last_fullsized":"2024-03-28T12:42:15.221976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229874+0000","last_change":"2024-03-28T12:42:01.936477+0000","last_active":"2024-03-28T12:42:15.229874+0000","last_peered":"2024-03-28T12:42:15.229874+0000","last_clean":"2024-03-28T12:42:15.229874+0000","last_became_active":"2024-03-28T12:42:01.936175+0000","last_became_peered":"2024-03-28T12:42:01.936175+0000","last_unstale":"2024-03-28T12:42:15.229874+0000","last_undegraded":"2024-03-28T12:42:15.229874+0000","last_fullsized":"2024-03-28T12:42:15.229874+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:14:14.822668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.227742+0000","last_change":"2024-03-28T12:42:01.960054+0000","last_active":"2024-03-28T12:42:15.227742+0000","last_peered":"2024-03-28T12:42:15.227742+0000","last_clean":"2024-03-28T12:42:15.227742+0000","last_became_active":"2024-03-28T12:42:01.959791+0000","last_became_peered":"2024-03-28T12:42:01.959791+0000","last_unstale":"2024-03-28T12:42:15.227742+0000","last_undegraded":"2024-03-28T12:42:15.227742+0000","last_fullsized":"2024-03-28T12:42:15.227742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:06:44.099531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.233310+0000","last_change":"2024-03-28T12:42:15.233310+0000","last_active":"2024-03-28T12:42:15.233310+0000","last_peered":"2024-03-28T12:42:15.233310+0000","last_clean":"2024-03-28T12:42:15.233310+0000","last_became_active":"2024-03-28T12:42:15.232678+0000","last_became_peered":"2024-03-28T12:42:15.232678+0000","last_unstale":"2024-03-28T12:42:15.233310+0000","last_undegraded":"2024-03-28T12:42:15.233310+0000","last_fullsized":"2024-03-28T12:42:15.233310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:11:33.781054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360961+0000","last_change":"2024-03-28T12:42:01.948602+0000","last_active":"2024-03-28T12:42:15.360961+0000","last_peered":"2024-03-28T12:42:15.360961+0000","last_clean":"2024-03-28T12:42:15.360961+0000","last_became_active":"2024-03-28T12:42:01.947869+0000","last_became_peered":"2024-03-28T12:42:01.947869+0000","last_unstale":"2024-03-28T12:42:15.360961+0000","last_undegraded":"2024-03-28T12:42:15.360961+0000","last_fullsized":"2024-03-28T12:42:15.360961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.362751+0000","last_change":"2024-03-28T12:42:01.940521+0000","last_active":"2024-03-28T12:42:15.362751+0000","last_peered":"2024-03-28T12:42:15.362751+0000","last_clean":"2024-03-28T12:42:15.362751+0000","last_became_active":"2024-03-28T12:42:01.939756+0000","last_became_peered":"2024-03-28T12:42:01.939756+0000","last_unstale":"2024-03-28T12:42:15.362751+0000","last_undegraded":"2024-03-28T12:42:15.362751+0000","last_fullsized":"2024-03-28T12:42:15.362751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:53:37.869232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359674+0000","last_change":"2024-03-28T12:42:01.960377+0000","last_active":"2024-03-28T12:42:15.359674+0000","last_peered":"2024-03-28T12:42:15.359674+0000","last_clean":"2024-03-28T12:42:15.359674+0000","last_became_active":"2024-03-28T12:42:01.960012+0000","last_became_peered":"2024-03-28T12:42:01.960012+0000","last_unstale":"2024-03-28T12:42:15.359674+0000","last_undegraded":"2024-03-28T12:42:15.359674+0000","last_fullsized":"2024-03-28T12:42:15.359674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:19:20.801201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359855+0000","last_change":"2024-03-28T12:42:01.937280+0000","last_active":"2024-03-28T12:42:15.359855+0000","last_peered":"2024-03-28T12:42:15.359855+0000","last_clean":"2024-03-28T12:42:15.359855+0000","last_became_active":"2024-03-28T12:42:01.936999+0000","last_became_peered":"2024-03-28T12:42:01.936999+0000","last_unstale":"2024-03-28T12:42:15.359855+0000","last_undegraded":"2024-03-28T12:42:15.359855+0000","last_fullsized":"2024-03-28T12:42:15.359855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:35:01.960186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.360045+0000","last_change":"2024-03-28T12:42:01.961991+0000","last_active":"2024-03-28T12:42:15.360045+0000","last_peered":"2024-03-28T12:42:15.360045+0000","last_clean":"2024-03-28T12:42:15.360045+0000","last_became_active":"2024-03-28T12:42:01.961694+0000","last_became_peered":"2024-03-28T12:42:01.961694+0000","last_unstale":"2024-03-28T12:42:15.360045+0000","last_undegraded":"2024-03-28T12:42:15.360045+0000","last_fullsized":"2024-03-28T12:42:15.360045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:12:20.857443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.353767+0000","last_change":"2024-03-28T12:42:01.966943+0000","last_active":"2024-03-28T12:42:15.353767+0000","last_peered":"2024-03-28T12:42:15.353767+0000","last_clean":"2024-03-28T12:42:15.353767+0000","last_became_active":"2024-03-28T12:42:01.966629+0000","last_became_peered":"2024-03-28T12:42:01.966629+0000","last_unstale":"2024-03-28T12:42:15.353767+0000","last_undegraded":"2024-03-28T12:42:15.353767+0000","last_fullsized":"2024-03-28T12:42:15.353767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.225924+0000","last_change":"2024-03-28T12:42:01.934727+0000","last_active":"2024-03-28T12:42:15.225924+0000","last_peered":"2024-03-28T12:42:15.225924+0000","last_clean":"2024-03-28T12:42:15.225924+0000","last_became_active":"2024-03-28T12:42:01.934130+0000","last_became_peered":"2024-03-28T12:42:01.934130+0000","last_unstale":"2024-03-28T12:42:15.225924+0000","last_undegraded":"2024-03-28T12:42:15.225924+0000","last_fullsized":"2024-03-28T12:42:15.225924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:20:32.024373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359366+0000","last_change":"2024-03-28T12:42:01.940164+0000","last_active":"2024-03-28T12:42:15.359366+0000","last_peered":"2024-03-28T12:42:15.359366+0000","last_clean":"2024-03-28T12:42:15.359366+0000","last_became_active":"2024-03-28T12:42:01.939962+0000","last_became_peered":"2024-03-28T12:42:01.939962+0000","last_unstale":"2024-03-28T12:42:15.359366+0000","last_undegraded":"2024-03-28T12:42:15.359366+0000","last_fullsized":"2024-03-28T12:42:15.359366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:31:15.643101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.215233+0000","last_change":"2024-03-28T12:42:01.968043+0000","last_active":"2024-03-28T12:42:15.215233+0000","last_peered":"2024-03-28T12:42:15.215233+0000","last_clean":"2024-03-28T12:42:15.215233+0000","last_became_active":"2024-03-28T12:42:01.964888+0000","last_became_peered":"2024-03-28T12:42:01.964888+0000","last_unstale":"2024-03-28T12:42:15.215233+0000","last_undegraded":"2024-03-28T12:42:15.215233+0000","last_fullsized":"2024-03-28T12:42:15.215233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359830+0000","last_change":"2024-03-28T12:42:01.939665+0000","last_active":"2024-03-28T12:42:15.359830+0000","last_peered":"2024-03-28T12:42:15.359830+0000","last_clean":"2024-03-28T12:42:15.359830+0000","last_became_active":"2024-03-28T12:42:01.939448+0000","last_became_peered":"2024-03-28T12:42:01.939448+0000","last_unstale":"2024-03-28T12:42:15.359830+0000","last_undegraded":"2024-03-28T12:42:15.359830+0000","last_fullsized":"2024-03-28T12:42:15.359830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:39.483160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.216062+0000","last_change":"2024-03-28T12:42:01.961147+0000","last_active":"2024-03-28T12:42:15.216062+0000","last_peered":"2024-03-28T12:42:15.216062+0000","last_clean":"2024-03-28T12:42:15.216062+0000","last_became_active":"2024-03-28T12:42:01.960511+0000","last_became_peered":"2024-03-28T12:42:01.960511+0000","last_unstale":"2024-03-28T12:42:15.216062+0000","last_undegraded":"2024-03-28T12:42:15.216062+0000","last_fullsized":"2024-03-28T12:42:15.216062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229345+0000","last_change":"2024-03-28T12:42:01.809029+0000","last_active":"2024-03-28T12:42:15.229345+0000","last_peered":"2024-03-28T12:42:15.229345+0000","last_clean":"2024-03-28T12:42:15.229345+0000","last_became_active":"2024-03-28T12:42:01.805168+0000","last_became_peered":"2024-03-28T12:42:01.805168+0000","last_unstale":"2024-03-28T12:42:15.229345+0000","last_undegraded":"2024-03-28T12:42:15.229345+0000","last_fullsized":"2024-03-28T12:42:15.229345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:00:10.281819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.229628+0000","last_change":"2024-03-28T12:42:01.809169+0000","last_active":"2024-03-28T12:42:15.229628+0000","last_peered":"2024-03-28T12:42:15.229628+0000","last_clean":"2024-03-28T12:42:15.229628+0000","last_became_active":"2024-03-28T12:42:01.805382+0000","last_became_peered":"2024-03-28T12:42:01.805382+0000","last_unstale":"2024-03-28T12:42:15.229628+0000","last_undegraded":"2024-03-28T12:42:15.229628+0000","last_fullsized":"2024-03-28T12:42:15.229628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:26:32.791857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T12:42:15.359741+0000","last_change":"2024-03-28T12:42:01.938613+0000","last_active":"2024-03-28T12:42:15.359741+0000","last_peered":"2024-03-28T12:42:15.359741+0000","last_clean":"2024-03-28T12:42:15.359741+0000","last_became_active":"2024-03-28T12:42:01.938408+0000","last_became_peered":"2024-03-28T12:42:01.938408+0000","last_unstale":"2024-03-28T12:42:15.359741+0000","last_undegraded":"2024-03-28T12:42:15.359741+0000","last_fullsized":"2024-03-28T12:42:15.359741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:36:57.708839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10264,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":214,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":20528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":186,"ondisk_log_size":186,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66494,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":127449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":128775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":132075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":130305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":718177,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509462,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":128937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":129117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":397312,"data_stored":717589,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":5680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T12:42:52.116 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-28T12:42:52.116 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-28T12:42:52.116 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-28T12:42:52.116 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-28T12:42:52.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.298+0000 7faecca00640 1 Processor -- start 2024-03-28T12:42:52.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.298+0000 7faecca00640 1 -- start start 2024-03-28T12:42:52.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.298+0000 7faecca00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7faec8151530 0x7faec806ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:52.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.298+0000 7faecca00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faec80cd730 0x7faec806ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:52.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.298+0000 7faecca00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7faec806fa10 0x7faec806bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:52.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.298+0000 7faecca00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7faec806f360 con 0x7faec806fa10 2024-03-28T12:42:52.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.298+0000 7faecca00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7faec80c8240 con 0x7faec8151530 2024-03-28T12:42:52.297 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.298+0000 7faecca00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7faec80c8520 con 0x7faec80cd730 2024-03-28T12:42:52.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.302+0000 7faec6800640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7faec8151530 0x7faec806ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:52.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.302+0000 7faec5e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faec80cd730 0x7faec806ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:52.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.302+0000 7faec6800640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7faec8151530 0x7faec806ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:58854/0 (socket says 172.21.15.76:58854) 2024-03-28T12:42:52.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.302+0000 7faec6800640 1 -- 172.21.15.76:0/1700072528 learned_addr learned my addr 172.21.15.76:0/1700072528 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:52.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.306+0000 7faec6800640 1 -- 172.21.15.76:0/1700072528 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faec80cd730 msgr2=0x7faec806ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:52.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.306+0000 7faec6800640 1 --2- 172.21.15.76:0/1700072528 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faec80cd730 0x7faec806ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:52.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.306+0000 7faec6800640 1 -- 172.21.15.76:0/1700072528 >> v2:172.21.15.76:3300/0 conn(0x7faec806fa10 msgr2=0x7faec806bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:52.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.306+0000 7faec6800640 1 --2- 172.21.15.76:0/1700072528 >> v2:172.21.15.76:3300/0 conn(0x7faec806fa10 0x7faec806bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:52.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.306+0000 7faec6800640 1 -- 172.21.15.76:0/1700072528 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec80c8800 con 0x7faec8151530 2024-03-28T12:42:52.309 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.310+0000 7faec6800640 1 --2- 172.21.15.76:0/1700072528 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faec8151530 0x7faec806ecb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faec80716d0 tx=0x7faeb801ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ce2a58af43bb31d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:52.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.318+0000 7faec5400640 1 -- 172.21.15.76:0/1700072528 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb80b5070 con 0x7faec8151530 2024-03-28T12:42:52.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.318+0000 7faec5400640 1 -- 172.21.15.76:0/1700072528 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb80a89d0 con 0x7faec8151530 2024-03-28T12:42:52.315 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.318+0000 7faec5400640 1 -- 172.21.15.76:0/1700072528 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb80a8da0 con 0x7faec8151530 2024-03-28T12:42:52.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.318+0000 7faecca00640 1 -- 172.21.15.76:0/1700072528 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faec8151530 msgr2=0x7faec806ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:52.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.318+0000 7faecca00640 1 --2- 172.21.15.76:0/1700072528 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faec8151530 0x7faec806ecb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faec80716d0 tx=0x7faeb801ed10 comp rx=0 tx=0).stop 2024-03-28T12:42:52.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.318+0000 7faecca00640 1 -- 172.21.15.76:0/1700072528 shutdown_connections 2024-03-28T12:42:52.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.318+0000 7faecca00640 1 --2- 172.21.15.76:0/1700072528 >> v2:172.21.15.76:3300/0 conn(0x7faec806fa10 0x7faec806bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:52.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.318+0000 7faecca00640 1 --2- 172.21.15.76:0/1700072528 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faec80cd730 0x7faec806ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:52.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.318+0000 7faecca00640 1 --2- 172.21.15.76:0/1700072528 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faec8151530 0x7faec806ecb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:52.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.318+0000 7faecca00640 1 -- 172.21.15.76:0/1700072528 >> 172.21.15.76:0/1700072528 conn(0x7faec8073670 msgr2=0x7faec8070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:52.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.318+0000 7faecca00640 1 -- 172.21.15.76:0/1700072528 shutdown_connections 2024-03-28T12:42:52.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.318+0000 7faecca00640 1 -- 172.21.15.76:0/1700072528 wait complete. 2024-03-28T12:42:52.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.318+0000 7faecca00640 1 Processor -- start 2024-03-28T12:42:52.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.318+0000 7faecca00640 1 -- start start 2024-03-28T12:42:52.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.322+0000 7faecca00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faec806fa10 0x7faec8152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:52.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.322+0000 7faecca00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faec80cd730 0x7faec8150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:52.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.322+0000 7faecca00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faec8151530 0x7faec8153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:52.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.322+0000 7faecca00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7faec8151910 con 0x7faec806fa10 2024-03-28T12:42:52.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.322+0000 7faecca00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7faec80c8dc0 con 0x7faec8151530 2024-03-28T12:42:52.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.322+0000 7faecca00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7faec815df10 con 0x7faec80cd730 2024-03-28T12:42:52.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.322+0000 7faec5e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faec80cd730 0x7faec8150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:52.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.326+0000 7faec5e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faec80cd730 0x7faec8150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:36498/0 (socket says 172.21.15.76:36498) 2024-03-28T12:42:52.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.326+0000 7faec5e00640 1 -- 172.21.15.76:0/4179602938 learned_addr learned my addr 172.21.15.76:0/4179602938 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:52.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.326+0000 7faec7200640 1 --2- 172.21.15.76:0/4179602938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faec8151530 0x7faec8153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:52.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.326+0000 7faec6800640 1 --2- 172.21.15.76:0/4179602938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faec806fa10 0x7faec8152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:52.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.330+0000 7faec7200640 1 -- 172.21.15.76:0/4179602938 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faec80cd730 msgr2=0x7faec8150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:52.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.330+0000 7faec7200640 1 --2- 172.21.15.76:0/4179602938 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faec80cd730 0x7faec8150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:52.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.330+0000 7faec7200640 1 -- 172.21.15.76:0/4179602938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faec806fa10 msgr2=0x7faec8152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:52.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.330+0000 7faec7200640 1 --2- 172.21.15.76:0/4179602938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faec806fa10 0x7faec8152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:52.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.330+0000 7faec7200640 1 -- 172.21.15.76:0/4179602938 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec815b2d0 con 0x7faec8151530 2024-03-28T12:42:52.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.334+0000 7faec7200640 1 --2- 172.21.15.76:0/4179602938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faec8151530 0x7faec8153af0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faec000be50 tx=0x7faec000bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:52.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.346+0000 7faebea00640 1 -- 172.21.15.76:0/4179602938 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0019070 con 0x7faec8151530 2024-03-28T12:42:52.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.346+0000 7faebea00640 1 -- 172.21.15.76:0/4179602938 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec0014440 con 0x7faec8151530 2024-03-28T12:42:52.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.346+0000 7faebea00640 1 -- 172.21.15.76:0/4179602938 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec0014830 con 0x7faec8151530 2024-03-28T12:42:52.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.346+0000 7faecca00640 1 -- 172.21.15.76:0/4179602938 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec815b570 con 0x7faec8151530 2024-03-28T12:42:52.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.346+0000 7faecca00640 1 -- 172.21.15.76:0/4179602938 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec80cccf0 con 0x7faec8151530 2024-03-28T12:42:52.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.346+0000 7faecca00640 1 -- 172.21.15.76:0/4179602938 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec80686e0 con 0x7faec8151530 2024-03-28T12:42:52.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.658+0000 7faebea00640 1 -- 172.21.15.76:0/4179602938 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7faec001c070 con 0x7faec8151530 2024-03-28T12:42:52.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.658+0000 7faebea00640 1 --2- 172.21.15.76:0/4179602938 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7faea8068010 0x7faea806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:52.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.658+0000 7faec6800640 1 --2- 172.21.15.76:0/4179602938 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7faea8068010 0x7faea806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:52.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.662+0000 7faec6800640 1 --2- 172.21.15.76:0/4179602938 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7faea8068010 0x7faea806a4d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faeb80b2000 tx=0x7faeb8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:52.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.670+0000 7faebea00640 1 -- 172.21.15.76:0/4179602938 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7faec0054ad0 con 0x7faec8151530 2024-03-28T12:42:52.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.682+0000 7faebea00640 1 -- 172.21.15.76:0/4179602938 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7faec0023020 con 0x7faec8151530 2024-03-28T12:42:52.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.882+0000 7faecca00640 1 -- 172.21.15.76:0/4179602938 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faec806f7f0 con 0x7faec8151530 2024-03-28T12:42:52.890 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.894+0000 7faebea00640 1 -- 172.21.15.76:0/4179602938 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7faec0056a30 con 0x7faec8151530 2024-03-28T12:42:52.891 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:52.891 INFO:teuthology.orchestra.run.smithi076.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-28T12:42:52.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.894+0000 7faecca00640 1 -- 172.21.15.76:0/4179602938 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7faea8068010 msgr2=0x7faea806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:52.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.894+0000 7faecca00640 1 --2- 172.21.15.76:0/4179602938 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7faea8068010 0x7faea806a4d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faeb80b2000 tx=0x7faeb8009040 comp rx=0 tx=0).stop 2024-03-28T12:42:52.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.894+0000 7faecca00640 1 -- 172.21.15.76:0/4179602938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faec8151530 msgr2=0x7faec8153af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:52.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.894+0000 7faecca00640 1 --2- 172.21.15.76:0/4179602938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faec8151530 0x7faec8153af0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faec000be50 tx=0x7faec000bf40 comp rx=0 tx=0).stop 2024-03-28T12:42:52.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.894+0000 7faecca00640 1 -- 172.21.15.76:0/4179602938 shutdown_connections 2024-03-28T12:42:52.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.894+0000 7faecca00640 1 --2- 172.21.15.76:0/4179602938 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7faea8068010 0x7faea806a4d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:52.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.894+0000 7faecca00640 1 --2- 172.21.15.76:0/4179602938 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faec8151530 0x7faec8153af0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:52.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.894+0000 7faecca00640 1 --2- 172.21.15.76:0/4179602938 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faec80cd730 0x7faec8150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:52.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.894+0000 7faecca00640 1 --2- 172.21.15.76:0/4179602938 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7faec806fa10 0x7faec8152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:52.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.894+0000 7faecca00640 1 -- 172.21.15.76:0/4179602938 >> 172.21.15.76:0/4179602938 conn(0x7faec8073670 msgr2=0x7faec814edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:52.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.894+0000 7faecca00640 1 -- 172.21.15.76:0/4179602938 shutdown_connections 2024-03-28T12:42:52.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:52.894+0000 7faecca00640 1 -- 172.21.15.76:0/4179602938 wait complete. 2024-03-28T12:42:52.913 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-28T12:42:52.913 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T12:42:53.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.082+0000 7f18df200640 1 Processor -- start 2024-03-28T12:42:53.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.082+0000 7f18df200640 1 -- start start 2024-03-28T12:42:53.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.082+0000 7f18df200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18e006efc0 0x7f18e015a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:53.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.082+0000 7f18df200640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e0154d20 con 0x7f18e0154940 2024-03-28T12:42:53.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.082+0000 7f18df200640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e00c3530 con 0x7f18e006eb90 2024-03-28T12:42:53.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.082+0000 7f18df200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f18e0070610 con 0x7f18e006efc0 2024-03-28T12:42:53.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.082+0000 7f18dde00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f18e0154940 0x7f18e006fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:41666/0 (socket says 172.21.15.76:41666) 2024-03-28T12:42:53.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.082+0000 7f18dde00640 1 -- 172.21.15.76:0/1334306671 learned_addr learned my addr 172.21.15.76:0/1334306671 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:53.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.082+0000 7f18de800640 1 --2- 172.21.15.76:0/1334306671 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18e006efc0 0x7f18e015a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:53.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.086+0000 7f18dd400640 1 -- 172.21.15.76:0/1334306671 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1729203719 0 0) 0x7f18e0154d20 con 0x7f18e0154940 2024-03-28T12:42:53.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.086+0000 7f18dd400640 1 -- 172.21.15.76:0/1334306671 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18c4003530 con 0x7f18e0154940 2024-03-28T12:42:53.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.090+0000 7f18dd400640 1 -- 172.21.15.76:0/1334306671 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4213196142 0 0) 0x7f18c4003530 con 0x7f18e0154940 2024-03-28T12:42:53.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.090+0000 7f18dd400640 1 -- 172.21.15.76:0/1334306671 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18e006efc0 msgr2=0x7f18e015a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:53.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.090+0000 7f18dd400640 1 --2- 172.21.15.76:0/1334306671 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18e006efc0 0x7f18e015a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:53.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.090+0000 7f18dd400640 1 -- 172.21.15.76:0/1334306671 >> v1:172.21.15.111:6789/0 conn(0x7f18e006eb90 legacy=0x7f18e00c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:53.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.090+0000 7f18dd400640 1 -- 172.21.15.76:0/1334306671 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e00c3810 con 0x7f18e0154940 2024-03-28T12:42:53.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.090+0000 7f18dd400640 1 -- 172.21.15.76:0/1334306671 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7f18d0001680 con 0x7f18e0154940 2024-03-28T12:42:53.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.090+0000 7f18dd400640 1 -- 172.21.15.76:0/1334306671 >> v1:172.21.15.76:6789/0 conn(0x7f18e0154940 legacy=0x7f18e006fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:53.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.090+0000 7f18dd400640 1 --2- 172.21.15.76:0/1334306671 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18c40039f0 0x7f18c4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:53.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.090+0000 7f18dd400640 1 --2- 172.21.15.76:0/1334306671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18c4004810 0x7f18c4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:53.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.090+0000 7f18dd400640 1 --2- 172.21.15.76:0/1334306671 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18e006efc0 0x7f18c4005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:53.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.090+0000 7f18dd400640 1 -- 172.21.15.76:0/1334306671 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f18e0070610 con 0x7f18c4004810 2024-03-28T12:42:53.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.090+0000 7f18dd400640 1 -- 172.21.15.76:0/1334306671 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f18c400bb90 con 0x7f18c40039f0 2024-03-28T12:42:53.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.090+0000 7f18dd400640 1 -- 172.21.15.76:0/1334306671 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f18c400bd90 con 0x7f18e006efc0 2024-03-28T12:42:53.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.090+0000 7f18de800640 1 --2- 172.21.15.76:0/1334306671 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18e006efc0 0x7f18c4005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:53.090 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.094+0000 7f18d7e00640 1 --2- 172.21.15.76:0/1334306671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18c4004810 0x7f18c4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:53.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.094+0000 7f18dde00640 1 --2- 172.21.15.76:0/1334306671 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18c40039f0 0x7f18c4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:53.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.094+0000 7f18d7e00640 1 -- 172.21.15.76:0/1334306671 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18e006efc0 msgr2=0x7f18c4005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:53.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.094+0000 7f18d7e00640 1 --2- 172.21.15.76:0/1334306671 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18e006efc0 0x7f18c4005280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:53.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.094+0000 7f18d7e00640 1 -- 172.21.15.76:0/1334306671 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18c40039f0 msgr2=0x7f18c4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:53.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.094+0000 7f18d7e00640 1 --2- 172.21.15.76:0/1334306671 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18c40039f0 0x7f18c4003e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:53.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.094+0000 7f18d7e00640 1 -- 172.21.15.76:0/1334306671 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c4003530 con 0x7f18c4004810 2024-03-28T12:42:53.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.102+0000 7f18d7e00640 1 --2- 172.21.15.76:0/1334306671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18c4004810 0x7f18c4004c90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f18c8001780 tx=0x7f18c801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378cdff5255419bf server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:53.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.106+0000 7f18dd400640 1 -- 172.21.15.76:0/1334306671 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c80013a0 con 0x7f18c4004810 2024-03-28T12:42:53.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.106+0000 7f18dd400640 1 -- 172.21.15.76:0/1334306671 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c80052f0 con 0x7f18c4004810 2024-03-28T12:42:53.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.106+0000 7f18dd400640 1 -- 172.21.15.76:0/1334306671 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8003840 con 0x7f18c4004810 2024-03-28T12:42:53.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.106+0000 7f18df200640 1 -- 172.21.15.76:0/1334306671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18c4004810 msgr2=0x7f18c4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:53.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.106+0000 7f18df200640 1 --2- 172.21.15.76:0/1334306671 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18c4004810 0x7f18c4004c90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f18c8001780 tx=0x7f18c801c420 comp rx=0 tx=0).stop 2024-03-28T12:42:53.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.106+0000 7f18de800640 1 -- 172.21.15.76:0/1334306671 reap_dead start 2024-03-28T12:42:53.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.106+0000 7f18df200640 1 -- 172.21.15.76:0/1334306671 shutdown_connections 2024-03-28T12:42:53.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.106+0000 7f18df200640 1 -- 172.21.15.76:0/1334306671 >> 172.21.15.76:0/1334306671 conn(0x7f18e0070c10 msgr2=0x7f18e0071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:53.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.106+0000 7f18df200640 1 -- 172.21.15.76:0/1334306671 shutdown_connections 2024-03-28T12:42:53.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.106+0000 7f18df200640 1 -- 172.21.15.76:0/1334306671 wait complete. 2024-03-28T12:42:53.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.106+0000 7f18df200640 1 Processor -- start 2024-03-28T12:42:53.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.106+0000 7f18df200640 1 -- start start 2024-03-28T12:42:53.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.110+0000 7f18df200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18c4004810 0x7f18e00c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:53.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.110+0000 7f18df200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18e0144f40 0x7f18e01453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:53.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.110+0000 7f18df200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18e00c8870 0x7f18e00c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:53.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.110+0000 7f18df200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f18e0165ef0 con 0x7f18e0144f40 2024-03-28T12:42:53.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.110+0000 7f18df200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f18e00c4140 con 0x7f18e00c8870 2024-03-28T12:42:53.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.110+0000 7f18df200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f18e0166070 con 0x7f18c4004810 2024-03-28T12:42:53.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.110+0000 7f18d7e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18e0144f40 0x7f18e01453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:53.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.110+0000 7f18de800640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18e00c8870 0x7f18e00c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:53.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.110+0000 7f18dde00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18c4004810 0x7f18e00c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:53.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.110+0000 7f18d7e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18e0144f40 0x7f18e01453a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56644/0 (socket says 172.21.15.76:56644) 2024-03-28T12:42:53.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.110+0000 7f18d7e00640 1 -- 172.21.15.76:0/3203796457 learned_addr learned my addr 172.21.15.76:0/3203796457 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:53.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.118+0000 7f18d7e00640 1 -- 172.21.15.76:0/3203796457 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18c4004810 msgr2=0x7f18e00c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:53.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.118+0000 7f18d7e00640 1 --2- 172.21.15.76:0/3203796457 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18c4004810 0x7f18e00c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:53.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.118+0000 7f18d7e00640 1 -- 172.21.15.76:0/3203796457 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18e00c8870 msgr2=0x7f18e00c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:53.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.118+0000 7f18d7e00640 1 --2- 172.21.15.76:0/3203796457 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18e00c8870 0x7f18e00c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:53.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.118+0000 7f18d7e00640 1 -- 172.21.15.76:0/3203796457 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e01469f0 con 0x7f18e0144f40 2024-03-28T12:42:53.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.118+0000 7f18d7e00640 1 --2- 172.21.15.76:0/3203796457 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18e0144f40 0x7f18e01453a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f18c8005040 tx=0x7f18c4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:53.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.122+0000 7f18d6000640 1 -- 172.21.15.76:0/3203796457 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c80054a0 con 0x7f18e0144f40 2024-03-28T12:42:53.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.122+0000 7f18df200640 1 -- 172.21.15.76:0/3203796457 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e01458e0 con 0x7f18e0144f40 2024-03-28T12:42:53.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.122+0000 7f18df200640 1 -- 172.21.15.76:0/3203796457 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e00cb420 con 0x7f18e0144f40 2024-03-28T12:42:53.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.122+0000 7f18df200640 1 -- 172.21.15.76:0/3203796457 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e0068df0 con 0x7f18e0144f40 2024-03-28T12:42:53.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.122+0000 7f18d6000640 1 -- 172.21.15.76:0/3203796457 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c80bb070 con 0x7f18e0144f40 2024-03-28T12:42:53.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.126+0000 7f18d6000640 1 -- 172.21.15.76:0/3203796457 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8001460 con 0x7f18e0144f40 2024-03-28T12:42:53.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.414+0000 7f18d6000640 1 -- 172.21.15.76:0/3203796457 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f18c80b4040 con 0x7f18e0144f40 2024-03-28T12:42:53.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.414+0000 7f18d6000640 1 --2- 172.21.15.76:0/3203796457 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f18bc067ff0 0x7f18bc06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:53.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.418+0000 7f18dde00640 1 --2- 172.21.15.76:0/3203796457 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f18bc067ff0 0x7f18bc06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:53.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.418+0000 7f18dde00640 1 --2- 172.21.15.76:0/3203796457 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f18bc067ff0 0x7f18bc06a4b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f18d0000c10 tx=0x7f18d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:53.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.442+0000 7f18d6000640 1 -- 172.21.15.76:0/3203796457 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f18c80eefd0 con 0x7f18e0144f40 2024-03-28T12:42:53.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.442+0000 7f18d6000640 1 -- 172.21.15.76:0/3203796457 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f18c8016130 con 0x7f18e0144f40 2024-03-28T12:42:53.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.790+0000 7f18df200640 1 -- 172.21.15.76:0/3203796457 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18e006f6f0 con 0x7f18e0144f40 2024-03-28T12:42:53.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.830+0000 7f18d6000640 1 -- 172.21.15.76:0/3203796457 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18798 (secure 0 0 0) 0x7f18c80f3090 con 0x7f18e0144f40 2024-03-28T12:42:53.830 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:53.830 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":29,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:42:15.156639+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T12:41:58.010965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T12:41:59.698601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-28T12:42:05.363180+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.1","mappings":[{"from":3,"to":4}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]},{"pgid":"4.d","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":5}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:42:53.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.834+0000 7f18df200640 1 -- 172.21.15.76:0/3203796457 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f18bc067ff0 msgr2=0x7f18bc06a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:53.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.834+0000 7f18df200640 1 --2- 172.21.15.76:0/3203796457 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f18bc067ff0 0x7f18bc06a4b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f18d0000c10 tx=0x7f18d0009040 comp rx=0 tx=0).stop 2024-03-28T12:42:53.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.834+0000 7f18df200640 1 -- 172.21.15.76:0/3203796457 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18e0144f40 msgr2=0x7f18e01453a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:53.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.834+0000 7f18df200640 1 --2- 172.21.15.76:0/3203796457 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18e0144f40 0x7f18e01453a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f18c8005040 tx=0x7f18c4005840 comp rx=0 tx=0).stop 2024-03-28T12:42:53.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.834+0000 7f18df200640 1 -- 172.21.15.76:0/3203796457 shutdown_connections 2024-03-28T12:42:53.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.834+0000 7f18df200640 1 --2- 172.21.15.76:0/3203796457 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f18bc067ff0 0x7f18bc06a4b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:53.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.834+0000 7f18df200640 1 --2- 172.21.15.76:0/3203796457 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18e00c8870 0x7f18e00c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:53.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.834+0000 7f18df200640 1 --2- 172.21.15.76:0/3203796457 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f18e0144f40 0x7f18e01453a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:53.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.834+0000 7f18df200640 1 --2- 172.21.15.76:0/3203796457 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18c4004810 0x7f18e00c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:53.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.834+0000 7f18df200640 1 -- 172.21.15.76:0/3203796457 >> 172.21.15.76:0/3203796457 conn(0x7f18e0070c10 msgr2=0x7f18e0153740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:53.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.834+0000 7f18df200640 1 -- 172.21.15.76:0/3203796457 shutdown_connections 2024-03-28T12:42:53.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:53.834+0000 7f18df200640 1 -- 172.21.15.76:0/3203796457 wait complete. 2024-03-28T12:42:53.854 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T12:41:23.389090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T12:41:58.010965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T12:41:59.698601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-28T12:42:05.363180+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-28T12:42:53.854 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T12:42:54.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.014+0000 7fa437000640 1 Processor -- start 2024-03-28T12:42:54.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.014+0000 7fa437000640 1 -- start start 2024-03-28T12:42:54.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.018+0000 7fa437000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fa430151910 0x7fa430073610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:54.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.018+0000 7fa437000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4300c6a40 0x7fa4300c7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:54.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.018+0000 7fa437000640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa430151cf0 con 0x7fa4300c75d0 2024-03-28T12:42:54.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.018+0000 7fa437000640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fa4301584a0 con 0x7fa430151910 2024-03-28T12:42:54.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.018+0000 7fa437000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa430073b50 con 0x7fa4300c6a40 2024-03-28T12:42:54.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.018+0000 7fa42fe00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fa430151910 0x7fa430073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:54.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.018+0000 7fa42f400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4300c6a40 0x7fa4300c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:54.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.018+0000 7fa42fe00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fa430151910 0x7fa430073610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56650/0 (socket says 172.21.15.76:56650) 2024-03-28T12:42:54.016 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.018+0000 7fa42fe00640 1 -- 172.21.15.76:0/786650575 learned_addr learned my addr 172.21.15.76:0/786650575 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:54.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.022+0000 7fa42fe00640 1 -- 172.21.15.76:0/786650575 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4300c6a40 msgr2=0x7fa4300c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:54.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.022+0000 7fa42fe00640 1 --2- 172.21.15.76:0/786650575 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4300c6a40 0x7fa4300c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:54.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.022+0000 7fa42fe00640 1 -- 172.21.15.76:0/786650575 >> v1:172.21.15.76:6789/0 conn(0x7fa4300c75d0 legacy=0x7fa4300727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:54.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.022+0000 7fa42fe00640 1 -- 172.21.15.76:0/786650575 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa430157920 con 0x7fa430151910 2024-03-28T12:42:54.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.030+0000 7fa42fe00640 1 --2- 172.21.15.76:0/786650575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa430151910 0x7fa430073610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa420009870 tx=0x7fa42001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1480f16fe90dade server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:54.031 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.034+0000 7fa42ea00640 1 -- 172.21.15.76:0/786650575 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4200a7070 con 0x7fa430151910 2024-03-28T12:42:54.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.034+0000 7fa42ea00640 1 -- 172.21.15.76:0/786650575 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4200b0070 con 0x7fa430151910 2024-03-28T12:42:54.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.034+0000 7fa42ea00640 1 -- 172.21.15.76:0/786650575 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4200ab890 con 0x7fa430151910 2024-03-28T12:42:54.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.038+0000 7fa437000640 1 -- 172.21.15.76:0/786650575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa430151910 msgr2=0x7fa430073610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:54.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.038+0000 7fa437000640 1 --2- 172.21.15.76:0/786650575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa430151910 0x7fa430073610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa420009870 tx=0x7fa42001c560 comp rx=0 tx=0).stop 2024-03-28T12:42:54.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.038+0000 7fa437000640 1 -- 172.21.15.76:0/786650575 shutdown_connections 2024-03-28T12:42:54.035 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.038+0000 7fa437000640 1 --2- 172.21.15.76:0/786650575 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4300c6a40 0x7fa4300c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:54.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.038+0000 7fa437000640 1 --2- 172.21.15.76:0/786650575 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa430151910 0x7fa430073610 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:54.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.038+0000 7fa437000640 1 -- 172.21.15.76:0/786650575 >> 172.21.15.76:0/786650575 conn(0x7fa43006fd30 msgr2=0x7fa430070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:54.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.038+0000 7fa437000640 1 -- 172.21.15.76:0/786650575 shutdown_connections 2024-03-28T12:42:54.036 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.038+0000 7fa437000640 1 -- 172.21.15.76:0/786650575 wait complete. 2024-03-28T12:42:54.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.038+0000 7fa437000640 1 Processor -- start 2024-03-28T12:42:54.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.038+0000 7fa437000640 1 -- start start 2024-03-28T12:42:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.042+0000 7fa437000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4300c6a40 0x7fa43014ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.042+0000 7fa437000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4300c75d0 0x7fa430149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.042+0000 7fa437000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa430151910 0x7fa430147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.042+0000 7fa437000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa4300c93d0 con 0x7fa430151910 2024-03-28T12:42:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.042+0000 7fa437000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa4300722c0 con 0x7fa4300c6a40 2024-03-28T12:42:54.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.042+0000 7fa437000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa430157550 con 0x7fa4300c75d0 2024-03-28T12:42:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.042+0000 7fa435000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa430151910 0x7fa430147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.042+0000 7fa42fe00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4300c6a40 0x7fa43014ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.042+0000 7fa435000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa430151910 0x7fa430147df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56662/0 (socket says 172.21.15.76:56662) 2024-03-28T12:42:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.042+0000 7fa435000640 1 -- 172.21.15.76:0/413826778 learned_addr learned my addr 172.21.15.76:0/413826778 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:54.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.042+0000 7fa42f400640 1 --2- 172.21.15.76:0/413826778 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4300c75d0 0x7fa430149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.046+0000 7fa435000640 1 -- 172.21.15.76:0/413826778 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4300c75d0 msgr2=0x7fa430149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.046+0000 7fa435000640 1 --2- 172.21.15.76:0/413826778 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4300c75d0 0x7fa430149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.046+0000 7fa435000640 1 -- 172.21.15.76:0/413826778 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4300c6a40 msgr2=0x7fa43014ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:54.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.046+0000 7fa435000640 1 --2- 172.21.15.76:0/413826778 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4300c6a40 0x7fa43014ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:54.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.046+0000 7fa435000640 1 -- 172.21.15.76:0/413826778 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43014b210 con 0x7fa430151910 2024-03-28T12:42:54.049 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.050+0000 7fa435000640 1 --2- 172.21.15.76:0/413826778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa430151910 0x7fa430147df0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa42800c730 tx=0x7fa42800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.058+0000 7fa427e00640 1 -- 172.21.15.76:0/413826778 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428003b80 con 0x7fa430151910 2024-03-28T12:42:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.058+0000 7fa427e00640 1 -- 172.21.15.76:0/413826778 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa428003d20 con 0x7fa430151910 2024-03-28T12:42:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.058+0000 7fa427e00640 1 -- 172.21.15.76:0/413826778 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42800aa30 con 0x7fa430151910 2024-03-28T12:42:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.058+0000 7fa437000640 1 -- 172.21.15.76:0/413826778 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa43014b480 con 0x7fa430151910 2024-03-28T12:42:54.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.058+0000 7fa437000640 1 -- 172.21.15.76:0/413826778 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa43014ba40 con 0x7fa430151910 2024-03-28T12:42:54.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.058+0000 7fa437000640 1 -- 172.21.15.76:0/413826778 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4300686e0 con 0x7fa430151910 2024-03-28T12:42:54.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.354+0000 7fa427e00640 1 -- 172.21.15.76:0/413826778 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fa42800abd0 con 0x7fa430151910 2024-03-28T12:42:54.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.354+0000 7fa427e00640 1 --2- 172.21.15.76:0/413826778 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa410068040 0x7fa41006a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:54.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.354+0000 7fa42fe00640 1 --2- 172.21.15.76:0/413826778 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa410068040 0x7fa41006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:54.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.358+0000 7fa42fe00640 1 --2- 172.21.15.76:0/413826778 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa410068040 0x7fa41006a500 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa4200af000 tx=0x7fa4200a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:54.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.366+0000 7fa427e00640 1 -- 172.21.15.76:0/413826778 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fa428054f80 con 0x7fa430151910 2024-03-28T12:42:54.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.366+0000 7fa427e00640 1 -- 172.21.15.76:0/413826778 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fa428056ee0 con 0x7fa430151910 2024-03-28T12:42:54.465 INFO:tasks.ceph.mds.c.smithi076.stderr:2024-03-28T12:42:54.094+0000 f9f5640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-03-28T12:42:54.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.618+0000 7fa437000640 1 -- 172.21.15.76:0/413826778 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa43006cde0 con 0x7fa430151910 2024-03-28T12:42:54.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.670+0000 7fa427e00640 1 -- 172.21.15.76:0/413826778 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7fa42805b1e0 con 0x7fa430151910 2024-03-28T12:42:54.667 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-03-28T12:42:54.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.670+0000 7fa437000640 1 -- 172.21.15.76:0/413826778 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa410068040 msgr2=0x7fa41006a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:54.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.670+0000 7fa437000640 1 --2- 172.21.15.76:0/413826778 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa410068040 0x7fa41006a500 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa4200af000 tx=0x7fa4200a7000 comp rx=0 tx=0).stop 2024-03-28T12:42:54.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.670+0000 7fa437000640 1 -- 172.21.15.76:0/413826778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa430151910 msgr2=0x7fa430147df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:54.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.670+0000 7fa437000640 1 --2- 172.21.15.76:0/413826778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa430151910 0x7fa430147df0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa42800c730 tx=0x7fa42800cbf0 comp rx=0 tx=0).stop 2024-03-28T12:42:54.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.670+0000 7fa437000640 1 -- 172.21.15.76:0/413826778 shutdown_connections 2024-03-28T12:42:54.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.670+0000 7fa437000640 1 --2- 172.21.15.76:0/413826778 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa410068040 0x7fa41006a500 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:54.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.670+0000 7fa437000640 1 --2- 172.21.15.76:0/413826778 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa430151910 0x7fa430147df0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:54.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.670+0000 7fa437000640 1 --2- 172.21.15.76:0/413826778 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4300c75d0 0x7fa430149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:54.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.670+0000 7fa437000640 1 --2- 172.21.15.76:0/413826778 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4300c6a40 0x7fa43014ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:54.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.670+0000 7fa437000640 1 -- 172.21.15.76:0/413826778 >> 172.21.15.76:0/413826778 conn(0x7fa43006fd30 msgr2=0x7fa430162620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:54.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.670+0000 7fa437000640 1 -- 172.21.15.76:0/413826778 shutdown_connections 2024-03-28T12:42:54.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.670+0000 7fa437000640 1 -- 172.21.15.76:0/413826778 wait complete. 2024-03-28T12:42:54.671 INFO:tasks.ceph.mds.c.smithi076.stderr:2024-03-28T12:42:54.094+0000 f9f5640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-03-28T12:42:54.689 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T12:42:54.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.842+0000 7f11a1200640 1 Processor -- start 2024-03-28T12:42:54.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.842+0000 7f11a1200640 1 -- start start 2024-03-28T12:42:54.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.842+0000 7f11a1200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f119c151910 0x7f119c073610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:54.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.842+0000 7f11a1200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f119c0c6a40 0x7f119c0c7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:54.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.842+0000 7f11a1200640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f119c151cf0 con 0x7f119c0c75d0 2024-03-28T12:42:54.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.842+0000 7f11a1200640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f119c1584a0 con 0x7f119c0c6a40 2024-03-28T12:42:54.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.842+0000 7f11a1200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f119c073b50 con 0x7f119c151910 2024-03-28T12:42:54.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.846+0000 7f1199e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f119c151910 0x7f119c073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:54.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.846+0000 7f1193e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f119c0c6a40 0x7f119c0c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:54.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.846+0000 7f1199e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f119c151910 0x7f119c073610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:50408/0 (socket says 172.21.15.76:50408) 2024-03-28T12:42:54.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.846+0000 7f1199e00640 1 -- 172.21.15.76:0/896861739 learned_addr learned my addr 172.21.15.76:0/896861739 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:54.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.850+0000 7f1193e00640 1 -- 172.21.15.76:0/896861739 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f119c151910 msgr2=0x7f119c073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:54.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.850+0000 7f1193e00640 1 --2- 172.21.15.76:0/896861739 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f119c151910 0x7f119c073610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:54.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.850+0000 7f1193e00640 1 -- 172.21.15.76:0/896861739 >> v1:172.21.15.111:6789/0 conn(0x7f119c0c75d0 legacy=0x7f119c0727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:54.847 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.850+0000 7f1193e00640 1 -- 172.21.15.76:0/896861739 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c157920 con 0x7f119c0c6a40 2024-03-28T12:42:54.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.854+0000 7f1193e00640 1 --2- 172.21.15.76:0/896861739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f119c0c6a40 0x7f119c0c7090 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f11840097c0 tx=0x7f118401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492275f446534625 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:54.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.858+0000 7f1199400640 1 -- 172.21.15.76:0/896861739 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11840aa600 con 0x7f119c0c6a40 2024-03-28T12:42:54.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.858+0000 7f1199400640 1 -- 172.21.15.76:0/896861739 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11840af070 con 0x7f119c0c6a40 2024-03-28T12:42:54.855 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.858+0000 7f1199400640 1 -- 172.21.15.76:0/896861739 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11840aa9c0 con 0x7f119c0c6a40 2024-03-28T12:42:54.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.858+0000 7f11a1200640 1 -- 172.21.15.76:0/896861739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f119c0c6a40 msgr2=0x7f119c0c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:54.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.858+0000 7f11a1200640 1 --2- 172.21.15.76:0/896861739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f119c0c6a40 0x7f119c0c7090 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f11840097c0 tx=0x7f118401c4a0 comp rx=0 tx=0).stop 2024-03-28T12:42:54.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.858+0000 7f11a1200640 1 -- 172.21.15.76:0/896861739 shutdown_connections 2024-03-28T12:42:54.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.858+0000 7f11a1200640 1 --2- 172.21.15.76:0/896861739 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f119c0c6a40 0x7f119c0c7090 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:54.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.858+0000 7f11a1200640 1 --2- 172.21.15.76:0/896861739 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f119c151910 0x7f119c073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:54.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.858+0000 7f11a1200640 1 -- 172.21.15.76:0/896861739 >> 172.21.15.76:0/896861739 conn(0x7f119c06fd30 msgr2=0x7f119c070140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:54.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.858+0000 7f11a1200640 1 -- 172.21.15.76:0/896861739 shutdown_connections 2024-03-28T12:42:54.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.858+0000 7f11a1200640 1 -- 172.21.15.76:0/896861739 wait complete. 2024-03-28T12:42:54.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.862+0000 7f11a1200640 1 Processor -- start 2024-03-28T12:42:54.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.862+0000 7f11a1200640 1 -- start start 2024-03-28T12:42:54.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.862+0000 7f11a1200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f119c0c6a40 0x7f119c1f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:54.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.862+0000 7f11a1200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f119c0c75d0 0x7f119c156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:54.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.862+0000 7f11a1200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f119c151910 0x7f119c156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:54.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.862+0000 7f11a1200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f119c0c93d0 con 0x7f119c151910 2024-03-28T12:42:54.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.862+0000 7f11a1200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f119c0722c0 con 0x7f119c0c6a40 2024-03-28T12:42:54.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.862+0000 7f11a1200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f119c157550 con 0x7f119c0c75d0 2024-03-28T12:42:54.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.862+0000 7f1193e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f119c0c75d0 0x7f119c156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:54.860 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.862+0000 7f119a800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f119c151910 0x7f119c156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:54.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.862+0000 7f119a800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f119c151910 0x7f119c156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56686/0 (socket says 172.21.15.76:56686) 2024-03-28T12:42:54.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.862+0000 7f119a800640 1 -- 172.21.15.76:0/4283535882 learned_addr learned my addr 172.21.15.76:0/4283535882 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:54.861 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.862+0000 7f1199e00640 1 --2- 172.21.15.76:0/4283535882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f119c0c6a40 0x7f119c1f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:54.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.866+0000 7f1193e00640 1 -- 172.21.15.76:0/4283535882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f119c0c6a40 msgr2=0x7f119c1f6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:54.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.866+0000 7f1193e00640 1 --2- 172.21.15.76:0/4283535882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f119c0c6a40 0x7f119c1f6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:54.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.866+0000 7f1193e00640 1 -- 172.21.15.76:0/4283535882 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f119c151910 msgr2=0x7f119c156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:54.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.866+0000 7f1193e00640 1 --2- 172.21.15.76:0/4283535882 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f119c151910 0x7f119c156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:54.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.866+0000 7f1193e00640 1 -- 172.21.15.76:0/4283535882 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c14ed70 con 0x7f119c0c75d0 2024-03-28T12:42:54.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.870+0000 7f1193e00640 1 --2- 172.21.15.76:0/4283535882 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f119c0c75d0 0x7f119c156570 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f11840ab000 tx=0x7f118401ace0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:54.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.878+0000 7f1192000640 1 -- 172.21.15.76:0/4283535882 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11840b4600 con 0x7f119c0c75d0 2024-03-28T12:42:54.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.878+0000 7f1192000640 1 -- 172.21.15.76:0/4283535882 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11840b47a0 con 0x7f119c0c75d0 2024-03-28T12:42:54.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.878+0000 7f11a1200640 1 -- 172.21.15.76:0/4283535882 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119c14fbb0 con 0x7f119c0c75d0 2024-03-28T12:42:54.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.878+0000 7f1192000640 1 -- 172.21.15.76:0/4283535882 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11840b4b90 con 0x7f119c0c75d0 2024-03-28T12:42:54.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.878+0000 7f11a1200640 1 -- 172.21.15.76:0/4283535882 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f119c1f77d0 con 0x7f119c0c75d0 2024-03-28T12:42:54.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.878+0000 7f11a1200640 1 -- 172.21.15.76:0/4283535882 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f119c0686e0 con 0x7f119c0c75d0 2024-03-28T12:42:54.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.914+0000 7f1192000640 1 -- 172.21.15.76:0/4283535882 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f11840bc070 con 0x7f119c0c75d0 2024-03-28T12:42:54.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.918+0000 7f1192000640 1 --2- 172.21.15.76:0/4283535882 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1178067fc0 0x7f117806a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:54.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.918+0000 7f1199e00640 1 --2- 172.21.15.76:0/4283535882 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1178067fc0 0x7f117806a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:54.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.918+0000 7f1199e00640 1 --2- 172.21.15.76:0/4283535882 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1178067fc0 0x7f117806a480 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f118c009ab0 tx=0x7f118c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:54.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:54.922+0000 7f1192000640 1 -- 172.21.15.76:0/4283535882 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f11840ee680 con 0x7f119c0c75d0 2024-03-28T12:42:55.173 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.174+0000 7f1192000640 1 -- 172.21.15.76:0/4283535882 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f119c14ed70 con 0x7f119c0c75d0 2024-03-28T12:42:55.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.370+0000 7f11a1200640 1 -- 172.21.15.76:0/4283535882 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f119c14ab90 con 0x7f119c0c75d0 2024-03-28T12:42:55.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.398+0000 7f1192000640 1 -- 172.21.15.76:0/4283535882 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f1184016090 con 0x7f119c0c75d0 2024-03-28T12:42:55.398 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-03-28T12:42:55.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.402+0000 7f11a1200640 1 -- 172.21.15.76:0/4283535882 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1178067fc0 msgr2=0x7f117806a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:55.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.402+0000 7f11a1200640 1 --2- 172.21.15.76:0/4283535882 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1178067fc0 0x7f117806a480 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f118c009ab0 tx=0x7f118c009240 comp rx=0 tx=0).stop 2024-03-28T12:42:55.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.402+0000 7f11a1200640 1 -- 172.21.15.76:0/4283535882 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f119c0c75d0 msgr2=0x7f119c156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:55.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.402+0000 7f11a1200640 1 --2- 172.21.15.76:0/4283535882 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f119c0c75d0 0x7f119c156570 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f11840ab000 tx=0x7f118401ace0 comp rx=0 tx=0).stop 2024-03-28T12:42:55.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.402+0000 7f11a1200640 1 -- 172.21.15.76:0/4283535882 shutdown_connections 2024-03-28T12:42:55.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.402+0000 7f11a1200640 1 --2- 172.21.15.76:0/4283535882 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1178067fc0 0x7f117806a480 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:55.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.402+0000 7f11a1200640 1 --2- 172.21.15.76:0/4283535882 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f119c151910 0x7f119c156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:55.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.402+0000 7f11a1200640 1 --2- 172.21.15.76:0/4283535882 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f119c0c75d0 0x7f119c156570 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:55.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.402+0000 7f11a1200640 1 --2- 172.21.15.76:0/4283535882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f119c0c6a40 0x7f119c1f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:55.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.402+0000 7f11a1200640 1 -- 172.21.15.76:0/4283535882 >> 172.21.15.76:0/4283535882 conn(0x7f119c06fd30 msgr2=0x7f119c06bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:55.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.402+0000 7f11a1200640 1 -- 172.21.15.76:0/4283535882 shutdown_connections 2024-03-28T12:42:55.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.402+0000 7f11a1200640 1 -- 172.21.15.76:0/4283535882 wait complete. 2024-03-28T12:42:55.424 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T12:42:55.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.570+0000 7f8e09200640 1 Processor -- start 2024-03-28T12:42:55.568 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.570+0000 7f8e09200640 1 -- start start 2024-03-28T12:42:55.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.570+0000 7f8e09200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8e04152450 0x7f8e0415b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:55.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.570+0000 7f8e09200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f8e040cd170 0x7f8e0406b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:55.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.570+0000 7f8e09200640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e0415bf90 con 0x7f8e04152830 2024-03-28T12:42:55.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.570+0000 7f8e09200640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f8e0406f260 con 0x7f8e040cd170 2024-03-28T12:42:55.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.570+0000 7f8e09200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f8e04159380 con 0x7f8e04152450 2024-03-28T12:42:55.570 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.574+0000 7f8e03e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f8e040cd170 0x7f8e0406b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:55.571 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.574+0000 7f8e03400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8e04152450 0x7f8e0415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:55.571 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.574+0000 7f8e03e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f8e040cd170 0x7f8e0406b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56698/0 (socket says 172.21.15.76:56698) 2024-03-28T12:42:55.571 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.574+0000 7f8e03e00640 1 -- 172.21.15.76:0/1418121098 learned_addr learned my addr 172.21.15.76:0/1418121098 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:55.571 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.574+0000 7f8e02a00640 1 --1- 172.21.15.76:0/1418121098 >> v1:172.21.15.111:6789/0 conn(0x7f8e04152830 0x7f8e04158c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:33062/0 (socket says 172.21.15.76:33062) 2024-03-28T12:42:55.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.574+0000 7f8e03e00640 1 -- 172.21.15.76:0/1418121098 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8e04152450 msgr2=0x7f8e0415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:55.573 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.574+0000 7f8e03e00640 1 --2- 172.21.15.76:0/1418121098 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8e04152450 0x7f8e0415b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:55.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.574+0000 7f8e03e00640 1 -- 172.21.15.76:0/1418121098 >> v1:172.21.15.111:6789/0 conn(0x7f8e04152830 legacy=0x7f8e04158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:55.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.574+0000 7f8e03e00640 1 -- 172.21.15.76:0/1418121098 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0415c270 con 0x7f8e040cd170 2024-03-28T12:42:55.579 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.582+0000 7f8e03e00640 1 --2- 172.21.15.76:0/1418121098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e040cd170 0x7f8e0406b5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc009e50 tx=0x7f8dfc01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d6bebd9daec66a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:55.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.586+0000 7f8e02000640 1 -- 172.21.15.76:0/1418121098 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc0b4070 con 0x7f8e040cd170 2024-03-28T12:42:55.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.586+0000 7f8e02000640 1 -- 172.21.15.76:0/1418121098 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dfc0af400 con 0x7f8e040cd170 2024-03-28T12:42:55.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.586+0000 7f8e02000640 1 -- 172.21.15.76:0/1418121098 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc0af7d0 con 0x7f8e040cd170 2024-03-28T12:42:55.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.586+0000 7f8e09200640 1 -- 172.21.15.76:0/1418121098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e040cd170 msgr2=0x7f8e0406b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:55.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.586+0000 7f8e09200640 1 --2- 172.21.15.76:0/1418121098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e040cd170 0x7f8e0406b5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc009e50 tx=0x7f8dfc01f210 comp rx=0 tx=0).stop 2024-03-28T12:42:55.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.586+0000 7f8e09200640 1 -- 172.21.15.76:0/1418121098 shutdown_connections 2024-03-28T12:42:55.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.586+0000 7f8e09200640 1 --2- 172.21.15.76:0/1418121098 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e040cd170 0x7f8e0406b5a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:55.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.586+0000 7f8e09200640 1 --2- 172.21.15.76:0/1418121098 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8e04152450 0x7f8e0415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:55.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.586+0000 7f8e09200640 1 -- 172.21.15.76:0/1418121098 >> 172.21.15.76:0/1418121098 conn(0x7f8e04073600 msgr2=0x7f8e04070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:55.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.586+0000 7f8e09200640 1 -- 172.21.15.76:0/1418121098 shutdown_connections 2024-03-28T12:42:55.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.586+0000 7f8e09200640 1 -- 172.21.15.76:0/1418121098 wait complete. 2024-03-28T12:42:55.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.590+0000 7f8e09200640 1 Processor -- start 2024-03-28T12:42:55.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.590+0000 7f8e09200640 1 -- start start 2024-03-28T12:42:55.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.590+0000 7f8e09200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e040cd170 0x7f8e04156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:55.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.590+0000 7f8e09200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8e04152450 0x7f8e0413e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:55.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.590+0000 7f8e09200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e04152830 0x7f8e0413e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:55.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.590+0000 7f8e09200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0415c830 con 0x7f8e040cd170 2024-03-28T12:42:55.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.590+0000 7f8e09200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8e041587e0 con 0x7f8e04152830 2024-03-28T12:42:55.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.590+0000 7f8e09200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f8e04158470 con 0x7f8e04152450 2024-03-28T12:42:55.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.594+0000 7f8e03400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e040cd170 0x7f8e04156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:55.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.594+0000 7f8e03400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e040cd170 0x7f8e04156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56700/0 (socket says 172.21.15.76:56700) 2024-03-28T12:42:55.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.594+0000 7f8e03e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e04152830 0x7f8e0413e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:55.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.594+0000 7f8e03400640 1 -- 172.21.15.76:0/1309559304 learned_addr learned my addr 172.21.15.76:0/1309559304 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:55.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.594+0000 7f8e02a00640 1 --2- 172.21.15.76:0/1309559304 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8e04152450 0x7f8e0413e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:55.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.598+0000 7f8e03400640 1 -- 172.21.15.76:0/1309559304 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8e04152450 msgr2=0x7f8e0413e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:55.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.598+0000 7f8e03400640 1 --2- 172.21.15.76:0/1309559304 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8e04152450 0x7f8e0413e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:55.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.598+0000 7f8e03400640 1 -- 172.21.15.76:0/1309559304 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e04152830 msgr2=0x7f8e0413e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:55.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.598+0000 7f8e03400640 1 --2- 172.21.15.76:0/1309559304 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e04152830 0x7f8e0413e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:55.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.598+0000 7f8e03400640 1 -- 172.21.15.76:0/1309559304 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0413c330 con 0x7f8e040cd170 2024-03-28T12:42:55.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.598+0000 7f8e03400640 1 --2- 172.21.15.76:0/1309559304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e040cd170 0x7f8e04156d30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8df400d830 tx=0x7f8df400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:55.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.602+0000 7f8dfb400640 1 -- 172.21.15.76:0/1309559304 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df400b6c0 con 0x7f8e040cd170 2024-03-28T12:42:55.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.602+0000 7f8e09200640 1 -- 172.21.15.76:0/1309559304 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e0413d150 con 0x7f8e040cd170 2024-03-28T12:42:55.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.602+0000 7f8e09200640 1 -- 172.21.15.76:0/1309559304 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e0413d710 con 0x7f8e040cd170 2024-03-28T12:42:55.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.602+0000 7f8e09200640 1 -- 172.21.15.76:0/1309559304 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e040686e0 con 0x7f8e040cd170 2024-03-28T12:42:55.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.606+0000 7f8dfb400640 1 -- 172.21.15.76:0/1309559304 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8df4019070 con 0x7f8e040cd170 2024-03-28T12:42:55.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.606+0000 7f8dfb400640 1 -- 172.21.15.76:0/1309559304 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df400bc70 con 0x7f8e040cd170 2024-03-28T12:42:55.870 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.870+0000 7f8dfb400640 1 -- 172.21.15.76:0/1309559304 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f8df401e460 con 0x7f8e040cd170 2024-03-28T12:42:55.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.874+0000 7f8dfb400640 1 --2- 172.21.15.76:0/1309559304 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8de4067ff0 0x7f8de406a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:55.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.874+0000 7f8e02a00640 1 --2- 172.21.15.76:0/1309559304 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8de4067ff0 0x7f8de406a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:55.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.874+0000 7f8e02a00640 1 --2- 172.21.15.76:0/1309559304 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8de4067ff0 0x7f8de406a4b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8e0413ced0 tx=0x7f8df0007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:55.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.886+0000 7f8dfb400640 1 -- 172.21.15.76:0/1309559304 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f8df40557a0 con 0x7f8e040cd170 2024-03-28T12:42:55.884 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:55.886+0000 7f8dfb400640 1 -- 172.21.15.76:0/1309559304 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f8e0413c330 con 0x7f8e040cd170 2024-03-28T12:42:56.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.178+0000 7f8e09200640 1 -- 172.21.15.76:0/1309559304 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8e040cdf20 con 0x7f8e040cd170 2024-03-28T12:42:56.186 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.190+0000 7f8dfb400640 1 -- 172.21.15.76:0/1309559304 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f8df40576a0 con 0x7f8e040cd170 2024-03-28T12:42:56.187 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-03-28T12:42:56.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.190+0000 7f8e09200640 1 -- 172.21.15.76:0/1309559304 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8de4067ff0 msgr2=0x7f8de406a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:56.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.190+0000 7f8e09200640 1 --2- 172.21.15.76:0/1309559304 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8de4067ff0 0x7f8de406a4b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8e0413ced0 tx=0x7f8df0007e90 comp rx=0 tx=0).stop 2024-03-28T12:42:56.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.190+0000 7f8e09200640 1 -- 172.21.15.76:0/1309559304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e040cd170 msgr2=0x7f8e04156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:56.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.190+0000 7f8e09200640 1 --2- 172.21.15.76:0/1309559304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e040cd170 0x7f8e04156d30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8df400d830 tx=0x7f8df400dcf0 comp rx=0 tx=0).stop 2024-03-28T12:42:56.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.194+0000 7f8e09200640 1 -- 172.21.15.76:0/1309559304 shutdown_connections 2024-03-28T12:42:56.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.194+0000 7f8e09200640 1 --2- 172.21.15.76:0/1309559304 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8de4067ff0 0x7f8de406a4b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:56.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.194+0000 7f8e09200640 1 --2- 172.21.15.76:0/1309559304 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e04152830 0x7f8e0413e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:56.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.194+0000 7f8e09200640 1 --2- 172.21.15.76:0/1309559304 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8e04152450 0x7f8e0413e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:56.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.194+0000 7f8e09200640 1 --2- 172.21.15.76:0/1309559304 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8e040cd170 0x7f8e04156d30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:56.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.194+0000 7f8e09200640 1 -- 172.21.15.76:0/1309559304 >> 172.21.15.76:0/1309559304 conn(0x7f8e04073600 msgr2=0x7f8e04140bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:56.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.194+0000 7f8e09200640 1 -- 172.21.15.76:0/1309559304 shutdown_connections 2024-03-28T12:42:56.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.194+0000 7f8e09200640 1 -- 172.21.15.76:0/1309559304 wait complete. 2024-03-28T12:42:56.212 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-28T12:42:56.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.370+0000 7fb26b400640 1 Processor -- start 2024-03-28T12:42:56.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.370+0000 7fb26b400640 1 -- start start 2024-03-28T12:42:56.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.370+0000 7fb26b400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fb264072340 0x7fb2640c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:56.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.370+0000 7fb26b400640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb2640ce9c0 0x7fb26415b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:56.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.374+0000 7fb26b400640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb26406d7f0 con 0x7fb264071f60 2024-03-28T12:42:56.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.374+0000 7fb26b400640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fb26406c750 con 0x7fb264072340 2024-03-28T12:42:56.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.374+0000 7fb26b400640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fb26406ca30 con 0x7fb2640ce9c0 2024-03-28T12:42:56.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.374+0000 7fb25be00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fb264072340 0x7fb2640c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:56.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.374+0000 7fb25be00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fb264072340 0x7fb2640c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56702/0 (socket says 172.21.15.76:56702) 2024-03-28T12:42:56.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.374+0000 7fb25be00640 1 -- 172.21.15.76:0/2646795528 learned_addr learned my addr 172.21.15.76:0/2646795528 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:56.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.374+0000 7fb269400640 1 --2- 172.21.15.76:0/2646795528 >> v2:172.21.15.111:3300/0 conn(0x7fb2640ce9c0 0x7fb26415b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:56.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.374+0000 7fb25be00640 1 -- 172.21.15.76:0/2646795528 >> v2:172.21.15.111:3300/0 conn(0x7fb2640ce9c0 msgr2=0x7fb26415b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:56.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.374+0000 7fb25be00640 1 --2- 172.21.15.76:0/2646795528 >> v2:172.21.15.111:3300/0 conn(0x7fb2640ce9c0 0x7fb26415b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:56.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.374+0000 7fb25be00640 1 -- 172.21.15.76:0/2646795528 >> v1:172.21.15.111:6789/0 conn(0x7fb264071f60 legacy=0x7fb2640c3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:56.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.374+0000 7fb25be00640 1 -- 172.21.15.76:0/2646795528 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26406cd10 con 0x7fb264072340 2024-03-28T12:42:56.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.382+0000 7fb25be00640 1 --2- 172.21.15.76:0/2646795528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb264072340 0x7fb2640c8d10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009870 tx=0x7fb24c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37bac0b2acc2179 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:56.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.386+0000 7fb263e00640 1 -- 172.21.15.76:0/2646795528 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c0b0070 con 0x7fb264072340 2024-03-28T12:42:56.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.386+0000 7fb263e00640 1 -- 172.21.15.76:0/2646795528 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24c0ab600 con 0x7fb264072340 2024-03-28T12:42:56.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.386+0000 7fb263e00640 1 -- 172.21.15.76:0/2646795528 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c0ab9d0 con 0x7fb264072340 2024-03-28T12:42:56.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.386+0000 7fb26b400640 1 -- 172.21.15.76:0/2646795528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb264072340 msgr2=0x7fb2640c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:56.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.386+0000 7fb26b400640 1 --2- 172.21.15.76:0/2646795528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb264072340 0x7fb2640c8d10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009870 tx=0x7fb24c01c520 comp rx=0 tx=0).stop 2024-03-28T12:42:56.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.386+0000 7fb26b400640 1 -- 172.21.15.76:0/2646795528 shutdown_connections 2024-03-28T12:42:56.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.386+0000 7fb26b400640 1 --2- 172.21.15.76:0/2646795528 >> v2:172.21.15.111:3300/0 conn(0x7fb2640ce9c0 0x7fb26415b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:56.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.386+0000 7fb26b400640 1 --2- 172.21.15.76:0/2646795528 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb264072340 0x7fb2640c8d10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:56.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.386+0000 7fb26b400640 1 -- 172.21.15.76:0/2646795528 >> 172.21.15.76:0/2646795528 conn(0x7fb264071540 msgr2=0x7fb264070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:56.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.386+0000 7fb26b400640 1 -- 172.21.15.76:0/2646795528 shutdown_connections 2024-03-28T12:42:56.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.386+0000 7fb26b400640 1 -- 172.21.15.76:0/2646795528 wait complete. 2024-03-28T12:42:56.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.390+0000 7fb26b400640 1 Processor -- start 2024-03-28T12:42:56.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.390+0000 7fb26b400640 1 -- start start 2024-03-28T12:42:56.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.390+0000 7fb26b400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb264071f60 0x7fb2640c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:56.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.390+0000 7fb26b400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb264072340 0x7fb2640ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:56.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.390+0000 7fb26b400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb2640ce9c0 0x7fb2640af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:56.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.390+0000 7fb26b400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb2641672e0 con 0x7fb264071f60 2024-03-28T12:42:56.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.390+0000 7fb26b400640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb2640cef00 con 0x7fb264072340 2024-03-28T12:42:56.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.390+0000 7fb26b400640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb264167460 con 0x7fb2640ce9c0 2024-03-28T12:42:56.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.390+0000 7fb268a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb264071f60 0x7fb2640c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:56.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.390+0000 7fb268a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb264071f60 0x7fb2640c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56704/0 (socket says 172.21.15.76:56704) 2024-03-28T12:42:56.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.390+0000 7fb268a00640 1 -- 172.21.15.76:0/970656436 learned_addr learned my addr 172.21.15.76:0/970656436 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:56.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.390+0000 7fb269400640 1 --2- 172.21.15.76:0/970656436 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb2640ce9c0 0x7fb2640af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:56.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.390+0000 7fb25be00640 1 --2- 172.21.15.76:0/970656436 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb264072340 0x7fb2640ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:56.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.398+0000 7fb268a00640 1 -- 172.21.15.76:0/970656436 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb2640ce9c0 msgr2=0x7fb2640af9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:56.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.398+0000 7fb268a00640 1 --2- 172.21.15.76:0/970656436 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb2640ce9c0 0x7fb2640af9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:56.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.398+0000 7fb268a00640 1 -- 172.21.15.76:0/970656436 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb264072340 msgr2=0x7fb2640ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:56.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.398+0000 7fb268a00640 1 --2- 172.21.15.76:0/970656436 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb264072340 0x7fb2640ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:56.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.398+0000 7fb268a00640 1 -- 172.21.15.76:0/970656436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2640b0590 con 0x7fb264071f60 2024-03-28T12:42:56.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.398+0000 7fb268a00640 1 --2- 172.21.15.76:0/970656436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb264071f60 0x7fb2640c7fc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb25400c370 tx=0x7fb25400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:56.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.402+0000 7fb261600640 1 -- 172.21.15.76:0/970656436 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2540052d0 con 0x7fb264071f60 2024-03-28T12:42:56.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.402+0000 7fb261600640 1 -- 172.21.15.76:0/970656436 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb254005470 con 0x7fb264071f60 2024-03-28T12:42:56.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.402+0000 7fb26b400640 1 -- 172.21.15.76:0/970656436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2640aedd0 con 0x7fb264071f60 2024-03-28T12:42:56.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.402+0000 7fb261600640 1 -- 172.21.15.76:0/970656436 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb254007260 con 0x7fb264071f60 2024-03-28T12:42:56.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.402+0000 7fb26b400640 1 -- 172.21.15.76:0/970656436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2640b0ae0 con 0x7fb264071f60 2024-03-28T12:42:56.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.406+0000 7fb26b400640 1 -- 172.21.15.76:0/970656436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2640686e0 con 0x7fb264071f60 2024-03-28T12:42:56.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.662+0000 7fb261600640 1 -- 172.21.15.76:0/970656436 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb254007400 con 0x7fb264071f60 2024-03-28T12:42:56.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.666+0000 7fb261600640 1 --2- 172.21.15.76:0/970656436 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb240068040 0x7fb24006a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:56.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.666+0000 7fb25be00640 1 --2- 172.21.15.76:0/970656436 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb240068040 0x7fb24006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:56.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.666+0000 7fb25be00640 1 --2- 172.21.15.76:0/970656436 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb240068040 0x7fb24006a500 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0ad000 tx=0x7fb24c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:56.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.674+0000 7fb261600640 1 -- 172.21.15.76:0/970656436 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fb254053f80 con 0x7fb264071f60 2024-03-28T12:42:56.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.674+0000 7fb261600640 1 -- 172.21.15.76:0/970656436 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fb254055ee0 con 0x7fb264071f60 2024-03-28T12:42:56.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.918+0000 7fb26b400640 1 -- 172.21.15.76:0/970656436 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb2641538e0 con 0x7fb264071f60 2024-03-28T12:42:56.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.922+0000 7fb261600640 1 -- 172.21.15.76:0/970656436 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fb25405a1e0 con 0x7fb264071f60 2024-03-28T12:42:56.921 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-03-28T12:42:56.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.926+0000 7fb26b400640 1 -- 172.21.15.76:0/970656436 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb240068040 msgr2=0x7fb24006a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:56.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.926+0000 7fb26b400640 1 --2- 172.21.15.76:0/970656436 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb240068040 0x7fb24006a500 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb24c0ad000 tx=0x7fb24c008040 comp rx=0 tx=0).stop 2024-03-28T12:42:56.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.926+0000 7fb26b400640 1 -- 172.21.15.76:0/970656436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb264071f60 msgr2=0x7fb2640c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:56.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.926+0000 7fb26b400640 1 --2- 172.21.15.76:0/970656436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb264071f60 0x7fb2640c7fc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb25400c370 tx=0x7fb25400c830 comp rx=0 tx=0).stop 2024-03-28T12:42:56.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.926+0000 7fb26b400640 1 -- 172.21.15.76:0/970656436 shutdown_connections 2024-03-28T12:42:56.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.926+0000 7fb26b400640 1 --2- 172.21.15.76:0/970656436 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb240068040 0x7fb24006a500 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:56.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.926+0000 7fb26b400640 1 --2- 172.21.15.76:0/970656436 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb2640ce9c0 0x7fb2640af9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:56.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.926+0000 7fb26b400640 1 --2- 172.21.15.76:0/970656436 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb264072340 0x7fb2640ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:56.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.926+0000 7fb26b400640 1 --2- 172.21.15.76:0/970656436 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb264071f60 0x7fb2640c7fc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:56.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.926+0000 7fb26b400640 1 -- 172.21.15.76:0/970656436 >> 172.21.15.76:0/970656436 conn(0x7fb264071540 msgr2=0x7fb26414f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:56.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.926+0000 7fb26b400640 1 -- 172.21.15.76:0/970656436 shutdown_connections 2024-03-28T12:42:56.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:56.926+0000 7fb26b400640 1 -- 172.21.15.76:0/970656436 wait complete. 2024-03-28T12:42:56.944 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T12:42:57.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.102+0000 7f65afe00640 1 Processor -- start 2024-03-28T12:42:57.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.102+0000 7f65afe00640 1 -- start start 2024-03-28T12:42:57.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.106+0000 7f65afe00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f65b006eb90 0x7f65b00c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:57.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.106+0000 7f65afe00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b0154d20 con 0x7f65b006efc0 2024-03-28T12:42:57.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.106+0000 7f65afe00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b00c3530 con 0x7f65b0154940 2024-03-28T12:42:57.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.106+0000 7f65afe00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f65b0070610 con 0x7f65b006eb90 2024-03-28T12:42:57.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.110+0000 7f65aea00640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f65b0154940 0x7f65b006fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:33086/0 (socket says 172.21.15.76:33086) 2024-03-28T12:42:57.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.110+0000 7f65aea00640 1 -- 172.21.15.76:0/2400477689 learned_addr learned my addr 172.21.15.76:0/2400477689 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:57.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.162+0000 7f65ae000640 1 --2- 172.21.15.76:0/2400477689 >> v2:172.21.15.76:3300/0 conn(0x7f65b006eb90 0x7f65b00c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:57.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.166+0000 7f65ae000640 1 -- 172.21.15.76:0/2400477689 >> v1:172.21.15.111:6789/0 conn(0x7f65b0154940 legacy=0x7f65b006fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:57.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.166+0000 7f65ae000640 1 -- 172.21.15.76:0/2400477689 >> v1:172.21.15.76:6789/0 conn(0x7f65b006efc0 legacy=0x7f65b015a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:57.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.166+0000 7f65ae000640 1 -- 172.21.15.76:0/2400477689 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b00c3810 con 0x7f65b006eb90 2024-03-28T12:42:57.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.174+0000 7f65ae000640 1 --2- 172.21.15.76:0/2400477689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65b006eb90 0x7f65b00c9a50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f65b0070790 tx=0x7f659c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd6f919ed9fb118 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:57.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.178+0000 7f65ad600640 1 -- 172.21.15.76:0/2400477689 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c0b0070 con 0x7f65b006eb90 2024-03-28T12:42:57.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.178+0000 7f65ad600640 1 -- 172.21.15.76:0/2400477689 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f659c0ab600 con 0x7f65b006eb90 2024-03-28T12:42:57.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.178+0000 7f65ad600640 1 -- 172.21.15.76:0/2400477689 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c0ab9d0 con 0x7f65b006eb90 2024-03-28T12:42:57.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.178+0000 7f65afe00640 1 -- 172.21.15.76:0/2400477689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65b006eb90 msgr2=0x7f65b00c9a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:57.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.178+0000 7f65afe00640 1 --2- 172.21.15.76:0/2400477689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65b006eb90 0x7f65b00c9a50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f65b0070790 tx=0x7f659c01c410 comp rx=0 tx=0).stop 2024-03-28T12:42:57.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.178+0000 7f65afe00640 1 -- 172.21.15.76:0/2400477689 shutdown_connections 2024-03-28T12:42:57.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.178+0000 7f65afe00640 1 --2- 172.21.15.76:0/2400477689 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65b006eb90 0x7f65b00c9a50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:57.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.178+0000 7f65afe00640 1 -- 172.21.15.76:0/2400477689 >> 172.21.15.76:0/2400477689 conn(0x7f65b0070c10 msgr2=0x7f65b0071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:57.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.182+0000 7f65afe00640 1 -- 172.21.15.76:0/2400477689 shutdown_connections 2024-03-28T12:42:57.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.182+0000 7f65afe00640 1 -- 172.21.15.76:0/2400477689 wait complete. 2024-03-28T12:42:57.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.182+0000 7f65afe00640 1 Processor -- start 2024-03-28T12:42:57.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.182+0000 7f65afe00640 1 -- start start 2024-03-28T12:42:57.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.182+0000 7f65afe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65b006eb90 0x7f65b013e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:57.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.182+0000 7f65afe00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f65b006efc0 0x7f65b00cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:57.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.182+0000 7f65afe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65b0154940 0x7f65b0145850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:57.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.182+0000 7f65afe00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f65b0168920 con 0x7f65b006eb90 2024-03-28T12:42:57.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.182+0000 7f65afe00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f65b00c4140 con 0x7f65b006efc0 2024-03-28T12:42:57.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.182+0000 7f65afe00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f65b0168aa0 con 0x7f65b0154940 2024-03-28T12:42:57.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.182+0000 7f65aea00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65b006eb90 0x7f65b013e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:57.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.182+0000 7f65aea00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65b006eb90 0x7f65b013e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56708/0 (socket says 172.21.15.76:56708) 2024-03-28T12:42:57.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.182+0000 7f65aea00640 1 -- 172.21.15.76:0/182969561 learned_addr learned my addr 172.21.15.76:0/182969561 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:57.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.190+0000 7f65aea00640 1 -- 172.21.15.76:0/182969561 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65b0154940 msgr2=0x7f65b0145850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:57.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.190+0000 7f65aea00640 1 --2- 172.21.15.76:0/182969561 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65b0154940 0x7f65b0145850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:57.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.190+0000 7f65aea00640 1 -- 172.21.15.76:0/182969561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f65b006efc0 msgr2=0x7f65b00cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:57.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.190+0000 7f65aea00640 1 --2- 172.21.15.76:0/182969561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f65b006efc0 0x7f65b00cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:57.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.190+0000 7f65aea00640 1 -- 172.21.15.76:0/182969561 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b00cccc0 con 0x7f65b006eb90 2024-03-28T12:42:57.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.194+0000 7f65aea00640 1 --2- 172.21.15.76:0/182969561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65b006eb90 0x7f65b013e090 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f65a000c400 tx=0x7f65a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:57.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.198+0000 7f65a6a00640 1 -- 172.21.15.76:0/182969561 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a0017070 con 0x7f65b006eb90 2024-03-28T12:42:57.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.198+0000 7f65a6a00640 1 -- 172.21.15.76:0/182969561 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a0005cf0 con 0x7f65b006eb90 2024-03-28T12:42:57.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.198+0000 7f65a6a00640 1 -- 172.21.15.76:0/182969561 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a00072d0 con 0x7f65b006eb90 2024-03-28T12:42:57.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.198+0000 7f65afe00640 1 -- 172.21.15.76:0/182969561 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b00c66a0 con 0x7f65b006eb90 2024-03-28T12:42:57.198 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.202+0000 7f65afe00640 1 -- 172.21.15.76:0/182969561 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b00c6c60 con 0x7f65b006eb90 2024-03-28T12:42:57.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.202+0000 7f65afe00640 1 -- 172.21.15.76:0/182969561 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65b0068df0 con 0x7f65b006eb90 2024-03-28T12:42:57.222 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.226+0000 7f65a6a00640 1 -- 172.21.15.76:0/182969561 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f65a001a070 con 0x7f65b006eb90 2024-03-28T12:42:57.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.226+0000 7f65a6a00640 1 --2- 172.21.15.76:0/182969561 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6590068010 0x7f659006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:57.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.226+0000 7f65ae000640 1 --2- 172.21.15.76:0/182969561 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6590068010 0x7f659006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:57.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.226+0000 7f65ae000640 1 --2- 172.21.15.76:0/182969561 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6590068010 0x7f659006a4d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f659c0ad000 tx=0x7f659c004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:57.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.226+0000 7f65a6a00640 1 -- 172.21.15.76:0/182969561 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f65a0053f40 con 0x7f65b006eb90 2024-03-28T12:42:57.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.670+0000 7f65a6a00640 1 -- 172.21.15.76:0/182969561 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f65a0055ea0 con 0x7f65b006eb90 2024-03-28T12:42:57.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.878+0000 7f65afe00640 1 -- 172.21.15.76:0/182969561 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65b006f6f0 con 0x7f65b006eb90 2024-03-28T12:42:57.891 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.894+0000 7f65a6a00640 1 -- 172.21.15.76:0/182969561 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6914 (secure 0 0 0) 0x7f65a005a1a0 con 0x7f65b006eb90 2024-03-28T12:42:57.891 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:57.891 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/335301918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":335301918},{"type":"v1","addr":"172.21.15.111:6835","nonce":335301918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T12:42:00.776505+0000","modified":"2024-03-28T12:42:47.404439+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4264,"mds_1":4258,"mds_2":4251,"mds_3":4248,"mds_4":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"e","rank":4,"incarnation":16,"state":"up:active","state_seq":18,"addr":"172.21.15.76:6837/1786218285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1786218285},{"type":"v1","addr":"172.21.15.76:6837","nonce":1786218285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4248":{"gid":4248,"name":"a","rank":3,"incarnation":14,"state":"up:active","state_seq":18,"addr":"172.21.15.76:6839/2729208421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":2729208421},{"type":"v1","addr":"172.21.15.76:6839","nonce":2729208421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4251":{"gid":4251,"name":"b","rank":2,"incarnation":12,"state":"up:active","state_seq":17,"addr":"172.21.15.111:6837/4176441330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":4176441330},{"type":"v1","addr":"172.21.15.111:6837","nonce":4176441330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4258":{"gid":4258,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":18,"addr":"172.21.15.111:6833/3175932821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":3175932821},{"type":"v1","addr":"172.21.15.111:6833","nonce":3175932821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":9,"addr":"172.21.15.76:6835/544947706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":544947706},{"type":"v1","addr":"172.21.15.76:6835","nonce":544947706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4264,"qdb_cluster":[4245,4258,4248,4251,4264]},"id":1}]} 2024-03-28T12:42:57.891 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 17 2024-03-28T12:42:57.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.894+0000 7f65afe00640 1 -- 172.21.15.76:0/182969561 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6590068010 msgr2=0x7f659006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:57.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.894+0000 7f65afe00640 1 --2- 172.21.15.76:0/182969561 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6590068010 0x7f659006a4d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f659c0ad000 tx=0x7f659c004740 comp rx=0 tx=0).stop 2024-03-28T12:42:57.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.894+0000 7f65afe00640 1 -- 172.21.15.76:0/182969561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65b006eb90 msgr2=0x7f65b013e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:57.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.894+0000 7f65afe00640 1 --2- 172.21.15.76:0/182969561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65b006eb90 0x7f65b013e090 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f65a000c400 tx=0x7f65a000c8c0 comp rx=0 tx=0).stop 2024-03-28T12:42:57.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.894+0000 7f65afe00640 1 -- 172.21.15.76:0/182969561 shutdown_connections 2024-03-28T12:42:57.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.894+0000 7f65afe00640 1 --2- 172.21.15.76:0/182969561 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6590068010 0x7f659006a4d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:57.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.894+0000 7f65afe00640 1 --2- 172.21.15.76:0/182969561 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65b0154940 0x7f65b0145850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:57.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.894+0000 7f65afe00640 1 --2- 172.21.15.76:0/182969561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f65b006efc0 0x7f65b00cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:57.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.894+0000 7f65afe00640 1 --2- 172.21.15.76:0/182969561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f65b006eb90 0x7f65b013e090 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:57.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.894+0000 7f65afe00640 1 -- 172.21.15.76:0/182969561 >> 172.21.15.76:0/182969561 conn(0x7f65b0070c10 msgr2=0x7f65b0147210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:57.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.894+0000 7f65afe00640 1 -- 172.21.15.76:0/182969561 shutdown_connections 2024-03-28T12:42:57.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:57.894+0000 7f65afe00640 1 -- 172.21.15.76:0/182969561 wait complete. 2024-03-28T12:42:57.914 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T12:42:58.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.130+0000 7fd439800640 1 Processor -- start 2024-03-28T12:42:58.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.130+0000 7fd439800640 1 -- start start 2024-03-28T12:42:58.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.130+0000 7fd439800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd434159260 0x7fd4340c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:58.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.134+0000 7fd439800640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd43415ef00 con 0x7fd434071e00 2024-03-28T12:42:58.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.134+0000 7fd439800640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd43415f1e0 con 0x7fd434158e80 2024-03-28T12:42:58.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.134+0000 7fd439800640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd4340c5250 con 0x7fd434159260 2024-03-28T12:42:58.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.182+0000 7fd433400640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fd434071e00 0x7fd434162410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:41682/0 (socket says 172.21.15.76:41682) 2024-03-28T12:42:58.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.182+0000 7fd433400640 1 -- 172.21.15.76:0/1072095298 learned_addr learned my addr 172.21.15.76:0/1072095298 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:58.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.186+0000 7fd431600640 1 -- 172.21.15.76:0/1072095298 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1892918692 0 0) 0x7fd43415ef00 con 0x7fd434071e00 2024-03-28T12:42:58.182 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.186+0000 7fd431600640 1 -- 172.21.15.76:0/1072095298 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd418003530 con 0x7fd434071e00 2024-03-28T12:42:58.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.190+0000 7fd431600640 1 -- 172.21.15.76:0/1072095298 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3871474695 0 0) 0x7fd418003530 con 0x7fd434071e00 2024-03-28T12:42:58.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.190+0000 7fd431600640 1 -- 172.21.15.76:0/1072095298 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd434159260 msgr2=0x7fd4340c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:58.187 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.190+0000 7fd431600640 1 --2- 172.21.15.76:0/1072095298 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd434159260 0x7fd4340c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:58.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.190+0000 7fd431600640 1 -- 172.21.15.76:0/1072095298 >> v1:172.21.15.111:6789/0 conn(0x7fd434158e80 legacy=0x7fd4340c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:58.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.190+0000 7fd431600640 1 -- 172.21.15.76:0/1072095298 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43415f4c0 con 0x7fd434071e00 2024-03-28T12:42:58.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.190+0000 7fd431600640 1 -- 172.21.15.76:0/1072095298 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7fd42c001a00 con 0x7fd434071e00 2024-03-28T12:42:58.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.190+0000 7fd431600640 1 -- 172.21.15.76:0/1072095298 >> v1:172.21.15.76:6789/0 conn(0x7fd434071e00 legacy=0x7fd434162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:58.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.190+0000 7fd431600640 1 --2- 172.21.15.76:0/1072095298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4180039f0 0x7fd418003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:58.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.190+0000 7fd431600640 1 --2- 172.21.15.76:0/1072095298 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd434159260 0x7fd418004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:58.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.190+0000 7fd431600640 1 --2- 172.21.15.76:0/1072095298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd418004e70 0x7fd41800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:58.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.190+0000 7fd431600640 1 -- 172.21.15.76:0/1072095298 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd4340c5250 con 0x7fd418004e70 2024-03-28T12:42:58.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.190+0000 7fd431600640 1 -- 172.21.15.76:0/1072095298 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd4180055b0 con 0x7fd4180039f0 2024-03-28T12:42:58.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.190+0000 7fd431600640 1 -- 172.21.15.76:0/1072095298 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd41800bf10 con 0x7fd434159260 2024-03-28T12:42:58.191 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.194+0000 7fd433400640 1 --2- 172.21.15.76:0/1072095298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd418004e70 0x7fd41800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:58.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.198+0000 7fd433400640 1 -- 172.21.15.76:0/1072095298 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd434159260 msgr2=0x7fd418004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:58.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.198+0000 7fd433400640 1 --2- 172.21.15.76:0/1072095298 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd434159260 0x7fd418004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:58.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.198+0000 7fd433400640 1 -- 172.21.15.76:0/1072095298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4180039f0 msgr2=0x7fd418003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:58.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.198+0000 7fd433400640 1 --2- 172.21.15.76:0/1072095298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4180039f0 0x7fd418003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:58.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.198+0000 7fd433400640 1 -- 172.21.15.76:0/1072095298 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd418003530 con 0x7fd418004e70 2024-03-28T12:42:58.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.202+0000 7fd433400640 1 --2- 172.21.15.76:0/1072095298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd418004e70 0x7fd41800b9d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00a790 tx=0x7fd42c01d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34cf05a3b3bb46e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:58.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.206+0000 7fd431600640 1 -- 172.21.15.76:0/1072095298 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c00a3b0 con 0x7fd418004e70 2024-03-28T12:42:58.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.206+0000 7fd431600640 1 -- 172.21.15.76:0/1072095298 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd42c0ad630 con 0x7fd418004e70 2024-03-28T12:42:58.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.206+0000 7fd431600640 1 -- 172.21.15.76:0/1072095298 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0ada20 con 0x7fd418004e70 2024-03-28T12:42:58.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.206+0000 7fd439800640 1 -- 172.21.15.76:0/1072095298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd418004e70 msgr2=0x7fd41800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:58.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.206+0000 7fd439800640 1 --2- 172.21.15.76:0/1072095298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd418004e70 0x7fd41800b9d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00a790 tx=0x7fd42c01d2c0 comp rx=0 tx=0).stop 2024-03-28T12:42:58.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.206+0000 7fd433400640 1 -- 172.21.15.76:0/1072095298 reap_dead start 2024-03-28T12:42:58.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.206+0000 7fd439800640 1 -- 172.21.15.76:0/1072095298 shutdown_connections 2024-03-28T12:42:58.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.206+0000 7fd439800640 1 -- 172.21.15.76:0/1072095298 >> 172.21.15.76:0/1072095298 conn(0x7fd434071520 msgr2=0x7fd434070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:58.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.206+0000 7fd439800640 1 -- 172.21.15.76:0/1072095298 shutdown_connections 2024-03-28T12:42:58.205 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.206+0000 7fd439800640 1 -- 172.21.15.76:0/1072095298 wait complete. 2024-03-28T12:42:58.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.210+0000 7fd439800640 1 Processor -- start 2024-03-28T12:42:58.208 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.210+0000 7fd439800640 1 -- start start 2024-03-28T12:42:58.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.210+0000 7fd439800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd418004e70 0x7fd4341f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:58.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.210+0000 7fd439800640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4341f8580 0x7fd4341f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:58.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.210+0000 7fd439800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd434156a10 0x7fd4341f70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:58.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.210+0000 7fd439800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd4340cb730 con 0x7fd434156a10 2024-03-28T12:42:58.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.210+0000 7fd439800640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd43415fa80 con 0x7fd4341f8580 2024-03-28T12:42:58.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.210+0000 7fd439800640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd4340cb8b0 con 0x7fd418004e70 2024-03-28T12:42:58.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.214+0000 7fd433400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd434156a10 0x7fd4341f70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:58.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.214+0000 7fd433400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd434156a10 0x7fd4341f70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56726/0 (socket says 172.21.15.76:56726) 2024-03-28T12:42:58.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.214+0000 7fd433400640 1 -- 172.21.15.76:0/1197994194 learned_addr learned my addr 172.21.15.76:0/1197994194 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:58.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.218+0000 7fd432a00640 1 --2- 172.21.15.76:0/1197994194 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd418004e70 0x7fd4341f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:58.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.218+0000 7fd433400640 1 -- 172.21.15.76:0/1197994194 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd418004e70 msgr2=0x7fd4341f8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:58.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.218+0000 7fd433400640 1 --2- 172.21.15.76:0/1197994194 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd418004e70 0x7fd4341f8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:58.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.218+0000 7fd433400640 1 -- 172.21.15.76:0/1197994194 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4341f8580 msgr2=0x7fd4341f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:58.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.218+0000 7fd433400640 1 --2- 172.21.15.76:0/1197994194 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4341f8580 0x7fd4341f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:58.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.218+0000 7fd433400640 1 -- 172.21.15.76:0/1197994194 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4341f5e10 con 0x7fd434156a10 2024-03-28T12:42:58.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.218+0000 7fd432a00640 1 --2- 172.21.15.76:0/1197994194 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd418004e70 0x7fd4341f8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T12:42:58.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.222+0000 7fd433400640 1 --2- 172.21.15.76:0/1197994194 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd434156a10 0x7fd4341f70d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00a790 tx=0x7fd418005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:58.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.226+0000 7fd42aa00640 1 -- 172.21.15.76:0/1197994194 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0bc070 con 0x7fd434156a10 2024-03-28T12:42:58.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.226+0000 7fd42aa00640 1 -- 172.21.15.76:0/1197994194 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd42c0017c0 con 0x7fd434156a10 2024-03-28T12:42:58.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.226+0000 7fd42aa00640 1 -- 172.21.15.76:0/1197994194 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd42c0b2040 con 0x7fd434156a10 2024-03-28T12:42:58.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.226+0000 7fd439800640 1 -- 172.21.15.76:0/1197994194 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4341f8a80 con 0x7fd434156a10 2024-03-28T12:42:58.223 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.226+0000 7fd439800640 1 -- 172.21.15.76:0/1197994194 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4341f6390 con 0x7fd434156a10 2024-03-28T12:42:58.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.226+0000 7fd439800640 1 -- 172.21.15.76:0/1197994194 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4340686e0 con 0x7fd434156a10 2024-03-28T12:42:58.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.482+0000 7fd42aa00640 1 -- 172.21.15.76:0/1197994194 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fd42c0bf070 con 0x7fd434156a10 2024-03-28T12:42:58.480 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.482+0000 7fd42aa00640 1 --2- 172.21.15.76:0/1197994194 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd414068040 0x7fd41406a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:58.481 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.482+0000 7fd432a00640 1 --2- 172.21.15.76:0/1197994194 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd414068040 0x7fd41406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:58.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.482+0000 7fd432a00640 1 --2- 172.21.15.76:0/1197994194 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd414068040 0x7fd41406a500 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd424001660 tx=0x7fd424009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:58.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.498+0000 7fd42aa00640 1 -- 172.21.15.76:0/1197994194 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fd42c0eebc0 con 0x7fd434156a10 2024-03-28T12:42:58.494 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.498+0000 7fd42aa00640 1 -- 172.21.15.76:0/1197994194 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fd42c0c7020 con 0x7fd434156a10 2024-03-28T12:42:58.696 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.698+0000 7fd439800640 1 -- 172.21.15.76:0/1197994194 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd434157cf0 con 0x7fd434156a10 2024-03-28T12:42:58.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.738+0000 7fd42aa00640 1 -- 172.21.15.76:0/1197994194 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18798 (secure 0 0 0) 0x7fd42c016fd0 con 0x7fd434156a10 2024-03-28T12:42:58.736 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:42:58.736 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":29,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:42:15.156639+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T12:41:58.010965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T12:41:59.698601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-28T12:42:05.363180+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.1","mappings":[{"from":3,"to":4}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]},{"pgid":"4.d","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":5}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:42:58.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.742+0000 7fd439800640 1 -- 172.21.15.76:0/1197994194 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd414068040 msgr2=0x7fd41406a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:58.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.742+0000 7fd439800640 1 --2- 172.21.15.76:0/1197994194 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd414068040 0x7fd41406a500 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd424001660 tx=0x7fd424009040 comp rx=0 tx=0).stop 2024-03-28T12:42:58.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.742+0000 7fd439800640 1 -- 172.21.15.76:0/1197994194 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd434156a10 msgr2=0x7fd4341f70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:58.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.742+0000 7fd439800640 1 --2- 172.21.15.76:0/1197994194 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd434156a10 0x7fd4341f70d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd42c00a790 tx=0x7fd418005840 comp rx=0 tx=0).stop 2024-03-28T12:42:58.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.742+0000 7fd439800640 1 -- 172.21.15.76:0/1197994194 shutdown_connections 2024-03-28T12:42:58.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.742+0000 7fd439800640 1 --2- 172.21.15.76:0/1197994194 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd414068040 0x7fd41406a500 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:58.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.742+0000 7fd439800640 1 --2- 172.21.15.76:0/1197994194 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd434156a10 0x7fd4341f70d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:58.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.742+0000 7fd439800640 1 --2- 172.21.15.76:0/1197994194 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd4341f8580 0x7fd4341f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:58.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.742+0000 7fd439800640 1 --2- 172.21.15.76:0/1197994194 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd418004e70 0x7fd4341f8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:58.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.742+0000 7fd439800640 1 -- 172.21.15.76:0/1197994194 >> 172.21.15.76:0/1197994194 conn(0x7fd434071520 msgr2=0x7fd4340c90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:58.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.742+0000 7fd439800640 1 -- 172.21.15.76:0/1197994194 shutdown_connections 2024-03-28T12:42:58.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.742+0000 7fd439800640 1 -- 172.21.15.76:0/1197994194 wait complete. 2024-03-28T12:42:58.759 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T12:41:23.389090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T12:41:58.010965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T12:41:59.698601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-28T12:42:05.363180+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-28T12:42:58.759 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T12:42:58.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.906+0000 7f369cc00640 1 Processor -- start 2024-03-28T12:42:58.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.906+0000 7f369cc00640 1 -- start start 2024-03-28T12:42:58.904 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.906+0000 7f369cc00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f36980c9a70 0x7f36980c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:58.904 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.906+0000 7f369cc00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f369806ee50 0x7f369815e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:58.904 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.906+0000 7f369cc00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36980c3b10 con 0x7f3698070080 2024-03-28T12:42:58.904 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.906+0000 7f369cc00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f36980c3db0 con 0x7f369806ee50 2024-03-28T12:42:58.904 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.906+0000 7f369cc00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f3698154e90 con 0x7f36980c9a70 2024-03-28T12:42:58.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.906+0000 7f3695400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f369806ee50 0x7f369815e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:58.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.906+0000 7f3695e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f36980c9a70 0x7f36980c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:58.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.906+0000 7f3695400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f369806ee50 0x7f369815e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56742/0 (socket says 172.21.15.76:56742) 2024-03-28T12:42:58.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.906+0000 7f3695400640 1 -- 172.21.15.76:0/111810116 learned_addr learned my addr 172.21.15.76:0/111810116 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:58.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.910+0000 7f3695400640 1 -- 172.21.15.76:0/111810116 >> v2:172.21.15.111:3300/0 conn(0x7f36980c9a70 msgr2=0x7f36980c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:58.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.910+0000 7f3695400640 1 --2- 172.21.15.76:0/111810116 >> v2:172.21.15.111:3300/0 conn(0x7f36980c9a70 0x7f36980c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:58.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.910+0000 7f3695400640 1 -- 172.21.15.76:0/111810116 >> v1:172.21.15.111:6789/0 conn(0x7f3698070080 legacy=0x7f369806b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:58.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.910+0000 7f3695400640 1 -- 172.21.15.76:0/111810116 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369806f5e0 con 0x7f369806ee50 2024-03-28T12:42:58.914 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.914+0000 7f3695400640 1 --2- 172.21.15.76:0/111810116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f369806ee50 0x7f369815e5b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3698072e10 tx=0x7f368401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e7966d64ede455 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:58.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f3694a00640 1 -- 172.21.15.76:0/111810116 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36840b0070 con 0x7f369806ee50 2024-03-28T12:42:58.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f3694a00640 1 -- 172.21.15.76:0/111810116 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36840ab600 con 0x7f369806ee50 2024-03-28T12:42:58.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f3694a00640 1 -- 172.21.15.76:0/111810116 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36840ab9d0 con 0x7f369806ee50 2024-03-28T12:42:58.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f369cc00640 1 -- 172.21.15.76:0/111810116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f369806ee50 msgr2=0x7f369815e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:58.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f369cc00640 1 --2- 172.21.15.76:0/111810116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f369806ee50 0x7f369815e5b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3698072e10 tx=0x7f368401c4e0 comp rx=0 tx=0).stop 2024-03-28T12:42:58.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f369cc00640 1 -- 172.21.15.76:0/111810116 shutdown_connections 2024-03-28T12:42:58.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f369cc00640 1 --2- 172.21.15.76:0/111810116 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f369806ee50 0x7f369815e5b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:58.919 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f369cc00640 1 --2- 172.21.15.76:0/111810116 >> v2:172.21.15.111:3300/0 conn(0x7f36980c9a70 0x7f36980c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:58.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f369cc00640 1 -- 172.21.15.76:0/111810116 >> 172.21.15.76:0/111810116 conn(0x7f3698070ca0 msgr2=0x7f36980710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:58.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f369cc00640 1 -- 172.21.15.76:0/111810116 shutdown_connections 2024-03-28T12:42:58.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f369cc00640 1 -- 172.21.15.76:0/111810116 wait complete. 2024-03-28T12:42:58.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f369cc00640 1 Processor -- start 2024-03-28T12:42:58.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f369cc00640 1 -- start start 2024-03-28T12:42:58.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f369cc00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f369806ee50 0x7f3698156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:58.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f369cc00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3698070080 0x7f36980cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:58.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f369cc00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36980c9a70 0x7f36980cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:58.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f369cc00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f36980c81c0 con 0x7f36980c9a70 2024-03-28T12:42:58.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f369cc00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f36980c8040 con 0x7f3698070080 2024-03-28T12:42:58.922 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.922+0000 7f369cc00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f36981683a0 con 0x7f369806ee50 2024-03-28T12:42:58.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.926+0000 7f3696800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36980c9a70 0x7f36980cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:58.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.926+0000 7f3695400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3698070080 0x7f36980cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:58.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.926+0000 7f3696800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36980c9a70 0x7f36980cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56752/0 (socket says 172.21.15.76:56752) 2024-03-28T12:42:58.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.926+0000 7f3696800640 1 -- 172.21.15.76:0/2081424298 learned_addr learned my addr 172.21.15.76:0/2081424298 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:58.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.926+0000 7f3695e00640 1 --2- 172.21.15.76:0/2081424298 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f369806ee50 0x7f3698156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:58.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.930+0000 7f3696800640 1 -- 172.21.15.76:0/2081424298 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f369806ee50 msgr2=0x7f3698156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:58.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.930+0000 7f3696800640 1 --2- 172.21.15.76:0/2081424298 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f369806ee50 0x7f3698156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:58.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.930+0000 7f3696800640 1 -- 172.21.15.76:0/2081424298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3698070080 msgr2=0x7f36980cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:58.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.930+0000 7f3696800640 1 --2- 172.21.15.76:0/2081424298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3698070080 0x7f36980cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:58.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.930+0000 7f3696800640 1 -- 172.21.15.76:0/2081424298 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36981f6280 con 0x7f36980c9a70 2024-03-28T12:42:58.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.934+0000 7f3696800640 1 --2- 172.21.15.76:0/2081424298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36980c9a70 0x7f36980cc370 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f369000c7b0 tx=0x7f369000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:58.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.938+0000 7f368e000640 1 -- 172.21.15.76:0/2081424298 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3690004b70 con 0x7f36980c9a70 2024-03-28T12:42:58.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.938+0000 7f368e000640 1 -- 172.21.15.76:0/2081424298 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3690004d10 con 0x7f36980c9a70 2024-03-28T12:42:58.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.938+0000 7f368e000640 1 -- 172.21.15.76:0/2081424298 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369000aa90 con 0x7f36980c9a70 2024-03-28T12:42:58.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.938+0000 7f369cc00640 1 -- 172.21.15.76:0/2081424298 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3698071460 con 0x7f36980c9a70 2024-03-28T12:42:58.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.938+0000 7f369cc00640 1 -- 172.21.15.76:0/2081424298 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36981f6520 con 0x7f36980c9a70 2024-03-28T12:42:58.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.938+0000 7f369cc00640 1 -- 172.21.15.76:0/2081424298 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36980686e0 con 0x7f36980c9a70 2024-03-28T12:42:58.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.966+0000 7f368e000640 1 -- 172.21.15.76:0/2081424298 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f369000ac30 con 0x7f36980c9a70 2024-03-28T12:42:58.966 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.970+0000 7f368e000640 1 --2- 172.21.15.76:0/2081424298 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3678068010 0x7f367806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:58.967 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.970+0000 7f3695e00640 1 --2- 172.21.15.76:0/2081424298 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3678068010 0x7f367806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:58.968 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.970+0000 7f3695e00640 1 --2- 172.21.15.76:0/2081424298 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3678068010 0x7f367806a4d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f36880079c0 tx=0x7f3688008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:58.970 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:58.974+0000 7f368e000640 1 -- 172.21.15.76:0/2081424298 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f3690054ff0 con 0x7f36980c9a70 2024-03-28T12:42:59.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.302+0000 7f368e000640 1 -- 172.21.15.76:0/2081424298 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f3690020070 con 0x7f36980c9a70 2024-03-28T12:42:59.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.618+0000 7f369cc00640 1 -- 172.21.15.76:0/2081424298 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f369814ef20 con 0x7f36980c9a70 2024-03-28T12:42:59.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.630+0000 7f368e000640 1 -- 172.21.15.76:0/2081424298 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f3690056f50 con 0x7f36980c9a70 2024-03-28T12:42:59.627 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-03-28T12:42:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.634+0000 7f369cc00640 1 -- 172.21.15.76:0/2081424298 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3678068010 msgr2=0x7f367806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.634+0000 7f369cc00640 1 --2- 172.21.15.76:0/2081424298 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3678068010 0x7f367806a4d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f36880079c0 tx=0x7f3688008040 comp rx=0 tx=0).stop 2024-03-28T12:42:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.634+0000 7f369cc00640 1 -- 172.21.15.76:0/2081424298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36980c9a70 msgr2=0x7f36980cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.634+0000 7f369cc00640 1 --2- 172.21.15.76:0/2081424298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36980c9a70 0x7f36980cc370 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f369000c7b0 tx=0x7f369000cc70 comp rx=0 tx=0).stop 2024-03-28T12:42:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.634+0000 7f369cc00640 1 -- 172.21.15.76:0/2081424298 shutdown_connections 2024-03-28T12:42:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.634+0000 7f369cc00640 1 --2- 172.21.15.76:0/2081424298 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3678068010 0x7f367806a4d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.634+0000 7f369cc00640 1 --2- 172.21.15.76:0/2081424298 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36980c9a70 0x7f36980cc370 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.634+0000 7f369cc00640 1 --2- 172.21.15.76:0/2081424298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3698070080 0x7f36980cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.634+0000 7f369cc00640 1 --2- 172.21.15.76:0/2081424298 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f369806ee50 0x7f3698156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.634+0000 7f369cc00640 1 -- 172.21.15.76:0/2081424298 >> 172.21.15.76:0/2081424298 conn(0x7f3698070ca0 msgr2=0x7f369806b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.634+0000 7f369cc00640 1 -- 172.21.15.76:0/2081424298 shutdown_connections 2024-03-28T12:42:59.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.634+0000 7f369cc00640 1 -- 172.21.15.76:0/2081424298 wait complete. 2024-03-28T12:42:59.660 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T12:42:59.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.806+0000 7fbdd2000640 1 Processor -- start 2024-03-28T12:42:59.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.806+0000 7fbdd2000640 1 -- start start 2024-03-28T12:42:59.805 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.806+0000 7fbdd2000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbdcc154a10 0x7fbdcc15a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:59.806 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.806+0000 7fbdd2000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbdcc0b1c90 0x7fbdcc06beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:59.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.806+0000 7fbdd2000640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdcc0c7d40 con 0x7fbdcc0b21e0 2024-03-28T12:42:59.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.806+0000 7fbdd2000640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fbdcc154df0 con 0x7fbdcc0b1c90 2024-03-28T12:42:59.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.806+0000 7fbdd2000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fbdcc06b5a0 con 0x7fbdcc154a10 2024-03-28T12:42:59.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.810+0000 7fbdd1600640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbdcc0b1c90 0x7fbdcc06beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:59.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.810+0000 7fbdcbe00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fbdcc0b21e0 0x7fbdcc0c92e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:41684/0 (socket says 172.21.15.76:41684) 2024-03-28T12:42:59.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.810+0000 7fbdcbe00640 1 -- 172.21.15.76:0/664314361 learned_addr learned my addr 172.21.15.76:0/664314361 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:42:59.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.810+0000 7fbdd0c00640 1 --2- 172.21.15.76:0/664314361 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbdcc154a10 0x7fbdcc15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:59.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.814+0000 7fbdcb400640 1 -- 172.21.15.76:0/664314361 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2716979605 0 0) 0x7fbdcc0c7d40 con 0x7fbdcc0b21e0 2024-03-28T12:42:59.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.814+0000 7fbdcb400640 1 -- 172.21.15.76:0/664314361 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdb4003530 con 0x7fbdcc0b21e0 2024-03-28T12:42:59.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.814+0000 7fbdd1600640 1 -- 172.21.15.76:0/664314361 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbdcc154a10 msgr2=0x7fbdcc15a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:42:59.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.814+0000 7fbdd1600640 1 --2- 172.21.15.76:0/664314361 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbdcc154a10 0x7fbdcc15a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:59.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.814+0000 7fbdd1600640 1 -- 172.21.15.76:0/664314361 >> v1:172.21.15.76:6789/0 conn(0x7fbdcc0b21e0 legacy=0x7fbdcc0c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:59.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.814+0000 7fbdd1600640 1 -- 172.21.15.76:0/664314361 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdcc06b7f0 con 0x7fbdcc0b1c90 2024-03-28T12:42:59.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.818+0000 7fbdd1600640 1 --2- 172.21.15.76:0/664314361 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdcc0b1c90 0x7fbdcc06beb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009d90 tx=0x7fbdc401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a633c1be871d343d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:59.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdcb400640 1 -- 172.21.15.76:0/664314361 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40b2070 con 0x7fbdcc0b1c90 2024-03-28T12:42:59.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdcb400640 1 -- 172.21.15.76:0/664314361 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc40a5910 con 0x7fbdcc0b1c90 2024-03-28T12:42:59.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdcb400640 1 -- 172.21.15.76:0/664314361 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40a5ce0 con 0x7fbdcc0b1c90 2024-03-28T12:42:59.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdd2000640 1 -- 172.21.15.76:0/664314361 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdcc0b1c90 msgr2=0x7fbdcc06beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:59.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdd2000640 1 --2- 172.21.15.76:0/664314361 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdcc0b1c90 0x7fbdcc06beb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009d90 tx=0x7fbdc401c940 comp rx=0 tx=0).stop 2024-03-28T12:42:59.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdd2000640 1 -- 172.21.15.76:0/664314361 shutdown_connections 2024-03-28T12:42:59.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdd2000640 1 --2- 172.21.15.76:0/664314361 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdcc0b1c90 0x7fbdcc06beb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:59.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdd2000640 1 --2- 172.21.15.76:0/664314361 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbdcc154a10 0x7fbdcc15a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:59.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdd2000640 1 -- 172.21.15.76:0/664314361 >> 172.21.15.76:0/664314361 conn(0x7fbdcc073520 msgr2=0x7fbdcc0ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:42:59.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdd2000640 1 -- 172.21.15.76:0/664314361 shutdown_connections 2024-03-28T12:42:59.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdd2000640 1 -- 172.21.15.76:0/664314361 wait complete. 2024-03-28T12:42:59.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdd2000640 1 Processor -- start 2024-03-28T12:42:59.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdd2000640 1 -- start start 2024-03-28T12:42:59.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdd2000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbdcc0b1c90 0x7fbdcc1f7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:59.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdd2000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdcc0b21e0 0x7fbdcc146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:59.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdd2000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbdcc154a10 0x7fbdcc14fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:59.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdd2000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc0c7900 con 0x7fbdcc0b1c90 2024-03-28T12:42:59.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdd2000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbdcc0cdd30 con 0x7fbdcc0b21e0 2024-03-28T12:42:59.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.826+0000 7fbdd2000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fbdcc0c7a80 con 0x7fbdcc154a10 2024-03-28T12:42:59.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.830+0000 7fbdcbe00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdcc0b21e0 0x7fbdcc146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:59.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.830+0000 7fbdd0c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbdcc0b1c90 0x7fbdcc1f7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:59.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.830+0000 7fbdd1600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbdcc154a10 0x7fbdcc14fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:59.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.830+0000 7fbdd0c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbdcc0b1c90 0x7fbdcc1f7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56768/0 (socket says 172.21.15.76:56768) 2024-03-28T12:42:59.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.830+0000 7fbdd0c00640 1 -- 172.21.15.76:0/485630651 learned_addr learned my addr 172.21.15.76:0/485630651 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:42:59.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.834+0000 7fbdd0c00640 1 -- 172.21.15.76:0/485630651 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbdcc154a10 msgr2=0x7fbdcc14fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:59.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.834+0000 7fbdd0c00640 1 --2- 172.21.15.76:0/485630651 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbdcc154a10 0x7fbdcc14fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:59.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.834+0000 7fbdd0c00640 1 -- 172.21.15.76:0/485630651 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdcc0b21e0 msgr2=0x7fbdcc146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:42:59.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.834+0000 7fbdd0c00640 1 --2- 172.21.15.76:0/485630651 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdcc0b21e0 0x7fbdcc146450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:42:59.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.834+0000 7fbdd0c00640 1 -- 172.21.15.76:0/485630651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdcc152bd0 con 0x7fbdcc0b1c90 2024-03-28T12:42:59.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.834+0000 7fbdd0c00640 1 --2- 172.21.15.76:0/485630651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbdcc0b1c90 0x7fbdcc1f7560 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000e960 tx=0x7fbdc000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:59.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.838+0000 7fbdc8c00640 1 -- 172.21.15.76:0/485630651 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0017070 con 0x7fbdcc0b1c90 2024-03-28T12:42:59.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.838+0000 7fbdc8c00640 1 -- 172.21.15.76:0/485630651 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc000ca00 con 0x7fbdcc0b1c90 2024-03-28T12:42:59.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.838+0000 7fbdd2000640 1 -- 172.21.15.76:0/485630651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdcc1f4540 con 0x7fbdcc0b1c90 2024-03-28T12:42:59.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.838+0000 7fbdd2000640 1 -- 172.21.15.76:0/485630651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdcc147e10 con 0x7fbdcc0b1c90 2024-03-28T12:42:59.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.838+0000 7fbdc8c00640 1 -- 172.21.15.76:0/485630651 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc000cdb0 con 0x7fbdcc0b1c90 2024-03-28T12:42:59.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.842+0000 7fbdd2000640 1 -- 172.21.15.76:0/485630651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbda80052a0 con 0x7fbdcc0b1c90 2024-03-28T12:42:59.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.862+0000 7fbdc8c00640 1 -- 172.21.15.76:0/485630651 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fbdc001a070 con 0x7fbdcc0b1c90 2024-03-28T12:42:59.862 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.866+0000 7fbdc8c00640 1 --2- 172.21.15.76:0/485630651 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbdac068040 0x7fbdac06a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:42:59.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.866+0000 7fbdcbe00640 1 --2- 172.21.15.76:0/485630651 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbdac068040 0x7fbdac06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:42:59.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.866+0000 7fbdcbe00640 1 --2- 172.21.15.76:0/485630651 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbdac068040 0x7fbdac06a500 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8007fd0 tx=0x7fbdb8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:42:59.869 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:42:59.870+0000 7fbdc8c00640 1 -- 172.21.15.76:0/485630651 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fbdc0054e90 con 0x7fbdcc0b1c90 2024-03-28T12:43:00.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.162+0000 7fbdc8c00640 1 -- 172.21.15.76:0/485630651 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fbdc0056df0 con 0x7fbdcc0b1c90 2024-03-28T12:43:00.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.358+0000 7fbdd2000640 1 -- 172.21.15.76:0/485630651 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbda8005860 con 0x7fbdcc0b1c90 2024-03-28T12:43:00.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.366+0000 7fbdc8c00640 1 -- 172.21.15.76:0/485630651 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7fbdc005b0f0 con 0x7fbdcc0b1c90 2024-03-28T12:43:00.366 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-03-28T12:43:00.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.370+0000 7fbdd2000640 1 -- 172.21.15.76:0/485630651 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbdac068040 msgr2=0x7fbdac06a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:00.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.370+0000 7fbdd2000640 1 --2- 172.21.15.76:0/485630651 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbdac068040 0x7fbdac06a500 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8007fd0 tx=0x7fbdb8009040 comp rx=0 tx=0).stop 2024-03-28T12:43:00.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.370+0000 7fbdd2000640 1 -- 172.21.15.76:0/485630651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbdcc0b1c90 msgr2=0x7fbdcc1f7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:00.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.370+0000 7fbdd2000640 1 --2- 172.21.15.76:0/485630651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbdcc0b1c90 0x7fbdcc1f7560 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000e960 tx=0x7fbdc000ee20 comp rx=0 tx=0).stop 2024-03-28T12:43:00.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.370+0000 7fbdd2000640 1 -- 172.21.15.76:0/485630651 shutdown_connections 2024-03-28T12:43:00.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.370+0000 7fbdd2000640 1 --2- 172.21.15.76:0/485630651 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbdac068040 0x7fbdac06a500 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:00.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.370+0000 7fbdd2000640 1 --2- 172.21.15.76:0/485630651 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbdcc154a10 0x7fbdcc14fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:00.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.370+0000 7fbdd2000640 1 --2- 172.21.15.76:0/485630651 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbdcc0b21e0 0x7fbdcc146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:00.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.370+0000 7fbdd2000640 1 --2- 172.21.15.76:0/485630651 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbdcc0b1c90 0x7fbdcc1f7560 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:00.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.370+0000 7fbdd2000640 1 -- 172.21.15.76:0/485630651 >> 172.21.15.76:0/485630651 conn(0x7fbdcc073520 msgr2=0x7fbdcc0cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:00.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.370+0000 7fbdd2000640 1 -- 172.21.15.76:0/485630651 shutdown_connections 2024-03-28T12:43:00.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.370+0000 7fbdd2000640 1 -- 172.21.15.76:0/485630651 wait complete. 2024-03-28T12:43:00.388 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T12:43:00.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.534+0000 7f2257e00640 1 Processor -- start 2024-03-28T12:43:00.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.534+0000 7f2257e00640 1 -- start start 2024-03-28T12:43:00.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.538+0000 7f2257e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f22580c95a0 0x7f2258163d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:00.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.538+0000 7f2257e00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f225806b5a0 con 0x7f22581524f0 2024-03-28T12:43:00.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.538+0000 7f2257e00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22581583d0 con 0x7f22581528d0 2024-03-28T12:43:00.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.538+0000 7f2257e00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f225815c8a0 con 0x7f22580c95a0 2024-03-28T12:43:00.582 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.586+0000 7f2256a00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f22581524f0 0x7f2258158bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:41688/0 (socket says 172.21.15.76:41688) 2024-03-28T12:43:00.582 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.586+0000 7f2256a00640 1 -- 172.21.15.76:0/2924980846 learned_addr learned my addr 172.21.15.76:0/2924980846 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:43:00.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.586+0000 7f2255600640 1 -- 172.21.15.76:0/2924980846 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1860087523 0 0) 0x7f225806b5a0 con 0x7f22581524f0 2024-03-28T12:43:00.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.586+0000 7f2255600640 1 -- 172.21.15.76:0/2924980846 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f223c003530 con 0x7f22581524f0 2024-03-28T12:43:00.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.590+0000 7f2255600640 1 -- 172.21.15.76:0/2924980846 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1556152541 0 0) 0x7f223c003530 con 0x7f22581524f0 2024-03-28T12:43:00.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.590+0000 7f2255600640 1 -- 172.21.15.76:0/2924980846 >> v2:172.21.15.111:3300/0 conn(0x7f22580c95a0 msgr2=0x7f2258163d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:00.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.590+0000 7f2255600640 1 --2- 172.21.15.76:0/2924980846 >> v2:172.21.15.111:3300/0 conn(0x7f22580c95a0 0x7f2258163d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:00.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.590+0000 7f2255600640 1 -- 172.21.15.76:0/2924980846 >> v1:172.21.15.111:6789/0 conn(0x7f22581528d0 legacy=0x7f2258070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:00.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.590+0000 7f2255600640 1 -- 172.21.15.76:0/2924980846 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22580c81a0 con 0x7f22581524f0 2024-03-28T12:43:00.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.590+0000 7f2255600640 1 -- 172.21.15.76:0/2924980846 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7f2248001680 con 0x7f22581524f0 2024-03-28T12:43:00.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.590+0000 7f2255600640 1 -- 172.21.15.76:0/2924980846 >> v1:172.21.15.76:6789/0 conn(0x7f22581524f0 legacy=0x7f2258158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:00.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.590+0000 7f2255600640 1 --2- 172.21.15.76:0/2924980846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f223c0039c0 0x7f223c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:00.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.590+0000 7f2255600640 1 --2- 172.21.15.76:0/2924980846 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f223c004810 0x7f223c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:00.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.590+0000 7f2255600640 1 --2- 172.21.15.76:0/2924980846 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f223c0053d0 0x7f223c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:00.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.590+0000 7f2255600640 1 -- 172.21.15.76:0/2924980846 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f225815c8a0 con 0x7f223c004810 2024-03-28T12:43:00.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.590+0000 7f2255600640 1 -- 172.21.15.76:0/2924980846 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f223c00c270 con 0x7f223c0039c0 2024-03-28T12:43:00.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.590+0000 7f2255600640 1 -- 172.21.15.76:0/2924980846 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f223c00c470 con 0x7f223c0053d0 2024-03-28T12:43:00.590 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.594+0000 7f2256000640 1 --2- 172.21.15.76:0/2924980846 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f223c004810 0x7f223c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:00.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.594+0000 7f2257400640 1 --2- 172.21.15.76:0/2924980846 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f223c0053d0 0x7f223c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:00.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.594+0000 7f2256a00640 1 --2- 172.21.15.76:0/2924980846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f223c0039c0 0x7f223c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:00.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.598+0000 7f2257400640 1 -- 172.21.15.76:0/2924980846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f223c0039c0 msgr2=0x7f223c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:00.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.598+0000 7f2257400640 1 --2- 172.21.15.76:0/2924980846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f223c0039c0 0x7f223c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:00.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.598+0000 7f2257400640 1 -- 172.21.15.76:0/2924980846 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f223c004810 msgr2=0x7f223c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:00.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.598+0000 7f2257400640 1 --2- 172.21.15.76:0/2924980846 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f223c004810 0x7f223c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:00.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.598+0000 7f2257400640 1 -- 172.21.15.76:0/2924980846 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22580c81a0 con 0x7f223c0053d0 2024-03-28T12:43:00.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.602+0000 7f2257400640 1 -- 172.21.15.76:0/2924980846 reap_dead start 2024-03-28T12:43:00.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.602+0000 7f2257400640 1 --2- 172.21.15.76:0/2924980846 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f223c0053d0 0x7f223c00b9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2250009ca0 tx=0x7f225001cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=983fa4a013a5ddf6 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:00.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.610+0000 7f2255600640 1 -- 172.21.15.76:0/2924980846 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2250006e60 con 0x7f223c0053d0 2024-03-28T12:43:00.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.610+0000 7f2255600640 1 -- 172.21.15.76:0/2924980846 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2250003bc0 con 0x7f223c0053d0 2024-03-28T12:43:00.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.610+0000 7f2255600640 1 -- 172.21.15.76:0/2924980846 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22500a5950 con 0x7f223c0053d0 2024-03-28T12:43:00.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.610+0000 7f2257e00640 1 -- 172.21.15.76:0/2924980846 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f223c0053d0 msgr2=0x7f223c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:00.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.610+0000 7f2257e00640 1 --2- 172.21.15.76:0/2924980846 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f223c0053d0 0x7f223c00b9d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2250009ca0 tx=0x7f225001cc70 comp rx=0 tx=0).stop 2024-03-28T12:43:00.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.610+0000 7f2257e00640 1 -- 172.21.15.76:0/2924980846 shutdown_connections 2024-03-28T12:43:00.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.610+0000 7f2257e00640 1 --2- 172.21.15.76:0/2924980846 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f223c0053d0 0x7f223c00b9d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:00.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.610+0000 7f2257e00640 1 -- 172.21.15.76:0/2924980846 >> 172.21.15.76:0/2924980846 conn(0x7f2258073520 msgr2=0x7f22580ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:00.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.610+0000 7f2257e00640 1 -- 172.21.15.76:0/2924980846 shutdown_connections 2024-03-28T12:43:00.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.610+0000 7f2257e00640 1 -- 172.21.15.76:0/2924980846 wait complete. 2024-03-28T12:43:00.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.610+0000 7f2257e00640 1 Processor -- start 2024-03-28T12:43:00.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.614+0000 7f2257e00640 1 -- start start 2024-03-28T12:43:00.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.614+0000 7f2257e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f223c0053d0 0x7f225815b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:00.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.614+0000 7f2257e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22581478e0 0x7f225814e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:00.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.614+0000 7f2257e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2258147d40 0x7f225814e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:00.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.614+0000 7f2257e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f2258158d30 con 0x7f22581478e0 2024-03-28T12:43:00.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.614+0000 7f2257e00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2258158bb0 con 0x7f223c0053d0 2024-03-28T12:43:00.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.614+0000 7f2257e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2258158eb0 con 0x7f2258147d40 2024-03-28T12:43:00.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.614+0000 7f2256000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22581478e0 0x7f225814e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:00.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.614+0000 7f2257400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2258147d40 0x7f225814e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:00.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.614+0000 7f2256a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f223c0053d0 0x7f225815b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:00.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.614+0000 7f2256000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22581478e0 0x7f225814e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56792/0 (socket says 172.21.15.76:56792) 2024-03-28T12:43:00.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.614+0000 7f2256000640 1 -- 172.21.15.76:0/476850968 learned_addr learned my addr 172.21.15.76:0/476850968 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:00.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.618+0000 7f2256000640 1 -- 172.21.15.76:0/476850968 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2258147d40 msgr2=0x7f225814e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:00.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.618+0000 7f2256000640 1 --2- 172.21.15.76:0/476850968 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2258147d40 0x7f225814e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:00.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.618+0000 7f2256000640 1 -- 172.21.15.76:0/476850968 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f223c0053d0 msgr2=0x7f225815b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:00.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.618+0000 7f2256000640 1 --2- 172.21.15.76:0/476850968 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f223c0053d0 0x7f225815b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:00.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.618+0000 7f2256000640 1 -- 172.21.15.76:0/476850968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2258148300 con 0x7f22581478e0 2024-03-28T12:43:00.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.622+0000 7f2256000640 1 --2- 172.21.15.76:0/476850968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22581478e0 0x7f225814e2b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f224400f670 tx=0x7f224400fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:00.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.622+0000 7f224ea00640 1 -- 172.21.15.76:0/476850968 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22440050d0 con 0x7f22581478e0 2024-03-28T12:43:00.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.626+0000 7f224ea00640 1 -- 172.21.15.76:0/476850968 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2244018070 con 0x7f22581478e0 2024-03-28T12:43:00.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.626+0000 7f224ea00640 1 -- 172.21.15.76:0/476850968 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224400d730 con 0x7f22581478e0 2024-03-28T12:43:00.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.626+0000 7f2257e00640 1 -- 172.21.15.76:0/476850968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f225814d210 con 0x7f22581478e0 2024-03-28T12:43:00.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.626+0000 7f2257e00640 1 -- 172.21.15.76:0/476850968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f225814d7d0 con 0x7f22581478e0 2024-03-28T12:43:00.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.626+0000 7f2257e00640 1 -- 172.21.15.76:0/476850968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2258068df0 con 0x7f22581478e0 2024-03-28T12:43:00.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.646+0000 7f224ea00640 1 -- 172.21.15.76:0/476850968 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f224400d8d0 con 0x7f22581478e0 2024-03-28T12:43:00.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.646+0000 7f224ea00640 1 --2- 172.21.15.76:0/476850968 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2238068010 0x7f223806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:00.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.646+0000 7f2256a00640 1 --2- 172.21.15.76:0/476850968 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2238068010 0x7f223806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:00.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.646+0000 7f2256a00640 1 --2- 172.21.15.76:0/476850968 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2238068010 0x7f223806a4d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2248005c10 tx=0x7f2248007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:00.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.646+0000 7f224ea00640 1 -- 172.21.15.76:0/476850968 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f2244054e90 con 0x7f22581478e0 2024-03-28T12:43:00.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:00.954+0000 7f224ea00640 1 -- 172.21.15.76:0/476850968 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f2244056df0 con 0x7f22581478e0 2024-03-28T12:43:01.133 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.134+0000 7f2257e00640 1 -- 172.21.15.76:0/476850968 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f225806cb40 con 0x7f22581478e0 2024-03-28T12:43:01.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.142+0000 7f224ea00640 1 -- 172.21.15.76:0/476850968 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f224405b0f0 con 0x7f22581478e0 2024-03-28T12:43:01.140 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-03-28T12:43:01.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.142+0000 7f2257e00640 1 -- 172.21.15.76:0/476850968 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2238068010 msgr2=0x7f223806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:01.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.142+0000 7f2257e00640 1 --2- 172.21.15.76:0/476850968 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2238068010 0x7f223806a4d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2248005c10 tx=0x7f2248007040 comp rx=0 tx=0).stop 2024-03-28T12:43:01.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.142+0000 7f2257e00640 1 -- 172.21.15.76:0/476850968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22581478e0 msgr2=0x7f225814e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:01.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.142+0000 7f2257e00640 1 --2- 172.21.15.76:0/476850968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22581478e0 0x7f225814e2b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f224400f670 tx=0x7f224400fb30 comp rx=0 tx=0).stop 2024-03-28T12:43:01.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.142+0000 7f2257e00640 1 -- 172.21.15.76:0/476850968 shutdown_connections 2024-03-28T12:43:01.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.142+0000 7f2257e00640 1 --2- 172.21.15.76:0/476850968 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2238068010 0x7f223806a4d0 secure :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2248005c10 tx=0x7f2248007040 comp rx=0 tx=0).stop 2024-03-28T12:43:01.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.142+0000 7f2257e00640 1 --2- 172.21.15.76:0/476850968 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2258147d40 0x7f225814e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:01.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.142+0000 7f2257e00640 1 --2- 172.21.15.76:0/476850968 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f22581478e0 0x7f225814e2b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:01.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.142+0000 7f2257e00640 1 --2- 172.21.15.76:0/476850968 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f223c0053d0 0x7f225815b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:01.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.142+0000 7f2257e00640 1 -- 172.21.15.76:0/476850968 >> 172.21.15.76:0/476850968 conn(0x7f2258073520 msgr2=0x7f22580cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:01.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.142+0000 7f2257e00640 1 -- 172.21.15.76:0/476850968 shutdown_connections 2024-03-28T12:43:01.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.146+0000 7f2257e00640 1 -- 172.21.15.76:0/476850968 wait complete. 2024-03-28T12:43:01.172 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-28T12:43:01.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.326+0000 7fbe97e00640 1 Processor -- start 2024-03-28T12:43:01.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.326+0000 7fbe97e00640 1 -- start start 2024-03-28T12:43:01.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.330+0000 7fbe97e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbe980c66c0 0x7fbe980c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:01.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.330+0000 7fbe97e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fbe9815b1b0 0x7fbe980c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:01.326 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.330+0000 7fbe97e00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe98073430 con 0x7fbe98154a00 2024-03-28T12:43:01.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.330+0000 7fbe97e00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fbe980731e0 con 0x7fbe9815b1b0 2024-03-28T12:43:01.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.330+0000 7fbe97e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9815e3d0 con 0x7fbe980c66c0 2024-03-28T12:43:01.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.330+0000 7fbe96a00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fbe98154a00 0x7fbe980726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:41696/0 (socket says 172.21.15.76:41696) 2024-03-28T12:43:01.327 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.330+0000 7fbe96a00640 1 -- 172.21.15.76:0/1764070332 learned_addr learned my addr 172.21.15.76:0/1764070332 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:43:01.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.330+0000 7fbe97400640 1 --2- 172.21.15.76:0/1764070332 >> v2:172.21.15.76:3300/0 conn(0x7fbe9815b1b0 0x7fbe980c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:01.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.330+0000 7fbe96000640 1 --2- 172.21.15.76:0/1764070332 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbe980c66c0 0x7fbe980c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:01.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.334+0000 7fbe95600640 1 -- 172.21.15.76:0/1764070332 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220454402 0 0) 0x7fbe98073430 con 0x7fbe98154a00 2024-03-28T12:43:01.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.334+0000 7fbe95600640 1 -- 172.21.15.76:0/1764070332 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe7c003530 con 0x7fbe98154a00 2024-03-28T12:43:01.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.334+0000 7fbe97400640 1 -- 172.21.15.76:0/1764070332 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbe980c66c0 msgr2=0x7fbe980c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:01.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.334+0000 7fbe97400640 1 --2- 172.21.15.76:0/1764070332 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbe980c66c0 0x7fbe980c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:01.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.334+0000 7fbe97400640 1 -- 172.21.15.76:0/1764070332 >> v1:172.21.15.76:6789/0 conn(0x7fbe98154a00 legacy=0x7fbe980726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:01.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.334+0000 7fbe97400640 1 -- 172.21.15.76:0/1764070332 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9815dd80 con 0x7fbe9815b1b0 2024-03-28T12:43:01.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.342+0000 7fbe97400640 1 --2- 172.21.15.76:0/1764070332 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe9815b1b0 0x7fbe980c7760 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009d90 tx=0x7fbe9001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9c4bf1000d1552 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:01.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.346+0000 7fbe95600640 1 -- 172.21.15.76:0/1764070332 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe900b2070 con 0x7fbe9815b1b0 2024-03-28T12:43:01.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.346+0000 7fbe95600640 1 -- 172.21.15.76:0/1764070332 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe900a5880 con 0x7fbe9815b1b0 2024-03-28T12:43:01.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.346+0000 7fbe95600640 1 -- 172.21.15.76:0/1764070332 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe900a5c50 con 0x7fbe9815b1b0 2024-03-28T12:43:01.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.346+0000 7fbe97e00640 1 -- 172.21.15.76:0/1764070332 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe9815b1b0 msgr2=0x7fbe980c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:01.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.346+0000 7fbe97e00640 1 --2- 172.21.15.76:0/1764070332 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe9815b1b0 0x7fbe980c7760 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbe90009d90 tx=0x7fbe9001c8b0 comp rx=0 tx=0).stop 2024-03-28T12:43:01.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.346+0000 7fbe97e00640 1 -- 172.21.15.76:0/1764070332 shutdown_connections 2024-03-28T12:43:01.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.346+0000 7fbe97e00640 1 --2- 172.21.15.76:0/1764070332 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe9815b1b0 0x7fbe980c7760 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:01.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.346+0000 7fbe97e00640 1 --2- 172.21.15.76:0/1764070332 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbe980c66c0 0x7fbe980c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:01.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.346+0000 7fbe97e00640 1 -- 172.21.15.76:0/1764070332 >> 172.21.15.76:0/1764070332 conn(0x7fbe980ccd70 msgr2=0x7fbe98070190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:01.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.346+0000 7fbe97e00640 1 -- 172.21.15.76:0/1764070332 shutdown_connections 2024-03-28T12:43:01.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.346+0000 7fbe97e00640 1 -- 172.21.15.76:0/1764070332 wait complete. 2024-03-28T12:43:01.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.350+0000 7fbe97e00640 1 Processor -- start 2024-03-28T12:43:01.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.350+0000 7fbe97e00640 1 -- start start 2024-03-28T12:43:01.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.350+0000 7fbe97e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbe980c66c0 0x7fbe98150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:01.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.350+0000 7fbe97e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbe98154a00 0x7fbe9814f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:01.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.350+0000 7fbe97e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe9815b1b0 0x7fbe9814a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:01.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.350+0000 7fbe97e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbe98072f30 con 0x7fbe9815b1b0 2024-03-28T12:43:01.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.350+0000 7fbe97e00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbe98072db0 con 0x7fbe98154a00 2024-03-28T12:43:01.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.350+0000 7fbe97e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fbe98167890 con 0x7fbe980c66c0 2024-03-28T12:43:01.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.350+0000 7fbe97400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe9815b1b0 0x7fbe9814a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:01.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.354+0000 7fbe96000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbe98154a00 0x7fbe9814f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:01.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.354+0000 7fbe97400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe9815b1b0 0x7fbe9814a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56806/0 (socket says 172.21.15.76:56806) 2024-03-28T12:43:01.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.354+0000 7fbe97400640 1 -- 172.21.15.76:0/3929796104 learned_addr learned my addr 172.21.15.76:0/3929796104 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:01.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.354+0000 7fbe96a00640 1 --2- 172.21.15.76:0/3929796104 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbe980c66c0 0x7fbe98150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:01.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.358+0000 7fbe97400640 1 -- 172.21.15.76:0/3929796104 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbe980c66c0 msgr2=0x7fbe98150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:01.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.358+0000 7fbe97400640 1 --2- 172.21.15.76:0/3929796104 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbe980c66c0 0x7fbe98150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:01.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.358+0000 7fbe97400640 1 -- 172.21.15.76:0/3929796104 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbe98154a00 msgr2=0x7fbe9814f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:01.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.358+0000 7fbe97400640 1 --2- 172.21.15.76:0/3929796104 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbe98154a00 0x7fbe9814f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:01.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.358+0000 7fbe97400640 1 -- 172.21.15.76:0/3929796104 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9814e5f0 con 0x7fbe9815b1b0 2024-03-28T12:43:01.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.362+0000 7fbe97400640 1 --2- 172.21.15.76:0/3929796104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe9815b1b0 0x7fbe9814a4a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbe900b0040 tx=0x7fbe90019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:01.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.366+0000 7fbe8ea00640 1 -- 172.21.15.76:0/3929796104 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe900bd020 con 0x7fbe9815b1b0 2024-03-28T12:43:01.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.366+0000 7fbe8ea00640 1 -- 172.21.15.76:0/3929796104 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe900b8470 con 0x7fbe9815b1b0 2024-03-28T12:43:01.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.366+0000 7fbe8ea00640 1 -- 172.21.15.76:0/3929796104 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe900b2040 con 0x7fbe9815b1b0 2024-03-28T12:43:01.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.366+0000 7fbe97e00640 1 -- 172.21.15.76:0/3929796104 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9814e8d0 con 0x7fbe9815b1b0 2024-03-28T12:43:01.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.366+0000 7fbe97e00640 1 -- 172.21.15.76:0/3929796104 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe9814ee90 con 0x7fbe9815b1b0 2024-03-28T12:43:01.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.366+0000 7fbe97e00640 1 -- 172.21.15.76:0/3929796104 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe98068df0 con 0x7fbe9815b1b0 2024-03-28T12:43:01.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.386+0000 7fbe8ea00640 1 -- 172.21.15.76:0/3929796104 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fbe900c0020 con 0x7fbe9815b1b0 2024-03-28T12:43:01.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.390+0000 7fbe8ea00640 1 --2- 172.21.15.76:0/3929796104 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbe78067ff0 0x7fbe7806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:01.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.390+0000 7fbe96a00640 1 --2- 172.21.15.76:0/3929796104 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbe78067ff0 0x7fbe7806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:01.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.390+0000 7fbe96a00640 1 --2- 172.21.15.76:0/3929796104 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbe78067ff0 0x7fbe7806a4b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbe88007fd0 tx=0x7fbe88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:01.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.394+0000 7fbe8ea00640 1 -- 172.21.15.76:0/3929796104 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fbe900ef860 con 0x7fbe9815b1b0 2024-03-28T12:43:01.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.666+0000 7fbe8ea00640 1 -- 172.21.15.76:0/3929796104 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fbe900c7030 con 0x7fbe9815b1b0 2024-03-28T12:43:01.846 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.850+0000 7fbe97e00640 1 -- 172.21.15.76:0/3929796104 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fbe98071060 con 0x7fbe9815b1b0 2024-03-28T12:43:01.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.874+0000 7fbe8ea00640 1 -- 172.21.15.76:0/3929796104 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fbe90016560 con 0x7fbe9815b1b0 2024-03-28T12:43:01.871 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-03-28T12:43:01.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.878+0000 7fbe97e00640 1 -- 172.21.15.76:0/3929796104 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbe78067ff0 msgr2=0x7fbe7806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:01.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.878+0000 7fbe97e00640 1 --2- 172.21.15.76:0/3929796104 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbe78067ff0 0x7fbe7806a4b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbe88007fd0 tx=0x7fbe88009040 comp rx=0 tx=0).stop 2024-03-28T12:43:01.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.878+0000 7fbe97e00640 1 -- 172.21.15.76:0/3929796104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe9815b1b0 msgr2=0x7fbe9814a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:01.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.878+0000 7fbe97e00640 1 --2- 172.21.15.76:0/3929796104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe9815b1b0 0x7fbe9814a4a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbe900b0040 tx=0x7fbe90019650 comp rx=0 tx=0).stop 2024-03-28T12:43:01.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.878+0000 7fbe97e00640 1 -- 172.21.15.76:0/3929796104 shutdown_connections 2024-03-28T12:43:01.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.878+0000 7fbe97e00640 1 --2- 172.21.15.76:0/3929796104 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbe78067ff0 0x7fbe7806a4b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:01.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.878+0000 7fbe97e00640 1 --2- 172.21.15.76:0/3929796104 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbe9815b1b0 0x7fbe9814a4a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:01.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.878+0000 7fbe97e00640 1 --2- 172.21.15.76:0/3929796104 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbe98154a00 0x7fbe9814f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:01.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.878+0000 7fbe97e00640 1 --2- 172.21.15.76:0/3929796104 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbe980c66c0 0x7fbe98150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:01.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.878+0000 7fbe97e00640 1 -- 172.21.15.76:0/3929796104 >> 172.21.15.76:0/3929796104 conn(0x7fbe980ccd70 msgr2=0x7fbe980c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:01.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.878+0000 7fbe97e00640 1 -- 172.21.15.76:0/3929796104 shutdown_connections 2024-03-28T12:43:01.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:01.878+0000 7fbe97e00640 1 -- 172.21.15.76:0/3929796104 wait complete. 2024-03-28T12:43:01.903 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T12:43:02.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.114+0000 7efc00000640 1 Processor -- start 2024-03-28T12:43:02.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.114+0000 7efc00000640 1 -- start start 2024-03-28T12:43:02.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.118+0000 7efc00000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7efbf815bb60 0x7efbf806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:02.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.118+0000 7efc00000640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbf806f570 con 0x7efbf815bf40 2024-03-28T12:43:02.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.118+0000 7efc00000640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbf806ea80 con 0x7efbf806e2c0 2024-03-28T12:43:02.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.118+0000 7efc00000640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7efbf806ed60 con 0x7efbf815bb60 2024-03-28T12:43:02.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.118+0000 7efbfd600640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7efbf815bb60 0x7efbf806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:02.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.118+0000 7efbfcc00640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7efbf806e2c0 0x7efbf8072140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:33116/0 (socket says 172.21.15.76:33116) 2024-03-28T12:43:02.116 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.118+0000 7efbfcc00640 1 -- 172.21.15.76:0/1162624346 learned_addr learned my addr 172.21.15.76:0/1162624346 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:43:02.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.122+0000 7efbf7e00640 1 -- 172.21.15.76:0/1162624346 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2867469750 0 0) 0x7efbf806ea80 con 0x7efbf806e2c0 2024-03-28T12:43:02.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.122+0000 7efbf7e00640 1 -- 172.21.15.76:0/1162624346 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbe0003530 con 0x7efbf806e2c0 2024-03-28T12:43:02.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.122+0000 7efbfd600640 1 -- 172.21.15.76:0/1162624346 >> v1:172.21.15.111:6789/0 conn(0x7efbf806e2c0 legacy=0x7efbf8072140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:02.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.122+0000 7efbfd600640 1 -- 172.21.15.76:0/1162624346 >> v1:172.21.15.76:6789/0 conn(0x7efbf815bf40 legacy=0x7efbf815c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:02.122 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.122+0000 7efbfd600640 1 -- 172.21.15.76:0/1162624346 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf806f040 con 0x7efbf815bb60 2024-03-28T12:43:02.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.130+0000 7efbfd600640 1 --2- 172.21.15.76:0/1162624346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbf815bb60 0x7efbf806dd80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efbec0097c0 tx=0x7efbec01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43565acaa76d29b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:02.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.134+0000 7efbf7e00640 1 -- 172.21.15.76:0/1162624346 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec0a7070 con 0x7efbf815bb60 2024-03-28T12:43:02.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.134+0000 7efbf7e00640 1 -- 172.21.15.76:0/1162624346 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbec0b0070 con 0x7efbf815bb60 2024-03-28T12:43:02.131 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.134+0000 7efbf7e00640 1 -- 172.21.15.76:0/1162624346 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec0ab890 con 0x7efbf815bb60 2024-03-28T12:43:02.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.134+0000 7efc00000640 1 -- 172.21.15.76:0/1162624346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbf815bb60 msgr2=0x7efbf806dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:02.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.134+0000 7efc00000640 1 --2- 172.21.15.76:0/1162624346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbf815bb60 0x7efbf806dd80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efbec0097c0 tx=0x7efbec01c470 comp rx=0 tx=0).stop 2024-03-28T12:43:02.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.134+0000 7efc00000640 1 -- 172.21.15.76:0/1162624346 shutdown_connections 2024-03-28T12:43:02.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.134+0000 7efc00000640 1 --2- 172.21.15.76:0/1162624346 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbf815bb60 0x7efbf806dd80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:02.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.134+0000 7efc00000640 1 -- 172.21.15.76:0/1162624346 >> 172.21.15.76:0/1162624346 conn(0x7efbf806fbe0 msgr2=0x7efbf806fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:02.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.134+0000 7efc00000640 1 -- 172.21.15.76:0/1162624346 shutdown_connections 2024-03-28T12:43:02.132 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.134+0000 7efc00000640 1 -- 172.21.15.76:0/1162624346 wait complete. 2024-03-28T12:43:02.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.138+0000 7efc00000640 1 Processor -- start 2024-03-28T12:43:02.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.138+0000 7efc00000640 1 -- start start 2024-03-28T12:43:02.136 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.138+0000 7efc00000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbf806e2c0 0x7efbf81f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:02.136 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.138+0000 7efc00000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efbf815bb60 0x7efbf80caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:02.136 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.138+0000 7efc00000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efbf815bf40 0x7efbf81f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:02.136 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.138+0000 7efc00000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7efbf80c8740 con 0x7efbf806e2c0 2024-03-28T12:43:02.136 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.138+0000 7efc00000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7efbf8072850 con 0x7efbf815bf40 2024-03-28T12:43:02.136 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.138+0000 7efc00000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7efbf80c88c0 con 0x7efbf815bb60 2024-03-28T12:43:02.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.138+0000 7efbfd600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbf806e2c0 0x7efbf81f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:02.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.138+0000 7efbfd600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbf806e2c0 0x7efbf81f40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:56830/0 (socket says 172.21.15.76:56830) 2024-03-28T12:43:02.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.138+0000 7efbfd600640 1 -- 172.21.15.76:0/4236223495 learned_addr learned my addr 172.21.15.76:0/4236223495 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:02.137 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.138+0000 7efbfcc00640 1 --2- 172.21.15.76:0/4236223495 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efbf815bb60 0x7efbf80caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:02.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.138+0000 7efbfe000640 1 --2- 172.21.15.76:0/4236223495 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efbf815bf40 0x7efbf81f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:02.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.142+0000 7efbfd600640 1 -- 172.21.15.76:0/4236223495 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efbf815bb60 msgr2=0x7efbf80caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:02.140 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.142+0000 7efbfd600640 1 --2- 172.21.15.76:0/4236223495 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efbf815bb60 0x7efbf80caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:02.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.142+0000 7efbfd600640 1 -- 172.21.15.76:0/4236223495 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efbf815bf40 msgr2=0x7efbf81f6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:02.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.142+0000 7efbfd600640 1 --2- 172.21.15.76:0/4236223495 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efbf815bf40 0x7efbf81f6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:02.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.142+0000 7efbfd600640 1 -- 172.21.15.76:0/4236223495 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf8143a20 con 0x7efbf806e2c0 2024-03-28T12:43:02.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.146+0000 7efbfd600640 1 --2- 172.21.15.76:0/4236223495 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbf806e2c0 0x7efbf81f40a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efbec019080 tx=0x7efbec01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:02.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.150+0000 7efbf5600640 1 -- 172.21.15.76:0/4236223495 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec0bf610 con 0x7efbf806e2c0 2024-03-28T12:43:02.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.150+0000 7efbf5600640 1 -- 172.21.15.76:0/4236223495 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbec0bf7d0 con 0x7efbf806e2c0 2024-03-28T12:43:02.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.150+0000 7efc00000640 1 -- 172.21.15.76:0/4236223495 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbf81f72b0 con 0x7efbf806e2c0 2024-03-28T12:43:02.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.150+0000 7efbf5600640 1 -- 172.21.15.76:0/4236223495 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec0bfbc0 con 0x7efbf806e2c0 2024-03-28T12:43:02.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.150+0000 7efc00000640 1 -- 172.21.15.76:0/4236223495 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbf81f35c0 con 0x7efbf806e2c0 2024-03-28T12:43:02.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.150+0000 7efc00000640 1 -- 172.21.15.76:0/4236223495 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbf80686e0 con 0x7efbf806e2c0 2024-03-28T12:43:02.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.174+0000 7efbf5600640 1 -- 172.21.15.76:0/4236223495 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7efbec0bd020 con 0x7efbf806e2c0 2024-03-28T12:43:02.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.178+0000 7efbf5600640 1 --2- 172.21.15.76:0/4236223495 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efbd8068010 0x7efbd806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:02.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.178+0000 7efbfcc00640 1 --2- 172.21.15.76:0/4236223495 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efbd8068010 0x7efbd806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:02.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.178+0000 7efbfcc00640 1 --2- 172.21.15.76:0/4236223495 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efbd8068010 0x7efbd806a4d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efbf8141d40 tx=0x7efbe4007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:02.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.430+0000 7efbf5600640 1 -- 172.21.15.76:0/4236223495 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7efbec0ef720 con 0x7efbf806e2c0 2024-03-28T12:43:02.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.430+0000 7efbf5600640 1 -- 172.21.15.76:0/4236223495 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7efbec016090 con 0x7efbf806e2c0 2024-03-28T12:43:02.734 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.738+0000 7efc00000640 1 -- 172.21.15.76:0/4236223495 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efbf8149a10 con 0x7efbf806e2c0 2024-03-28T12:43:02.837 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.838+0000 7efbf5600640 1 -- 172.21.15.76:0/4236223495 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6914 (secure 0 0 0) 0x7efbec0f1680 con 0x7efbf806e2c0 2024-03-28T12:43:02.837 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:43:02.837 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/335301918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":335301918},{"type":"v1","addr":"172.21.15.111:6835","nonce":335301918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T12:42:00.776505+0000","modified":"2024-03-28T12:42:47.404439+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4264,"mds_1":4258,"mds_2":4251,"mds_3":4248,"mds_4":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"e","rank":4,"incarnation":16,"state":"up:active","state_seq":18,"addr":"172.21.15.76:6837/1786218285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1786218285},{"type":"v1","addr":"172.21.15.76:6837","nonce":1786218285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4248":{"gid":4248,"name":"a","rank":3,"incarnation":14,"state":"up:active","state_seq":18,"addr":"172.21.15.76:6839/2729208421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":2729208421},{"type":"v1","addr":"172.21.15.76:6839","nonce":2729208421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4251":{"gid":4251,"name":"b","rank":2,"incarnation":12,"state":"up:active","state_seq":17,"addr":"172.21.15.111:6837/4176441330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":4176441330},{"type":"v1","addr":"172.21.15.111:6837","nonce":4176441330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4258":{"gid":4258,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":18,"addr":"172.21.15.111:6833/3175932821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":3175932821},{"type":"v1","addr":"172.21.15.111:6833","nonce":3175932821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":9,"addr":"172.21.15.76:6835/544947706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":544947706},{"type":"v1","addr":"172.21.15.76:6835","nonce":544947706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4264,"qdb_cluster":[4245,4258,4248,4251,4264]},"id":1}]} 2024-03-28T12:43:02.837 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 17 2024-03-28T12:43:02.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.842+0000 7efc00000640 1 -- 172.21.15.76:0/4236223495 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efbd8068010 msgr2=0x7efbd806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:02.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.842+0000 7efc00000640 1 --2- 172.21.15.76:0/4236223495 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efbd8068010 0x7efbd806a4d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efbf8141d40 tx=0x7efbe4007d40 comp rx=0 tx=0).stop 2024-03-28T12:43:02.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.842+0000 7efc00000640 1 -- 172.21.15.76:0/4236223495 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbf806e2c0 msgr2=0x7efbf81f40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:02.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.842+0000 7efc00000640 1 --2- 172.21.15.76:0/4236223495 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbf806e2c0 0x7efbf81f40a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efbec019080 tx=0x7efbec01acb0 comp rx=0 tx=0).stop 2024-03-28T12:43:02.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.842+0000 7efc00000640 1 -- 172.21.15.76:0/4236223495 shutdown_connections 2024-03-28T12:43:02.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.842+0000 7efc00000640 1 --2- 172.21.15.76:0/4236223495 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efbd8068010 0x7efbd806a4d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:02.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.842+0000 7efc00000640 1 --2- 172.21.15.76:0/4236223495 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efbf815bf40 0x7efbf81f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:02.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.842+0000 7efc00000640 1 --2- 172.21.15.76:0/4236223495 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efbf815bb60 0x7efbf80caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:02.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.842+0000 7efc00000640 1 --2- 172.21.15.76:0/4236223495 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efbf806e2c0 0x7efbf81f40a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:02.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.842+0000 7efc00000640 1 -- 172.21.15.76:0/4236223495 >> 172.21.15.76:0/4236223495 conn(0x7efbf806fbe0 msgr2=0x7efbf8151970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:02.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.842+0000 7efc00000640 1 -- 172.21.15.76:0/4236223495 shutdown_connections 2024-03-28T12:43:02.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:02.842+0000 7efc00000640 1 -- 172.21.15.76:0/4236223495 wait complete. 2024-03-28T12:43:02.863 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T12:43:03.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.010+0000 7fb594800640 1 Processor -- start 2024-03-28T12:43:03.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.010+0000 7fb594800640 1 -- start start 2024-03-28T12:43:03.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.010+0000 7fb594800640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fb58c06f580 0x7fb58c0c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:03.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.010+0000 7fb594800640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb58c0c3d30 con 0x7fb58c06c6b0 2024-03-28T12:43:03.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.010+0000 7fb594800640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb58c1580f0 con 0x7fb58c14e5a0 2024-03-28T12:43:03.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.010+0000 7fb594800640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fb58c1583d0 con 0x7fb58c06f580 2024-03-28T12:43:03.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.010+0000 7fb592800640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fb58c06f580 0x7fb58c0c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:03.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.010+0000 7fb591400640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fb58c06c6b0 0x7fb58c0c43f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:41334/0 (socket says 172.21.15.76:41334) 2024-03-28T12:43:03.009 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.010+0000 7fb591400640 1 -- 172.21.15.76:0/2475249764 learned_addr learned my addr 172.21.15.76:0/2475249764 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:43:03.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.014+0000 7fb592800640 1 -- 172.21.15.76:0/2475249764 >> v1:172.21.15.111:6789/0 conn(0x7fb58c14e5a0 legacy=0x7fb58c0678a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:03.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.014+0000 7fb592800640 1 -- 172.21.15.76:0/2475249764 >> v1:172.21.15.76:6789/0 conn(0x7fb58c06c6b0 legacy=0x7fb58c0c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:03.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.014+0000 7fb592800640 1 -- 172.21.15.76:0/2475249764 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb58c0c6600 con 0x7fb58c06f580 2024-03-28T12:43:03.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.034+0000 7fb592800640 1 --2- 172.21.15.76:0/2475249764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb58c06f580 0x7fb58c0c4b00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb588009d90 tx=0x7fb58801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb6c0fafb979d0e server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:03.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.042+0000 7fb590a00640 1 -- 172.21.15.76:0/2475249764 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5880a6620 con 0x7fb58c06f580 2024-03-28T12:43:03.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.042+0000 7fb590a00640 1 -- 172.21.15.76:0/2475249764 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5880a67c0 con 0x7fb58c06f580 2024-03-28T12:43:03.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.042+0000 7fb590a00640 1 -- 172.21.15.76:0/2475249764 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5880a6b90 con 0x7fb58c06f580 2024-03-28T12:43:03.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.042+0000 7fb594800640 1 -- 172.21.15.76:0/2475249764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb58c06f580 msgr2=0x7fb58c0c4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:03.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.042+0000 7fb594800640 1 --2- 172.21.15.76:0/2475249764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb58c06f580 0x7fb58c0c4b00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb588009d90 tx=0x7fb58801c850 comp rx=0 tx=0).stop 2024-03-28T12:43:03.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.042+0000 7fb594800640 1 -- 172.21.15.76:0/2475249764 shutdown_connections 2024-03-28T12:43:03.040 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.042+0000 7fb594800640 1 --2- 172.21.15.76:0/2475249764 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb58c06f580 0x7fb58c0c4b00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:03.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.042+0000 7fb594800640 1 -- 172.21.15.76:0/2475249764 >> 172.21.15.76:0/2475249764 conn(0x7fb58c0c9330 msgr2=0x7fb58c0c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:03.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.042+0000 7fb594800640 1 -- 172.21.15.76:0/2475249764 shutdown_connections 2024-03-28T12:43:03.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.042+0000 7fb594800640 1 -- 172.21.15.76:0/2475249764 wait complete. 2024-03-28T12:43:03.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.046+0000 7fb594800640 1 Processor -- start 2024-03-28T12:43:03.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.046+0000 7fb594800640 1 -- start start 2024-03-28T12:43:03.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.046+0000 7fb594800640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb58c06c6b0 0x7fb58c14ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:03.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.046+0000 7fb594800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb58c06f580 0x7fb58c1540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:03.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.046+0000 7fb594800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb58c14e5a0 0x7fb58c14bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:03.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.046+0000 7fb594800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c0c9fa0 con 0x7fb58c14e5a0 2024-03-28T12:43:03.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.046+0000 7fb594800640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb58c0c9e20 con 0x7fb58c06c6b0 2024-03-28T12:43:03.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.046+0000 7fb594800640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb58c06bdb0 con 0x7fb58c06f580 2024-03-28T12:43:03.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.046+0000 7fb592800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb58c14e5a0 0x7fb58c14bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:03.044 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.046+0000 7fb591e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb58c06c6b0 0x7fb58c14ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:03.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.046+0000 7fb592800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb58c14e5a0 0x7fb58c14bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55470/0 (socket says 172.21.15.76:55470) 2024-03-28T12:43:03.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.046+0000 7fb592800640 1 -- 172.21.15.76:0/2948787307 learned_addr learned my addr 172.21.15.76:0/2948787307 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:03.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.046+0000 7fb591400640 1 --2- 172.21.15.76:0/2948787307 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb58c06f580 0x7fb58c1540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:03.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.050+0000 7fb592800640 1 -- 172.21.15.76:0/2948787307 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb58c06f580 msgr2=0x7fb58c1540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:03.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.050+0000 7fb592800640 1 --2- 172.21.15.76:0/2948787307 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb58c06f580 0x7fb58c1540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:03.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.050+0000 7fb592800640 1 -- 172.21.15.76:0/2948787307 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb58c06c6b0 msgr2=0x7fb58c14ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:03.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.050+0000 7fb592800640 1 --2- 172.21.15.76:0/2948787307 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb58c06c6b0 0x7fb58c14ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:03.050 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.050+0000 7fb592800640 1 -- 172.21.15.76:0/2948787307 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb58c1f3bf0 con 0x7fb58c14e5a0 2024-03-28T12:43:03.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.054+0000 7fb592800640 1 --2- 172.21.15.76:0/2948787307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb58c14e5a0 0x7fb58c14bfd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb588019460 tx=0x7fb5880195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:03.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.062+0000 7fb586000640 1 -- 172.21.15.76:0/2948787307 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5880b0810 con 0x7fb58c14e5a0 2024-03-28T12:43:03.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.062+0000 7fb586000640 1 -- 172.21.15.76:0/2948787307 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5880c0070 con 0x7fb58c14e5a0 2024-03-28T12:43:03.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.062+0000 7fb594800640 1 -- 172.21.15.76:0/2948787307 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb58c15de40 con 0x7fb58c14e5a0 2024-03-28T12:43:03.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.062+0000 7fb594800640 1 -- 172.21.15.76:0/2948787307 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb58c1532e0 con 0x7fb58c14e5a0 2024-03-28T12:43:03.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.062+0000 7fb586000640 1 -- 172.21.15.76:0/2948787307 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5880b0bb0 con 0x7fb58c14e5a0 2024-03-28T12:43:03.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.062+0000 7fb594800640 1 -- 172.21.15.76:0/2948787307 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5680052a0 con 0x7fb58c14e5a0 2024-03-28T12:43:03.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.386+0000 7fb586000640 1 -- 172.21.15.76:0/2948787307 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb5880b8030 con 0x7fb58c14e5a0 2024-03-28T12:43:03.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.386+0000 7fb586000640 1 --2- 172.21.15.76:0/2948787307 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb570068010 0x7fb57006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:03.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.390+0000 7fb591e00640 1 --2- 172.21.15.76:0/2948787307 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb570068010 0x7fb57006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:03.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.390+0000 7fb591e00640 1 --2- 172.21.15.76:0/2948787307 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb570068010 0x7fb57006a4d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb580007fd0 tx=0x7fb580009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:03.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.402+0000 7fb586000640 1 -- 172.21.15.76:0/2948787307 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fb5880f07c0 con 0x7fb58c14e5a0 2024-03-28T12:43:03.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.402+0000 7fb586000640 1 -- 172.21.15.76:0/2948787307 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fb58c15de40 con 0x7fb58c14e5a0 2024-03-28T12:43:03.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.562+0000 7fb594800640 1 -- 172.21.15.76:0/2948787307 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb568005860 con 0x7fb58c14e5a0 2024-03-28T12:43:03.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.606+0000 7fb586000640 1 -- 172.21.15.76:0/2948787307 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18798 (secure 0 0 0) 0x7fb5880b6040 con 0x7fb58c14e5a0 2024-03-28T12:43:03.604 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:43:03.604 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":29,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:42:15.156639+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T12:41:58.010965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T12:41:59.698601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-28T12:42:05.363180+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.1","mappings":[{"from":3,"to":4}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]},{"pgid":"4.d","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":5}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T12:43:03.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.606+0000 7fb594800640 1 -- 172.21.15.76:0/2948787307 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb570068010 msgr2=0x7fb57006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:03.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.606+0000 7fb594800640 1 --2- 172.21.15.76:0/2948787307 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb570068010 0x7fb57006a4d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb580007fd0 tx=0x7fb580009040 comp rx=0 tx=0).stop 2024-03-28T12:43:03.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.606+0000 7fb594800640 1 -- 172.21.15.76:0/2948787307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb58c14e5a0 msgr2=0x7fb58c14bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:03.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.606+0000 7fb594800640 1 --2- 172.21.15.76:0/2948787307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb58c14e5a0 0x7fb58c14bfd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb588019460 tx=0x7fb5880195f0 comp rx=0 tx=0).stop 2024-03-28T12:43:03.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.606+0000 7fb594800640 1 -- 172.21.15.76:0/2948787307 shutdown_connections 2024-03-28T12:43:03.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.606+0000 7fb594800640 1 --2- 172.21.15.76:0/2948787307 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb570068010 0x7fb57006a4d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:03.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.606+0000 7fb594800640 1 --2- 172.21.15.76:0/2948787307 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb58c14e5a0 0x7fb58c14bfd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:03.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.606+0000 7fb594800640 1 --2- 172.21.15.76:0/2948787307 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb58c06f580 0x7fb58c1540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:03.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.606+0000 7fb594800640 1 --2- 172.21.15.76:0/2948787307 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb58c06c6b0 0x7fb58c14ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:03.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.606+0000 7fb594800640 1 -- 172.21.15.76:0/2948787307 >> 172.21.15.76:0/2948787307 conn(0x7fb58c0c9330 msgr2=0x7fb58c0c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:03.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.610+0000 7fb594800640 1 -- 172.21.15.76:0/2948787307 shutdown_connections 2024-03-28T12:43:03.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.610+0000 7fb594800640 1 -- 172.21.15.76:0/2948787307 wait complete. 2024-03-28T12:43:03.634 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T12:43:03.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.778+0000 7fec15200640 1 Processor -- start 2024-03-28T12:43:03.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.778+0000 7fec15200640 1 -- start start 2024-03-28T12:43:03.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.782+0000 7fec15200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1015bb60 0x7fec1006dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:03.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.782+0000 7fec15200640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fec1015bf40 0x7fec1015c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:03.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.782+0000 7fec15200640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec1015c8f0 con 0x7fec1006e2c0 2024-03-28T12:43:03.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.782+0000 7fec15200640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fec1006f570 con 0x7fec1015bf40 2024-03-28T12:43:03.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.782+0000 7fec15200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fec1006ea80 con 0x7fec1015bb60 2024-03-28T12:43:03.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.782+0000 7fec0e800640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fec1015bf40 0x7fec1015c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:03.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.782+0000 7fec0de00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1015bb60 0x7fec1006dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:03.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.782+0000 7fec0e800640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fec1015bf40 0x7fec1015c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:41042/0 (socket says 172.21.15.76:41042) 2024-03-28T12:43:03.780 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.782+0000 7fec0e800640 1 -- 172.21.15.76:0/1242305433 learned_addr learned my addr 172.21.15.76:0/1242305433 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:03.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.786+0000 7fec0e800640 1 -- 172.21.15.76:0/1242305433 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1015bb60 msgr2=0x7fec1006dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:03.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.786+0000 7fec0e800640 1 --2- 172.21.15.76:0/1242305433 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1015bb60 0x7fec1006dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:03.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.786+0000 7fec0e800640 1 -- 172.21.15.76:0/1242305433 >> v1:172.21.15.76:6789/0 conn(0x7fec1006e2c0 legacy=0x7fec10072140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:03.785 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.786+0000 7fec0e800640 1 -- 172.21.15.76:0/1242305433 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1006ed60 con 0x7fec1015bf40 2024-03-28T12:43:03.789 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.790+0000 7fec0e800640 1 --2- 172.21.15.76:0/1242305433 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec1015bf40 0x7fec1015c3b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fec08009e50 tx=0x7fec0801c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f4ddf7fe5e2835b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:03.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.798+0000 7fec0ca00640 1 -- 172.21.15.76:0/1242305433 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec080a5660 con 0x7fec1015bf40 2024-03-28T12:43:03.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.798+0000 7fec0ca00640 1 -- 172.21.15.76:0/1242305433 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec080a5800 con 0x7fec1015bf40 2024-03-28T12:43:03.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.798+0000 7fec0ca00640 1 -- 172.21.15.76:0/1242305433 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec080a5bd0 con 0x7fec1015bf40 2024-03-28T12:43:03.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.798+0000 7fec15200640 1 -- 172.21.15.76:0/1242305433 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec1015bf40 msgr2=0x7fec1015c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:03.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.798+0000 7fec15200640 1 --2- 172.21.15.76:0/1242305433 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec1015bf40 0x7fec1015c3b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fec08009e50 tx=0x7fec0801c7e0 comp rx=0 tx=0).stop 2024-03-28T12:43:03.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.798+0000 7fec15200640 1 -- 172.21.15.76:0/1242305433 shutdown_connections 2024-03-28T12:43:03.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.798+0000 7fec15200640 1 --2- 172.21.15.76:0/1242305433 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec1015bf40 0x7fec1015c3b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:03.796 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.798+0000 7fec15200640 1 --2- 172.21.15.76:0/1242305433 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1015bb60 0x7fec1006dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:03.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.798+0000 7fec15200640 1 -- 172.21.15.76:0/1242305433 >> 172.21.15.76:0/1242305433 conn(0x7fec1006fbe0 msgr2=0x7fec1006fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:03.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.798+0000 7fec15200640 1 -- 172.21.15.76:0/1242305433 shutdown_connections 2024-03-28T12:43:03.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.798+0000 7fec15200640 1 -- 172.21.15.76:0/1242305433 wait complete. 2024-03-28T12:43:03.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.802+0000 7fec15200640 1 Processor -- start 2024-03-28T12:43:03.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.802+0000 7fec15200640 1 -- start start 2024-03-28T12:43:03.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.802+0000 7fec15200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fec1006e2c0 0x7fec1014a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:03.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.802+0000 7fec15200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1015bb60 0x7fec10144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:03.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.802+0000 7fec15200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec1015bf40 0x7fec10148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:03.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.802+0000 7fec15200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fec10072850 con 0x7fec1006e2c0 2024-03-28T12:43:03.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.802+0000 7fec15200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fec100c8220 con 0x7fec1015bf40 2024-03-28T12:43:03.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.802+0000 7fec15200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fec100c8740 con 0x7fec1015bb60 2024-03-28T12:43:03.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.802+0000 7fec0d400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1015bb60 0x7fec10144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:03.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.802+0000 7fec0d400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1015bb60 0x7fec10144760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:47672/0 (socket says 172.21.15.76:47672) 2024-03-28T12:43:03.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.802+0000 7fec0d400640 1 -- 172.21.15.76:0/977952501 learned_addr learned my addr 172.21.15.76:0/977952501 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:03.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.806+0000 7fec0e800640 1 --2- 172.21.15.76:0/977952501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec1015bf40 0x7fec10148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:03.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.814+0000 7fec0d400640 1 -- 172.21.15.76:0/977952501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec1015bf40 msgr2=0x7fec10148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:03.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.814+0000 7fec0d400640 1 --2- 172.21.15.76:0/977952501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec1015bf40 0x7fec10148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:03.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.814+0000 7fec0d400640 1 -- 172.21.15.76:0/977952501 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fec1006e2c0 msgr2=0x7fec1014a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:03.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.814+0000 7fec0d400640 1 --2- 172.21.15.76:0/977952501 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fec1006e2c0 0x7fec1014a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:03.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.814+0000 7fec0d400640 1 -- 172.21.15.76:0/977952501 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec10145160 con 0x7fec1015bb60 2024-03-28T12:43:03.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.826+0000 7fec0d400640 1 --2- 172.21.15.76:0/977952501 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1015bb60 0x7fec10144760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7febfc00b410 tx=0x7febfc00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:03.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.838+0000 7fec06000640 1 -- 172.21.15.76:0/977952501 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc015020 con 0x7fec1015bb60 2024-03-28T12:43:03.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.838+0000 7fec15200640 1 -- 172.21.15.76:0/977952501 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec1015b750 con 0x7fec1015bb60 2024-03-28T12:43:03.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.838+0000 7fec15200640 1 -- 172.21.15.76:0/977952501 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fec1015a6b0 con 0x7fec1015bb60 2024-03-28T12:43:03.836 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:03.838+0000 7fec15200640 1 -- 172.21.15.76:0/977952501 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec100686e0 con 0x7fec1015bb60 2024-03-28T12:43:04.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.234+0000 7fec06000640 1 -- 172.21.15.76:0/977952501 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febfc011830 con 0x7fec1015bb60 2024-03-28T12:43:04.232 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.234+0000 7fec06000640 1 -- 172.21.15.76:0/977952501 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc011c20 con 0x7fec1015bb60 2024-03-28T12:43:04.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.234+0000 7fec06000640 1 -- 172.21.15.76:0/977952501 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7febfc018020 con 0x7fec1015bb60 2024-03-28T12:43:04.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.238+0000 7fec06000640 1 --2- 172.21.15.76:0/977952501 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7febf0067fc0 0x7febf006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:04.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.238+0000 7fec0de00640 1 --2- 172.21.15.76:0/977952501 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7febf0067fc0 0x7febf006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:04.235 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.238+0000 7fec0de00640 1 --2- 172.21.15.76:0/977952501 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7febf0067fc0 0x7febf006a480 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fec00006aa0 tx=0x7fec00006a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:04.240 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.242+0000 7fec06000640 1 -- 172.21.15.76:0/977952501 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7febfc011dc0 con 0x7fec1015bb60 2024-03-28T12:43:04.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.278+0000 7fec06000640 1 -- 172.21.15.76:0/977952501 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7febfc01f020 con 0x7fec1015bb60 2024-03-28T12:43:04.515 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.518+0000 7fec15200640 1 -- 172.21.15.76:0/977952501 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec1006e730 con 0x7fec1015bb60 2024-03-28T12:43:04.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.562+0000 7fec06000640 1 -- 172.21.15.76:0/977952501 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6914 (secure 0 0 0) 0x7febfc057200 con 0x7fec1015bb60 2024-03-28T12:43:04.559 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T12:43:04.559 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/335301918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":335301918},{"type":"v1","addr":"172.21.15.111:6835","nonce":335301918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T12:42:00.776505+0000","modified":"2024-03-28T12:42:47.404439+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4264,"mds_1":4258,"mds_2":4251,"mds_3":4248,"mds_4":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"e","rank":4,"incarnation":16,"state":"up:active","state_seq":18,"addr":"172.21.15.76:6837/1786218285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1786218285},{"type":"v1","addr":"172.21.15.76:6837","nonce":1786218285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4248":{"gid":4248,"name":"a","rank":3,"incarnation":14,"state":"up:active","state_seq":18,"addr":"172.21.15.76:6839/2729208421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":2729208421},{"type":"v1","addr":"172.21.15.76:6839","nonce":2729208421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4251":{"gid":4251,"name":"b","rank":2,"incarnation":12,"state":"up:active","state_seq":17,"addr":"172.21.15.111:6837/4176441330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":4176441330},{"type":"v1","addr":"172.21.15.111:6837","nonce":4176441330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4258":{"gid":4258,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":18,"addr":"172.21.15.111:6833/3175932821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":3175932821},{"type":"v1","addr":"172.21.15.111:6833","nonce":3175932821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":9,"addr":"172.21.15.76:6835/544947706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":544947706},{"type":"v1","addr":"172.21.15.76:6835","nonce":544947706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4264,"qdb_cluster":[4245,4258,4248,4251,4264]},"id":1}]} 2024-03-28T12:43:04.559 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 17 2024-03-28T12:43:04.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.562+0000 7fec15200640 1 -- 172.21.15.76:0/977952501 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7febf0067fc0 msgr2=0x7febf006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:04.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.562+0000 7fec15200640 1 --2- 172.21.15.76:0/977952501 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7febf0067fc0 0x7febf006a480 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fec00006aa0 tx=0x7fec00006a30 comp rx=0 tx=0).stop 2024-03-28T12:43:04.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.562+0000 7fec15200640 1 -- 172.21.15.76:0/977952501 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1015bb60 msgr2=0x7fec10144760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:04.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.562+0000 7fec15200640 1 --2- 172.21.15.76:0/977952501 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1015bb60 0x7fec10144760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7febfc00b410 tx=0x7febfc00b8d0 comp rx=0 tx=0).stop 2024-03-28T12:43:04.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.562+0000 7fec15200640 1 -- 172.21.15.76:0/977952501 shutdown_connections 2024-03-28T12:43:04.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.562+0000 7fec15200640 1 --2- 172.21.15.76:0/977952501 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7febf0067fc0 0x7febf006a480 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:04.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.562+0000 7fec15200640 1 --2- 172.21.15.76:0/977952501 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec1015bf40 0x7fec10148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:04.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.562+0000 7fec15200640 1 --2- 172.21.15.76:0/977952501 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1015bb60 0x7fec10144760 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:04.561 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.562+0000 7fec15200640 1 --2- 172.21.15.76:0/977952501 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fec1006e2c0 0x7fec1014a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:04.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.562+0000 7fec15200640 1 -- 172.21.15.76:0/977952501 >> 172.21.15.76:0/977952501 conn(0x7fec1006fbe0 msgr2=0x7fec1014b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:04.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.562+0000 7fec15200640 1 -- 172.21.15.76:0/977952501 shutdown_connections 2024-03-28T12:43:04.562 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:04.562+0000 7fec15200640 1 -- 172.21.15.76:0/977952501 wait complete. 2024-03-28T12:43:05.185 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-28T12:42:00.776505+0000', 'modified': '2024-03-28T12:42:47.404439+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4264, 'mds_1': 4258, 'mds_2': 4251, 'mds_3': 4248, 'mds_4': 4245}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4245': {'gid': 4245, 'name': 'e', 'rank': 4, 'incarnation': 16, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.76:6837/1786218285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6836', 'nonce': 1786218285}, {'type': 'v1', 'addr': '172.21.15.76:6837', 'nonce': 1786218285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4248': {'gid': 4248, 'name': 'a', 'rank': 3, 'incarnation': 14, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.76:6839/2729208421', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6838', 'nonce': 2729208421}, {'type': 'v1', 'addr': '172.21.15.76:6839', 'nonce': 2729208421}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4251': {'gid': 4251, 'name': 'b', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.111:6837/4176441330', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6836', 'nonce': 4176441330}, {'type': 'v1', 'addr': '172.21.15.111:6837', 'nonce': 4176441330}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4258': {'gid': 4258, 'name': 'f', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.111:6833/3175932821', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.111:6832', 'nonce': 3175932821}, {'type': 'v1', 'addr': '172.21.15.111:6833', 'nonce': 3175932821}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4264': {'gid': 4264, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.76:6835/544947706', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.76:6834', 'nonce': 544947706}, {'type': 'v1', 'addr': '172.21.15.76:6835', 'nonce': 544947706}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4264, 'qdb_cluster': [4245, 4258, 4248, 4251, 4264]} 2024-03-28T12:43:05.185 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-03-28T12:43:05.186 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-03-28T12:43:05.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.346+0000 7f62a6a00640 1 Processor -- start 2024-03-28T12:43:05.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.346+0000 7f62a6a00640 1 -- start start 2024-03-28T12:43:05.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.346+0000 7f62a6a00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f62a0071e00 0x7f62a00c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.346+0000 7f62a6a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62a0159110 0x7f62a0152250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.346+0000 7f62a6a00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62a015bd90 con 0x7f62a00721e0 2024-03-28T12:43:05.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.346+0000 7f62a6a00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f62a015c030 con 0x7f62a0071e00 2024-03-28T12:43:05.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.346+0000 7f62a6a00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f62a015c310 con 0x7f62a0159110 2024-03-28T12:43:05.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.350+0000 7f62a5600640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f62a0071e00 0x7f62a00c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:05.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.350+0000 7f62a4c00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f62a00721e0 0x7f62a0158a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:41360/0 (socket says 172.21.15.76:41360) 2024-03-28T12:43:05.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.350+0000 7f62a4c00640 1 -- 172.21.15.76:0/3692017722 learned_addr learned my addr 172.21.15.76:0/3692017722 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:43:05.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.354+0000 7f62a5600640 1 -- 172.21.15.76:0/3692017722 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62a0159110 msgr2=0x7f62a0152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:05.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.354+0000 7f62a5600640 1 --2- 172.21.15.76:0/3692017722 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62a0159110 0x7f62a0152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.354+0000 7f62a5600640 1 -- 172.21.15.76:0/3692017722 >> v1:172.21.15.76:6789/0 conn(0x7f62a00721e0 legacy=0x7f62a0158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:05.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.354+0000 7f62a5600640 1 -- 172.21.15.76:0/3692017722 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a015c5f0 con 0x7f62a0071e00 2024-03-28T12:43:05.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.358+0000 7f62a5600640 1 --2- 172.21.15.76:0/3692017722 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62a0071e00 0x7f62a00c3000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f62940097c0 tx=0x7f629401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c014955c0e64961c server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:05.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.366+0000 7f629fe00640 1 -- 172.21.15.76:0/3692017722 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62940b5070 con 0x7f62a0071e00 2024-03-28T12:43:05.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.366+0000 7f629fe00640 1 -- 172.21.15.76:0/3692017722 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62940a8990 con 0x7f62a0071e00 2024-03-28T12:43:05.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.366+0000 7f629fe00640 1 -- 172.21.15.76:0/3692017722 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62940a8d60 con 0x7f62a0071e00 2024-03-28T12:43:05.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.366+0000 7f62a6a00640 1 -- 172.21.15.76:0/3692017722 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62a0071e00 msgr2=0x7f62a00c3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:05.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.366+0000 7f62a6a00640 1 --2- 172.21.15.76:0/3692017722 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62a0071e00 0x7f62a00c3000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f62940097c0 tx=0x7f629401ec90 comp rx=0 tx=0).stop 2024-03-28T12:43:05.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.366+0000 7f62a6a00640 1 -- 172.21.15.76:0/3692017722 shutdown_connections 2024-03-28T12:43:05.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.366+0000 7f62a6a00640 1 --2- 172.21.15.76:0/3692017722 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62a0159110 0x7f62a0152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.366+0000 7f62a6a00640 1 --2- 172.21.15.76:0/3692017722 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62a0071e00 0x7f62a00c3000 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.366+0000 7f62a6a00640 1 -- 172.21.15.76:0/3692017722 >> 172.21.15.76:0/3692017722 conn(0x7f62a0067330 msgr2=0x7f62a0067740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:05.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.366+0000 7f62a6a00640 1 -- 172.21.15.76:0/3692017722 shutdown_connections 2024-03-28T12:43:05.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.366+0000 7f62a6a00640 1 -- 172.21.15.76:0/3692017722 wait complete. 2024-03-28T12:43:05.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.366+0000 7f62a6a00640 1 Processor -- start 2024-03-28T12:43:05.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.366+0000 7f62a6a00640 1 -- start start 2024-03-28T12:43:05.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.370+0000 7f62a6a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62a0071e00 0x7f62a0159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.370+0000 7f62a6a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62a00721e0 0x7f62a0159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.370+0000 7f62a6a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62a0159110 0x7f62a014fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.370+0000 7f62a6a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f62a00c36c0 con 0x7f62a0071e00 2024-03-28T12:43:05.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.370+0000 7f62a6a00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f62a00c3540 con 0x7f62a00721e0 2024-03-28T12:43:05.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.370+0000 7f62a6a00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f62a00ca0b0 con 0x7f62a0159110 2024-03-28T12:43:05.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.370+0000 7f62a5600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62a0071e00 0x7f62a0159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:05.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.370+0000 7f62a5600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62a0071e00 0x7f62a0159aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55486/0 (socket says 172.21.15.76:55486) 2024-03-28T12:43:05.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.370+0000 7f62a5600640 1 -- 172.21.15.76:0/1349496919 learned_addr learned my addr 172.21.15.76:0/1349496919 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:05.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.374+0000 7f62a5600640 1 -- 172.21.15.76:0/1349496919 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62a0159110 msgr2=0x7f62a014fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:05.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.374+0000 7f62a5600640 1 --2- 172.21.15.76:0/1349496919 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62a0159110 0x7f62a014fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.374+0000 7f62a5600640 1 -- 172.21.15.76:0/1349496919 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62a00721e0 msgr2=0x7f62a0159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:05.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.374+0000 7f62a5600640 1 --2- 172.21.15.76:0/1349496919 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62a00721e0 0x7f62a0159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.374+0000 7f62a5600640 1 -- 172.21.15.76:0/1349496919 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62a014b350 con 0x7f62a0071e00 2024-03-28T12:43:05.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.378+0000 7f62a5600640 1 --2- 172.21.15.76:0/1349496919 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62a0071e00 0x7f62a0159aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f62940097c0 tx=0x7f629401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:05.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.382+0000 7f629d600640 1 -- 172.21.15.76:0/1349496919 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62940bf070 con 0x7f62a0071e00 2024-03-28T12:43:05.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.382+0000 7f629d600640 1 -- 172.21.15.76:0/1349496919 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62940b0920 con 0x7f62a0071e00 2024-03-28T12:43:05.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.382+0000 7f629d600640 1 -- 172.21.15.76:0/1349496919 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62940b5040 con 0x7f62a0071e00 2024-03-28T12:43:05.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.382+0000 7f62a6a00640 1 -- 172.21.15.76:0/1349496919 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62a014f3c0 con 0x7f62a0071e00 2024-03-28T12:43:05.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.382+0000 7f62a6a00640 1 -- 172.21.15.76:0/1349496919 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62a015ae70 con 0x7f62a0071e00 2024-03-28T12:43:05.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.386+0000 7f62ab3df000 1 Processor -- start 2024-03-28T12:43:05.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.386+0000 7f62ab3df000 1 -- start start 2024-03-28T12:43:05.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.390+0000 7f62ab3df000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b989daf0 0x5619b9863bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.390+0000 7f62ab3df000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 0x5619b9864130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.387 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.390+0000 7f62ab3df000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 0x5619b98865f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.390+0000 7f62ab3df000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5619b96ae950 con 0x5619b989ded0 2024-03-28T12:43:05.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.390+0000 7f62ab3df000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5619b964b990 con 0x5619b9886210 2024-03-28T12:43:05.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.390+0000 7f62ab3df000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x5619b96aa900 con 0x5619b989daf0 2024-03-28T12:43:05.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.406+0000 7f62a4c00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 0x5619b98865f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:05.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.406+0000 7f62a4c00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 0x5619b98865f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:41052/0 (socket says 172.21.15.76:41052) 2024-03-28T12:43:05.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.406+0000 7f62a4c00640 1 -- 172.21.15.76:0/429086884 learned_addr learned my addr 172.21.15.76:0/429086884 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:05.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.410+0000 7f62a4c00640 1 -- 172.21.15.76:0/429086884 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b989daf0 msgr2=0x5619b9863bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:05.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.410+0000 7f62a4c00640 1 --2- 172.21.15.76:0/429086884 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b989daf0 0x5619b9863bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.410+0000 7f62a4c00640 1 -- 172.21.15.76:0/429086884 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 msgr2=0x5619b9864130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:05.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.410+0000 7f62a4c00640 1 --2- 172.21.15.76:0/429086884 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 0x5619b9864130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.410+0000 7f62a4c00640 1 -- 172.21.15.76:0/429086884 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b96f3100 con 0x5619b9886210 2024-03-28T12:43:05.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.418+0000 7f629d600640 1 -- 172.21.15.76:0/1349496919 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f62940c2070 con 0x7f62a0071e00 2024-03-28T12:43:05.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.418+0000 7f629d600640 1 --2- 172.21.15.76:0/1349496919 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6280068040 0x7f628006a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.418+0000 7f62a4c00640 1 --2- 172.21.15.76:0/429086884 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 0x5619b98865f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f628c0015c0 tx=0x7f628c001a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec1a6f49469a4a6b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:05.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.418+0000 7f62a6000640 1 --2- 172.21.15.76:0/1349496919 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6280068040 0x7f628006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:05.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.418+0000 7f62a6000640 1 --2- 172.21.15.76:0/1349496919 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6280068040 0x7f628006a500 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f62a0151a30 tx=0x7f6298009250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:05.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.418+0000 7f629d600640 1 -- 172.21.15.76:0/1349496919 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f62940f1280 con 0x7f62a0071e00 2024-03-28T12:43:05.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.422+0000 7f6292000640 1 -- 172.21.15.76:0/429086884 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c017070 con 0x5619b9886210 2024-03-28T12:43:05.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.426+0000 7f6292000640 1 -- 172.21.15.76:0/429086884 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f628c005ac0 con 0x5619b9886210 2024-03-28T12:43:05.425 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.426+0000 7f6292000640 1 -- 172.21.15.76:0/429086884 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c0070d0 con 0x5619b9886210 2024-03-28T12:43:05.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.426+0000 7f62ab3df000 1 -- 172.21.15.76:0/429086884 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 msgr2=0x5619b98865f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:05.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.426+0000 7f62ab3df000 1 --2- 172.21.15.76:0/429086884 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 0x5619b98865f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f628c0015c0 tx=0x7f628c001a80 comp rx=0 tx=0).stop 2024-03-28T12:43:05.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62ab3df000 1 -- 172.21.15.76:0/429086884 shutdown_connections 2024-03-28T12:43:05.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62ab3df000 1 --2- 172.21.15.76:0/429086884 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 0x5619b98865f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62ab3df000 1 --2- 172.21.15.76:0/429086884 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 0x5619b9864130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.426 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62ab3df000 1 --2- 172.21.15.76:0/429086884 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b989daf0 0x5619b9863bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62ab3df000 1 -- 172.21.15.76:0/429086884 >> 172.21.15.76:0/429086884 conn(0x5619b9746b80 msgr2=0x5619b989d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:05.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62ab3df000 1 -- 172.21.15.76:0/429086884 shutdown_connections 2024-03-28T12:43:05.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62ab3df000 1 -- 172.21.15.76:0/429086884 wait complete. 2024-03-28T12:43:05.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62ab3df000 1 -- start start 2024-03-28T12:43:05.427 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62ab3df000 1 Processor -- start 2024-03-28T12:43:05.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62ab3df000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 0x5619b9899f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62ab3df000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b989daf0 0x5619b98ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62ab3df000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 0x5619b98abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62ab3df000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5619b9676300 con 0x5619b989ded0 2024-03-28T12:43:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62ab3df000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5619b966c3e0 con 0x5619b9886210 2024-03-28T12:43:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62ab3df000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x5619b9632b10 con 0x5619b989daf0 2024-03-28T12:43:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62ab3df000 10 client.0 _ll_register_callbacks cb 0x5619b970f0f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T12:43:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62a4c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b989daf0 0x5619b98ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:05.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.430+0000 7f62a5600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 0x5619b9899f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:05.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.434+0000 7f62a5600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 0x5619b9899f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:41058/0 (socket says 172.21.15.76:41058) 2024-03-28T12:43:05.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.434+0000 7f62a5600640 1 -- 172.21.15.76:0/3604400182 learned_addr learned my addr 172.21.15.76:0/3604400182 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.438+0000 7f62a4c00640 1 -- 172.21.15.76:0/3604400182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 msgr2=0x5619b9899f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.438+0000 7f62a4c00640 1 --2- 172.21.15.76:0/3604400182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 0x5619b9899f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.438+0000 7f62a4c00640 1 -- 172.21.15.76:0/3604400182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 msgr2=0x5619b98abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.438+0000 7f62a4c00640 1 --2- 172.21.15.76:0/3604400182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 0x5619b98abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.438+0000 7f62a4c00640 1 -- 172.21.15.76:0/3604400182 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x5619b96788c0 con 0x5619b989daf0 2024-03-28T12:43:05.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.442+0000 7f62a4c00640 1 --2- 172.21.15.76:0/3604400182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b989daf0 0x5619b98ab5b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f62a014e4f0 tx=0x7f628c005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcf93b71e979f81b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:05.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.442+0000 7f6286a00640 10 client.0 ms_handle_connect on v2:172.21.15.111:3301/0 2024-03-28T12:43:05.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.450+0000 7f6286a00640 1 -- 172.21.15.76:0/3604400182 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c022060 con 0x5619b989daf0 2024-03-28T12:43:05.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.450+0000 7f6286a00640 1 -- 172.21.15.76:0/3604400182 <== mon.2 v2:172.21.15.111:3301/0 2 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f628c00ca70 con 0x5619b989daf0 2024-03-28T12:43:05.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.450+0000 7f62ab3df000 1 -- 172.21.15.76:0/3604400182 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f628c005ac0 con 0x5619b989daf0 2024-03-28T12:43:05.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.546+0000 7f6286a00640 1 -- 172.21.15.76:0/3604400182 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f628c028050 con 0x5619b989daf0 2024-03-28T12:43:05.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.546+0000 7f62ab3df000 10 client.14588 fetch_fsmap learned FSMap version 17 2024-03-28T12:43:05.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.546+0000 7f62ab3df000 1 -- 172.21.15.76:0/3604400182 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5619b9636e80 con 0x5619b989daf0 2024-03-28T12:43:05.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.594+0000 7f6286a00640 1 -- 172.21.15.76:0/3604400182 <== mon.2 v2:172.21.15.111:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f628c005ac0 con 0x5619b989daf0 2024-03-28T12:43:05.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.594+0000 7f6286a00640 1 -- 172.21.15.76:0/3604400182 <== mon.2 v2:172.21.15.111:3301/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f628c02b020 con 0x5619b989daf0 2024-03-28T12:43:05.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.594+0000 7f62ab3df000 10 client.14588 fetch_fsmap finished waiting for FSMap version 17 2024-03-28T12:43:05.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.594+0000 7f62ab3df000 10 client.14588 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-28T12:43:05.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.594+0000 7f62ab3df000 20 client.14588 populate_metadata read hostname 'smithi076' 2024-03-28T12:43:05.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.594+0000 7f62ab3df000 1 --2- 172.21.15.76:0/3604400182 >> [v2:172.21.15.76:6836/1786218285,v1:172.21.15.76:6837/1786218285] conn(0x5619b98a8510 0x5619b98a88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.594+0000 7f62ab3df000 4 client.14588 mds_command: new command op to 4245 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T12:43:05.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.594+0000 7f62ab3df000 1 -- 172.21.15.76:0/3604400182 --> [v2:172.21.15.76:6836/1786218285,v1:172.21.15.76:6837/1786218285] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619b9649bc0 con 0x5619b98a8510 2024-03-28T12:43:05.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.598+0000 7f62a5600640 1 --2- 172.21.15.76:0/3604400182 >> [v2:172.21.15.76:6836/1786218285,v1:172.21.15.76:6837/1786218285] conn(0x5619b98a8510 0x5619b98a88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:05.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.686+0000 7f6286a00640 10 client.14588 ms_handle_connect on v2:172.21.15.76:6836/1786218285 2024-03-28T12:43:05.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.686+0000 7f62a5600640 1 --2- 172.21.15.76:0/3604400182 >> [v2:172.21.15.76:6836/1786218285,v1:172.21.15.76:6837/1786218285] conn(0x5619b98a8510 0x5619b98a88f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=305da9bf68f0c4c4 server_cookie=96e42d3a611c68bb in_seq=0 out_seq=0 2024-03-28T12:43:05.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.810+0000 7f6286a00640 1 -- 172.21.15.76:0/3604400182 <== mds.4 v2:172.21.15.76:6836/1786218285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5619b9649bc0 con 0x5619b98a8510 2024-03-28T12:43:05.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.810+0000 7f6286a00640 10 client.14588 handle_command_reply: tid=0 2024-03-28T12:43:05.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.810+0000 7f62ab3df000 1 client.14588 shutdown 2024-03-28T12:43:05.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.810+0000 7f62ab3df000 1 -- 172.21.15.76:0/3604400182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b989daf0 msgr2=0x5619b98ab5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:05.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.810+0000 7f62ab3df000 1 --2- 172.21.15.76:0/3604400182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b989daf0 0x5619b98ab5b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f62a014e4f0 tx=0x7f628c005800 comp rx=0 tx=0).stop 2024-03-28T12:43:05.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.810+0000 7f62ab3df000 1 -- 172.21.15.76:0/3604400182 shutdown_connections 2024-03-28T12:43:05.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.810+0000 7f62ab3df000 1 --2- 172.21.15.76:0/3604400182 >> [v2:172.21.15.76:6836/1786218285,v1:172.21.15.76:6837/1786218285] conn(0x5619b98a8510 0x5619b98a88f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.810+0000 7f62ab3df000 1 --2- 172.21.15.76:0/3604400182 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 0x5619b98abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.810+0000 7f62ab3df000 1 --2- 172.21.15.76:0/3604400182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b989daf0 0x5619b98ab5b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.810+0000 7f62ab3df000 1 --2- 172.21.15.76:0/3604400182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 0x5619b9899f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.807 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.810+0000 7f62ab3df000 1 -- 172.21.15.76:0/3604400182 >> 172.21.15.76:0/3604400182 conn(0x5619b9746b80 msgr2=0x5619b989ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:05.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.810+0000 7f6286a00640 0 client.14588 ms_handle_reset on v2:172.21.15.76:6836/1786218285 2024-03-28T12:43:05.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.810+0000 7f62ab3df000 1 -- 172.21.15.76:0/3604400182 shutdown_connections 2024-03-28T12:43:05.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.810+0000 7f62ab3df000 1 -- 172.21.15.76:0/3604400182 wait complete. 2024-03-28T12:43:05.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.810+0000 7f62ab3df000 20 client.14588 trim_cache size 0 max 16384 2024-03-28T12:43:05.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.826+0000 7f62ab3df000 1 Processor -- start 2024-03-28T12:43:05.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.826+0000 7f62ab3df000 1 -- start start 2024-03-28T12:43:05.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.830+0000 7f62ab3df000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b9886210 0x5619b98abb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.830+0000 7f62ab3df000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b989daf0 0x5619b989bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.830+0000 7f62ab3df000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 0x5619b989c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.830+0000 7f62ab3df000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f62a0147de0 con 0x5619b989ded0 2024-03-28T12:43:05.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.830+0000 7f62ab3df000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5619b96b2f80 con 0x5619b989daf0 2024-03-28T12:43:05.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.830+0000 7f62ab3df000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x5619b96adc60 con 0x5619b9886210 2024-03-28T12:43:05.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.830+0000 7f62a6000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 0x5619b989c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:05.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.830+0000 7f62a4c00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b989daf0 0x5619b989bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:05.827 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.830+0000 7f62a5600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b9886210 0x5619b98abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:05.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.830+0000 7f62a4c00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b989daf0 0x5619b989bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:41074/0 (socket says 172.21.15.76:41074) 2024-03-28T12:43:05.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.830+0000 7f62a4c00640 1 -- 172.21.15.76:0/3854956118 learned_addr learned my addr 172.21.15.76:0/3854956118 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:05.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.834+0000 7f62a6000640 1 -- 172.21.15.76:0/3854956118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b9886210 msgr2=0x5619b98abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:05.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.834+0000 7f62a6000640 1 --2- 172.21.15.76:0/3854956118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b9886210 0x5619b98abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.834+0000 7f62a6000640 1 -- 172.21.15.76:0/3854956118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b989daf0 msgr2=0x5619b989bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:05.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.834+0000 7f62a6000640 1 --2- 172.21.15.76:0/3854956118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b989daf0 0x5619b989bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.834+0000 7f62a6000640 1 -- 172.21.15.76:0/3854956118 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619b9669490 con 0x5619b989ded0 2024-03-28T12:43:05.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.834+0000 7f62a6000640 1 --2- 172.21.15.76:0/3854956118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 0x5619b989c2a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f629800c7d0 tx=0x7f629800f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e136e9fa33a3ac1 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:05.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.842+0000 7f6291600640 1 -- 172.21.15.76:0/3854956118 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629801a420 con 0x5619b989ded0 2024-03-28T12:43:05.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.842+0000 7f6291600640 1 -- 172.21.15.76:0/3854956118 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f629801a5c0 con 0x5619b989ded0 2024-03-28T12:43:05.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.842+0000 7f6291600640 1 -- 172.21.15.76:0/3854956118 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629801a9b0 con 0x5619b989ded0 2024-03-28T12:43:05.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.842+0000 7f62ab3df000 1 -- 172.21.15.76:0/3854956118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 msgr2=0x5619b989c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:05.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.842+0000 7f62ab3df000 1 --2- 172.21.15.76:0/3854956118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 0x5619b989c2a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f629800c7d0 tx=0x7f629800f070 comp rx=0 tx=0).stop 2024-03-28T12:43:05.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.842+0000 7f62ab3df000 1 -- 172.21.15.76:0/3854956118 shutdown_connections 2024-03-28T12:43:05.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.842+0000 7f62ab3df000 1 --2- 172.21.15.76:0/3854956118 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 0x5619b989c2a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.842+0000 7f62ab3df000 1 --2- 172.21.15.76:0/3854956118 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b989daf0 0x5619b989bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.842+0000 7f62ab3df000 1 --2- 172.21.15.76:0/3854956118 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b9886210 0x5619b98abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.842+0000 7f62ab3df000 1 -- 172.21.15.76:0/3854956118 >> 172.21.15.76:0/3854956118 conn(0x5619b9746b80 msgr2=0x5619b98a5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:05.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.842+0000 7f62ab3df000 1 -- 172.21.15.76:0/3854956118 shutdown_connections 2024-03-28T12:43:05.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.842+0000 7f62ab3df000 1 -- 172.21.15.76:0/3854956118 wait complete. 2024-03-28T12:43:05.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.842+0000 7f62ab3df000 1 -- start start 2024-03-28T12:43:05.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.842+0000 7f62ab3df000 1 Processor -- start 2024-03-28T12:43:05.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.846+0000 7f62ab3df000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 0x5619b9914b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.846+0000 7f62ab3df000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b989daf0 0x5619b9915050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.846+0000 7f62ab3df000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 0x5619b98b1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.846+0000 7f62ab3df000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5619b9654e80 con 0x5619b989ded0 2024-03-28T12:43:05.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.846+0000 7f62ab3df000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5619b96467b0 con 0x5619b9886210 2024-03-28T12:43:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.846+0000 7f62ab3df000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x5619b9748df0 con 0x5619b989daf0 2024-03-28T12:43:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.846+0000 7f62ab3df000 10 client.0 _ll_register_callbacks cb 0x7f628c015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T12:43:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.846+0000 7f62a6000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 0x5619b98b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.846+0000 7f62a4c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b989daf0 0x5619b9915050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:05.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.846+0000 7f62a6000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 0x5619b98b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55518/0 (socket says 172.21.15.76:55518) 2024-03-28T12:43:05.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.846+0000 7f62a6000640 1 -- 172.21.15.76:0/3441620788 learned_addr learned my addr 172.21.15.76:0/3441620788 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:05.844 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.846+0000 7f62a5600640 1 --2- 172.21.15.76:0/3441620788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 0x5619b9914b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:05.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.850+0000 7f62a6000640 1 -- 172.21.15.76:0/3441620788 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b989daf0 msgr2=0x5619b9915050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:05.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.850+0000 7f62a6000640 1 --2- 172.21.15.76:0/3441620788 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b989daf0 0x5619b9915050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.850+0000 7f62a6000640 1 -- 172.21.15.76:0/3441620788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 msgr2=0x5619b9914b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:05.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.850+0000 7f62a6000640 1 --2- 172.21.15.76:0/3441620788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 0x5619b9914b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.848 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.850+0000 7f62a6000640 1 -- 172.21.15.76:0/3441620788 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619b9667e80 con 0x5619b989ded0 2024-03-28T12:43:05.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.854+0000 7f62a6000640 1 --2- 172.21.15.76:0/3441620788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 0x5619b98b1400 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f629800a870 tx=0x7f6298011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8b26b2ab082d3e server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:05.851 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.854+0000 7f6286a00640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-03-28T12:43:05.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.858+0000 7f6286a00640 1 -- 172.21.15.76:0/3441620788 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6298032060 con 0x5619b989ded0 2024-03-28T12:43:05.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.858+0000 7f6286a00640 1 -- 172.21.15.76:0/3441620788 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f6298022610 con 0x5619b989ded0 2024-03-28T12:43:05.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.858+0000 7f62ab3df000 1 -- 172.21.15.76:0/3441620788 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f629801a5c0 con 0x5619b989ded0 2024-03-28T12:43:05.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.862+0000 7f6286a00640 1 -- 172.21.15.76:0/3441620788 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f6298038050 con 0x5619b989ded0 2024-03-28T12:43:05.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.862+0000 7f62ab3df000 10 client.4668 fetch_fsmap learned FSMap version 17 2024-03-28T12:43:05.859 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.862+0000 7f62ab3df000 1 -- 172.21.15.76:0/3441620788 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5619b9655270 con 0x5619b989ded0 2024-03-28T12:43:05.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.866+0000 7f6286a00640 1 -- 172.21.15.76:0/3441620788 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f629801a5c0 con 0x5619b989ded0 2024-03-28T12:43:05.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.866+0000 7f6286a00640 1 -- 172.21.15.76:0/3441620788 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f629803b020 con 0x5619b989ded0 2024-03-28T12:43:05.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.866+0000 7f62ab3df000 10 client.4668 fetch_fsmap finished waiting for FSMap version 17 2024-03-28T12:43:05.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.866+0000 7f62ab3df000 10 client.4668 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-28T12:43:05.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.866+0000 7f62ab3df000 20 client.4668 populate_metadata read hostname 'smithi076' 2024-03-28T12:43:05.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.866+0000 7f62ab3df000 1 --2- 172.21.15.76:0/3441620788 >> [v2:172.21.15.76:6836/1786218285,v1:172.21.15.76:6837/1786218285] conn(0x5619b9912b50 0x5619b9912f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:05.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.866+0000 7f62ab3df000 4 client.4668 mds_command: new command op to 4245 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-28T12:43:05.866 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.866+0000 7f62ab3df000 1 -- 172.21.15.76:0/3441620788 --> [v2:172.21.15.76:6836/1786218285,v1:172.21.15.76:6837/1786218285] -- command(tid 0: {"prefix": "status"}) -- 0x5619b96bbe90 con 0x5619b9912b50 2024-03-28T12:43:05.867 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.870+0000 7f62a5600640 1 --2- 172.21.15.76:0/3441620788 >> [v2:172.21.15.76:6836/1786218285,v1:172.21.15.76:6837/1786218285] conn(0x5619b9912b50 0x5619b9912f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:05.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.874+0000 7f62a5600640 1 --2- 172.21.15.76:0/3441620788 >> [v2:172.21.15.76:6836/1786218285,v1:172.21.15.76:6837/1786218285] conn(0x5619b9912b50 0x5619b9912f30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d5fe7b03148583dc server_cookie=3f25a976869ba579 in_seq=0 out_seq=0 2024-03-28T12:43:05.872 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.874+0000 7f6286a00640 10 client.4668 ms_handle_connect on v2:172.21.15.76:6836/1786218285 2024-03-28T12:43:05.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.894+0000 7f6286a00640 1 -- 172.21.15.76:0/3441620788 <== mds.4 v2:172.21.15.76:6836/1786218285 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5619b96bbe90 con 0x5619b9912b50 2024-03-28T12:43:05.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.894+0000 7f6286a00640 10 client.4668 handle_command_reply: tid=0 2024-03-28T12:43:05.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.894+0000 7f62ab3df000 1 client.4668 shutdown 2024-03-28T12:43:05.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.894+0000 7f62ab3df000 1 -- 172.21.15.76:0/3441620788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 msgr2=0x5619b98b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:05.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.894+0000 7f62ab3df000 1 --2- 172.21.15.76:0/3441620788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 0x5619b98b1400 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f629800a870 tx=0x7f6298011000 comp rx=0 tx=0).stop 2024-03-28T12:43:05.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.894+0000 7f62ab3df000 1 -- 172.21.15.76:0/3441620788 shutdown_connections 2024-03-28T12:43:05.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.894+0000 7f62ab3df000 1 --2- 172.21.15.76:0/3441620788 >> [v2:172.21.15.76:6836/1786218285,v1:172.21.15.76:6837/1786218285] conn(0x5619b9912b50 0x5619b9912f30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.894+0000 7f62ab3df000 1 --2- 172.21.15.76:0/3441620788 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x5619b989ded0 0x5619b98b1400 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.894+0000 7f62ab3df000 1 --2- 172.21.15.76:0/3441620788 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5619b989daf0 0x5619b9915050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.894+0000 7f62ab3df000 1 --2- 172.21.15.76:0/3441620788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5619b9886210 0x5619b9914b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.894+0000 7f6286a00640 0 client.4668 ms_handle_reset on v2:172.21.15.76:6836/1786218285 2024-03-28T12:43:05.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.894+0000 7f62ab3df000 1 -- 172.21.15.76:0/3441620788 >> 172.21.15.76:0/3441620788 conn(0x5619b9746b80 msgr2=0x5619b9898680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:05.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.894+0000 7f62ab3df000 1 -- 172.21.15.76:0/3441620788 shutdown_connections 2024-03-28T12:43:05.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.894+0000 7f62ab3df000 1 -- 172.21.15.76:0/3441620788 wait complete. 2024-03-28T12:43:05.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.894+0000 7f62ab3df000 20 client.4668 trim_cache size 0 max 16384 2024-03-28T12:43:05.895 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-03-28T12:43:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "ed125c42-99c2-4574-a55f-ea7172f89d9c", 2024-03-28T12:43:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 4, 2024-03-28T12:43:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 4245, 2024-03-28T12:43:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-03-28T12:43:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-03-28T12:43:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-03-28T12:43:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 20.922700712000001, 2024-03-28T12:43:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 17, 2024-03-28T12:43:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 29, 2024-03-28T12:43:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 29, 2024-03-28T12:43:05.895 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 93.365825502000007 2024-03-28T12:43:05.895 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-03-28T12:43:05.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.898+0000 7f62a6a00640 1 -- 172.21.15.76:0/1349496919 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6280068040 msgr2=0x7f628006a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:05.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.898+0000 7f62a6a00640 1 --2- 172.21.15.76:0/1349496919 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6280068040 0x7f628006a500 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f62a0151a30 tx=0x7f6298009250 comp rx=0 tx=0).stop 2024-03-28T12:43:05.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.898+0000 7f62a6a00640 1 -- 172.21.15.76:0/1349496919 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62a0071e00 msgr2=0x7f62a0159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:05.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.898+0000 7f62a6a00640 1 --2- 172.21.15.76:0/1349496919 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62a0071e00 0x7f62a0159aa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f62940097c0 tx=0x7f629401ba30 comp rx=0 tx=0).stop 2024-03-28T12:43:05.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.898+0000 7f62a6a00640 1 -- 172.21.15.76:0/1349496919 shutdown_connections 2024-03-28T12:43:05.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.898+0000 7f62a6a00640 1 --2- 172.21.15.76:0/1349496919 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6280068040 0x7f628006a500 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.898+0000 7f62a6a00640 1 --2- 172.21.15.76:0/1349496919 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62a0159110 0x7f62a014fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.898+0000 7f62a6a00640 1 --2- 172.21.15.76:0/1349496919 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62a00721e0 0x7f62a0159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.898+0000 7f62a6a00640 1 --2- 172.21.15.76:0/1349496919 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f62a0071e00 0x7f62a0159aa0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:05.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.898+0000 7f62a6a00640 1 -- 172.21.15.76:0/1349496919 >> 172.21.15.76:0/1349496919 conn(0x7f62a0067330 msgr2=0x7f62a00ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:05.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.898+0000 7f62a6a00640 1 -- 172.21.15.76:0/1349496919 shutdown_connections 2024-03-28T12:43:05.897 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:05.898+0000 7f62a6a00640 1 -- 172.21.15.76:0/1349496919 wait complete. 2024-03-28T12:43:05.915 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-28T12:43:06.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.058+0000 7f0d46000640 1 Processor -- start 2024-03-28T12:43:06.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.058+0000 7f0d46000640 1 -- start start 2024-03-28T12:43:06.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.062+0000 7f0d46000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0d400cab80 0x7f0d400cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.062+0000 7f0d46000640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d40158680 con 0x7f0d40152800 2024-03-28T12:43:06.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.062+0000 7f0d46000640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d400cb4f0 con 0x7f0d400cea30 2024-03-28T12:43:06.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.062+0000 7f0d46000640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f0d40159550 con 0x7f0d400cab80 2024-03-28T12:43:06.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.062+0000 7f0d3f400640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f0d40152800 0x7f0d400c97e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:41362/0 (socket says 172.21.15.76:41362) 2024-03-28T12:43:06.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.062+0000 7f0d3f400640 1 -- 172.21.15.76:0/855317908 learned_addr learned my addr 172.21.15.76:0/855317908 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:43:06.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.062+0000 7f0d3fe00640 1 --2- 172.21.15.76:0/855317908 >> v2:172.21.15.111:3300/0 conn(0x7f0d400cab80 0x7f0d400cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.066+0000 7f0d3ea00640 1 -- 172.21.15.76:0/855317908 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 208084059 0 0) 0x7f0d40158680 con 0x7f0d40152800 2024-03-28T12:43:06.062 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.066+0000 7f0d3ea00640 1 -- 172.21.15.76:0/855317908 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d24003530 con 0x7f0d40152800 2024-03-28T12:43:06.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.066+0000 7f0d3fe00640 1 -- 172.21.15.76:0/855317908 >> v1:172.21.15.111:6789/0 conn(0x7f0d400cea30 legacy=0x7f0d40071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:06.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.066+0000 7f0d3fe00640 1 -- 172.21.15.76:0/855317908 >> v1:172.21.15.76:6789/0 conn(0x7f0d40152800 legacy=0x7f0d400c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:06.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.066+0000 7f0d3fe00640 1 -- 172.21.15.76:0/855317908 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d40158940 con 0x7f0d400cab80 2024-03-28T12:43:06.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.074+0000 7f0d3fe00640 1 --2- 172.21.15.76:0/855317908 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d400cab80 0x7f0d400cafb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009d90 tx=0x7f0d3801c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25a1a82619c6b6e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:06.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.078+0000 7f0d3ea00640 1 -- 172.21.15.76:0/855317908 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d380b2070 con 0x7f0d400cab80 2024-03-28T12:43:06.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.078+0000 7f0d3ea00640 1 -- 172.21.15.76:0/855317908 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d380a58e0 con 0x7f0d400cab80 2024-03-28T12:43:06.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.078+0000 7f0d3ea00640 1 -- 172.21.15.76:0/855317908 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d380a5cb0 con 0x7f0d400cab80 2024-03-28T12:43:06.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.078+0000 7f0d46000640 1 -- 172.21.15.76:0/855317908 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d400cab80 msgr2=0x7f0d400cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:06.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.078+0000 7f0d46000640 1 --2- 172.21.15.76:0/855317908 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d400cab80 0x7f0d400cafb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009d90 tx=0x7f0d3801c930 comp rx=0 tx=0).stop 2024-03-28T12:43:06.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.078+0000 7f0d46000640 1 -- 172.21.15.76:0/855317908 shutdown_connections 2024-03-28T12:43:06.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.078+0000 7f0d46000640 1 --2- 172.21.15.76:0/855317908 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d400cab80 0x7f0d400cafb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.078+0000 7f0d46000640 1 -- 172.21.15.76:0/855317908 >> 172.21.15.76:0/855317908 conn(0x7f0d40071540 msgr2=0x7f0d40070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:06.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.078+0000 7f0d46000640 1 -- 172.21.15.76:0/855317908 shutdown_connections 2024-03-28T12:43:06.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.078+0000 7f0d46000640 1 -- 172.21.15.76:0/855317908 wait complete. 2024-03-28T12:43:06.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.082+0000 7f0d46000640 1 Processor -- start 2024-03-28T12:43:06.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.082+0000 7f0d46000640 1 -- start start 2024-03-28T12:43:06.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.082+0000 7f0d46000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0d400cab80 0x7f0d40145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.082+0000 7f0d46000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d400cea30 0x7f0d40151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.082+0000 7f0d46000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d40152800 0x7f0d40151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.082+0000 7f0d46000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0d40072410 con 0x7f0d400cea30 2024-03-28T12:43:06.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.082+0000 7f0d46000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0d400c8d00 con 0x7f0d40152800 2024-03-28T12:43:06.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.082+0000 7f0d46000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f0d40072590 con 0x7f0d400cab80 2024-03-28T12:43:06.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.082+0000 7f0d37e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d400cea30 0x7f0d40151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.086+0000 7f0d3fe00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d40152800 0x7f0d40151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.086+0000 7f0d37e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d400cea30 0x7f0d40151050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55522/0 (socket says 172.21.15.76:55522) 2024-03-28T12:43:06.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.086+0000 7f0d37e00640 1 -- 172.21.15.76:0/4122932070 learned_addr learned my addr 172.21.15.76:0/4122932070 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:06.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.086+0000 7f0d3f400640 1 --2- 172.21.15.76:0/4122932070 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0d400cab80 0x7f0d40145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.086+0000 7f0d37e00640 1 -- 172.21.15.76:0/4122932070 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0d400cab80 msgr2=0x7f0d40145cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:06.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.086+0000 7f0d37e00640 1 --2- 172.21.15.76:0/4122932070 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0d400cab80 0x7f0d40145cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.086+0000 7f0d37e00640 1 -- 172.21.15.76:0/4122932070 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d40152800 msgr2=0x7f0d40151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:06.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.086+0000 7f0d37e00640 1 --2- 172.21.15.76:0/4122932070 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d40152800 0x7f0d40151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.086 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.086+0000 7f0d37e00640 1 -- 172.21.15.76:0/4122932070 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d400c8930 con 0x7f0d400cea30 2024-03-28T12:43:06.087 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.090+0000 7f0d37e00640 1 --2- 172.21.15.76:0/4122932070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d400cea30 0x7f0d40151050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800c490 tx=0x7f0d28001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:06.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.094+0000 7f0d37400640 1 -- 172.21.15.76:0/4122932070 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d28017070 con 0x7f0d400cea30 2024-03-28T12:43:06.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.094+0000 7f0d37400640 1 -- 172.21.15.76:0/4122932070 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d28003600 con 0x7f0d400cea30 2024-03-28T12:43:06.091 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.094+0000 7f0d37400640 1 -- 172.21.15.76:0/4122932070 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d28003a30 con 0x7f0d400cea30 2024-03-28T12:43:06.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.094+0000 7f0d46000640 1 -- 172.21.15.76:0/4122932070 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d400af550 con 0x7f0d400cea30 2024-03-28T12:43:06.092 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.094+0000 7f0d46000640 1 -- 172.21.15.76:0/4122932070 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d40147ef0 con 0x7f0d400cea30 2024-03-28T12:43:06.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.098+0000 7f0d49410000 1 Processor -- start 2024-03-28T12:43:06.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.098+0000 7f0d49410000 1 -- start start 2024-03-28T12:43:06.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.098+0000 7f0d49410000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ad9af0 0x555878a9fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.098+0000 7f0d49410000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9ed0 0x555878aa0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.098+0000 7f0d49410000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ac2210 0x555878ac25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.098+0000 7f0d49410000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5558788ea950 con 0x555878ad9af0 2024-03-28T12:43:06.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.098+0000 7f0d49410000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x555878887990 con 0x555878ad9ed0 2024-03-28T12:43:06.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.098+0000 7f0d49410000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x5558788e6900 con 0x555878ac2210 2024-03-28T12:43:06.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.098+0000 7f0d3f400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9ed0 0x555878aa0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.098+0000 7f0d37e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ac2210 0x555878ac25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.102+0000 7f0d3f400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9ed0 0x555878aa0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:41106/0 (socket says 172.21.15.76:41106) 2024-03-28T12:43:06.098 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.102+0000 7f0d3f400640 1 -- 172.21.15.76:0/254211854 learned_addr learned my addr 172.21.15.76:0/254211854 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:06.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.102+0000 7f0d3f400640 1 -- 172.21.15.76:0/254211854 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ac2210 msgr2=0x555878ac25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:06.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.102+0000 7f0d3f400640 1 --2- 172.21.15.76:0/254211854 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ac2210 0x555878ac25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.102+0000 7f0d3f400640 1 -- 172.21.15.76:0/254211854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ad9af0 msgr2=0x555878a9fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:06.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.102+0000 7f0d3f400640 1 --2- 172.21.15.76:0/254211854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ad9af0 0x555878a9fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.102+0000 7f0d3f400640 1 -- 172.21.15.76:0/254211854 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55587892f100 con 0x555878ad9ed0 2024-03-28T12:43:06.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.106+0000 7f0d3f400640 1 --2- 172.21.15.76:0/254211854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9ed0 0x555878aa0130 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d30001900 tx=0x7f0d30000bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45db34f3dd773723 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:06.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.114+0000 7f0d2fe00640 1 -- 172.21.15.76:0/254211854 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d30005ad0 con 0x555878ad9ed0 2024-03-28T12:43:06.112 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.114+0000 7f0d2fe00640 1 -- 172.21.15.76:0/254211854 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d30018070 con 0x555878ad9ed0 2024-03-28T12:43:06.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.114+0000 7f0d49410000 1 -- 172.21.15.76:0/254211854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9ed0 msgr2=0x555878aa0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:06.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.114+0000 7f0d49410000 1 --2- 172.21.15.76:0/254211854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9ed0 0x555878aa0130 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0d30001900 tx=0x7f0d30000bd0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.114+0000 7f0d49410000 1 -- 172.21.15.76:0/254211854 shutdown_connections 2024-03-28T12:43:06.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.114+0000 7f0d49410000 1 --2- 172.21.15.76:0/254211854 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ac2210 0x555878ac25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.114+0000 7f0d49410000 1 --2- 172.21.15.76:0/254211854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9ed0 0x555878aa0130 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.114+0000 7f0d49410000 1 --2- 172.21.15.76:0/254211854 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ad9af0 0x555878a9fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.113 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.114+0000 7f0d49410000 1 -- 172.21.15.76:0/254211854 >> 172.21.15.76:0/254211854 conn(0x555878982b80 msgr2=0x555878ad93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:06.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.114+0000 7f0d37400640 1 -- 172.21.15.76:0/4122932070 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f0d28003d10 con 0x7f0d400cea30 2024-03-28T12:43:06.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.114+0000 7f0d49410000 1 -- 172.21.15.76:0/254211854 shutdown_connections 2024-03-28T12:43:06.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.114+0000 7f0d49410000 1 -- 172.21.15.76:0/254211854 wait complete. 2024-03-28T12:43:06.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.118+0000 7f0d49410000 1 -- start start 2024-03-28T12:43:06.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.118+0000 7f0d37400640 1 --2- 172.21.15.76:0/4122932070 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0d1c067ee0 0x7f0d1c06a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.118+0000 7f0d49410000 1 Processor -- start 2024-03-28T12:43:06.115 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.118+0000 7f0d3fe00640 1 --2- 172.21.15.76:0/4122932070 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0d1c067ee0 0x7f0d1c06a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.118+0000 7f0d3fe00640 1 --2- 172.21.15.76:0/4122932070 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0d1c067ee0 0x7f0d1c06a3a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0d380af000 tx=0x7f0d38004ac0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:06.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.118+0000 7f0d49410000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ac2210 0x555878aefb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.118+0000 7f0d49410000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9af0 0x555878af0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.118+0000 7f0d49410000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ad9ed0 0x555878a9e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.118+0000 7f0d49410000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5558788b2300 con 0x555878ac2210 2024-03-28T12:43:06.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.118+0000 7f0d49410000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5558788a83e0 con 0x555878ad9af0 2024-03-28T12:43:06.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.118+0000 7f0d49410000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55587886eb10 con 0x555878ad9ed0 2024-03-28T12:43:06.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.118+0000 7f0d49410000 10 client.0 _ll_register_callbacks cb 0x55587894b0f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T12:43:06.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.118+0000 7f0d37400640 1 -- 172.21.15.76:0/4122932070 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f0d28053ea0 con 0x7f0d400cea30 2024-03-28T12:43:06.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.122+0000 7f0d37e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9af0 0x555878af0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.122+0000 7f0d3fe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ad9ed0 0x555878a9e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.122+0000 7f0d37e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9af0 0x555878af0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:41116/0 (socket says 172.21.15.76:41116) 2024-03-28T12:43:06.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.122+0000 7f0d37e00640 1 -- 172.21.15.76:0/3298123013 learned_addr learned my addr 172.21.15.76:0/3298123013 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:06.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.122+0000 7f0d3f400640 1 --2- 172.21.15.76:0/3298123013 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ac2210 0x555878aefb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.126+0000 7f0d3f400640 1 -- 172.21.15.76:0/3298123013 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ad9ed0 msgr2=0x555878a9e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:06.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.126+0000 7f0d3f400640 1 --2- 172.21.15.76:0/3298123013 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ad9ed0 0x555878a9e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.126+0000 7f0d3f400640 1 -- 172.21.15.76:0/3298123013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9af0 msgr2=0x555878af0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:06.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.126+0000 7f0d3f400640 1 --2- 172.21.15.76:0/3298123013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9af0 0x555878af0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.126+0000 7f0d3f400640 1 -- 172.21.15.76:0/3298123013 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558788b48c0 con 0x555878ac2210 2024-03-28T12:43:06.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.126+0000 7f0d3f400640 1 --2- 172.21.15.76:0/3298123013 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ac2210 0x555878aefb10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0d30017000 tx=0x7f0d300010b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e56720079536d61d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:06.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.126+0000 7f0d2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-03-28T12:43:06.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.130+0000 7f0d2cc00640 1 -- 172.21.15.76:0/3298123013 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d300049f0 con 0x555878ac2210 2024-03-28T12:43:06.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.130+0000 7f0d2cc00640 1 -- 172.21.15.76:0/3298123013 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f0d30004b90 con 0x555878ac2210 2024-03-28T12:43:06.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.130+0000 7f0d49410000 1 -- 172.21.15.76:0/3298123013 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d30018070 con 0x555878ac2210 2024-03-28T12:43:06.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.134+0000 7f0d2cc00640 1 -- 172.21.15.76:0/3298123013 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f0d3002b050 con 0x555878ac2210 2024-03-28T12:43:06.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.134+0000 7f0d49410000 10 client.4677 fetch_fsmap learned FSMap version 17 2024-03-28T12:43:06.130 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.134+0000 7f0d49410000 1 -- 172.21.15.76:0/3298123013 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x555878872e80 con 0x555878ac2210 2024-03-28T12:43:06.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.138+0000 7f0d2cc00640 1 -- 172.21.15.76:0/3298123013 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d30018070 con 0x555878ac2210 2024-03-28T12:43:06.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.138+0000 7f0d2cc00640 1 -- 172.21.15.76:0/3298123013 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f0d3002e020 con 0x555878ac2210 2024-03-28T12:43:06.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.138+0000 7f0d49410000 10 client.4677 fetch_fsmap finished waiting for FSMap version 17 2024-03-28T12:43:06.134 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.138+0000 7f0d49410000 10 client.4677 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-28T12:43:06.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.138+0000 7f0d49410000 20 client.4677 populate_metadata read hostname 'smithi076' 2024-03-28T12:43:06.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.138+0000 7f0d49410000 1 --2- 172.21.15.76:0/3298123013 >> [v2:172.21.15.76:6838/2729208421,v1:172.21.15.76:6839/2729208421] conn(0x555878aedee0 0x555878aee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.138+0000 7f0d49410000 4 client.4677 mds_command: new command op to 4248 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T12:43:06.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.138+0000 7f0d49410000 1 -- 172.21.15.76:0/3298123013 --> [v2:172.21.15.76:6838/2729208421,v1:172.21.15.76:6839/2729208421] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555878885bc0 con 0x555878aedee0 2024-03-28T12:43:06.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.150+0000 7f0d37e00640 1 --2- 172.21.15.76:0/3298123013 >> [v2:172.21.15.76:6838/2729208421,v1:172.21.15.76:6839/2729208421] conn(0x555878aedee0 0x555878aee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.238+0000 7f0d37e00640 1 --2- 172.21.15.76:0/3298123013 >> [v2:172.21.15.76:6838/2729208421,v1:172.21.15.76:6839/2729208421] conn(0x555878aedee0 0x555878aee2c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dbc8318df93d6efa server_cookie=66420ff9dd46fbc1 in_seq=0 out_seq=0 2024-03-28T12:43:06.236 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.238+0000 7f0d2cc00640 10 client.4677 ms_handle_connect on v2:172.21.15.76:6838/2729208421 2024-03-28T12:43:06.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.374+0000 7f0d2cc00640 1 -- 172.21.15.76:0/3298123013 <== mds.3 v2:172.21.15.76:6838/2729208421 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555878885bc0 con 0x555878aedee0 2024-03-28T12:43:06.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.374+0000 7f0d2cc00640 10 client.4677 handle_command_reply: tid=0 2024-03-28T12:43:06.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.374+0000 7f0d49410000 1 client.4677 shutdown 2024-03-28T12:43:06.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.374+0000 7f0d49410000 1 -- 172.21.15.76:0/3298123013 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ac2210 msgr2=0x555878aefb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.374+0000 7f0d49410000 1 --2- 172.21.15.76:0/3298123013 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ac2210 0x555878aefb10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0d30017000 tx=0x7f0d300010b0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.374+0000 7f0d49410000 1 -- 172.21.15.76:0/3298123013 shutdown_connections 2024-03-28T12:43:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.374+0000 7f0d49410000 1 --2- 172.21.15.76:0/3298123013 >> [v2:172.21.15.76:6838/2729208421,v1:172.21.15.76:6839/2729208421] conn(0x555878aedee0 0x555878aee2c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.374+0000 7f0d49410000 1 --2- 172.21.15.76:0/3298123013 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ad9ed0 0x555878a9e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.374+0000 7f0d49410000 1 --2- 172.21.15.76:0/3298123013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9af0 0x555878af0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.374+0000 7f0d49410000 1 --2- 172.21.15.76:0/3298123013 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ac2210 0x555878aefb10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.374+0000 7f0d49410000 1 -- 172.21.15.76:0/3298123013 >> 172.21.15.76:0/3298123013 conn(0x555878982b80 msgr2=0x555878ad8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.374+0000 7f0d2cc00640 0 client.4677 ms_handle_reset on v2:172.21.15.76:6838/2729208421 2024-03-28T12:43:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.374+0000 7f0d49410000 1 -- 172.21.15.76:0/3298123013 shutdown_connections 2024-03-28T12:43:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.374+0000 7f0d49410000 1 -- 172.21.15.76:0/3298123013 wait complete. 2024-03-28T12:43:06.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.374+0000 7f0d49410000 20 client.4677 trim_cache size 0 max 16384 2024-03-28T12:43:06.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.390+0000 7f0d49410000 1 Processor -- start 2024-03-28T12:43:06.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.390+0000 7f0d49410000 1 -- start start 2024-03-28T12:43:06.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.394+0000 7f0d49410000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ac2210 0x555878a9e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.394+0000 7f0d49410000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ad9af0 0x555878aff170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.394+0000 7f0d49410000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9ed0 0x555878aff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.394+0000 7f0d49410000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0d401f7410 con 0x555878ac2210 2024-03-28T12:43:06.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.394+0000 7f0d49410000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5558788f7060 con 0x555878ad9ed0 2024-03-28T12:43:06.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.394+0000 7f0d49410000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x5558788e9c60 con 0x555878ad9af0 2024-03-28T12:43:06.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.394+0000 7f0d3f400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ac2210 0x555878a9e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.394+0000 7f0d3f400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ac2210 0x555878a9e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55544/0 (socket says 172.21.15.76:55544) 2024-03-28T12:43:06.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.394+0000 7f0d3f400640 1 -- 172.21.15.76:0/640474664 learned_addr learned my addr 172.21.15.76:0/640474664 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:06.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.394+0000 7f0d3fe00640 1 --2- 172.21.15.76:0/640474664 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9ed0 0x555878aff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.394+0000 7f0d37e00640 1 --2- 172.21.15.76:0/640474664 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ad9af0 0x555878aff170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.398+0000 7f0d3f400640 1 -- 172.21.15.76:0/640474664 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ad9af0 msgr2=0x555878aff170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:06.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.398+0000 7f0d3f400640 1 --2- 172.21.15.76:0/640474664 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ad9af0 0x555878aff170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.398+0000 7f0d3f400640 1 -- 172.21.15.76:0/640474664 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9ed0 msgr2=0x555878aff6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:06.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.398+0000 7f0d3f400640 1 --2- 172.21.15.76:0/640474664 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9ed0 0x555878aff6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.398+0000 7f0d3f400640 1 -- 172.21.15.76:0/640474664 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558788a5490 con 0x555878ac2210 2024-03-28T12:43:06.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.398+0000 7f0d3f400640 1 --2- 172.21.15.76:0/640474664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ac2210 0x555878a9e780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0d30001850 tx=0x7f0d3001f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2864f419d618489a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:06.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.402+0000 7f0d2f400640 1 -- 172.21.15.76:0/640474664 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d30034070 con 0x555878ac2210 2024-03-28T12:43:06.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.402+0000 7f0d2f400640 1 -- 172.21.15.76:0/640474664 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d30018040 con 0x555878ac2210 2024-03-28T12:43:06.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.402+0000 7f0d2f400640 1 -- 172.21.15.76:0/640474664 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d30007430 con 0x555878ac2210 2024-03-28T12:43:06.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.402+0000 7f0d49410000 1 -- 172.21.15.76:0/640474664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ac2210 msgr2=0x555878a9e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:06.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.402+0000 7f0d49410000 1 --2- 172.21.15.76:0/640474664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ac2210 0x555878a9e780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0d30001850 tx=0x7f0d3001f070 comp rx=0 tx=0).stop 2024-03-28T12:43:06.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.402+0000 7f0d49410000 1 -- 172.21.15.76:0/640474664 shutdown_connections 2024-03-28T12:43:06.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.402+0000 7f0d49410000 1 --2- 172.21.15.76:0/640474664 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ad9ed0 0x555878aff6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.402+0000 7f0d49410000 1 --2- 172.21.15.76:0/640474664 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ad9af0 0x555878aff170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.402+0000 7f0d49410000 1 --2- 172.21.15.76:0/640474664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ac2210 0x555878a9e780 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.402+0000 7f0d49410000 1 -- 172.21.15.76:0/640474664 >> 172.21.15.76:0/640474664 conn(0x555878982b80 msgr2=0x555878ae98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:06.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.402+0000 7f0d49410000 1 -- 172.21.15.76:0/640474664 shutdown_connections 2024-03-28T12:43:06.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.402+0000 7f0d49410000 1 -- 172.21.15.76:0/640474664 wait complete. 2024-03-28T12:43:06.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.406+0000 7f0d49410000 1 -- start start 2024-03-28T12:43:06.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.406+0000 7f0d49410000 1 Processor -- start 2024-03-28T12:43:06.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.406+0000 7f0d49410000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ac2210 0x555878b59390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.406+0000 7f0d49410000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ad9af0 0x555878b56ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.406+0000 7f0d49410000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ad9ed0 0x555878b573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.406+0000 7f0d49410000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x555878890e80 con 0x555878ad9af0 2024-03-28T12:43:06.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.406+0000 7f0d49410000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5558788827b0 con 0x555878ac2210 2024-03-28T12:43:06.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.406+0000 7f0d49410000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x5558788eef80 con 0x555878ad9ed0 2024-03-28T12:43:06.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.406+0000 7f0d49410000 10 client.0 _ll_register_callbacks cb 0x7f0d28015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T12:43:06.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.406+0000 7f0d37e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ad9af0 0x555878b56ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.406+0000 7f0d3fe00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ad9ed0 0x555878b573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.406+0000 7f0d37e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ad9af0 0x555878b56ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55548/0 (socket says 172.21.15.76:55548) 2024-03-28T12:43:06.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.406+0000 7f0d37e00640 1 -- 172.21.15.76:0/2729454166 learned_addr learned my addr 172.21.15.76:0/2729454166 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:06.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.406+0000 7f0d3f400640 1 --2- 172.21.15.76:0/2729454166 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ac2210 0x555878b59390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.410+0000 7f0d37e00640 1 -- 172.21.15.76:0/2729454166 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ad9ed0 msgr2=0x555878b573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:06.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.410+0000 7f0d37e00640 1 --2- 172.21.15.76:0/2729454166 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ad9ed0 0x555878b573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.410+0000 7f0d37e00640 1 -- 172.21.15.76:0/2729454166 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ac2210 msgr2=0x555878b59390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:06.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.410+0000 7f0d37e00640 1 --2- 172.21.15.76:0/2729454166 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ac2210 0x555878b59390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.410+0000 7f0d37e00640 1 -- 172.21.15.76:0/2729454166 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558788a3e80 con 0x555878ad9af0 2024-03-28T12:43:06.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.414+0000 7f0d37e00640 1 --2- 172.21.15.76:0/2729454166 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ad9af0 0x555878b56ea0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0d28055d90 tx=0x7f0d28084060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963826a928064f21 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:06.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.414+0000 7f0d2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-03-28T12:43:06.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.418+0000 7f0d2cc00640 1 -- 172.21.15.76:0/2729454166 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d280525f0 con 0x555878ad9af0 2024-03-28T12:43:06.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.418+0000 7f0d2cc00640 1 -- 172.21.15.76:0/2729454166 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f0d2805c300 con 0x555878ad9af0 2024-03-28T12:43:06.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.418+0000 7f0d49410000 1 -- 172.21.15.76:0/2729454166 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d30018040 con 0x555878ad9af0 2024-03-28T12:43:06.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.422+0000 7f0d2cc00640 1 -- 172.21.15.76:0/2729454166 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f0d28079050 con 0x555878ad9af0 2024-03-28T12:43:06.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.422+0000 7f0d49410000 10 client.4683 fetch_fsmap learned FSMap version 17 2024-03-28T12:43:06.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.422+0000 7f0d49410000 1 -- 172.21.15.76:0/2729454166 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x555878891270 con 0x555878ad9af0 2024-03-28T12:43:06.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.430+0000 7f0d2cc00640 1 -- 172.21.15.76:0/2729454166 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d30018040 con 0x555878ad9af0 2024-03-28T12:43:06.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.430+0000 7f0d2cc00640 1 -- 172.21.15.76:0/2729454166 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f0d2807d6b0 con 0x555878ad9af0 2024-03-28T12:43:06.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.430+0000 7f0d49410000 10 client.4683 fetch_fsmap finished waiting for FSMap version 17 2024-03-28T12:43:06.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.430+0000 7f0d49410000 10 client.4683 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-28T12:43:06.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.430+0000 7f0d49410000 20 client.4683 populate_metadata read hostname 'smithi076' 2024-03-28T12:43:06.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.430+0000 7f0d49410000 1 --2- 172.21.15.76:0/2729454166 >> [v2:172.21.15.76:6838/2729208421,v1:172.21.15.76:6839/2729208421] conn(0x555878b55b80 0x555878b55f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.430+0000 7f0d49410000 4 client.4683 mds_command: new command op to 4248 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-28T12:43:06.429 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.430+0000 7f0d49410000 1 -- 172.21.15.76:0/2729454166 --> [v2:172.21.15.76:6838/2729208421,v1:172.21.15.76:6839/2729208421] -- command(tid 0: {"prefix": "status"}) -- 0x5558788f7e90 con 0x555878b55b80 2024-03-28T12:43:06.430 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.430+0000 7f0d3f400640 1 --2- 172.21.15.76:0/2729454166 >> [v2:172.21.15.76:6838/2729208421,v1:172.21.15.76:6839/2729208421] conn(0x555878b55b80 0x555878b55f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.438+0000 7f0d3f400640 1 --2- 172.21.15.76:0/2729454166 >> [v2:172.21.15.76:6838/2729208421,v1:172.21.15.76:6839/2729208421] conn(0x555878b55b80 0x555878b55f60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2e3484df3b2d3827 server_cookie=8b25251e3abd6ef1 in_seq=0 out_seq=0 2024-03-28T12:43:06.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.438+0000 7f0d2cc00640 10 client.4683 ms_handle_connect on v2:172.21.15.76:6838/2729208421 2024-03-28T12:43:06.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d2cc00640 1 -- 172.21.15.76:0/2729454166 <== mds.3 v2:172.21.15.76:6838/2729208421 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x5558788f7e90 con 0x555878b55b80 2024-03-28T12:43:06.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d2cc00640 10 client.4683 handle_command_reply: tid=0 2024-03-28T12:43:06.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d49410000 1 client.4683 shutdown 2024-03-28T12:43:06.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d49410000 1 -- 172.21.15.76:0/2729454166 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ad9af0 msgr2=0x555878b56ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:06.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d49410000 1 --2- 172.21.15.76:0/2729454166 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ad9af0 0x555878b56ea0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0d28055d90 tx=0x7f0d28084060 comp rx=0 tx=0).stop 2024-03-28T12:43:06.460 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d49410000 1 -- 172.21.15.76:0/2729454166 shutdown_connections 2024-03-28T12:43:06.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d49410000 1 --2- 172.21.15.76:0/2729454166 >> [v2:172.21.15.76:6838/2729208421,v1:172.21.15.76:6839/2729208421] conn(0x555878b55b80 0x555878b55f60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d49410000 1 --2- 172.21.15.76:0/2729454166 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x555878ad9ed0 0x555878b573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d49410000 1 --2- 172.21.15.76:0/2729454166 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x555878ad9af0 0x555878b56ea0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d2cc00640 0 client.4683 ms_handle_reset on v2:172.21.15.76:6838/2729208421 2024-03-28T12:43:06.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d49410000 1 --2- 172.21.15.76:0/2729454166 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x555878ac2210 0x555878b59390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d49410000 1 -- 172.21.15.76:0/2729454166 >> 172.21.15.76:0/2729454166 conn(0x555878982b80 msgr2=0x555878ae98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:06.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d49410000 1 -- 172.21.15.76:0/2729454166 shutdown_connections 2024-03-28T12:43:06.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d49410000 1 -- 172.21.15.76:0/2729454166 wait complete. 2024-03-28T12:43:06.461 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d49410000 20 client.4683 trim_cache size 0 max 16384 2024-03-28T12:43:06.462 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-03-28T12:43:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "ed125c42-99c2-4574-a55f-ea7172f89d9c", 2024-03-28T12:43:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 3, 2024-03-28T12:43:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 4248, 2024-03-28T12:43:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-03-28T12:43:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-03-28T12:43:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-03-28T12:43:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 23.922194378, 2024-03-28T12:43:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 17, 2024-03-28T12:43:06.462 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 29, 2024-03-28T12:43:06.463 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 29, 2024-03-28T12:43:06.463 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 92.621635368 2024-03-28T12:43:06.463 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-03-28T12:43:06.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d46000640 1 -- 172.21.15.76:0/4122932070 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0d1c067ee0 msgr2=0x7f0d1c06a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:06.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d46000640 1 --2- 172.21.15.76:0/4122932070 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0d1c067ee0 0x7f0d1c06a3a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0d380af000 tx=0x7f0d38004ac0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d46000640 1 -- 172.21.15.76:0/4122932070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d400cea30 msgr2=0x7f0d40151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:06.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d46000640 1 --2- 172.21.15.76:0/4122932070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d400cea30 0x7f0d40151050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800c490 tx=0x7f0d28001e80 comp rx=0 tx=0).stop 2024-03-28T12:43:06.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d46000640 1 -- 172.21.15.76:0/4122932070 shutdown_connections 2024-03-28T12:43:06.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d46000640 1 --2- 172.21.15.76:0/4122932070 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0d1c067ee0 0x7f0d1c06a3a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d46000640 1 --2- 172.21.15.76:0/4122932070 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d40152800 0x7f0d40151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d46000640 1 --2- 172.21.15.76:0/4122932070 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d400cea30 0x7f0d40151050 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d46000640 1 --2- 172.21.15.76:0/4122932070 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0d400cab80 0x7f0d40145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.462+0000 7f0d46000640 1 -- 172.21.15.76:0/4122932070 >> 172.21.15.76:0/4122932070 conn(0x7f0d40071540 msgr2=0x7f0d400ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:06.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.466+0000 7f0d46000640 1 -- 172.21.15.76:0/4122932070 shutdown_connections 2024-03-28T12:43:06.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.466+0000 7f0d46000640 1 -- 172.21.15.76:0/4122932070 wait complete. 2024-03-28T12:43:06.484 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-28T12:43:06.580 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:43:06.583 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:43:06.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.634+0000 7f487d800640 1 Processor -- start 2024-03-28T12:43:06.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.634+0000 7f487d800640 1 -- start start 2024-03-28T12:43:06.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.634+0000 7f487d800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48781528d0 0x7f4878070810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.634+0000 7f487d800640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f48780c95a0 0x7f4878070d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.634+0000 7f487d800640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f487806b5a0 con 0x7f48781524f0 2024-03-28T12:43:06.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.634+0000 7f487d800640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f48781583d0 con 0x7f48780c95a0 2024-03-28T12:43:06.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.634+0000 7f487d800640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f487815c8a0 con 0x7f48781528d0 2024-03-28T12:43:06.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.638+0000 7f4877400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48781528d0 0x7f4878070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.638+0000 7f487ce00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f48780c95a0 0x7f4878070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.638+0000 7f487ce00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f48780c95a0 0x7f4878070d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:41142/0 (socket says 172.21.15.76:41142) 2024-03-28T12:43:06.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.638+0000 7f487ce00640 1 -- 172.21.15.76:0/3989392988 learned_addr learned my addr 172.21.15.76:0/3989392988 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:06.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.642+0000 7f487ce00640 1 -- 172.21.15.76:0/3989392988 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48781528d0 msgr2=0x7f4878070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:06.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.642+0000 7f487ce00640 1 --2- 172.21.15.76:0/3989392988 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48781528d0 0x7f4878070810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.642+0000 7f487ce00640 1 -- 172.21.15.76:0/3989392988 >> v1:172.21.15.111:6789/0 conn(0x7f48781524f0 legacy=0x7f4878158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:06.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.642+0000 7f487ce00640 1 -- 172.21.15.76:0/3989392988 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48780c81a0 con 0x7f48780c95a0 2024-03-28T12:43:06.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.646+0000 7f487ce00640 1 --2- 172.21.15.76:0/3989392988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f48780c95a0 0x7f4878070d50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4870009e50 tx=0x7f487001c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df8eb56b2619e961 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:06.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.654+0000 7f4876a00640 1 -- 172.21.15.76:0/3989392988 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48700a56d0 con 0x7f48780c95a0 2024-03-28T12:43:06.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.654+0000 7f4876a00640 1 -- 172.21.15.76:0/3989392988 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48700a5870 con 0x7f48780c95a0 2024-03-28T12:43:06.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.654+0000 7f4876a00640 1 -- 172.21.15.76:0/3989392988 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48700a5c40 con 0x7f48780c95a0 2024-03-28T12:43:06.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.654+0000 7f487d800640 1 -- 172.21.15.76:0/3989392988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f48780c95a0 msgr2=0x7f4878070d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:06.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.654+0000 7f487d800640 1 --2- 172.21.15.76:0/3989392988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f48780c95a0 0x7f4878070d50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4870009e50 tx=0x7f487001c960 comp rx=0 tx=0).stop 2024-03-28T12:43:06.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.654+0000 7f487d800640 1 -- 172.21.15.76:0/3989392988 shutdown_connections 2024-03-28T12:43:06.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.654+0000 7f487d800640 1 --2- 172.21.15.76:0/3989392988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f48780c95a0 0x7f4878070d50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.653 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.654+0000 7f487d800640 1 --2- 172.21.15.76:0/3989392988 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48781528d0 0x7f4878070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.654+0000 7f487d800640 1 -- 172.21.15.76:0/3989392988 >> 172.21.15.76:0/3989392988 conn(0x7f4878073520 msgr2=0x7f48780ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:06.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.654+0000 7f487d800640 1 -- 172.21.15.76:0/3989392988 shutdown_connections 2024-03-28T12:43:06.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.654+0000 7f487d800640 1 -- 172.21.15.76:0/3989392988 wait complete. 2024-03-28T12:43:06.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.658+0000 7f487d800640 1 Processor -- start 2024-03-28T12:43:06.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.658+0000 7f487d800640 1 -- start start 2024-03-28T12:43:06.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.658+0000 7f487d800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f48780c95a0 0x7f4878156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.658+0000 7f487d800640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f48781524f0 0x7f48781f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.658+0000 7f487d800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48781528d0 0x7f48781f3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.658+0000 7f487d800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4878165570 con 0x7f48780c95a0 2024-03-28T12:43:06.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.658+0000 7f487d800640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f48780c7970 con 0x7f48781524f0 2024-03-28T12:43:06.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.658+0000 7f487d800640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f48781656f0 con 0x7f48781528d0 2024-03-28T12:43:06.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.662+0000 7f4877e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f48780c95a0 0x7f4878156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.662+0000 7f487ce00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48781528d0 0x7f48781f3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.662+0000 7f4877400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f48781524f0 0x7f48781f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.662+0000 7f4877e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f48780c95a0 0x7f4878156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55558/0 (socket says 172.21.15.76:55558) 2024-03-28T12:43:06.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.662+0000 7f4877e00640 1 -- 172.21.15.76:0/3089946561 learned_addr learned my addr 172.21.15.76:0/3089946561 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:06.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.666+0000 7f4877400640 1 -- 172.21.15.76:0/3089946561 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48781528d0 msgr2=0x7f48781f3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:06.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.666+0000 7f4877400640 1 --2- 172.21.15.76:0/3089946561 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48781528d0 0x7f48781f3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.666+0000 7f4877400640 1 -- 172.21.15.76:0/3089946561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f48780c95a0 msgr2=0x7f4878156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:06.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.666+0000 7f4877400640 1 --2- 172.21.15.76:0/3089946561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f48780c95a0 0x7f4878156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.666+0000 7f4877400640 1 -- 172.21.15.76:0/3089946561 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48781469c0 con 0x7f48781524f0 2024-03-28T12:43:06.667 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.670+0000 7f4877400640 1 --2- 172.21.15.76:0/3089946561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f48781524f0 0x7f48781f3610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f486400e870 tx=0x7f486400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:06.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.674+0000 7f486fe00640 1 -- 172.21.15.76:0/3089946561 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864017070 con 0x7f48781524f0 2024-03-28T12:43:06.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.674+0000 7f486fe00640 1 -- 172.21.15.76:0/3089946561 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f486400c940 con 0x7f48781524f0 2024-03-28T12:43:06.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.674+0000 7f486fe00640 1 -- 172.21.15.76:0/3089946561 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486400ccf0 con 0x7f48781524f0 2024-03-28T12:43:06.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.674+0000 7f487d800640 1 -- 172.21.15.76:0/3089946561 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48781f6d20 con 0x7f48781524f0 2024-03-28T12:43:06.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.674+0000 7f487d800640 1 -- 172.21.15.76:0/3089946561 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48781f72e0 con 0x7f48781524f0 2024-03-28T12:43:06.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.678+0000 7f488226c000 1 Processor -- start 2024-03-28T12:43:06.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.678+0000 7f488226c000 1 -- start start 2024-03-28T12:43:06.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.678+0000 7f488226c000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973297af0 0x55997325dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.677 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.678+0000 7f488226c000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 0x55997325e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.678+0000 7f488226c000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973280210 0x5599732805f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.678+0000 7f488226c000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5599730a8950 con 0x559973297ed0 2024-03-28T12:43:06.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.678+0000 7f488226c000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x559973045990 con 0x559973297af0 2024-03-28T12:43:06.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.678+0000 7f488226c000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x5599730a4900 con 0x559973280210 2024-03-28T12:43:06.678 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.682+0000 7f4877e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 0x55997325e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.682+0000 7f4877400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973280210 0x5599732805f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.682+0000 7f4877e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 0x55997325e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55564/0 (socket says 172.21.15.76:55564) 2024-03-28T12:43:06.679 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.682+0000 7f4877e00640 1 -- 172.21.15.76:0/3795319525 learned_addr learned my addr 172.21.15.76:0/3795319525 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:06.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.686+0000 7f4877e00640 1 -- 172.21.15.76:0/3795319525 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973280210 msgr2=0x5599732805f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:06.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.686+0000 7f4877e00640 1 --2- 172.21.15.76:0/3795319525 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973280210 0x5599732805f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.686+0000 7f4877e00640 1 -- 172.21.15.76:0/3795319525 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973297af0 msgr2=0x55997325dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:06.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.686+0000 7f4877e00640 1 --2- 172.21.15.76:0/3795319525 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973297af0 0x55997325dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.683 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.686+0000 7f4877e00640 1 -- 172.21.15.76:0/3795319525 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599730ed100 con 0x559973297ed0 2024-03-28T12:43:06.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.686+0000 7f4877e00640 1 --2- 172.21.15.76:0/3795319525 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 0x55997325e130 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4868005180 tx=0x7f4868007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a17033cb161247 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:06.690 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.694+0000 7f486cc00640 1 -- 172.21.15.76:0/3795319525 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4868018020 con 0x559973297ed0 2024-03-28T12:43:06.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.694+0000 7f486cc00640 1 -- 172.21.15.76:0/3795319525 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f486800fba0 con 0x559973297ed0 2024-03-28T12:43:06.691 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.694+0000 7f486cc00640 1 -- 172.21.15.76:0/3795319525 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4868014470 con 0x559973297ed0 2024-03-28T12:43:06.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.694+0000 7f488226c000 1 -- 172.21.15.76:0/3795319525 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 msgr2=0x55997325e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:06.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.694+0000 7f488226c000 1 --2- 172.21.15.76:0/3795319525 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 0x55997325e130 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4868005180 tx=0x7f4868007f00 comp rx=0 tx=0).stop 2024-03-28T12:43:06.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.694+0000 7f488226c000 1 -- 172.21.15.76:0/3795319525 shutdown_connections 2024-03-28T12:43:06.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.694+0000 7f488226c000 1 --2- 172.21.15.76:0/3795319525 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973280210 0x5599732805f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.694+0000 7f488226c000 1 --2- 172.21.15.76:0/3795319525 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 0x55997325e130 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.694+0000 7f488226c000 1 --2- 172.21.15.76:0/3795319525 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973297af0 0x55997325dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.694+0000 7f488226c000 1 -- 172.21.15.76:0/3795319525 >> 172.21.15.76:0/3795319525 conn(0x559973140b80 msgr2=0x5599732973e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:06.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.694+0000 7f488226c000 1 -- 172.21.15.76:0/3795319525 shutdown_connections 2024-03-28T12:43:06.692 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.694+0000 7f488226c000 1 -- 172.21.15.76:0/3795319525 wait complete. 2024-03-28T12:43:06.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.694+0000 7f488226c000 1 -- start start 2024-03-28T12:43:06.693 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.694+0000 7f488226c000 1 Processor -- start 2024-03-28T12:43:06.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.694+0000 7f488226c000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973280210 0x5599732a5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.694+0000 7f488226c000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973297af0 0x5599732a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.698+0000 7f488226c000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 0x55997325c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.698+0000 7f488226c000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x559973070300 con 0x559973297ed0 2024-03-28T12:43:06.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.698+0000 7f488226c000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5599730663e0 con 0x559973280210 2024-03-28T12:43:06.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.698+0000 7f488226c000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55997302cb10 con 0x559973297af0 2024-03-28T12:43:06.694 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.698+0000 7f488226c000 10 client.0 _ll_register_callbacks cb 0x5599731090f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T12:43:06.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.698+0000 7f4877e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973297af0 0x5599732a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.698+0000 7f4877400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 0x55997325c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.698+0000 7f4877400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 0x55997325c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55572/0 (socket says 172.21.15.76:55572) 2024-03-28T12:43:06.695 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.698+0000 7f4877400640 1 -- 172.21.15.76:0/3121285022 learned_addr learned my addr 172.21.15.76:0/3121285022 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:06.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.702+0000 7f4877400640 1 -- 172.21.15.76:0/3121285022 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973297af0 msgr2=0x5599732a5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:06.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.702+0000 7f4877400640 1 --2- 172.21.15.76:0/3121285022 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973297af0 0x5599732a5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.702+0000 7f4877400640 1 -- 172.21.15.76:0/3121285022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973280210 msgr2=0x5599732a5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:06.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.702+0000 7f4877400640 1 --2- 172.21.15.76:0/3121285022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973280210 0x5599732a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:06.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.702+0000 7f4877400640 1 -- 172.21.15.76:0/3121285022 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599730728c0 con 0x559973297ed0 2024-03-28T12:43:06.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.706+0000 7f4877400640 1 --2- 172.21.15.76:0/3121285022 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 0x55997325c780 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f48781500a0 tx=0x7f48640046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4dbccd82177130 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:06.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.706+0000 7f4861600640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-03-28T12:43:06.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.706+0000 7f4861600640 1 -- 172.21.15.76:0/3121285022 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864021060 con 0x559973297ed0 2024-03-28T12:43:06.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.706+0000 7f488226c000 1 -- 172.21.15.76:0/3121285022 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f486800fba0 con 0x559973297ed0 2024-03-28T12:43:06.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.710+0000 7f4861600640 1 -- 172.21.15.76:0/3121285022 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f4864013dd0 con 0x559973297ed0 2024-03-28T12:43:06.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.714+0000 7f486fe00640 1 -- 172.21.15.76:0/3089946561 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f486402f070 con 0x7f48781524f0 2024-03-28T12:43:06.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.714+0000 7f4861600640 1 -- 172.21.15.76:0/3121285022 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f48640899f0 con 0x559973297ed0 2024-03-28T12:43:06.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.714+0000 7f488226c000 10 client.4692 fetch_fsmap learned FSMap version 17 2024-03-28T12:43:06.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.714+0000 7f488226c000 1 -- 172.21.15.76:0/3121285022 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x559973030e80 con 0x559973297ed0 2024-03-28T12:43:06.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.714+0000 7f486fe00640 1 --2- 172.21.15.76:0/3089946561 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f4858067f80 0x7f485806a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.713 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.714+0000 7f487ce00640 1 --2- 172.21.15.76:0/3089946561 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f4858067f80 0x7f485806a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.718+0000 7f487ce00640 1 --2- 172.21.15.76:0/3089946561 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f4858067f80 0x7f485806a440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f48700ae000 tx=0x7f4870004a50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:06.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.718+0000 7f4861600640 1 -- 172.21.15.76:0/3121285022 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f486408f020 con 0x559973297ed0 2024-03-28T12:43:06.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.718+0000 7f486fe00640 1 -- 172.21.15.76:0/3089946561 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f4864090080 con 0x7f48781524f0 2024-03-28T12:43:06.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.722+0000 7f4861600640 1 -- 172.21.15.76:0/3121285022 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f4864057730 con 0x559973297ed0 2024-03-28T12:43:06.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.722+0000 7f488226c000 10 client.4692 fetch_fsmap finished waiting for FSMap version 17 2024-03-28T12:43:06.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.722+0000 7f488226c000 10 client.4692 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-28T12:43:06.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.722+0000 7f488226c000 20 client.4692 populate_metadata read hostname 'smithi076' 2024-03-28T12:43:06.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.722+0000 7f488226c000 1 --2- 172.21.15.76:0/3121285022 >> [v2:172.21.15.111:6836/4176441330,v1:172.21.15.111:6837/4176441330] conn(0x5599732a3b20 0x5599732a3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:06.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.722+0000 7f488226c000 4 client.4692 mds_command: new command op to 4251 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T12:43:06.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.722+0000 7f488226c000 1 -- 172.21.15.76:0/3121285022 --> [v2:172.21.15.111:6836/4176441330,v1:172.21.15.111:6837/4176441330] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559973043bc0 con 0x5599732a3b20 2024-03-28T12:43:06.727 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.730+0000 7f4877e00640 1 --2- 172.21.15.76:0/3121285022 >> [v2:172.21.15.111:6836/4176441330,v1:172.21.15.111:6837/4176441330] conn(0x5599732a3b20 0x5599732a3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:06.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.818+0000 7f4877e00640 1 --2- 172.21.15.76:0/3121285022 >> [v2:172.21.15.111:6836/4176441330,v1:172.21.15.111:6837/4176441330] conn(0x5599732a3b20 0x5599732a3f00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=114ff608ec07628 server_cookie=8332b160dd7006c in_seq=0 out_seq=0 2024-03-28T12:43:06.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:06.818+0000 7f4861600640 10 client.4692 ms_handle_connect on v2:172.21.15.111:6836/4176441330 2024-03-28T12:43:07.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.014+0000 7f4861600640 1 -- 172.21.15.76:0/3121285022 <== mds.2 v2:172.21.15.111:6836/4176441330 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559973043bc0 con 0x5599732a3b20 2024-03-28T12:43:07.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.014+0000 7f4861600640 10 client.4692 handle_command_reply: tid=0 2024-03-28T12:43:07.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.014+0000 7f488226c000 1 client.4692 shutdown 2024-03-28T12:43:07.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.014+0000 7f488226c000 1 -- 172.21.15.76:0/3121285022 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 msgr2=0x55997325c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:07.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.014+0000 7f488226c000 1 --2- 172.21.15.76:0/3121285022 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 0x55997325c780 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f48781500a0 tx=0x7f48640046d0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.014+0000 7f488226c000 1 -- 172.21.15.76:0/3121285022 shutdown_connections 2024-03-28T12:43:07.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.014+0000 7f488226c000 1 --2- 172.21.15.76:0/3121285022 >> [v2:172.21.15.111:6836/4176441330,v1:172.21.15.111:6837/4176441330] conn(0x5599732a3b20 0x5599732a3f00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.014+0000 7f488226c000 1 --2- 172.21.15.76:0/3121285022 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 0x55997325c780 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.014+0000 7f488226c000 1 --2- 172.21.15.76:0/3121285022 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973297af0 0x5599732a5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.014+0000 7f488226c000 1 --2- 172.21.15.76:0/3121285022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973280210 0x5599732a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.014+0000 7f488226c000 1 -- 172.21.15.76:0/3121285022 >> 172.21.15.76:0/3121285022 conn(0x559973140b80 msgr2=0x559973296e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:07.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.014+0000 7f4861600640 0 client.4692 ms_handle_reset on v2:172.21.15.111:6836/4176441330 2024-03-28T12:43:07.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.014+0000 7f488226c000 1 -- 172.21.15.76:0/3121285022 shutdown_connections 2024-03-28T12:43:07.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.014+0000 7f488226c000 1 -- 172.21.15.76:0/3121285022 wait complete. 2024-03-28T12:43:07.012 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.014+0000 7f488226c000 20 client.4692 trim_cache size 0 max 16384 2024-03-28T12:43:07.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.030+0000 7f488226c000 1 Processor -- start 2024-03-28T12:43:07.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.030+0000 7f488226c000 1 -- start start 2024-03-28T12:43:07.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.034+0000 7f488226c000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973280210 0x5599732a2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.034+0000 7f488226c000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973297af0 0x5599732a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.034+0000 7f488226c000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 0x5599732b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.034+0000 7f488226c000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f48781ffaf0 con 0x559973297ed0 2024-03-28T12:43:07.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.034+0000 7f488226c000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x5599730acf80 con 0x559973297af0 2024-03-28T12:43:07.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.034+0000 7f488226c000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x5599730407b0 con 0x559973280210 2024-03-28T12:43:07.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.034+0000 7f4877400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973297af0 0x5599732a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.034+0000 7f4877e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973280210 0x5599732a2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.032 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.034+0000 7f4877e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973280210 0x5599732a2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:47814/0 (socket says 172.21.15.76:47814) 2024-03-28T12:43:07.033 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.034+0000 7f4877e00640 1 -- 172.21.15.76:0/3473664691 learned_addr learned my addr 172.21.15.76:0/3473664691 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:07.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.042+0000 7f4877400640 1 -- 172.21.15.76:0/3473664691 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973280210 msgr2=0x5599732a2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:07.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.042+0000 7f4877400640 1 --2- 172.21.15.76:0/3473664691 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973280210 0x5599732a2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.038 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.042+0000 7f4877400640 1 -- 172.21.15.76:0/3473664691 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 msgr2=0x5599732b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:07.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.042+0000 7f4877400640 1 --2- 172.21.15.76:0/3473664691 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 0x5599732b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.039 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.042+0000 7f4877400640 1 -- 172.21.15.76:0/3473664691 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559973063490 con 0x559973297af0 2024-03-28T12:43:07.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.046+0000 7f4877400640 1 --2- 172.21.15.76:0/3473664691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973297af0 0x5599732a26a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4864063770 tx=0x7f4864013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3ab551ebc188f83 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:07.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.058+0000 7f4863e00640 1 -- 172.21.15.76:0/3473664691 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864021040 con 0x559973297af0 2024-03-28T12:43:07.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.058+0000 7f4863e00640 1 -- 172.21.15.76:0/3473664691 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f486800fba0 con 0x559973297af0 2024-03-28T12:43:07.055 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.058+0000 7f4863e00640 1 -- 172.21.15.76:0/3473664691 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486405ac00 con 0x559973297af0 2024-03-28T12:43:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.058+0000 7f488226c000 1 -- 172.21.15.76:0/3473664691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973297af0 msgr2=0x5599732a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.058+0000 7f488226c000 1 --2- 172.21.15.76:0/3473664691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973297af0 0x5599732a26a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4864063770 tx=0x7f4864013000 comp rx=0 tx=0).stop 2024-03-28T12:43:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.058+0000 7f488226c000 1 -- 172.21.15.76:0/3473664691 shutdown_connections 2024-03-28T12:43:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.058+0000 7f488226c000 1 --2- 172.21.15.76:0/3473664691 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297ed0 0x5599732b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.058+0000 7f488226c000 1 --2- 172.21.15.76:0/3473664691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973297af0 0x5599732a26a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.058+0000 7f488226c000 1 --2- 172.21.15.76:0/3473664691 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973280210 0x5599732a2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.058+0000 7f488226c000 1 -- 172.21.15.76:0/3473664691 >> 172.21.15.76:0/3473664691 conn(0x559973140b80 msgr2=0x55997325c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.058+0000 7f488226c000 1 -- 172.21.15.76:0/3473664691 shutdown_connections 2024-03-28T12:43:07.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.058+0000 7f488226c000 1 -- 172.21.15.76:0/3473664691 wait complete. 2024-03-28T12:43:07.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.058+0000 7f488226c000 1 -- start start 2024-03-28T12:43:07.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.058+0000 7f488226c000 1 Processor -- start 2024-03-28T12:43:07.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.062+0000 7f488226c000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973280210 0x55997330f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.062+0000 7f488226c000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297af0 0x55997330fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.062+0000 7f488226c000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973297ed0 0x5599732ab740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.062+0000 7f488226c000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x5599730a7c60 con 0x559973297af0 2024-03-28T12:43:07.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.062+0000 7f488226c000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55997304ee80 con 0x559973297ed0 2024-03-28T12:43:07.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.062+0000 7f488226c000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x5599731719c0 con 0x559973280210 2024-03-28T12:43:07.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.062+0000 7f488226c000 10 client.0 _ll_register_callbacks cb 0x7f4868007da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T12:43:07.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.062+0000 7f4877400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297af0 0x55997330fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.062+0000 7f4877400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297af0 0x55997330fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55594/0 (socket says 172.21.15.76:55594) 2024-03-28T12:43:07.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.062+0000 7f4877400640 1 -- 172.21.15.76:0/1561348586 learned_addr learned my addr 172.21.15.76:0/1561348586 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:07.060 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.062+0000 7f4877e00640 1 --2- 172.21.15.76:0/1561348586 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973280210 0x55997330f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.066+0000 7f4877400640 1 -- 172.21.15.76:0/1561348586 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973280210 msgr2=0x55997330f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:07.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.066+0000 7f4877400640 1 --2- 172.21.15.76:0/1561348586 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973280210 0x55997330f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.066+0000 7f4877400640 1 -- 172.21.15.76:0/1561348586 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973297ed0 msgr2=0x5599732ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:07.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.066+0000 7f4877400640 1 --2- 172.21.15.76:0/1561348586 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973297ed0 0x5599732ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.066+0000 7f4877400640 1 -- 172.21.15.76:0/1561348586 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559973061e80 con 0x559973297af0 2024-03-28T12:43:07.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.066+0000 7f4877400640 1 --2- 172.21.15.76:0/1561348586 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297af0 0x55997330fa70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f486405b050 tx=0x7f4864008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49375b447de7c28 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:07.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.066+0000 7f4861600640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-03-28T12:43:07.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.074+0000 7f4861600640 1 -- 172.21.15.76:0/1561348586 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864079060 con 0x559973297af0 2024-03-28T12:43:07.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.074+0000 7f4861600640 1 -- 172.21.15.76:0/1561348586 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f48640593c0 con 0x559973297af0 2024-03-28T12:43:07.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.074+0000 7f488226c000 1 -- 172.21.15.76:0/1561348586 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f486800fba0 con 0x559973297af0 2024-03-28T12:43:07.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.074+0000 7f4861600640 1 -- 172.21.15.76:0/1561348586 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f4864089050 con 0x559973297af0 2024-03-28T12:43:07.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.074+0000 7f488226c000 10 client.4695 fetch_fsmap learned FSMap version 17 2024-03-28T12:43:07.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.074+0000 7f488226c000 1 -- 172.21.15.76:0/1561348586 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55997304f270 con 0x559973297af0 2024-03-28T12:43:07.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.082+0000 7f4861600640 1 -- 172.21.15.76:0/1561348586 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f486800fba0 con 0x559973297af0 2024-03-28T12:43:07.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.082+0000 7f4861600640 1 -- 172.21.15.76:0/1561348586 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f4864005fb0 con 0x559973297af0 2024-03-28T12:43:07.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.082+0000 7f488226c000 10 client.4695 fetch_fsmap finished waiting for FSMap version 17 2024-03-28T12:43:07.080 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.082+0000 7f488226c000 10 client.4695 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-28T12:43:07.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.082+0000 7f488226c000 20 client.4695 populate_metadata read hostname 'smithi076' 2024-03-28T12:43:07.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.082+0000 7f488226c000 1 --2- 172.21.15.76:0/1561348586 >> [v2:172.21.15.111:6836/4176441330,v1:172.21.15.111:6837/4176441330] conn(0x55997330c030 0x55997330c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.082+0000 7f488226c000 4 client.4695 mds_command: new command op to 4251 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-28T12:43:07.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.082+0000 7f488226c000 1 -- 172.21.15.76:0/1561348586 --> [v2:172.21.15.111:6836/4176441330,v1:172.21.15.111:6837/4176441330] -- command(tid 0: {"prefix": "status"}) -- 0x5599730b5e90 con 0x55997330c030 2024-03-28T12:43:07.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.086+0000 7f4877e00640 1 --2- 172.21.15.76:0/1561348586 >> [v2:172.21.15.111:6836/4176441330,v1:172.21.15.111:6837/4176441330] conn(0x55997330c030 0x55997330c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.090+0000 7f4877e00640 1 --2- 172.21.15.76:0/1561348586 >> [v2:172.21.15.111:6836/4176441330,v1:172.21.15.111:6837/4176441330] conn(0x55997330c030 0x55997330c410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5fd9743e7b58fe7b server_cookie=7b75d5257c239439 in_seq=0 out_seq=0 2024-03-28T12:43:07.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.090+0000 7f4861600640 10 client.4695 ms_handle_connect on v2:172.21.15.111:6836/4176441330 2024-03-28T12:43:07.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f4861600640 1 -- 172.21.15.76:0/1561348586 <== mds.2 v2:172.21.15.111:6836/4176441330 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5599730b5e90 con 0x55997330c030 2024-03-28T12:43:07.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f4861600640 10 client.4695 handle_command_reply: tid=0 2024-03-28T12:43:07.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f488226c000 1 client.4695 shutdown 2024-03-28T12:43:07.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f488226c000 1 -- 172.21.15.76:0/1561348586 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297af0 msgr2=0x55997330fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:07.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f488226c000 1 --2- 172.21.15.76:0/1561348586 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297af0 0x55997330fa70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f486405b050 tx=0x7f4864008030 comp rx=0 tx=0).stop 2024-03-28T12:43:07.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f488226c000 1 -- 172.21.15.76:0/1561348586 shutdown_connections 2024-03-28T12:43:07.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f488226c000 1 --2- 172.21.15.76:0/1561348586 >> [v2:172.21.15.111:6836/4176441330,v1:172.21.15.111:6837/4176441330] conn(0x55997330c030 0x55997330c410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f488226c000 1 --2- 172.21.15.76:0/1561348586 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x559973297ed0 0x5599732ab740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f488226c000 1 --2- 172.21.15.76:0/1561348586 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x559973297af0 0x55997330fa70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f4861600640 0 client.4695 ms_handle_reset on v2:172.21.15.111:6836/4176441330 2024-03-28T12:43:07.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f488226c000 1 --2- 172.21.15.76:0/1561348586 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x559973280210 0x55997330f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f488226c000 1 -- 172.21.15.76:0/1561348586 >> 172.21.15.76:0/1561348586 conn(0x559973140b80 msgr2=0x5599732a2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:07.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f488226c000 1 -- 172.21.15.76:0/1561348586 shutdown_connections 2024-03-28T12:43:07.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f488226c000 1 -- 172.21.15.76:0/1561348586 wait complete. 2024-03-28T12:43:07.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f488226c000 20 client.4695 trim_cache size 0 max 16384 2024-03-28T12:43:07.122 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-03-28T12:43:07.122 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "ed125c42-99c2-4574-a55f-ea7172f89d9c", 2024-03-28T12:43:07.122 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 2, 2024-03-28T12:43:07.122 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 4251, 2024-03-28T12:43:07.122 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-03-28T12:43:07.122 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-03-28T12:43:07.122 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-03-28T12:43:07.122 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 26.891411922, 2024-03-28T12:43:07.122 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 17, 2024-03-28T12:43:07.122 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 29, 2024-03-28T12:43:07.122 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 29, 2024-03-28T12:43:07.122 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 93.213984264999993 2024-03-28T12:43:07.123 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-03-28T12:43:07.123 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f487d800640 1 -- 172.21.15.76:0/3089946561 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f4858067f80 msgr2=0x7f485806a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:07.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f487d800640 1 --2- 172.21.15.76:0/3089946561 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f4858067f80 0x7f485806a440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f48700ae000 tx=0x7f4870004a50 comp rx=0 tx=0).stop 2024-03-28T12:43:07.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f487d800640 1 -- 172.21.15.76:0/3089946561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f48781524f0 msgr2=0x7f48781f3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:07.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f487d800640 1 --2- 172.21.15.76:0/3089946561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f48781524f0 0x7f48781f3610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f486400e870 tx=0x7f486400ed30 comp rx=0 tx=0).stop 2024-03-28T12:43:07.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f487d800640 1 -- 172.21.15.76:0/3089946561 shutdown_connections 2024-03-28T12:43:07.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f487d800640 1 --2- 172.21.15.76:0/3089946561 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f4858067f80 0x7f485806a440 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f487d800640 1 --2- 172.21.15.76:0/3089946561 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48781528d0 0x7f48781f3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f487d800640 1 --2- 172.21.15.76:0/3089946561 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f48781524f0 0x7f48781f3610 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f487d800640 1 --2- 172.21.15.76:0/3089946561 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f48780c95a0 0x7f4878156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f487d800640 1 -- 172.21.15.76:0/3089946561 >> 172.21.15.76:0/3089946561 conn(0x7f4878073520 msgr2=0x7f48780ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:07.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f487d800640 1 -- 172.21.15.76:0/3089946561 shutdown_connections 2024-03-28T12:43:07.124 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.122+0000 7f487d800640 1 -- 172.21.15.76:0/3089946561 wait complete. 2024-03-28T12:43:07.150 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-03-28T12:43:07.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.350+0000 7f3c43e00640 1 Processor -- start 2024-03-28T12:43:07.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.350+0000 7f3c43e00640 1 -- start start 2024-03-28T12:43:07.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.350+0000 7f3c43e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3c4406ee30 0x7f3c440c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.350+0000 7f3c43e00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c440700b0 con 0x7f3c441549f0 2024-03-28T12:43:07.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.350+0000 7f3c43e00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c44070390 con 0x7f3c4415b190 2024-03-28T12:43:07.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.350+0000 7f3c43e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f3c44070670 con 0x7f3c4406ee30 2024-03-28T12:43:07.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.350+0000 7f3c42a00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f3c441549f0 0x7f3c4415da80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:41378/0 (socket says 172.21.15.76:41378) 2024-03-28T12:43:07.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.350+0000 7f3c42a00640 1 -- 172.21.15.76:0/1321080290 learned_addr learned my addr 172.21.15.76:0/1321080290 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:43:07.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.354+0000 7f3c43400640 1 --2- 172.21.15.76:0/1321080290 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3c4406ee30 0x7f3c440c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.354+0000 7f3c41600640 1 -- 172.21.15.76:0/1321080290 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3283293813 0 0) 0x7f3c440700b0 con 0x7f3c441549f0 2024-03-28T12:43:07.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.354+0000 7f3c41600640 1 -- 172.21.15.76:0/1321080290 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c28003530 con 0x7f3c441549f0 2024-03-28T12:43:07.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.354+0000 7f3c41600640 1 -- 172.21.15.76:0/1321080290 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 284584679 0 0) 0x7f3c44070390 con 0x7f3c4415b190 2024-03-28T12:43:07.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.354+0000 7f3c41600640 1 -- 172.21.15.76:0/1321080290 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c440700b0 con 0x7f3c4415b190 2024-03-28T12:43:07.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.358+0000 7f3c43400640 1 -- 172.21.15.76:0/1321080290 >> v1:172.21.15.111:6789/0 conn(0x7f3c4415b190 legacy=0x7f3c440c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:07.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.358+0000 7f3c43400640 1 -- 172.21.15.76:0/1321080290 >> v1:172.21.15.76:6789/0 conn(0x7f3c441549f0 legacy=0x7f3c4415da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:07.356 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.358+0000 7f3c43400640 1 -- 172.21.15.76:0/1321080290 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4415a6b0 con 0x7f3c4406ee30 2024-03-28T12:43:07.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.366+0000 7f3c43400640 1 --2- 172.21.15.76:0/1321080290 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3c4406ee30 0x7f3c440c3cb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009dc0 tx=0x7f3c3c01f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26f4ff27a163a32d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:07.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.370+0000 7f3c41600640 1 -- 172.21.15.76:0/1321080290 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0b4070 con 0x7f3c4406ee30 2024-03-28T12:43:07.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.370+0000 7f3c41600640 1 -- 172.21.15.76:0/1321080290 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c3c0af600 con 0x7f3c4406ee30 2024-03-28T12:43:07.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.370+0000 7f3c41600640 1 -- 172.21.15.76:0/1321080290 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0af9d0 con 0x7f3c4406ee30 2024-03-28T12:43:07.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.374+0000 7f3c43e00640 1 -- 172.21.15.76:0/1321080290 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3c4406ee30 msgr2=0x7f3c440c3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:07.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.374+0000 7f3c43e00640 1 --2- 172.21.15.76:0/1321080290 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3c4406ee30 0x7f3c440c3cb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009dc0 tx=0x7f3c3c01f170 comp rx=0 tx=0).stop 2024-03-28T12:43:07.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.374+0000 7f3c43e00640 1 -- 172.21.15.76:0/1321080290 shutdown_connections 2024-03-28T12:43:07.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.374+0000 7f3c43e00640 1 --2- 172.21.15.76:0/1321080290 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3c4406ee30 0x7f3c440c3cb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.374+0000 7f3c43e00640 1 -- 172.21.15.76:0/1321080290 >> 172.21.15.76:0/1321080290 conn(0x7f3c44070b80 msgr2=0x7f3c44070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:07.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.374+0000 7f3c43e00640 1 -- 172.21.15.76:0/1321080290 shutdown_connections 2024-03-28T12:43:07.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.374+0000 7f3c43e00640 1 -- 172.21.15.76:0/1321080290 wait complete. 2024-03-28T12:43:07.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.374+0000 7f3c43e00640 1 Processor -- start 2024-03-28T12:43:07.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.374+0000 7f3c43e00640 1 -- start start 2024-03-28T12:43:07.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.374+0000 7f3c43e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3c4406ee30 0x7f3c441e6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.374+0000 7f3c43e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3c441549f0 0x7f3c441e4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.374+0000 7f3c43e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3c4415b190 0x7f3c4414faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.374+0000 7f3c43e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4406f2c0 con 0x7f3c441549f0 2024-03-28T12:43:07.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.374+0000 7f3c43e00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4415ad00 con 0x7f3c4415b190 2024-03-28T12:43:07.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.374+0000 7f3c43e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f3c440ca8b0 con 0x7f3c4406ee30 2024-03-28T12:43:07.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.374+0000 7f3c42000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3c441549f0 0x7f3c441e4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.378+0000 7f3c42000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3c441549f0 0x7f3c441e4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55598/0 (socket says 172.21.15.76:55598) 2024-03-28T12:43:07.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.378+0000 7f3c42000640 1 -- 172.21.15.76:0/2523926781 learned_addr learned my addr 172.21.15.76:0/2523926781 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:07.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.378+0000 7f3c43400640 1 --2- 172.21.15.76:0/2523926781 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3c4415b190 0x7f3c4414faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.378+0000 7f3c42a00640 1 --2- 172.21.15.76:0/2523926781 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3c4406ee30 0x7f3c441e6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.378+0000 7f3c42000640 1 -- 172.21.15.76:0/2523926781 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3c4406ee30 msgr2=0x7f3c441e6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:07.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.378+0000 7f3c42000640 1 --2- 172.21.15.76:0/2523926781 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3c4406ee30 0x7f3c441e6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.378+0000 7f3c42000640 1 -- 172.21.15.76:0/2523926781 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3c4415b190 msgr2=0x7f3c4414faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:07.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.378+0000 7f3c42000640 1 --2- 172.21.15.76:0/2523926781 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3c4415b190 0x7f3c4414faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.378+0000 7f3c42000640 1 -- 172.21.15.76:0/2523926781 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c441e5140 con 0x7f3c441549f0 2024-03-28T12:43:07.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.382+0000 7f3c42a00640 1 --2- 172.21.15.76:0/2523926781 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3c4406ee30 0x7f3c441e6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-28T12:43:07.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.382+0000 7f3c42000640 1 --2- 172.21.15.76:0/2523926781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3c441549f0 0x7f3c441e4c00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000c430 tx=0x7f3c3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:07.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.386+0000 7f3c3aa00640 1 -- 172.21.15.76:0/2523926781 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c30017070 con 0x7f3c441549f0 2024-03-28T12:43:07.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.386+0000 7f3c3aa00640 1 -- 172.21.15.76:0/2523926781 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c300052f0 con 0x7f3c441549f0 2024-03-28T12:43:07.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.386+0000 7f3c3aa00640 1 -- 172.21.15.76:0/2523926781 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c30003840 con 0x7f3c441549f0 2024-03-28T12:43:07.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.386+0000 7f3c43e00640 1 -- 172.21.15.76:0/2523926781 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c441f4770 con 0x7f3c441549f0 2024-03-28T12:43:07.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.386+0000 7f3c43e00640 1 -- 172.21.15.76:0/2523926781 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c440cb260 con 0x7f3c441549f0 2024-03-28T12:43:07.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.390+0000 7f3c4ce24000 1 Processor -- start 2024-03-28T12:43:07.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.390+0000 7f3c4ce24000 1 -- start start 2024-03-28T12:43:07.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.390+0000 7f3c4ce24000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962af0 0x55cdc0928bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.390+0000 7f3c4ce24000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc0962ed0 0x55cdc0929130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.390+0000 7f3c4ce24000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc094b210 0x55cdc094b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.390+0000 7f3c4ce24000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55cdc0773950 con 0x55cdc094b210 2024-03-28T12:43:07.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.390+0000 7f3c4ce24000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55cdc0710990 con 0x55cdc0962ed0 2024-03-28T12:43:07.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.390+0000 7f3c4ce24000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55cdc076f900 con 0x55cdc0962af0 2024-03-28T12:43:07.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.394+0000 7f3c43400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962af0 0x55cdc0928bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.394+0000 7f3c43400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962af0 0x55cdc0928bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:47832/0 (socket says 172.21.15.76:47832) 2024-03-28T12:43:07.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.394+0000 7f3c43400640 1 -- 172.21.15.76:0/2193281423 learned_addr learned my addr 172.21.15.76:0/2193281423 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:07.393 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.394+0000 7f3c42a00640 1 --2- 172.21.15.76:0/2193281423 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc0962ed0 0x55cdc0929130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.398+0000 7f3c43400640 1 -- 172.21.15.76:0/2193281423 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc0962ed0 msgr2=0x55cdc0929130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:07.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.398+0000 7f3c43400640 1 --2- 172.21.15.76:0/2193281423 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc0962ed0 0x55cdc0929130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.398+0000 7f3c43400640 1 -- 172.21.15.76:0/2193281423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc094b210 msgr2=0x55cdc094b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:07.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.398+0000 7f3c43400640 1 --2- 172.21.15.76:0/2193281423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc094b210 0x55cdc094b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.398+0000 7f3c43400640 1 -- 172.21.15.76:0/2193281423 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdc07b8100 con 0x55cdc0962af0 2024-03-28T12:43:07.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.402+0000 7f3c43400640 1 --2- 172.21.15.76:0/2193281423 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962af0 0x55cdc0928bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0b2040 tx=0x7f3c3c004ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20b49f8761d8d6de server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:07.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.406+0000 7f3c2f400640 1 -- 172.21.15.76:0/2193281423 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0b4040 con 0x55cdc0962af0 2024-03-28T12:43:07.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.406+0000 7f3c2f400640 1 -- 172.21.15.76:0/2193281423 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c3c0af740 con 0x55cdc0962af0 2024-03-28T12:43:07.405 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.406+0000 7f3c2f400640 1 -- 172.21.15.76:0/2193281423 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0afb10 con 0x55cdc0962af0 2024-03-28T12:43:07.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 1 -- 172.21.15.76:0/2193281423 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962af0 msgr2=0x55cdc0928bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:07.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/2193281423 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962af0 0x55cdc0928bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0b2040 tx=0x7f3c3c004ac0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 1 -- 172.21.15.76:0/2193281423 shutdown_connections 2024-03-28T12:43:07.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/2193281423 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc094b210 0x55cdc094b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/2193281423 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc0962ed0 0x55cdc0929130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/2193281423 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962af0 0x55cdc0928bf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 1 -- 172.21.15.76:0/2193281423 >> 172.21.15.76:0/2193281423 conn(0x55cdc080bb80 msgr2=0x55cdc09623e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:07.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 1 -- 172.21.15.76:0/2193281423 shutdown_connections 2024-03-28T12:43:07.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 1 -- 172.21.15.76:0/2193281423 wait complete. 2024-03-28T12:43:07.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 1 -- start start 2024-03-28T12:43:07.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 1 Processor -- start 2024-03-28T12:43:07.408 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc094b210 0x55cdc095ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc0962af0 0x55cdc09706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962ed0 0x55cdc0970bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55cdc073b300 con 0x55cdc094b210 2024-03-28T12:43:07.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55cdc07313e0 con 0x55cdc0962af0 2024-03-28T12:43:07.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55cdc06f7b10 con 0x55cdc0962ed0 2024-03-28T12:43:07.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.410+0000 7f3c4ce24000 10 client.0 _ll_register_callbacks cb 0x55cdc07d40f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T12:43:07.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.414+0000 7f3c42a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc0962af0 0x55cdc09706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.414+0000 7f3c3aa00640 1 -- 172.21.15.76:0/2523926781 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f3c3001a070 con 0x7f3c441549f0 2024-03-28T12:43:07.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.414+0000 7f3c42000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962ed0 0x55cdc0970bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.414+0000 7f3c42000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962ed0 0x55cdc0970bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:47846/0 (socket says 172.21.15.76:47846) 2024-03-28T12:43:07.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.414+0000 7f3c42000640 1 -- 172.21.15.76:0/1673072981 learned_addr learned my addr 172.21.15.76:0/1673072981 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:07.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.414+0000 7f3c3aa00640 1 --2- 172.21.15.76:0/2523926781 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3c24067f80 0x7f3c2406a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.414+0000 7f3c43400640 1 --2- 172.21.15.76:0/2523926781 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3c24067f80 0x7f3c2406a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.414+0000 7f3c43400640 1 --2- 172.21.15.76:0/2523926781 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3c24067f80 0x7f3c2406a440 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0bd000 tx=0x7f3c3c0ac000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:07.415 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.414+0000 7f3c3aa00640 1 -- 172.21.15.76:0/2523926781 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f3c300860a0 con 0x7f3c441549f0 2024-03-28T12:43:07.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.418+0000 7f3c42000640 1 -- 172.21.15.76:0/1673072981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc0962af0 msgr2=0x55cdc09706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:07.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.418+0000 7f3c42000640 1 --2- 172.21.15.76:0/1673072981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc0962af0 0x55cdc09706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.418+0000 7f3c42000640 1 -- 172.21.15.76:0/1673072981 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc094b210 msgr2=0x55cdc095ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:07.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.418+0000 7f3c43400640 1 --2- 172.21.15.76:0/1673072981 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc094b210 0x55cdc095ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.418+0000 7f3c42000640 1 --2- 172.21.15.76:0/1673072981 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc094b210 0x55cdc095ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.418+0000 7f3c42000640 1 -- 172.21.15.76:0/1673072981 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55cdc073d8c0 con 0x55cdc0962ed0 2024-03-28T12:43:07.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.426+0000 7f3c42000640 1 --2- 172.21.15.76:0/1673072981 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962ed0 0x55cdc0970bf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3c30057ac0 tx=0x7f3c30057670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=185f1136b14a798d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:07.423 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.426+0000 7f3c23e00640 10 client.0 ms_handle_connect on v2:172.21.15.111:3301/0 2024-03-28T12:43:07.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.434+0000 7f3c23e00640 1 -- 172.21.15.76:0/1673072981 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c30057180 con 0x55cdc0962ed0 2024-03-28T12:43:07.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.434+0000 7f3c23e00640 1 -- 172.21.15.76:0/1673072981 <== mon.2 v2:172.21.15.111:3301/0 2 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f3c30053880 con 0x55cdc0962ed0 2024-03-28T12:43:07.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.434+0000 7f3c4ce24000 1 -- 172.21.15.76:0/1673072981 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c3c0af740 con 0x55cdc0962ed0 2024-03-28T12:43:07.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.446+0000 7f3c23e00640 1 -- 172.21.15.76:0/1673072981 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f3c30084050 con 0x55cdc0962ed0 2024-03-28T12:43:07.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.446+0000 7f3c4ce24000 10 client.14639 fetch_fsmap learned FSMap version 17 2024-03-28T12:43:07.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.446+0000 7f3c4ce24000 1 -- 172.21.15.76:0/1673072981 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55cdc06fbe80 con 0x55cdc0962ed0 2024-03-28T12:43:07.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.454+0000 7f3c23e00640 1 -- 172.21.15.76:0/1673072981 <== mon.2 v2:172.21.15.111:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c3c0af740 con 0x55cdc0962ed0 2024-03-28T12:43:07.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.454+0000 7f3c23e00640 1 -- 172.21.15.76:0/1673072981 <== mon.2 v2:172.21.15.111:3301/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f3c30053a80 con 0x55cdc0962ed0 2024-03-28T12:43:07.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.454+0000 7f3c4ce24000 10 client.14639 fetch_fsmap finished waiting for FSMap version 17 2024-03-28T12:43:07.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.454+0000 7f3c4ce24000 10 client.14639 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-28T12:43:07.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.454+0000 7f3c4ce24000 20 client.14639 populate_metadata read hostname 'smithi076' 2024-03-28T12:43:07.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.454+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/1673072981 >> [v2:172.21.15.111:6832/3175932821,v1:172.21.15.111:6833/3175932821] conn(0x55cdc0949090 0x55cdc0949470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.454+0000 7f3c4ce24000 4 client.14639 mds_command: new command op to 4258 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T12:43:07.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.454+0000 7f3c4ce24000 1 -- 172.21.15.76:0/1673072981 --> [v2:172.21.15.111:6832/3175932821,v1:172.21.15.111:6833/3175932821] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cdc070ebc0 con 0x55cdc0949090 2024-03-28T12:43:07.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.458+0000 7f3c42a00640 1 --2- 172.21.15.76:0/1673072981 >> [v2:172.21.15.111:6832/3175932821,v1:172.21.15.111:6833/3175932821] conn(0x55cdc0949090 0x55cdc0949470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.546+0000 7f3c42a00640 1 --2- 172.21.15.76:0/1673072981 >> [v2:172.21.15.111:6832/3175932821,v1:172.21.15.111:6833/3175932821] conn(0x55cdc0949090 0x55cdc0949470 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a35cd0b7b7a73f3 server_cookie=61bdcf41e1ee19ef in_seq=0 out_seq=0 2024-03-28T12:43:07.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.546+0000 7f3c23e00640 10 client.14639 ms_handle_connect on v2:172.21.15.111:6832/3175932821 2024-03-28T12:43:07.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.710+0000 7f3c23e00640 1 -- 172.21.15.76:0/1673072981 <== mds.1 v2:172.21.15.111:6832/3175932821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cdc070ebc0 con 0x55cdc0949090 2024-03-28T12:43:07.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.710+0000 7f3c23e00640 10 client.14639 handle_command_reply: tid=0 2024-03-28T12:43:07.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.710+0000 7f3c4ce24000 1 client.14639 shutdown 2024-03-28T12:43:07.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.710+0000 7f3c4ce24000 1 -- 172.21.15.76:0/1673072981 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962ed0 msgr2=0x55cdc0970bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:07.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.710+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/1673072981 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962ed0 0x55cdc0970bf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3c30057ac0 tx=0x7f3c30057670 comp rx=0 tx=0).stop 2024-03-28T12:43:07.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.710+0000 7f3c4ce24000 1 -- 172.21.15.76:0/1673072981 shutdown_connections 2024-03-28T12:43:07.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.710+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/1673072981 >> [v2:172.21.15.111:6832/3175932821,v1:172.21.15.111:6833/3175932821] conn(0x55cdc0949090 0x55cdc0949470 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.710+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/1673072981 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962ed0 0x55cdc0970bf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.710+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/1673072981 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc0962af0 0x55cdc09706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.710+0000 7f3c23e00640 0 client.14639 ms_handle_reset on v2:172.21.15.111:6832/3175932821 2024-03-28T12:43:07.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.710+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/1673072981 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc094b210 0x55cdc095ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.710+0000 7f3c4ce24000 1 -- 172.21.15.76:0/1673072981 >> 172.21.15.76:0/1673072981 conn(0x55cdc080bb80 msgr2=0x55cdc0961e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:07.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.710+0000 7f3c4ce24000 1 -- 172.21.15.76:0/1673072981 shutdown_connections 2024-03-28T12:43:07.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.710+0000 7f3c4ce24000 1 -- 172.21.15.76:0/1673072981 wait complete. 2024-03-28T12:43:07.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.710+0000 7f3c4ce24000 20 client.14639 trim_cache size 0 max 16384 2024-03-28T12:43:07.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.750+0000 7f3c4ce24000 1 Processor -- start 2024-03-28T12:43:07.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.750+0000 7f3c4ce24000 1 -- start start 2024-03-28T12:43:07.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.750+0000 7f3c4ce24000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc094b210 0x55cdc0980f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.750+0000 7f3c4ce24000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962af0 0x55cdc0947ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.750+0000 7f3c4ce24000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc0962ed0 0x55cdc0948020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.750+0000 7f3c4ce24000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f3c441f10c0 con 0x55cdc0962ed0 2024-03-28T12:43:07.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.750+0000 7f3c4ce24000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55cdc0772c60 con 0x55cdc094b210 2024-03-28T12:43:07.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.750+0000 7f3c4ce24000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55cdc0719e80 con 0x55cdc0962af0 2024-03-28T12:43:07.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.750+0000 7f3c43400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc0962ed0 0x55cdc0948020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.750+0000 7f3c42a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc094b210 0x55cdc0980f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.750+0000 7f3c43400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc0962ed0 0x55cdc0948020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55612/0 (socket says 172.21.15.76:55612) 2024-03-28T12:43:07.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.750+0000 7f3c43400640 1 -- 172.21.15.76:0/2857608757 learned_addr learned my addr 172.21.15.76:0/2857608757 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:07.750 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.750+0000 7f3c42000640 1 --2- 172.21.15.76:0/2857608757 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962af0 0x55cdc0947ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.754+0000 7f3c43400640 1 -- 172.21.15.76:0/2857608757 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962af0 msgr2=0x55cdc0947ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:07.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.754+0000 7f3c43400640 1 --2- 172.21.15.76:0/2857608757 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962af0 0x55cdc0947ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.754+0000 7f3c43400640 1 -- 172.21.15.76:0/2857608757 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc094b210 msgr2=0x55cdc0980f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:07.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.754+0000 7f3c43400640 1 --2- 172.21.15.76:0/2857608757 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc094b210 0x55cdc0980f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.754+0000 7f3c43400640 1 -- 172.21.15.76:0/2857608757 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdc072e490 con 0x55cdc0962ed0 2024-03-28T12:43:07.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.758+0000 7f3c43400640 1 --2- 172.21.15.76:0/2857608757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc0962ed0 0x55cdc0948020 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c01fa10 tx=0x7f3c3c0bb000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47adf1d03b06a63f server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:07.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.758+0000 7f3c2ea00640 1 -- 172.21.15.76:0/2857608757 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0d3070 con 0x55cdc0962ed0 2024-03-28T12:43:07.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.758+0000 7f3c2ea00640 1 -- 172.21.15.76:0/2857608757 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c3c0b0c80 con 0x55cdc0962ed0 2024-03-28T12:43:07.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.758+0000 7f3c2ea00640 1 -- 172.21.15.76:0/2857608757 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0b4040 con 0x55cdc0962ed0 2024-03-28T12:43:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 1 -- 172.21.15.76:0/2857608757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc0962ed0 msgr2=0x55cdc0948020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/2857608757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc0962ed0 0x55cdc0948020 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c01fa10 tx=0x7f3c3c0bb000 comp rx=0 tx=0).stop 2024-03-28T12:43:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 1 -- 172.21.15.76:0/2857608757 shutdown_connections 2024-03-28T12:43:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/2857608757 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc0962ed0 0x55cdc0948020 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/2857608757 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962af0 0x55cdc0947ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/2857608757 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc094b210 0x55cdc0980f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 1 -- 172.21.15.76:0/2857608757 >> 172.21.15.76:0/2857608757 conn(0x55cdc080bb80 msgr2=0x55cdc0961f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 1 -- 172.21.15.76:0/2857608757 shutdown_connections 2024-03-28T12:43:07.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 1 -- 172.21.15.76:0/2857608757 wait complete. 2024-03-28T12:43:07.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 1 -- start start 2024-03-28T12:43:07.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 1 Processor -- start 2024-03-28T12:43:07.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc094b210 0x55cdc0980e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc0962af0 0x55cdc09d98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962ed0 0x55cdc09d9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55cdc0777f80 con 0x55cdc094b210 2024-03-28T12:43:07.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55cdc070b7b0 con 0x55cdc0962af0 2024-03-28T12:43:07.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55cdc0717c40 con 0x55cdc0962ed0 2024-03-28T12:43:07.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.762+0000 7f3c4ce24000 10 client.0 _ll_register_callbacks cb 0x7f3c30087620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T12:43:07.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.766+0000 7f3c42a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc094b210 0x55cdc0980e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.766+0000 7f3c42a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc094b210 0x55cdc0980e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55614/0 (socket says 172.21.15.76:55614) 2024-03-28T12:43:07.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.766+0000 7f3c42a00640 1 -- 172.21.15.76:0/587374242 learned_addr learned my addr 172.21.15.76:0/587374242 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:07.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.766+0000 7f3c42000640 1 --2- 172.21.15.76:0/587374242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc0962af0 0x55cdc09d98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.766+0000 7f3c43400640 1 --2- 172.21.15.76:0/587374242 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962ed0 0x55cdc09d9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.770+0000 7f3c43400640 1 -- 172.21.15.76:0/587374242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc0962af0 msgr2=0x55cdc09d98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:07.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.770+0000 7f3c43400640 1 --2- 172.21.15.76:0/587374242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc0962af0 0x55cdc09d98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.770+0000 7f3c43400640 1 -- 172.21.15.76:0/587374242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc094b210 msgr2=0x55cdc0980e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:07.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.770+0000 7f3c43400640 1 --2- 172.21.15.76:0/587374242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc094b210 0x55cdc0980e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.770+0000 7f3c43400640 1 -- 172.21.15.76:0/587374242 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55cdc072ce80 con 0x55cdc0962ed0 2024-03-28T12:43:07.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.770+0000 7f3c43400640 1 --2- 172.21.15.76:0/587374242 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962ed0 0x55cdc09d9de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0bc000 tx=0x7f3c3c01d9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8999719c4b8003c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:07.770 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.770+0000 7f3c23e00640 10 client.0 ms_handle_connect on v2:172.21.15.111:3301/0 2024-03-28T12:43:07.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.778+0000 7f3c23e00640 1 -- 172.21.15.76:0/587374242 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0d3050 con 0x55cdc0962ed0 2024-03-28T12:43:07.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.778+0000 7f3c23e00640 1 -- 172.21.15.76:0/587374242 <== mon.2 v2:172.21.15.111:3301/0 2 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f3c3c0b0a80 con 0x55cdc0962ed0 2024-03-28T12:43:07.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.778+0000 7f3c4ce24000 1 -- 172.21.15.76:0/587374242 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c3c0b0c80 con 0x55cdc0962ed0 2024-03-28T12:43:07.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.778+0000 7f3c23e00640 1 -- 172.21.15.76:0/587374242 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f3c3c0b4040 con 0x55cdc0962ed0 2024-03-28T12:43:07.777 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.778+0000 7f3c4ce24000 10 client.14645 fetch_fsmap learned FSMap version 17 2024-03-28T12:43:07.778 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.778+0000 7f3c4ce24000 1 -- 172.21.15.76:0/587374242 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55cdc071a270 con 0x55cdc0962ed0 2024-03-28T12:43:07.787 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.790+0000 7f3c23e00640 1 -- 172.21.15.76:0/587374242 <== mon.2 v2:172.21.15.111:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c3c0b0c80 con 0x55cdc0962ed0 2024-03-28T12:43:07.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.790+0000 7f3c23e00640 1 -- 172.21.15.76:0/587374242 <== mon.2 v2:172.21.15.111:3301/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f3c3c0b1050 con 0x55cdc0962ed0 2024-03-28T12:43:07.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.790+0000 7f3c4ce24000 10 client.14645 fetch_fsmap finished waiting for FSMap version 17 2024-03-28T12:43:07.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.790+0000 7f3c4ce24000 10 client.14645 resolve_mds: resolved name 'f' to daemon mds.f 2024-03-28T12:43:07.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.790+0000 7f3c4ce24000 20 client.14645 populate_metadata read hostname 'smithi076' 2024-03-28T12:43:07.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.790+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/587374242 >> [v2:172.21.15.111:6832/3175932821,v1:172.21.15.111:6833/3175932821] conn(0x55cdc09d63a0 0x55cdc09d6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:07.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.790+0000 7f3c4ce24000 4 client.14645 mds_command: new command op to 4258 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-28T12:43:07.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.790+0000 7f3c4ce24000 1 -- 172.21.15.76:0/587374242 --> [v2:172.21.15.111:6832/3175932821,v1:172.21.15.111:6833/3175932821] -- command(tid 0: {"prefix": "status"}) -- 0x55cdc0780e90 con 0x55cdc09d63a0 2024-03-28T12:43:07.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.790+0000 7f3c42a00640 1 --2- 172.21.15.76:0/587374242 >> [v2:172.21.15.111:6832/3175932821,v1:172.21.15.111:6833/3175932821] conn(0x55cdc09d63a0 0x55cdc09d6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:07.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.794+0000 7f3c42a00640 1 --2- 172.21.15.76:0/587374242 >> [v2:172.21.15.111:6832/3175932821,v1:172.21.15.111:6833/3175932821] conn(0x55cdc09d63a0 0x55cdc09d6780 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d2f00f2e512c97cd server_cookie=549cfd6fcb12efc4 in_seq=0 out_seq=0 2024-03-28T12:43:07.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.794+0000 7f3c23e00640 10 client.14645 ms_handle_connect on v2:172.21.15.111:6832/3175932821 2024-03-28T12:43:07.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c23e00640 1 -- 172.21.15.76:0/587374242 <== mds.1 v2:172.21.15.111:6832/3175932821 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55cdc0780e90 con 0x55cdc09d63a0 2024-03-28T12:43:07.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c23e00640 10 client.14645 handle_command_reply: tid=0 2024-03-28T12:43:07.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c4ce24000 1 client.14645 shutdown 2024-03-28T12:43:07.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c4ce24000 1 -- 172.21.15.76:0/587374242 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962ed0 msgr2=0x55cdc09d9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:07.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/587374242 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962ed0 0x55cdc09d9de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0bc000 tx=0x7f3c3c01d9b0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c4ce24000 1 -- 172.21.15.76:0/587374242 shutdown_connections 2024-03-28T12:43:07.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/587374242 >> [v2:172.21.15.111:6832/3175932821,v1:172.21.15.111:6833/3175932821] conn(0x55cdc09d63a0 0x55cdc09d6780 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/587374242 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55cdc0962ed0 0x55cdc09d9de0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/587374242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55cdc0962af0 0x55cdc09d98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c4ce24000 1 --2- 172.21.15.76:0/587374242 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55cdc094b210 0x55cdc0980e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c23e00640 0 client.14645 ms_handle_reset on v2:172.21.15.111:6832/3175932821 2024-03-28T12:43:07.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c4ce24000 1 -- 172.21.15.76:0/587374242 >> 172.21.15.76:0/587374242 conn(0x55cdc080bb80 msgr2=0x55cdc096d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:07.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c4ce24000 1 -- 172.21.15.76:0/587374242 shutdown_connections 2024-03-28T12:43:07.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c4ce24000 1 -- 172.21.15.76:0/587374242 wait complete. 2024-03-28T12:43:07.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c4ce24000 20 client.14645 trim_cache size 0 max 16384 2024-03-28T12:43:07.817 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-03-28T12:43:07.817 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "ed125c42-99c2-4574-a55f-ea7172f89d9c", 2024-03-28T12:43:07.817 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 1, 2024-03-28T12:43:07.817 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 4258, 2024-03-28T12:43:07.817 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-03-28T12:43:07.817 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-03-28T12:43:07.818 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-03-28T12:43:07.818 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 30.654200779, 2024-03-28T12:43:07.818 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 17, 2024-03-28T12:43:07.818 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 29, 2024-03-28T12:43:07.818 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 29, 2024-03-28T12:43:07.818 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 95.515612931000007 2024-03-28T12:43:07.818 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-03-28T12:43:07.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c43e00640 1 -- 172.21.15.76:0/2523926781 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3c24067f80 msgr2=0x7f3c2406a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:07.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c43e00640 1 --2- 172.21.15.76:0/2523926781 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3c24067f80 0x7f3c2406a440 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0bd000 tx=0x7f3c3c0ac000 comp rx=0 tx=0).stop 2024-03-28T12:43:07.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c43e00640 1 -- 172.21.15.76:0/2523926781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3c441549f0 msgr2=0x7f3c441e4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:07.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c43e00640 1 --2- 172.21.15.76:0/2523926781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3c441549f0 0x7f3c441e4c00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3c3000c430 tx=0x7f3c3000c8f0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c43e00640 1 -- 172.21.15.76:0/2523926781 shutdown_connections 2024-03-28T12:43:07.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c43e00640 1 --2- 172.21.15.76:0/2523926781 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3c24067f80 0x7f3c2406a440 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c43e00640 1 --2- 172.21.15.76:0/2523926781 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3c4415b190 0x7f3c4414faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c43e00640 1 --2- 172.21.15.76:0/2523926781 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f3c441549f0 0x7f3c441e4c00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c43e00640 1 --2- 172.21.15.76:0/2523926781 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3c4406ee30 0x7f3c441e6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:07.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c43e00640 1 -- 172.21.15.76:0/2523926781 >> 172.21.15.76:0/2523926781 conn(0x7f3c44070b80 msgr2=0x7f3c440c36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:07.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c43e00640 1 -- 172.21.15.76:0/2523926781 shutdown_connections 2024-03-28T12:43:07.822 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:07.818+0000 7f3c43e00640 1 -- 172.21.15.76:0/2523926781 wait complete. 2024-03-28T12:43:07.838 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-28T12:43:08.007 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.010+0000 7f5c7f200640 1 Processor -- start 2024-03-28T12:43:08.008 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.010+0000 7f5c7f200640 1 -- start start 2024-03-28T12:43:08.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.010+0000 7f5c7f200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f5c800b21e0 0x7f5c8015a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.010+0000 7f5c7f200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c800b1c90 0x7f5c8006beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.010+0000 7f5c7f200640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c800c7d40 con 0x7f5c80154a10 2024-03-28T12:43:08.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.010+0000 7f5c7f200640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f5c80154df0 con 0x7f5c800b21e0 2024-03-28T12:43:08.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.010+0000 7f5c7f200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5c8006b5a0 con 0x7f5c800b1c90 2024-03-28T12:43:08.010 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.014+0000 7f5c77e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f5c800b21e0 0x7f5c8015a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.014+0000 7f5c77e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f5c800b21e0 0x7f5c8015a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55620/0 (socket says 172.21.15.76:55620) 2024-03-28T12:43:08.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.014+0000 7f5c77e00640 1 -- 172.21.15.76:0/4174996111 learned_addr learned my addr 172.21.15.76:0/4174996111 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:08.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.014+0000 7f5c7de00640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f5c80154a10 0x7f5c800c92e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:40374/0 (socket says 172.21.15.76:40374) 2024-03-28T12:43:08.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.014+0000 7f5c7e800640 1 --2- 172.21.15.76:0/4174996111 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c800b1c90 0x7f5c8006beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.014+0000 7f5c77e00640 1 -- 172.21.15.76:0/4174996111 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c800b1c90 msgr2=0x7f5c8006beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:08.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.014+0000 7f5c77e00640 1 --2- 172.21.15.76:0/4174996111 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c800b1c90 0x7f5c8006beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.013 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.014+0000 7f5c77e00640 1 -- 172.21.15.76:0/4174996111 >> v1:172.21.15.111:6789/0 conn(0x7f5c80154a10 legacy=0x7f5c800c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:08.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.014+0000 7f5c77e00640 1 -- 172.21.15.76:0/4174996111 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c8006b7f0 con 0x7f5c800b21e0 2024-03-28T12:43:08.020 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.022+0000 7f5c77e00640 1 --2- 172.21.15.76:0/4174996111 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c800b21e0 0x7f5c8015a610 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009870 tx=0x7f5c6801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edddb0d3339fe30 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:08.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.026+0000 7f5c7d400640 1 -- 172.21.15.76:0/4174996111 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c680ab640 con 0x7f5c800b21e0 2024-03-28T12:43:08.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.026+0000 7f5c7d400640 1 -- 172.21.15.76:0/4174996111 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c680b0070 con 0x7f5c800b21e0 2024-03-28T12:43:08.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.026+0000 7f5c7d400640 1 -- 172.21.15.76:0/4174996111 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c680aba00 con 0x7f5c800b21e0 2024-03-28T12:43:08.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.026+0000 7f5c7f200640 1 -- 172.21.15.76:0/4174996111 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c800b21e0 msgr2=0x7f5c8015a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:08.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.026+0000 7f5c7f200640 1 --2- 172.21.15.76:0/4174996111 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c800b21e0 0x7f5c8015a610 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009870 tx=0x7f5c6801c530 comp rx=0 tx=0).stop 2024-03-28T12:43:08.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.026+0000 7f5c7f200640 1 -- 172.21.15.76:0/4174996111 shutdown_connections 2024-03-28T12:43:08.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.026+0000 7f5c7f200640 1 --2- 172.21.15.76:0/4174996111 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c800b1c90 0x7f5c8006beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.026+0000 7f5c7f200640 1 --2- 172.21.15.76:0/4174996111 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c800b21e0 0x7f5c8015a610 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.026+0000 7f5c7f200640 1 -- 172.21.15.76:0/4174996111 >> 172.21.15.76:0/4174996111 conn(0x7f5c80073520 msgr2=0x7f5c800ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:08.027 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.026+0000 7f5c7f200640 1 -- 172.21.15.76:0/4174996111 shutdown_connections 2024-03-28T12:43:08.028 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.026+0000 7f5c7f200640 1 -- 172.21.15.76:0/4174996111 wait complete. 2024-03-28T12:43:08.028 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.030+0000 7f5c7f200640 1 Processor -- start 2024-03-28T12:43:08.028 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.030+0000 7f5c7f200640 1 -- start start 2024-03-28T12:43:08.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.030+0000 7f5c7f200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c800b1c90 0x7f5c8014b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.030+0000 7f5c7f200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c800b21e0 0x7f5c801f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.030+0000 7f5c7f200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c80154a10 0x7f5c801583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.030+0000 7f5c7f200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5c800c7900 con 0x7f5c800b21e0 2024-03-28T12:43:08.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.030+0000 7f5c7f200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5c800cdd30 con 0x7f5c800b1c90 2024-03-28T12:43:08.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.030+0000 7f5c7f200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5c800c7a80 con 0x7f5c80154a10 2024-03-28T12:43:08.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.030+0000 7f5c77e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c800b21e0 0x7f5c801f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.030+0000 7f5c77e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c800b21e0 0x7f5c801f72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55636/0 (socket says 172.21.15.76:55636) 2024-03-28T12:43:08.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.030+0000 7f5c77e00640 1 -- 172.21.15.76:0/3372243256 learned_addr learned my addr 172.21.15.76:0/3372243256 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:08.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.030+0000 7f5c7de00640 1 --2- 172.21.15.76:0/3372243256 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c800b1c90 0x7f5c8014b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.030+0000 7f5c7e800640 1 --2- 172.21.15.76:0/3372243256 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c80154a10 0x7f5c801583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.038+0000 7f5c77e00640 1 -- 172.21.15.76:0/3372243256 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c80154a10 msgr2=0x7f5c801583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:08.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.038+0000 7f5c77e00640 1 --2- 172.21.15.76:0/3372243256 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c80154a10 0x7f5c801583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.038+0000 7f5c77e00640 1 -- 172.21.15.76:0/3372243256 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c800b1c90 msgr2=0x7f5c8014b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:08.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.038+0000 7f5c77e00640 1 --2- 172.21.15.76:0/3372243256 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c800b1c90 0x7f5c8014b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.038+0000 7f5c77e00640 1 -- 172.21.15.76:0/3372243256 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c800ca740 con 0x7f5c800b21e0 2024-03-28T12:43:08.037 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.038+0000 7f5c77e00640 1 --2- 172.21.15.76:0/3372243256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c800b21e0 0x7f5c801f72c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5c680ad040 tx=0x7f5c6801ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:08.041 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.042+0000 7f5c76000640 1 -- 172.21.15.76:0/3372243256 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c680be3f0 con 0x7f5c800b21e0 2024-03-28T12:43:08.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.042+0000 7f5c76000640 1 -- 172.21.15.76:0/3372243256 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c680be590 con 0x7f5c800b21e0 2024-03-28T12:43:08.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.042+0000 7f5c76000640 1 -- 172.21.15.76:0/3372243256 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c680be980 con 0x7f5c800b21e0 2024-03-28T12:43:08.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.042+0000 7f5c7f200640 1 -- 172.21.15.76:0/3372243256 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c801f6b00 con 0x7f5c800b21e0 2024-03-28T12:43:08.042 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.042+0000 7f5c7f200640 1 -- 172.21.15.76:0/3372243256 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c80153960 con 0x7f5c800b21e0 2024-03-28T12:43:08.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.046+0000 7f5c88011000 1 Processor -- start 2024-03-28T12:43:08.045 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.046+0000 7f5c88011000 1 -- start start 2024-03-28T12:43:08.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.050+0000 7f5c88011000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4af0 0x55556c77abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.050+0000 7f5c88011000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c7b4ed0 0x55556c77b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.050+0000 7f5c88011000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c79d210 0x55556c79d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.046 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.050+0000 7f5c88011000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55556c5c5950 con 0x55556c7b4af0 2024-03-28T12:43:08.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.050+0000 7f5c88011000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55556c562990 con 0x55556c7b4ed0 2024-03-28T12:43:08.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.050+0000 7f5c88011000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55556c5c1900 con 0x55556c79d210 2024-03-28T12:43:08.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.050+0000 7f5c7de00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c7b4ed0 0x55556c77b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.050+0000 7f5c77e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c79d210 0x55556c79d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.050+0000 7f5c77e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c79d210 0x55556c79d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:47902/0 (socket says 172.21.15.76:47902) 2024-03-28T12:43:08.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.050+0000 7f5c77e00640 1 -- 172.21.15.76:0/1786170153 learned_addr learned my addr 172.21.15.76:0/1786170153 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:08.051 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.054+0000 7f5c7e800640 1 --2- 172.21.15.76:0/1786170153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4af0 0x55556c77abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.053 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.054+0000 7f5c77e00640 1 -- 172.21.15.76:0/1786170153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c7b4ed0 msgr2=0x55556c77b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:08.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.054+0000 7f5c77e00640 1 --2- 172.21.15.76:0/1786170153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c7b4ed0 0x55556c77b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.054+0000 7f5c77e00640 1 -- 172.21.15.76:0/1786170153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4af0 msgr2=0x55556c77abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:08.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.054+0000 7f5c77e00640 1 --2- 172.21.15.76:0/1786170153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4af0 0x55556c77abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.054+0000 7f5c77e00640 1 -- 172.21.15.76:0/1786170153 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55556c60a100 con 0x55556c79d210 2024-03-28T12:43:08.058 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.062+0000 7f5c77e00640 1 --2- 172.21.15.76:0/1786170153 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c79d210 0x55556c79d5f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5c68097f10 tx=0x7f5c680b5000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7bffdd6bc67e35b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:08.064 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.066+0000 7f5c76000640 1 -- 172.21.15.76:0/3372243256 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f5c68006040 con 0x7f5c800b21e0 2024-03-28T12:43:08.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.066+0000 7f5c76000640 1 --2- 172.21.15.76:0/3372243256 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5c5c068010 0x7f5c5c06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.065 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.066+0000 7f5c7e800640 1 --2- 172.21.15.76:0/3372243256 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5c5c068010 0x7f5c5c06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.070+0000 7f5c7e800640 1 --2- 172.21.15.76:0/3372243256 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5c5c068010 0x7f5c5c06a4d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5c78003ab0 tx=0x7f5c78009780 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:08.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.070+0000 7f5c76000640 1 -- 172.21.15.76:0/3372243256 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f5c680f0f90 con 0x7f5c800b21e0 2024-03-28T12:43:08.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.070+0000 7f5c6ea00640 1 -- 172.21.15.76:0/1786170153 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c680ef190 con 0x55556c79d210 2024-03-28T12:43:08.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.070+0000 7f5c6ea00640 1 -- 172.21.15.76:0/1786170153 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c680b0050 con 0x55556c79d210 2024-03-28T12:43:08.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.070+0000 7f5c6ea00640 1 -- 172.21.15.76:0/1786170153 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c680f2850 con 0x55556c79d210 2024-03-28T12:43:08.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.070+0000 7f5c88011000 1 -- 172.21.15.76:0/1786170153 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c79d210 msgr2=0x55556c79d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:08.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.070+0000 7f5c88011000 1 --2- 172.21.15.76:0/1786170153 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c79d210 0x55556c79d5f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5c68097f10 tx=0x7f5c680b5000 comp rx=0 tx=0).stop 2024-03-28T12:43:08.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.070+0000 7f5c88011000 1 -- 172.21.15.76:0/1786170153 shutdown_connections 2024-03-28T12:43:08.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.070+0000 7f5c88011000 1 --2- 172.21.15.76:0/1786170153 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c79d210 0x55556c79d5f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.070+0000 7f5c88011000 1 --2- 172.21.15.76:0/1786170153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c7b4ed0 0x55556c77b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.070+0000 7f5c88011000 1 --2- 172.21.15.76:0/1786170153 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4af0 0x55556c77abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.070+0000 7f5c88011000 1 -- 172.21.15.76:0/1786170153 >> 172.21.15.76:0/1786170153 conn(0x55556c65db80 msgr2=0x55556c7b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:08.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.070+0000 7f5c88011000 1 -- 172.21.15.76:0/1786170153 shutdown_connections 2024-03-28T12:43:08.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.070+0000 7f5c88011000 1 -- 172.21.15.76:0/1786170153 wait complete. 2024-03-28T12:43:08.069 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.070+0000 7f5c88011000 1 -- start start 2024-03-28T12:43:08.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.074+0000 7f5c88011000 1 Processor -- start 2024-03-28T12:43:08.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.074+0000 7f5c88011000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c79d210 0x55556c7b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.074+0000 7f5c88011000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c7b4af0 0x55556c7bee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.074+0000 7f5c88011000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4ed0 0x55556c7bf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.074+0000 7f5c88011000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55556c5c1900 con 0x55556c7b4ed0 2024-03-28T12:43:08.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.074+0000 7f5c88011000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55556c5833e0 con 0x55556c7b4af0 2024-03-28T12:43:08.071 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.074+0000 7f5c88011000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55556c58d300 con 0x55556c79d210 2024-03-28T12:43:08.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.074+0000 7f5c88011000 10 client.0 _ll_register_callbacks cb 0x55556c6260f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T12:43:08.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.074+0000 7f5c7e800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4ed0 0x55556c7bf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.074+0000 7f5c77e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c7b4af0 0x55556c7bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.074+0000 7f5c7e800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4ed0 0x55556c7bf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55666/0 (socket says 172.21.15.76:55666) 2024-03-28T12:43:08.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.074+0000 7f5c7e800640 1 -- 172.21.15.76:0/3068999770 learned_addr learned my addr 172.21.15.76:0/3068999770 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:08.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.074+0000 7f5c7de00640 1 --2- 172.21.15.76:0/3068999770 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c79d210 0x55556c7b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.078+0000 7f5c7e800640 1 -- 172.21.15.76:0/3068999770 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c79d210 msgr2=0x55556c7b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:08.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.078+0000 7f5c7e800640 1 --2- 172.21.15.76:0/3068999770 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c79d210 0x55556c7b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.078+0000 7f5c7e800640 1 -- 172.21.15.76:0/3068999770 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c7b4af0 msgr2=0x55556c7bee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:08.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.078+0000 7f5c7e800640 1 --2- 172.21.15.76:0/3068999770 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c7b4af0 0x55556c7bee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.078+0000 7f5c7e800640 1 -- 172.21.15.76:0/3068999770 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55556c58f8c0 con 0x55556c7b4ed0 2024-03-28T12:43:08.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.082+0000 7f5c7e800640 1 --2- 172.21.15.76:0/3068999770 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4ed0 0x55556c7bf350 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5c78009fd0 tx=0x7f5c78004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6a8f302814ac5a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:08.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.082+0000 7f5c63400640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-03-28T12:43:08.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.086+0000 7f5c63400640 1 -- 172.21.15.76:0/3068999770 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7801d050 con 0x55556c7b4ed0 2024-03-28T12:43:08.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.086+0000 7f5c63400640 1 -- 172.21.15.76:0/3068999770 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f5c78004780 con 0x55556c7b4ed0 2024-03-28T12:43:08.085 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.086+0000 7f5c88011000 1 -- 172.21.15.76:0/3068999770 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c680b0050 con 0x55556c7b4ed0 2024-03-28T12:43:08.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.090+0000 7f5c63400640 1 -- 172.21.15.76:0/3068999770 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f5c78022440 con 0x55556c7b4ed0 2024-03-28T12:43:08.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.090+0000 7f5c88011000 10 client.4716 fetch_fsmap learned FSMap version 17 2024-03-28T12:43:08.088 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.090+0000 7f5c88011000 1 -- 172.21.15.76:0/3068999770 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55556c54de80 con 0x55556c7b4ed0 2024-03-28T12:43:08.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.094+0000 7f5c63400640 1 -- 172.21.15.76:0/3068999770 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c680b0050 con 0x55556c7b4ed0 2024-03-28T12:43:08.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.094+0000 7f5c63400640 1 -- 172.21.15.76:0/3068999770 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f5c78032080 con 0x55556c7b4ed0 2024-03-28T12:43:08.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.094+0000 7f5c88011000 10 client.4716 fetch_fsmap finished waiting for FSMap version 17 2024-03-28T12:43:08.093 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.094+0000 7f5c88011000 10 client.4716 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-28T12:43:08.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.094+0000 7f5c88011000 20 client.4716 populate_metadata read hostname 'smithi076' 2024-03-28T12:43:08.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.094+0000 7f5c88011000 1 --2- 172.21.15.76:0/3068999770 >> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] conn(0x55556c7c26b0 0x55556c7c2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.094+0000 7f5c88011000 4 client.4716 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-28T12:43:08.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.094+0000 7f5c88011000 1 -- 172.21.15.76:0/3068999770 --> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55556c560bc0 con 0x55556c7c26b0 2024-03-28T12:43:08.094 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.098+0000 7f5c7de00640 1 --2- 172.21.15.76:0/3068999770 >> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] conn(0x55556c7c26b0 0x55556c7c2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.098+0000 7f5c7de00640 1 --2- 172.21.15.76:0/3068999770 >> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] conn(0x55556c7c26b0 0x55556c7c2a90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94594d309452853b server_cookie=532ec7777b992af7 in_seq=0 out_seq=0 2024-03-28T12:43:08.097 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.098+0000 7f5c63400640 10 client.4716 ms_handle_connect on v2:172.21.15.76:6834/544947706 2024-03-28T12:43:08.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.122+0000 7f5c63400640 1 -- 172.21.15.76:0/3068999770 <== mds.0 v2:172.21.15.76:6834/544947706 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55556c560bc0 con 0x55556c7c26b0 2024-03-28T12:43:08.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.122+0000 7f5c63400640 10 client.4716 handle_command_reply: tid=0 2024-03-28T12:43:08.119 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.122+0000 7f5c88011000 1 client.4716 shutdown 2024-03-28T12:43:08.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.122+0000 7f5c88011000 1 -- 172.21.15.76:0/3068999770 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4ed0 msgr2=0x55556c7bf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:08.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.122+0000 7f5c88011000 1 --2- 172.21.15.76:0/3068999770 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4ed0 0x55556c7bf350 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5c78009fd0 tx=0x7f5c78004ac0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.122+0000 7f5c88011000 1 -- 172.21.15.76:0/3068999770 shutdown_connections 2024-03-28T12:43:08.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.122+0000 7f5c88011000 1 --2- 172.21.15.76:0/3068999770 >> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] conn(0x55556c7c26b0 0x55556c7c2a90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.122+0000 7f5c88011000 1 --2- 172.21.15.76:0/3068999770 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4ed0 0x55556c7bf350 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.122+0000 7f5c88011000 1 --2- 172.21.15.76:0/3068999770 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c7b4af0 0x55556c7bee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.120 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.122+0000 7f5c88011000 1 --2- 172.21.15.76:0/3068999770 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c79d210 0x55556c7b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.122+0000 7f5c88011000 1 -- 172.21.15.76:0/3068999770 >> 172.21.15.76:0/3068999770 conn(0x55556c65db80 msgr2=0x55556c7b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:08.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.122+0000 7f5c63400640 0 client.4716 ms_handle_reset on v2:172.21.15.76:6834/544947706 2024-03-28T12:43:08.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.122+0000 7f5c88011000 1 -- 172.21.15.76:0/3068999770 shutdown_connections 2024-03-28T12:43:08.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.122+0000 7f5c88011000 1 -- 172.21.15.76:0/3068999770 wait complete. 2024-03-28T12:43:08.121 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.122+0000 7f5c88011000 20 client.4716 trim_cache size 0 max 16384 2024-03-28T12:43:08.157 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.158+0000 7f5c88011000 1 Processor -- start 2024-03-28T12:43:08.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.158+0000 7f5c88011000 1 -- start start 2024-03-28T12:43:08.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.162+0000 7f5c88011000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c79d210 0x55556c7bb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.162+0000 7f5c88011000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4af0 0x55556c7bbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.162+0000 7f5c88011000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c7b4ed0 0x55556c7d2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.162+0000 7f5c88011000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f5c800c9ff0 con 0x55556c7b4af0 2024-03-28T12:43:08.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.162+0000 7f5c88011000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55556c56be80 con 0x55556c7b4ed0 2024-03-28T12:43:08.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.162+0000 7f5c88011000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55556c55d7b0 con 0x55556c79d210 2024-03-28T12:43:08.159 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.162+0000 7f5c77e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4af0 0x55556c7bbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.162+0000 7f5c77e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4af0 0x55556c7bbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55670/0 (socket says 172.21.15.76:55670) 2024-03-28T12:43:08.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.162+0000 7f5c77e00640 1 -- 172.21.15.76:0/3255847701 learned_addr learned my addr 172.21.15.76:0/3255847701 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:08.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.162+0000 7f5c7e800640 1 --2- 172.21.15.76:0/3255847701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c7b4ed0 0x55556c7d2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.160 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.162+0000 7f5c7de00640 1 --2- 172.21.15.76:0/3255847701 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c79d210 0x55556c7bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.163 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.166+0000 7f5c77e00640 1 -- 172.21.15.76:0/3255847701 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c79d210 msgr2=0x55556c7bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:08.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.166+0000 7f5c77e00640 1 --2- 172.21.15.76:0/3255847701 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c79d210 0x55556c7bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.166+0000 7f5c77e00640 1 -- 172.21.15.76:0/3255847701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c7b4ed0 msgr2=0x55556c7d2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:08.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.166+0000 7f5c77e00640 1 --2- 172.21.15.76:0/3255847701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c7b4ed0 0x55556c7d2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.164 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.166+0000 7f5c77e00640 1 -- 172.21.15.76:0/3255847701 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55556c580490 con 0x55556c7b4af0 2024-03-28T12:43:08.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.170+0000 7f5c77e00640 1 --2- 172.21.15.76:0/3255847701 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4af0 0x55556c7bbca0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5c6801abe0 tx=0x7f5c680d4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de81c30eb8568410 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:08.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.174+0000 7f5c6e000640 1 -- 172.21.15.76:0/3255847701 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c680f5070 con 0x55556c7b4af0 2024-03-28T12:43:08.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.174+0000 7f5c6e000640 1 -- 172.21.15.76:0/3255847701 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c680b0040 con 0x55556c7b4af0 2024-03-28T12:43:08.171 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.174+0000 7f5c6e000640 1 -- 172.21.15.76:0/3255847701 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c680f2a30 con 0x55556c7b4af0 2024-03-28T12:43:08.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.174+0000 7f5c88011000 1 -- 172.21.15.76:0/3255847701 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4af0 msgr2=0x55556c7bbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:08.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.174+0000 7f5c88011000 1 --2- 172.21.15.76:0/3255847701 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4af0 0x55556c7bbca0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5c6801abe0 tx=0x7f5c680d4040 comp rx=0 tx=0).stop 2024-03-28T12:43:08.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.174+0000 7f5c88011000 1 -- 172.21.15.76:0/3255847701 shutdown_connections 2024-03-28T12:43:08.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.174+0000 7f5c88011000 1 --2- 172.21.15.76:0/3255847701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c7b4ed0 0x55556c7d2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.174+0000 7f5c88011000 1 --2- 172.21.15.76:0/3255847701 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4af0 0x55556c7bbca0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.174+0000 7f5c88011000 1 --2- 172.21.15.76:0/3255847701 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c79d210 0x55556c7bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.174+0000 7f5c88011000 1 -- 172.21.15.76:0/3255847701 >> 172.21.15.76:0/3255847701 conn(0x55556c65db80 msgr2=0x55556c7aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:08.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.174+0000 7f5c88011000 1 -- 172.21.15.76:0/3255847701 shutdown_connections 2024-03-28T12:43:08.172 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.174+0000 7f5c88011000 1 -- 172.21.15.76:0/3255847701 wait complete. 2024-03-28T12:43:08.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.174+0000 7f5c88011000 1 -- start start 2024-03-28T12:43:08.174 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.174+0000 7f5c88011000 1 Processor -- start 2024-03-28T12:43:08.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.178+0000 7f5c88011000 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c79d210 0x55556c772500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.178+0000 7f5c88011000 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c7b4af0 0x55556c7c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.178+0000 7f5c88011000 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4ed0 0x55556c7c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.178+0000 7f5c88011000 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x55556c5c4c60 con 0x55556c7b4ed0 2024-03-28T12:43:08.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.178+0000 7f5c88011000 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x55556c5c9f80 con 0x55556c79d210 2024-03-28T12:43:08.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.178+0000 7f5c88011000 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x55556c65fdf0 con 0x55556c7b4af0 2024-03-28T12:43:08.175 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.178+0000 7f5c88011000 10 client.0 _ll_register_callbacks cb 0x7f5c78009410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-28T12:43:08.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.178+0000 7f5c7e800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4ed0 0x55556c7c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.178+0000 7f5c7e800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4ed0 0x55556c7c4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55680/0 (socket says 172.21.15.76:55680) 2024-03-28T12:43:08.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.178+0000 7f5c7e800640 1 -- 172.21.15.76:0/2238489821 learned_addr learned my addr 172.21.15.76:0/2238489821 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:08.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.178+0000 7f5c7de00640 1 --2- 172.21.15.76:0/2238489821 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c79d210 0x55556c772500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.178+0000 7f5c77e00640 1 --2- 172.21.15.76:0/2238489821 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c7b4af0 0x55556c7c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.182+0000 7f5c7e800640 1 -- 172.21.15.76:0/2238489821 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c7b4af0 msgr2=0x55556c7c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:08.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.182+0000 7f5c7e800640 1 --2- 172.21.15.76:0/2238489821 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c7b4af0 0x55556c7c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.182+0000 7f5c7e800640 1 -- 172.21.15.76:0/2238489821 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c79d210 msgr2=0x55556c772500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:08.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.182+0000 7f5c7e800640 1 --2- 172.21.15.76:0/2238489821 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c79d210 0x55556c772500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.181 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.182+0000 7f5c7e800640 1 -- 172.21.15.76:0/2238489821 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55556c57ee80 con 0x55556c7b4ed0 2024-03-28T12:43:08.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.186+0000 7f5c7e800640 1 --2- 172.21.15.76:0/2238489821 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4ed0 0x55556c7c4c00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5c78009fd0 tx=0x7f5c78016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e170b899590f609b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:08.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.186+0000 7f5c63400640 10 client.0 ms_handle_connect on v2:172.21.15.76:3300/0 2024-03-28T12:43:08.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.190+0000 7f5c63400640 1 -- 172.21.15.76:0/2238489821 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c7801d050 con 0x55556c7b4ed0 2024-03-28T12:43:08.189 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.190+0000 7f5c63400640 1 -- 172.21.15.76:0/2238489821 <== mon.0 v2:172.21.15.76:3300/0 2 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f5c78004780 con 0x55556c7b4ed0 2024-03-28T12:43:08.190 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.190+0000 7f5c88011000 1 -- 172.21.15.76:0/2238489821 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c680b0040 con 0x55556c7b4ed0 2024-03-28T12:43:08.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.194+0000 7f5c63400640 1 -- 172.21.15.76:0/2238489821 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f5c78022cf0 con 0x55556c7b4ed0 2024-03-28T12:43:08.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.194+0000 7f5c88011000 10 client.4722 fetch_fsmap learned FSMap version 17 2024-03-28T12:43:08.192 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.194+0000 7f5c88011000 1 -- 172.21.15.76:0/2238489821 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55556c56c270 con 0x55556c7b4ed0 2024-03-28T12:43:08.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.202+0000 7f5c63400640 1 -- 172.21.15.76:0/2238489821 <== mon.0 v2:172.21.15.76:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c680b0040 con 0x55556c7b4ed0 2024-03-28T12:43:08.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.202+0000 7f5c63400640 1 -- 172.21.15.76:0/2238489821 <== mon.0 v2:172.21.15.76:3300/0 5 ==== fsmap(e 17) ==== 4792+0+0 (secure 0 0 0) 0x7f5c78038030 con 0x55556c7b4ed0 2024-03-28T12:43:08.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.202+0000 7f5c88011000 10 client.4722 fetch_fsmap finished waiting for FSMap version 17 2024-03-28T12:43:08.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.202+0000 7f5c88011000 10 client.4722 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-28T12:43:08.199 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.202+0000 7f5c88011000 20 client.4722 populate_metadata read hostname 'smithi076' 2024-03-28T12:43:08.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.202+0000 7f5c88011000 1 --2- 172.21.15.76:0/2238489821 >> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] conn(0x55556c7c5140 0x55556c8342b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.202+0000 7f5c88011000 4 client.4722 mds_command: new command op to 4264 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-28T12:43:08.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.202+0000 7f5c88011000 1 -- 172.21.15.76:0/2238489821 --> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] -- command(tid 0: {"prefix": "status"}) -- 0x55556c5d2e90 con 0x55556c7c5140 2024-03-28T12:43:08.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.202+0000 7f5c7de00640 1 --2- 172.21.15.76:0/2238489821 >> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] conn(0x55556c7c5140 0x55556c8342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.206+0000 7f5c7de00640 1 --2- 172.21.15.76:0/2238489821 >> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] conn(0x55556c7c5140 0x55556c8342b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dad98c9e95de87c server_cookie=1761aacd3ca2e18a in_seq=0 out_seq=0 2024-03-28T12:43:08.204 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.206+0000 7f5c63400640 10 client.4722 ms_handle_connect on v2:172.21.15.76:6834/544947706 2024-03-28T12:43:08.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.210+0000 7f5c63400640 1 -- 172.21.15.76:0/2238489821 <== mds.0 v2:172.21.15.76:6834/544947706 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55556c5d2e90 con 0x55556c7c5140 2024-03-28T12:43:08.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.210+0000 7f5c63400640 10 client.4722 handle_command_reply: tid=0 2024-03-28T12:43:08.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.210+0000 7f5c88011000 1 client.4722 shutdown 2024-03-28T12:43:08.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.210+0000 7f5c88011000 1 -- 172.21.15.76:0/2238489821 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4ed0 msgr2=0x55556c7c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:08.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.210+0000 7f5c88011000 1 --2- 172.21.15.76:0/2238489821 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4ed0 0x55556c7c4c00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5c78009fd0 tx=0x7f5c78016000 comp rx=0 tx=0).stop 2024-03-28T12:43:08.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.210+0000 7f5c88011000 1 -- 172.21.15.76:0/2238489821 shutdown_connections 2024-03-28T12:43:08.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.210+0000 7f5c88011000 1 --2- 172.21.15.76:0/2238489821 >> [v2:172.21.15.76:6834/544947706,v1:172.21.15.76:6835/544947706] conn(0x55556c7c5140 0x55556c8342b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.210+0000 7f5c88011000 1 --2- 172.21.15.76:0/2238489821 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x55556c7b4ed0 0x55556c7c4c00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.210+0000 7f5c88011000 1 --2- 172.21.15.76:0/2238489821 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55556c7b4af0 0x55556c7c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.210+0000 7f5c63400640 0 client.4722 ms_handle_reset on v2:172.21.15.76:6834/544947706 2024-03-28T12:43:08.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.210+0000 7f5c88011000 1 --2- 172.21.15.76:0/2238489821 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55556c79d210 0x55556c772500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.210+0000 7f5c88011000 1 -- 172.21.15.76:0/2238489821 >> 172.21.15.76:0/2238489821 conn(0x55556c65db80 msgr2=0x55556c79c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:08.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.210+0000 7f5c88011000 1 -- 172.21.15.76:0/2238489821 shutdown_connections 2024-03-28T12:43:08.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.210+0000 7f5c88011000 1 -- 172.21.15.76:0/2238489821 wait complete. 2024-03-28T12:43:08.211 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.210+0000 7f5c88011000 20 client.4722 trim_cache size 0 max 16384 2024-03-28T12:43:08.211 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-03-28T12:43:08.211 INFO:teuthology.orchestra.run.smithi076.stdout: "cluster_fsid": "ed125c42-99c2-4574-a55f-ea7172f89d9c", 2024-03-28T12:43:08.211 INFO:teuthology.orchestra.run.smithi076.stdout: "whoami": 0, 2024-03-28T12:43:08.211 INFO:teuthology.orchestra.run.smithi076.stdout: "id": 4264, 2024-03-28T12:43:08.211 INFO:teuthology.orchestra.run.smithi076.stdout: "want_state": "up:active", 2024-03-28T12:43:08.211 INFO:teuthology.orchestra.run.smithi076.stdout: "state": "up:active", 2024-03-28T12:43:08.212 INFO:teuthology.orchestra.run.smithi076.stdout: "fs_name": "cephfs", 2024-03-28T12:43:08.212 INFO:teuthology.orchestra.run.smithi076.stdout: "rank_uptime": 65.957216656, 2024-03-28T12:43:08.212 INFO:teuthology.orchestra.run.smithi076.stdout: "mdsmap_epoch": 17, 2024-03-28T12:43:08.212 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch": 29, 2024-03-28T12:43:08.212 INFO:teuthology.orchestra.run.smithi076.stdout: "osdmap_epoch_barrier": 29, 2024-03-28T12:43:08.212 INFO:teuthology.orchestra.run.smithi076.stdout: "uptime": 95.875435288999995 2024-03-28T12:43:08.212 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-03-28T12:43:08.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.214+0000 7f5c7f200640 1 -- 172.21.15.76:0/3372243256 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5c5c068010 msgr2=0x7f5c5c06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:08.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.214+0000 7f5c7f200640 1 --2- 172.21.15.76:0/3372243256 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5c5c068010 0x7f5c5c06a4d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5c78003ab0 tx=0x7f5c78009780 comp rx=0 tx=0).stop 2024-03-28T12:43:08.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.214+0000 7f5c7f200640 1 -- 172.21.15.76:0/3372243256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c800b21e0 msgr2=0x7f5c801f72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:08.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.214+0000 7f5c7f200640 1 --2- 172.21.15.76:0/3372243256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c800b21e0 0x7f5c801f72c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5c680ad040 tx=0x7f5c6801ad70 comp rx=0 tx=0).stop 2024-03-28T12:43:08.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.214+0000 7f5c7f200640 1 -- 172.21.15.76:0/3372243256 shutdown_connections 2024-03-28T12:43:08.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.214+0000 7f5c7f200640 1 --2- 172.21.15.76:0/3372243256 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f5c5c068010 0x7f5c5c06a4d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.214+0000 7f5c7f200640 1 --2- 172.21.15.76:0/3372243256 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5c80154a10 0x7f5c801583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.214+0000 7f5c7f200640 1 --2- 172.21.15.76:0/3372243256 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f5c800b21e0 0x7f5c801f72c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.214+0000 7f5c7f200640 1 --2- 172.21.15.76:0/3372243256 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c800b1c90 0x7f5c8014b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.214+0000 7f5c7f200640 1 -- 172.21.15.76:0/3372243256 >> 172.21.15.76:0/3372243256 conn(0x7f5c80073520 msgr2=0x7f5c8014d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:08.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.214+0000 7f5c7f200640 1 -- 172.21.15.76:0/3372243256 shutdown_connections 2024-03-28T12:43:08.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.214+0000 7f5c7f200640 1 -- 172.21.15.76:0/3372243256 wait complete. 2024-03-28T12:43:08.241 INFO:teuthology.run_tasks:Running task sequential... 2024-03-28T12:43:08.250 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-03-28T12:43:08.250 INFO:teuthology.task.sequential:In sequential, running task print... 2024-03-28T12:43:08.250 INFO:teuthology.task.print:Enabling mgr modules 2024-03-28T12:43:08.250 INFO:teuthology.run_tasks:Running task kclient... 2024-03-28T12:43:08.264 INFO:tasks.kclient:Mounting kernel clients... 2024-03-28T12:43:08.264 INFO:tasks.kclient:config is {'client.0': {}} 2024-03-28T12:43:08.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:43:08.264 DEBUG:teuthology.orchestra.run.smithi076:> ip netns list 2024-03-28T12:43:08.275 INFO:teuthology.orchestra.run.smithi076.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-03-28T12:43:08.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:43:08.275 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-28T12:43:08.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:43:08.348 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link delete ceph-brx 2024-03-28T12:43:08.561 INFO:tasks.kclient:client.0 config is {} 2024-03-28T12:43:08.561 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-28T12:43:08.561 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-28T12:43:08.561 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-28T12:43:08.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.738+0000 7efcef200640 1 Processor -- start 2024-03-28T12:43:08.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.738+0000 7efcef200640 1 -- start start 2024-03-28T12:43:08.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.738+0000 7efcef200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efcf0152690 0x7efcf00c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.738+0000 7efcef200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7efcf0158400 0x7efcf0158870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.738+0000 7efcef200640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcf0158f90 con 0x7efcf006f780 2024-03-28T12:43:08.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.738+0000 7efcef200640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7efcf015c320 con 0x7efcf0158400 2024-03-28T12:43:08.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.738+0000 7efcef200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7efcf0159270 con 0x7efcf0152690 2024-03-28T12:43:08.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.738+0000 7efcee800640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7efcf0158400 0x7efcf0158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.742+0000 7efced400640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7efcf006f780 0x7efcf006ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:41390/0 (socket says 172.21.15.76:41390) 2024-03-28T12:43:08.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.742+0000 7efced400640 1 -- 172.21.15.76:0/2574502130 learned_addr learned my addr 172.21.15.76:0/2574502130 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T12:43:08.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.742+0000 7efcede00640 1 --2- 172.21.15.76:0/2574502130 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efcf0152690 0x7efcf00c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.742+0000 7efcee800640 1 -- 172.21.15.76:0/2574502130 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efcf0152690 msgr2=0x7efcf00c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T12:43:08.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.742+0000 7efcee800640 1 --2- 172.21.15.76:0/2574502130 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efcf0152690 0x7efcf00c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.742+0000 7efcee800640 1 -- 172.21.15.76:0/2574502130 >> v1:172.21.15.76:6789/0 conn(0x7efcf006f780 legacy=0x7efcf006ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:08.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.742+0000 7efcee800640 1 -- 172.21.15.76:0/2574502130 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf015b9f0 con 0x7efcf0158400 2024-03-28T12:43:08.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.750+0000 7efcee800640 1 --2- 172.21.15.76:0/2574502130 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efcf0158400 0x7efcf0158870 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efce8009d90 tx=0x7efce801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f14e719ae56fa1 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:08.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.754+0000 7efceca00640 1 -- 172.21.15.76:0/2574502130 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce80b4070 con 0x7efcf0158400 2024-03-28T12:43:08.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.754+0000 7efceca00640 1 -- 172.21.15.76:0/2574502130 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce80af600 con 0x7efcf0158400 2024-03-28T12:43:08.752 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.754+0000 7efceca00640 1 -- 172.21.15.76:0/2574502130 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce80af9d0 con 0x7efcf0158400 2024-03-28T12:43:08.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.754+0000 7efcef200640 1 -- 172.21.15.76:0/2574502130 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efcf0158400 msgr2=0x7efcf0158870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:08.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.754+0000 7efcef200640 1 --2- 172.21.15.76:0/2574502130 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efcf0158400 0x7efcf0158870 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efce8009d90 tx=0x7efce801f150 comp rx=0 tx=0).stop 2024-03-28T12:43:08.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.754+0000 7efcef200640 1 -- 172.21.15.76:0/2574502130 shutdown_connections 2024-03-28T12:43:08.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.754+0000 7efcef200640 1 --2- 172.21.15.76:0/2574502130 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efcf0158400 0x7efcf0158870 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.753 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.754+0000 7efcef200640 1 --2- 172.21.15.76:0/2574502130 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efcf0152690 0x7efcf00c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.754+0000 7efcef200640 1 -- 172.21.15.76:0/2574502130 >> 172.21.15.76:0/2574502130 conn(0x7efcf0070c10 msgr2=0x7efcf0071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:08.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.754+0000 7efcef200640 1 -- 172.21.15.76:0/2574502130 shutdown_connections 2024-03-28T12:43:08.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.754+0000 7efcef200640 1 -- 172.21.15.76:0/2574502130 wait complete. 2024-03-28T12:43:08.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.758+0000 7efcef200640 1 Processor -- start 2024-03-28T12:43:08.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.758+0000 7efcef200640 1 -- start start 2024-03-28T12:43:08.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.758+0000 7efcef200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efcf006f780 0x7efcf0159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.758+0000 7efcef200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efcf0152690 0x7efcf01ee300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.758+0000 7efcef200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efcf0158400 0x7efcf01e3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.758+0000 7efcef200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7efcf0152a70 con 0x7efcf0152690 2024-03-28T12:43:08.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.758+0000 7efcef200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7efcf015bfb0 con 0x7efcf0158400 2024-03-28T12:43:08.756 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.758+0000 7efcef200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7efcf015c7b0 con 0x7efcf006f780 2024-03-28T12:43:08.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.758+0000 7efced400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efcf0152690 0x7efcf01ee300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.758+0000 7efcede00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efcf006f780 0x7efcf0159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.758+0000 7efcee800640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efcf0158400 0x7efcf01e3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.758+0000 7efced400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efcf0152690 0x7efcf01ee300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:55694/0 (socket says 172.21.15.76:55694) 2024-03-28T12:43:08.758 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.758+0000 7efced400640 1 -- 172.21.15.76:0/3827835244 learned_addr learned my addr 172.21.15.76:0/3827835244 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T12:43:08.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.766+0000 7efced400640 1 -- 172.21.15.76:0/3827835244 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efcf006f780 msgr2=0x7efcf0159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:08.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.766+0000 7efced400640 1 --2- 172.21.15.76:0/3827835244 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efcf006f780 0x7efcf0159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.766+0000 7efced400640 1 -- 172.21.15.76:0/3827835244 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efcf0158400 msgr2=0x7efcf01e3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:08.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.766+0000 7efced400640 1 --2- 172.21.15.76:0/3827835244 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efcf0158400 0x7efcf01e3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:08.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.766+0000 7efced400640 1 -- 172.21.15.76:0/3827835244 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf0159a10 con 0x7efcf0152690 2024-03-28T12:43:08.766 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.770+0000 7efced400640 1 --2- 172.21.15.76:0/3827835244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efcf0152690 0x7efcf01ee300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00c420 tx=0x7efcdc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:08.771 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.774+0000 7efce6000640 1 -- 172.21.15.76:0/3827835244 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcdc017070 con 0x7efcf0152690 2024-03-28T12:43:08.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.774+0000 7efce6000640 1 -- 172.21.15.76:0/3827835244 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcdc005cf0 con 0x7efcf0152690 2024-03-28T12:43:08.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.774+0000 7efce6000640 1 -- 172.21.15.76:0/3827835244 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcdc0072f0 con 0x7efcf0152690 2024-03-28T12:43:08.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.774+0000 7efcef200640 1 -- 172.21.15.76:0/3827835244 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf01516d0 con 0x7efcf0152690 2024-03-28T12:43:08.772 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.774+0000 7efcef200640 1 -- 172.21.15.76:0/3827835244 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf01f1c80 con 0x7efcf0152690 2024-03-28T12:43:08.773 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.774+0000 7efcef200640 1 -- 172.21.15.76:0/3827835244 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcf0068df0 con 0x7efcf0152690 2024-03-28T12:43:08.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.810+0000 7efce6000640 1 -- 172.21.15.76:0/3827835244 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7efcdc01a070 con 0x7efcf0152690 2024-03-28T12:43:08.809 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.810+0000 7efce6000640 1 --2- 172.21.15.76:0/3827835244 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efcd0068040 0x7efcd006a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T12:43:08.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.814+0000 7efcede00640 1 --2- 172.21.15.76:0/3827835244 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efcd0068040 0x7efcd006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T12:43:08.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.814+0000 7efcede00640 1 --2- 172.21.15.76:0/3827835244 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efcd0068040 0x7efcd006a500 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efce0009b60 tx=0x7efce0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T12:43:08.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:08.814+0000 7efce6000640 1 -- 172.21.15.76:0/3827835244 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7efcdc053e80 con 0x7efcf0152690 2024-03-28T12:43:09.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09.074+0000 7efce6000640 1 -- 172.21.15.76:0/3827835244 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7efcdc021020 con 0x7efcf0152690 2024-03-28T12:43:09.275 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09.278+0000 7efcef200640 1 -- 172.21.15.76:0/3827835244 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efcf0071180 con 0x7efcf0152690 2024-03-28T12:43:09.287 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09.290+0000 7efce6000640 1 -- 172.21.15.76:0/3827835244 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7efcdc055de0 con 0x7efcf0152690 2024-03-28T12:43:09.288 INFO:teuthology.orchestra.run.smithi076.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-28T12:43:09.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09.294+0000 7efcef200640 1 -- 172.21.15.76:0/3827835244 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efcd0068040 msgr2=0x7efcd006a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:09.291 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09.294+0000 7efcef200640 1 --2- 172.21.15.76:0/3827835244 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efcd0068040 0x7efcd006a500 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efce0009b60 tx=0x7efce0009190 comp rx=0 tx=0).stop 2024-03-28T12:43:09.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09.294+0000 7efcef200640 1 -- 172.21.15.76:0/3827835244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efcf0152690 msgr2=0x7efcf01ee300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T12:43:09.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09.294+0000 7efcef200640 1 --2- 172.21.15.76:0/3827835244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efcf0152690 0x7efcf01ee300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efcdc00c420 tx=0x7efcdc00c8e0 comp rx=0 tx=0).stop 2024-03-28T12:43:09.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09.294+0000 7efcef200640 1 -- 172.21.15.76:0/3827835244 shutdown_connections 2024-03-28T12:43:09.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09.294+0000 7efcef200640 1 --2- 172.21.15.76:0/3827835244 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7efcd0068040 0x7efcd006a500 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:09.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09.294+0000 7efcef200640 1 --2- 172.21.15.76:0/3827835244 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efcf0158400 0x7efcf01e3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:09.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09.294+0000 7efcef200640 1 --2- 172.21.15.76:0/3827835244 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7efcf0152690 0x7efcf01ee300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:09.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09.294+0000 7efcef200640 1 --2- 172.21.15.76:0/3827835244 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efcf006f780 0x7efcf0159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T12:43:09.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09.294+0000 7efcef200640 1 -- 172.21.15.76:0/3827835244 >> 172.21.15.76:0/3827835244 conn(0x7efcf0070c10 msgr2=0x7efcf00c9920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T12:43:09.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09.294+0000 7efcef200640 1 -- 172.21.15.76:0/3827835244 shutdown_connections 2024-03-28T12:43:09.292 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09.294+0000 7efcef200640 1 -- 172.21.15.76:0/3827835244 wait complete. 2024-03-28T12:43:09.321 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-28T12:43:09.321 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-28T12:43:09.321 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi076.front.sepia.ceph.com 2024-03-28T12:43:09.321 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-28T12:43:09.321 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-28T12:43:09.321 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-28T12:43:09.321 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-28T12:43:09.322 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-28T12:43:09.322 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-28T12:43:09.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:43:09.322 DEBUG:teuthology.orchestra.run.smithi076:> ip addr 2024-03-28T12:43:09.331 INFO:teuthology.orchestra.run.smithi076.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-28T12:43:09.331 INFO:teuthology.orchestra.run.smithi076.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-28T12:43:09.331 INFO:teuthology.orchestra.run.smithi076.stdout: inet 127.0.0.1/8 scope host lo 2024-03-28T12:43:09.332 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft forever preferred_lft forever 2024-03-28T12:43:09.332 INFO:teuthology.orchestra.run.smithi076.stdout: inet6 ::1/128 scope host 2024-03-28T12:43:09.332 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft forever preferred_lft forever 2024-03-28T12:43:09.332 INFO:teuthology.orchestra.run.smithi076.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-28T12:43:09.332 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:d8:da:66 brd ff:ff:ff:ff:ff:ff 2024-03-28T12:43:09.332 INFO:teuthology.orchestra.run.smithi076.stdout: altname enp7s0f0 2024-03-28T12:43:09.332 INFO:teuthology.orchestra.run.smithi076.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-28T12:43:09.332 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:d8:da:67 brd ff:ff:ff:ff:ff:ff 2024-03-28T12:43:09.332 INFO:teuthology.orchestra.run.smithi076.stdout: altname enp7s0f1 2024-03-28T12:43:09.332 INFO:teuthology.orchestra.run.smithi076.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-03-28T12:43:09.332 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:8f:47:e0 brd ff:ff:ff:ff:ff:ff 2024-03-28T12:43:09.332 INFO:teuthology.orchestra.run.smithi076.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-28T12:43:09.332 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 0c:c4:7a:8f:47:e1 brd ff:ff:ff:ff:ff:ff 2024-03-28T12:43:09.332 INFO:teuthology.orchestra.run.smithi076.stdout: inet 172.21.15.76/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-03-28T12:43:09.332 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft 42051sec preferred_lft 42051sec 2024-03-28T12:43:09.332 INFO:teuthology.orchestra.run.smithi076.stdout: inet6 fe80::ec4:7aff:fe8f:47e1/64 scope link 2024-03-28T12:43:09.333 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft forever preferred_lft forever 2024-03-28T12:43:09.333 INFO:teuthology.orchestra.run.smithi076.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-03-28T12:43:09.333 INFO:teuthology.orchestra.run.smithi076.stdout: link/ether 02:42:4b:86:a7:00 brd ff:ff:ff:ff:ff:ff 2024-03-28T12:43:09.333 INFO:teuthology.orchestra.run.smithi076.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-03-28T12:43:09.333 INFO:teuthology.orchestra.run.smithi076.stdout: valid_lft forever preferred_lft forever 2024-03-28T12:43:09.333 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-28T12:43:09.333 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T12:43:09.333 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-03-28T12:43:09.333 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link add name ceph-brx type bridge 2024-03-28T12:43:09.333 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip addr flush dev ceph-brx 2024-03-28T12:43:09.333 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link set ceph-brx up 2024-03-28T12:43:09.333 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-28T12:43:09.334 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-03-28T12:43:09.421 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T12:43:09.504 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T12:43:09.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:43:09.514 DEBUG:teuthology.orchestra.run.smithi076:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-28T12:43:09.580 INFO:teuthology.orchestra.run.smithi076.stdout:1 2024-03-28T12:43:09.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:43:09.582 DEBUG:teuthology.orchestra.run.smithi076:> route 2024-03-28T12:43:09.646 INFO:teuthology.orchestra.run.smithi076.stdout:Kernel IP routing table 2024-03-28T12:43:09.646 INFO:teuthology.orchestra.run.smithi076.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-28T12:43:09.647 INFO:teuthology.orchestra.run.smithi076.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-03-28T12:43:09.647 INFO:teuthology.orchestra.run.smithi076.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-28T12:43:09.647 INFO:teuthology.orchestra.run.smithi076.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-03-28T12:43:09.647 INFO:teuthology.orchestra.run.smithi076.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-03-28T12:43:09.647 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-28T12:43:09.647 INFO:teuthology.orchestra.run.smithi076.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-28T12:43:09.647 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-28T12:43:09.647 INFO:teuthology.orchestra.run.smithi076.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-03-28T12:43:09.647 INFO:teuthology.orchestra.run.smithi076.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-28T12:43:09.648 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T12:43:09.648 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-03-28T12:43:09.648 DEBUG:teuthology.orchestra.run.smithi076:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-28T12:43:09.648 DEBUG:teuthology.orchestra.run.smithi076:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-28T12:43:09.648 DEBUG:teuthology.orchestra.run.smithi076:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-28T12:43:09.648 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-03-28T12:43:09.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T12:43:09.779 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T12:43:09.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:43:09.787 DEBUG:teuthology.orchestra.run.smithi076:> ip netns list 2024-03-28T12:43:09.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:43:09.797 DEBUG:teuthology.orchestra.run.smithi076:> ip netns list-id 2024-03-28T12:43:09.851 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T12:43:09.851 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-03-28T12:43:09.852 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-28T12:43:09.852 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-28T12:43:09.852 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-03-28T12:43:09.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T12:43:09.977 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T12:43:09.983 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-28T12:43:09.984 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T12:43:09.984 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-03-28T12:43:09.984 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-28T12:43:09.984 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-28T12:43:09.984 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-28T12:43:09.984 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-28T12:43:09.984 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-28T12:43:09.984 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-03-28T12:43:10.075 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T12:43:10.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T12:43:10.185 DEBUG:teuthology.orchestra.run.smithi076:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-28T12:43:10.185 DEBUG:teuthology.orchestra.run.smithi076:> set -e 2024-03-28T12:43:10.185 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link set brx.0 up 2024-03-28T12:43:10.185 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link set dev brx.0 master ceph-brx 2024-03-28T12:43:10.185 DEBUG:teuthology.orchestra.run.smithi076:> ') 2024-03-28T12:43:10.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T12:43:10.267 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T12:43:10.278 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-28T12:43:10.278 DEBUG:teuthology.orchestra.run.smithi076:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-28T12:43:10.288 INFO:teuthology.orchestra.run.smithi076.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-28T12:43:10.288 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-28T12:43:10.288 DEBUG:teuthology.orchestra.run.smithi076:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-28T12:43:10.339 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-28T12:43:10.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:43:10.339 DEBUG:teuthology.orchestra.run.smithi076:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-28T12:43:10.442 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-28T12:43:10.442 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-28T12:43:11.166 INFO:teuthology.orchestra.run.smithi076.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-28T12:43:11.166 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-28T12:43:11.166 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: resolved to: "172.21.15.76:3300,172.21.15.111:3300,172.21.15.111:3301" 2024-03-28T12:43:11.166 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: trying mount with new device syntax: 0@ed125c42-99c2-4574-a55f-ea7172f89d9c.cephfs=/ 2024-03-28T12:43:11.167 INFO:teuthology.orchestra.run.smithi076.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.76:3300/172.21.15.111:3300/172.21.15.111:3301" will pass to kernel 2024-03-28T12:43:11.171 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-28T12:43:11.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T12:43:11.171 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-28T12:43:11.192 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-28T12:43:11.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-28T12:43:11.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T12:43:11.338 INFO:teuthology.orchestra.run.smithi076.stdout:client4734 2024-03-28T12:43:11.338 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:43:11.339 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T12:43:11.349 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-28T12:43:11.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-28T12:43:11.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T12:43:11.489 INFO:teuthology.orchestra.run.smithi076.stdout:client4734 2024-03-28T12:43:11.490 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-28T12:43:11.538 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-28T12:43:11.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T12:43:11.563 INFO:teuthology.orchestra.run.smithi076.stdout:client4734 2024-03-28T12:43:11.563 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/ed125c42-99c2-4574-a55f-ea7172f89d9c.client4734/status') 2024-03-28T12:43:11.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-28T12:43:11.624 INFO:teuthology.orchestra.run.smithi076.stdout:instance: client.4734 (3)192.168.0.1:0/3133127655 2024-03-28T12:43:11.624 INFO:teuthology.orchestra.run.smithi076.stdout:blocklisted: false 2024-03-28T12:43:11.624 INFO:teuthology.orchestra.run.smithi076.stderr:0+1 records in 2024-03-28T12:43:11.624 INFO:teuthology.orchestra.run.smithi076.stderr:0+1 records out 2024-03-28T12:43:11.624 INFO:teuthology.orchestra.run.smithi076.stderr:69 bytes copied, 5.4354e-05 s, 1.3 MB/s 2024-03-28T12:43:11.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T12:43:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-28T12:43:11.635 INFO:teuthology.run_tasks:Running task workunit... 2024-03-28T12:43:11.647 INFO:tasks.workunit:Pulling workunits from ref e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15 2024-03-28T12:43:11.647 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-28T12:43:11.647 INFO:tasks.workunit:timeout=6h 2024-03-28T12:43:11.647 INFO:tasks.workunit:cleanup=True 2024-03-28T12:43:11.647 DEBUG:teuthology.orchestra.run.smithi076:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-28T12:43:11.657 INFO:teuthology.orchestra.run.smithi076.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-28T12:43:11.657 INFO:teuthology.orchestra.run.smithi076.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-03-28T12:43:11.657 INFO:teuthology.orchestra.run.smithi076.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-03-28T12:43:11.657 INFO:teuthology.orchestra.run.smithi076.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-28T12:43:11.657 INFO:teuthology.orchestra.run.smithi076.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-28T12:43:11.658 INFO:teuthology.orchestra.run.smithi076.stdout:Modify: 2024-03-28 12:42:02.579634383 +0000 2024-03-28T12:43:11.658 INFO:teuthology.orchestra.run.smithi076.stdout:Change: 2024-03-28 12:42:18.047381638 +0000 2024-03-28T12:43:11.658 INFO:teuthology.orchestra.run.smithi076.stdout: Birth: 2024-03-28 12:42:02.579634383 +0000 2024-03-28T12:43:11.658 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-28T12:43:11.658 DEBUG:teuthology.orchestra.run.smithi076:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-28T12:43:12.068 DEBUG:teuthology.orchestra.run.smithi076:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15 2024-03-28T12:43:12.081 INFO:tasks.workunit.client.0.smithi076.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-28T12:43:36.636 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:43:36.640 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:44:06.720 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:44:06.725 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:44:36.825 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:44:36.830 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:44:49.268 INFO:tasks.workunit.client.0.smithi076.stderr:Updating files: 62% (7656/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 94% (11556/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-28T12:44:49.926 INFO:tasks.workunit.client.0.smithi076.stderr:Note: switching to 'e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15'. 2024-03-28T12:44:49.926 INFO:tasks.workunit.client.0.smithi076.stderr: 2024-03-28T12:44:49.926 INFO:tasks.workunit.client.0.smithi076.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-28T12:44:49.926 INFO:tasks.workunit.client.0.smithi076.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-28T12:44:49.926 INFO:tasks.workunit.client.0.smithi076.stderr:state without impacting any branches by switching back to a branch. 2024-03-28T12:44:49.926 INFO:tasks.workunit.client.0.smithi076.stderr: 2024-03-28T12:44:49.926 INFO:tasks.workunit.client.0.smithi076.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-28T12:44:49.926 INFO:tasks.workunit.client.0.smithi076.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-28T12:44:49.926 INFO:tasks.workunit.client.0.smithi076.stderr: 2024-03-28T12:44:49.926 INFO:tasks.workunit.client.0.smithi076.stderr: git switch -c 2024-03-28T12:44:49.926 INFO:tasks.workunit.client.0.smithi076.stderr: 2024-03-28T12:44:49.927 INFO:tasks.workunit.client.0.smithi076.stderr:Or undo this operation with: 2024-03-28T12:44:49.927 INFO:tasks.workunit.client.0.smithi076.stderr: 2024-03-28T12:44:49.927 INFO:tasks.workunit.client.0.smithi076.stderr: git switch - 2024-03-28T12:44:49.927 INFO:tasks.workunit.client.0.smithi076.stderr: 2024-03-28T12:44:49.927 INFO:tasks.workunit.client.0.smithi076.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-28T12:44:49.927 INFO:tasks.workunit.client.0.smithi076.stderr: 2024-03-28T12:44:49.927 INFO:tasks.workunit.client.0.smithi076.stderr:HEAD is now at e0e48ba6ee8 Merge PR #56536 into wip-batrick-testing-20240327.230800 2024-03-28T12:44:49.949 DEBUG:teuthology.orchestra.run.smithi076:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-28T12:44:49.960 INFO:tasks.workunit.client.0.smithi076.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-28T12:44:49.963 INFO:tasks.workunit.client.0.smithi076.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-28T12:44:49.964 INFO:tasks.workunit.client.0.smithi076.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-28T12:44:50.719 INFO:tasks.workunit.client.0.smithi076.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-28T12:44:50.811 INFO:tasks.workunit.client.0.smithi076.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-28T12:44:50.869 INFO:tasks.workunit.client.0.smithi076.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-28T12:44:50.872 INFO:tasks.workunit.client.0.smithi076.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-28T12:44:50.872 INFO:tasks.workunit.client.0.smithi076.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-28T12:44:50.934 INFO:tasks.workunit.client.0.smithi076.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-28T12:44:50.941 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T12:44:50.941 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-28T12:44:50.998 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-03-28T12:44:50.999 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-03-28T12:44:50.999 DEBUG:teuthology.orchestra.run.smithi076:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-03-28T12:44:51.191 INFO:tasks.workunit.client.0.smithi076.stderr:+ mkdir -p fsstress 2024-03-28T12:44:51.225 INFO:tasks.workunit.client.0.smithi076.stderr:+ pushd fsstress 2024-03-28T12:44:51.225 INFO:tasks.workunit.client.0.smithi076.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-28T12:44:51.226 INFO:tasks.workunit.client.0.smithi076.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-03-28T12:44:52.277 INFO:tasks.workunit.client.0.smithi076.stderr:+ tar xzf ltp-full.tgz 2024-03-28T12:45:07.106 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:45:07.110 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:45:37.160 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:45:37.165 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:46:07.299 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:46:07.302 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:46:37.364 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:46:37.369 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:47:07.487 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:47:07.493 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:47:37.576 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:47:37.580 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:48:07.689 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:48:07.697 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:48:38.045 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:48:38.052 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:49:08.218 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:49:08.223 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:49:38.275 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:49:38.280 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:50:08.407 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:50:08.413 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:50:15.957 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:09:33.150 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T12:50:16.035 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:09:33.228 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T12:50:16.098 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:09:33.213 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T12:50:16.147 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:09:33.262 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T12:50:16.176 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:09:33.291 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T12:50:16.242 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:09:33.358 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T12:50:16.494 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:09:33.688 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T12:50:16.640 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:09:33.755 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T12:50:16.794 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:09:33.910 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T12:50:38.543 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:50:38.548 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:51:08.602 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:51:08.606 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:51:38.812 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:51:38.817 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:52:08.870 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:52:08.875 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:52:38.929 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:52:38.935 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:52:47.602 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:12:04.795 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T12:52:47.612 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:12:04.805 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T12:52:47.649 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:12:04.765 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T12:52:47.654 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:12:04.769 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T12:52:47.654 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:12:04.770 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T12:52:47.658 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:12:04.773 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T12:52:47.722 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:12:04.915 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T12:52:47.764 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:12:04.880 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T12:52:47.795 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:12:04.910 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T12:53:09.052 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:53:09.057 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:53:39.257 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:53:39.261 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:54:09.614 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:54:09.619 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:54:39.677 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:54:39.681 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:55:09.947 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:55:09.952 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:55:40.063 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:55:40.066 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:56:10.118 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:56:10.122 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:56:40.215 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:56:40.219 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:56:57.565 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:16:14.758 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T12:56:57.589 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:16:14.705 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T12:56:57.593 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:16:14.708 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T12:56:57.618 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:16:14.811 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T12:56:57.639 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:16:14.754 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T12:56:57.675 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:16:14.790 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T12:56:57.730 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:16:14.923 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T12:56:57.780 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:16:14.896 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T12:56:57.816 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:16:14.931 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T12:57:10.267 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:57:10.272 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:57:40.402 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:57:40.405 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:58:10.454 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:58:10.458 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:58:37.289 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:17:54.480 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T12:58:37.293 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:17:54.485 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T12:58:37.336 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:17:54.527 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T12:58:37.452 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:17:54.567 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T12:58:37.455 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:17:54.570 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T12:58:37.457 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:17:54.574 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T12:58:37.460 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:17:54.576 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T12:58:37.521 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:17:54.637 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T12:58:37.523 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:17:54.639 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T12:58:40.596 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:58:40.601 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:59:10.952 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:59:10.956 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:59:41.082 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T12:59:41.085 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:00:11.187 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:00:11.191 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:00:41.259 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:00:41.264 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:01:06.235 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:20:23.423 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:01:06.240 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:20:23.428 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:01:06.273 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:20:23.390 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:01:06.277 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:20:23.394 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:01:06.286 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:20:23.402 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:01:06.290 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:20:23.406 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:01:06.311 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:20:23.500 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:01:06.363 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:20:23.479 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:01:06.394 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:20:23.511 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:01:11.407 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:01:11.411 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:01:18.007 INFO:tasks.workunit.client.0.smithi076.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-03-28T13:01:18.027 INFO:tasks.workunit.client.0.smithi076.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-28T13:01:18.028 INFO:tasks.workunit.client.0.smithi076.stderr:+ make 2024-03-28T13:01:18.817 INFO:tasks.workunit.client.0.smithi076.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-03-28T13:01:19.682 INFO:tasks.workunit.client.0.smithi076.stderr:++ readlink -f fsstress 2024-03-28T13:01:19.682 INFO:tasks.workunit.client.0.smithi076.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-03-28T13:01:19.682 INFO:tasks.workunit.client.0.smithi076.stderr:+ popd 2024-03-28T13:01:19.683 INFO:tasks.workunit.client.0.smithi076.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-28T13:01:19.683 INFO:tasks.workunit.client.0.smithi076.stderr:+ popd 2024-03-28T13:01:19.683 INFO:tasks.workunit.client.0.smithi076.stdout:~/cephtest/mnt.0/client.0/tmp 2024-03-28T13:01:19.683 INFO:tasks.workunit.client.0.smithi076.stderr:++ mktemp -d -p . 2024-03-28T13:01:19.723 INFO:tasks.workunit.client.0.smithi076.stderr:+ T=./tmp.TaPi7Wcq54 2024-03-28T13:01:19.723 INFO:tasks.workunit.client.0.smithi076.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.TaPi7Wcq54 -l 1 -n 1000 -p 10 -v 2024-03-28T13:01:19.752 INFO:tasks.workunit.client.0.smithi076.stdout:seed = 1712256595 2024-03-28T13:01:19.867 INFO:tasks.workunit.client.0.smithi076.stdout:0/0: truncate - no filename 2024-03-28T13:01:19.929 INFO:tasks.workunit.client.0.smithi076.stdout:0/1: symlink l0 0 2024-03-28T13:01:19.929 INFO:tasks.workunit.client.0.smithi076.stdout:1/0: dwrite - no filename 2024-03-28T13:01:19.929 INFO:tasks.workunit.client.0.smithi076.stdout:1/1: write - no filename 2024-03-28T13:01:19.929 INFO:tasks.workunit.client.0.smithi076.stdout:1/2: rmdir - no directory 2024-03-28T13:01:19.929 INFO:tasks.workunit.client.0.smithi076.stdout:1/3: chown . 229997 1 2024-03-28T13:01:19.929 INFO:tasks.workunit.client.0.smithi076.stdout:1/4: write - no filename 2024-03-28T13:01:19.959 INFO:tasks.workunit.client.0.smithi076.stdout:2/0: fsync - no filename 2024-03-28T13:01:19.959 INFO:tasks.workunit.client.0.smithi076.stdout:2/1: chown . 2 1 2024-03-28T13:01:19.960 INFO:tasks.workunit.client.0.smithi076.stdout:2/2: stat - no entries 2024-03-28T13:01:19.960 INFO:tasks.workunit.client.0.smithi076.stdout:2/3: dwrite - no filename 2024-03-28T13:01:20.013 INFO:tasks.workunit.client.0.smithi076.stdout:0/2: creat f1 x:0 0 0 2024-03-28T13:01:20.013 INFO:tasks.workunit.client.0.smithi076.stdout:1/5: creat f0 x:0 0 0 2024-03-28T13:01:20.013 INFO:tasks.workunit.client.0.smithi076.stdout:1/6: dread - f0 zero size 2024-03-28T13:01:20.048 INFO:tasks.workunit.client.0.smithi076.stdout:1/7: dwrite f0 [0,4194304] 0 2024-03-28T13:01:20.048 INFO:tasks.workunit.client.0.smithi076.stdout:1/8: fdatasync f0 0 2024-03-28T13:01:20.086 INFO:tasks.workunit.client.0.smithi076.stdout:2/4: creat f0 x:0 0 0 2024-03-28T13:01:20.089 INFO:tasks.workunit.client.0.smithi076.stdout:1/9: dwrite f0 [0,4194304] 0 2024-03-28T13:01:20.225 INFO:tasks.workunit.client.0.smithi076.stdout:0/3: symlink l2 0 2024-03-28T13:01:20.225 INFO:tasks.workunit.client.0.smithi076.stdout:2/5: symlink l1 0 2024-03-28T13:01:20.225 INFO:tasks.workunit.client.0.smithi076.stdout:2/6: truncate f0 1041571 0 2024-03-28T13:01:20.228 INFO:tasks.workunit.client.0.smithi076.stdout:2/7: dread f0 [0,4194304] 0 2024-03-28T13:01:20.228 INFO:tasks.workunit.client.0.smithi076.stdout:4/0: fdatasync - no filename 2024-03-28T13:01:20.228 INFO:tasks.workunit.client.0.smithi076.stdout:4/1: dread - no filename 2024-03-28T13:01:20.239 INFO:tasks.workunit.client.0.smithi076.stdout:1/10: mknod c1 0 2024-03-28T13:01:20.239 INFO:tasks.workunit.client.0.smithi076.stdout:1/11: stat c1 0 2024-03-28T13:01:20.239 INFO:tasks.workunit.client.0.smithi076.stdout:1/12: chown c1 459 1 2024-03-28T13:01:20.240 INFO:tasks.workunit.client.0.smithi076.stdout:3/0: creat f0 x:0 0 0 2024-03-28T13:01:20.240 INFO:tasks.workunit.client.0.smithi076.stdout:3/1: write f0 [508473,129141] 0 2024-03-28T13:01:20.655 INFO:tasks.workunit.client.0.smithi076.stdout:0/4: symlink l3 0 2024-03-28T13:01:20.655 INFO:tasks.workunit.client.0.smithi076.stdout:0/5: rmdir - no directory 2024-03-28T13:01:20.656 INFO:tasks.workunit.client.0.smithi076.stdout:2/8: mkdir d2 0 2024-03-28T13:01:20.656 INFO:tasks.workunit.client.0.smithi076.stdout:5/0: read - no filename 2024-03-28T13:01:20.656 INFO:tasks.workunit.client.0.smithi076.stdout:5/1: readlink - no filename 2024-03-28T13:01:20.656 INFO:tasks.workunit.client.0.smithi076.stdout:5/2: rmdir - no directory 2024-03-28T13:01:20.656 INFO:tasks.workunit.client.0.smithi076.stdout:5/3: rmdir - no directory 2024-03-28T13:01:20.657 INFO:tasks.workunit.client.0.smithi076.stdout:5/4: link - no file 2024-03-28T13:01:20.657 INFO:tasks.workunit.client.0.smithi076.stdout:5/5: readlink - no filename 2024-03-28T13:01:20.657 INFO:tasks.workunit.client.0.smithi076.stdout:5/6: write - no filename 2024-03-28T13:01:20.657 INFO:tasks.workunit.client.0.smithi076.stdout:5/7: dread - no filename 2024-03-28T13:01:20.657 INFO:tasks.workunit.client.0.smithi076.stdout:4/2: mkdir d0 0 2024-03-28T13:01:20.657 INFO:tasks.workunit.client.0.smithi076.stdout:3/2: mkdir d1 0 2024-03-28T13:01:20.657 INFO:tasks.workunit.client.0.smithi076.stdout:1/13: unlink c1 0 2024-03-28T13:01:20.673 INFO:tasks.workunit.client.0.smithi076.stdout:3/3: dread f0 [0,4194304] 0 2024-03-28T13:01:20.791 INFO:tasks.workunit.client.0.smithi076.stdout:0/6: symlink l4 0 2024-03-28T13:01:20.792 INFO:tasks.workunit.client.0.smithi076.stdout:0/7: dread - f1 zero size 2024-03-28T13:01:20.792 INFO:tasks.workunit.client.0.smithi076.stdout:0/8: chown l0 19064 1 2024-03-28T13:01:20.804 INFO:tasks.workunit.client.0.smithi076.stdout:5/8: symlink l0 0 2024-03-28T13:01:20.804 INFO:tasks.workunit.client.0.smithi076.stdout:5/9: write - no filename 2024-03-28T13:01:20.804 INFO:tasks.workunit.client.0.smithi076.stdout:6/0: truncate - no filename 2024-03-28T13:01:20.804 INFO:tasks.workunit.client.0.smithi076.stdout:6/1: dread - no filename 2024-03-28T13:01:20.804 INFO:tasks.workunit.client.0.smithi076.stdout:6/2: truncate - no filename 2024-03-28T13:01:20.805 INFO:tasks.workunit.client.0.smithi076.stdout:6/3: rename - no filename 2024-03-28T13:01:20.805 INFO:tasks.workunit.client.0.smithi076.stdout:6/4: chown . 6406681 1 2024-03-28T13:01:20.805 INFO:tasks.workunit.client.0.smithi076.stdout:6/5: dread - no filename 2024-03-28T13:01:20.805 INFO:tasks.workunit.client.0.smithi076.stdout:6/6: write - no filename 2024-03-28T13:01:20.818 INFO:tasks.workunit.client.0.smithi076.stdout:2/9: unlink f0 0 2024-03-28T13:01:20.818 INFO:tasks.workunit.client.0.smithi076.stdout:2/10: dwrite - no filename 2024-03-28T13:01:20.818 INFO:tasks.workunit.client.0.smithi076.stdout:2/11: write - no filename 2024-03-28T13:01:20.818 INFO:tasks.workunit.client.0.smithi076.stdout:4/3: mknod d0/c1 0 2024-03-28T13:01:20.988 INFO:tasks.workunit.client.0.smithi076.stdout:1/14: creat f2 x:0 0 0 2024-03-28T13:01:20.988 INFO:tasks.workunit.client.0.smithi076.stdout:0/9: creat f5 x:0 0 0 2024-03-28T13:01:21.014 INFO:tasks.workunit.client.0.smithi076.stdout:1/15: dread f0 [0,4194304] 0 2024-03-28T13:01:21.037 INFO:tasks.workunit.client.0.smithi076.stdout:5/10: creat f1 x:0 0 0 2024-03-28T13:01:21.056 INFO:tasks.workunit.client.0.smithi076.stdout:6/7: creat f0 x:0 0 0 2024-03-28T13:01:21.056 INFO:tasks.workunit.client.0.smithi076.stdout:6/8: stat f0 0 2024-03-28T13:01:21.057 INFO:tasks.workunit.client.0.smithi076.stdout:2/12: unlink l1 0 2024-03-28T13:01:21.272 INFO:tasks.workunit.client.0.smithi076.stdout:0/10: symlink l6 0 2024-03-28T13:01:21.273 INFO:tasks.workunit.client.0.smithi076.stdout:1/16: rename f2 to f3 0 2024-03-28T13:01:21.296 INFO:tasks.workunit.client.0.smithi076.stdout:8/0: truncate - no filename 2024-03-28T13:01:21.324 INFO:tasks.workunit.client.0.smithi076.stdout:5/11: mknod c2 0 2024-03-28T13:01:21.324 INFO:tasks.workunit.client.0.smithi076.stdout:7/0: symlink l0 0 2024-03-28T13:01:21.325 INFO:tasks.workunit.client.0.smithi076.stdout:6/9: creat f1 x:0 0 0 2024-03-28T13:01:21.509 INFO:tasks.workunit.client.0.smithi076.stdout:2/13: symlink d2/l3 0 2024-03-28T13:01:21.509 INFO:tasks.workunit.client.0.smithi076.stdout:2/14: dread - no filename 2024-03-28T13:01:21.509 INFO:tasks.workunit.client.0.smithi076.stdout:2/15: write - no filename 2024-03-28T13:01:21.509 INFO:tasks.workunit.client.0.smithi076.stdout:2/16: readlink d2/l3 0 2024-03-28T13:01:21.509 INFO:tasks.workunit.client.0.smithi076.stdout:2/17: dread - no filename 2024-03-28T13:01:21.509 INFO:tasks.workunit.client.0.smithi076.stdout:2/18: dread - no filename 2024-03-28T13:01:21.540 INFO:tasks.workunit.client.0.smithi076.stdout:3/4: fsync f0 0 2024-03-28T13:01:21.622 INFO:tasks.workunit.client.0.smithi076.stdout:4/4: getdents d0 0 2024-03-28T13:01:21.623 INFO:tasks.workunit.client.0.smithi076.stdout:4/5: write - no filename 2024-03-28T13:01:21.623 INFO:tasks.workunit.client.0.smithi076.stdout:4/6: stat d0/c1 0 2024-03-28T13:01:21.623 INFO:tasks.workunit.client.0.smithi076.stdout:4/7: fsync - no filename 2024-03-28T13:01:21.623 INFO:tasks.workunit.client.0.smithi076.stdout:4/8: dread - no filename 2024-03-28T13:01:21.623 INFO:tasks.workunit.client.0.smithi076.stdout:4/9: chown d0 75604311 1 2024-03-28T13:01:21.787 INFO:tasks.workunit.client.0.smithi076.stdout:0/11: rename l0 to l7 0 2024-03-28T13:01:21.787 INFO:tasks.workunit.client.0.smithi076.stdout:0/12: write f1 [186846,102151] 0 2024-03-28T13:01:21.910 INFO:tasks.workunit.client.0.smithi076.stdout:1/17: creat f4 x:0 0 0 2024-03-28T13:01:21.910 INFO:tasks.workunit.client.0.smithi076.stdout:9/0: chown . 452134 1 2024-03-28T13:01:21.929 INFO:tasks.workunit.client.0.smithi076.stdout:1/18: write f0 [4188305,115772] 0 2024-03-28T13:01:21.934 INFO:tasks.workunit.client.0.smithi076.stdout:8/1: mknod c0 0 2024-03-28T13:01:21.934 INFO:tasks.workunit.client.0.smithi076.stdout:5/12: creat f3 x:0 0 0 2024-03-28T13:01:21.934 INFO:tasks.workunit.client.0.smithi076.stdout:6/10: mknod c2 0 2024-03-28T13:01:21.934 INFO:tasks.workunit.client.0.smithi076.stdout:7/1: unlink l0 0 2024-03-28T13:01:21.934 INFO:tasks.workunit.client.0.smithi076.stdout:7/2: unlink - no file 2024-03-28T13:01:21.934 INFO:tasks.workunit.client.0.smithi076.stdout:7/3: rmdir - no directory 2024-03-28T13:01:21.947 INFO:tasks.workunit.client.0.smithi076.stdout:2/19: unlink d2/l3 0 2024-03-28T13:01:21.947 INFO:tasks.workunit.client.0.smithi076.stdout:2/20: truncate - no filename 2024-03-28T13:01:21.947 INFO:tasks.workunit.client.0.smithi076.stdout:3/5: mkdir d1/d2 0 2024-03-28T13:01:21.947 INFO:tasks.workunit.client.0.smithi076.stdout:4/10: creat d0/f2 x:0 0 0 2024-03-28T13:01:21.948 INFO:tasks.workunit.client.0.smithi076.stdout:4/11: fdatasync d0/f2 0 2024-03-28T13:01:21.951 INFO:tasks.workunit.client.0.smithi076.stdout:3/6: write f0 [141323,4961] 0 2024-03-28T13:01:21.951 INFO:tasks.workunit.client.0.smithi076.stdout:3/7: read f0 [401805,92222] 0 2024-03-28T13:01:21.951 INFO:tasks.workunit.client.0.smithi076.stdout:3/8: readlink - no filename 2024-03-28T13:01:21.952 INFO:tasks.workunit.client.0.smithi076.stdout:3/9: rename d1 to d1/d3 22 2024-03-28T13:01:21.952 INFO:tasks.workunit.client.0.smithi076.stdout:3/10: readlink - no filename 2024-03-28T13:01:22.206 INFO:tasks.workunit.client.0.smithi076.stdout:0/13: symlink l8 0 2024-03-28T13:01:22.207 INFO:tasks.workunit.client.0.smithi076.stdout:9/1: mknod c0 0 2024-03-28T13:01:22.207 INFO:tasks.workunit.client.0.smithi076.stdout:9/2: write - no filename 2024-03-28T13:01:22.221 INFO:tasks.workunit.client.0.smithi076.stdout:8/2: unlink c0 0 2024-03-28T13:01:22.221 INFO:tasks.workunit.client.0.smithi076.stdout:1/19: creat f5 x:0 0 0 2024-03-28T13:01:22.221 INFO:tasks.workunit.client.0.smithi076.stdout:1/20: rmdir - no directory 2024-03-28T13:01:22.221 INFO:tasks.workunit.client.0.smithi076.stdout:6/11: mknod c3 0 2024-03-28T13:01:22.221 INFO:tasks.workunit.client.0.smithi076.stdout:6/12: write f0 [272760,126765] 0 2024-03-28T13:01:22.234 INFO:tasks.workunit.client.0.smithi076.stdout:5/13: creat f4 x:0 0 0 2024-03-28T13:01:22.234 INFO:tasks.workunit.client.0.smithi076.stdout:7/4: mkdir d1 0 2024-03-28T13:01:22.234 INFO:tasks.workunit.client.0.smithi076.stdout:7/5: dwrite - no filename 2024-03-28T13:01:22.234 INFO:tasks.workunit.client.0.smithi076.stdout:7/6: write - no filename 2024-03-28T13:01:22.234 INFO:tasks.workunit.client.0.smithi076.stdout:7/7: read - no filename 2024-03-28T13:01:22.234 INFO:tasks.workunit.client.0.smithi076.stdout:7/8: chown d1 6458 1 2024-03-28T13:01:22.234 INFO:tasks.workunit.client.0.smithi076.stdout:7/9: dread - no filename 2024-03-28T13:01:22.234 INFO:tasks.workunit.client.0.smithi076.stdout:2/21: creat d2/f4 x:0 0 0 2024-03-28T13:01:22.234 INFO:tasks.workunit.client.0.smithi076.stdout:4/12: mknod d0/c3 0 2024-03-28T13:01:22.234 INFO:tasks.workunit.client.0.smithi076.stdout:4/13: dread - d0/f2 zero size 2024-03-28T13:01:22.235 INFO:tasks.workunit.client.0.smithi076.stdout:3/11: mknod d1/c4 0 2024-03-28T13:01:22.235 INFO:tasks.workunit.client.0.smithi076.stdout:4/14: write d0/f2 [377868,99196] 0 2024-03-28T13:01:22.247 INFO:tasks.workunit.client.0.smithi076.stdout:6/13: dread f0 [0,4194304] 0 2024-03-28T13:01:22.290 INFO:tasks.workunit.client.0.smithi076.stdout:3/12: dread f0 [0,4194304] 0 2024-03-28T13:01:22.290 INFO:tasks.workunit.client.0.smithi076.stdout:3/13: read f0 [418065,60412] 0 2024-03-28T13:01:22.296 INFO:tasks.workunit.client.0.smithi076.stdout:0/14: dwrite f1 [0,4194304] 0 2024-03-28T13:01:22.305 INFO:tasks.workunit.client.0.smithi076.stdout:4/15: dread d0/f2 [0,4194304] 0 2024-03-28T13:01:22.305 INFO:tasks.workunit.client.0.smithi076.stdout:4/16: rename d0 to d0/d4 22 2024-03-28T13:01:22.314 INFO:tasks.workunit.client.0.smithi076.stdout:0/15: write f1 [2721304,16213] 0 2024-03-28T13:01:22.359 INFO:tasks.workunit.client.0.smithi076.stdout:0/16: dwrite f5 [0,4194304] 0 2024-03-28T13:01:22.375 INFO:tasks.workunit.client.0.smithi076.stdout:0/17: write f5 [1087769,125539] 0 2024-03-28T13:01:23.531 INFO:tasks.workunit.client.0.smithi076.stdout:9/3: creat f1 x:0 0 0 2024-03-28T13:01:23.531 INFO:tasks.workunit.client.0.smithi076.stdout:9/4: readlink - no filename 2024-03-28T13:01:23.531 INFO:tasks.workunit.client.0.smithi076.stdout:8/3: mkdir d1 0 2024-03-28T13:01:23.537 INFO:tasks.workunit.client.0.smithi076.stdout:1/21: symlink l6 0 2024-03-28T13:01:23.537 INFO:tasks.workunit.client.0.smithi076.stdout:1/22: chown f4 31424 1 2024-03-28T13:01:23.556 INFO:tasks.workunit.client.0.smithi076.stdout:7/10: mknod d1/c2 0 2024-03-28T13:01:23.557 INFO:tasks.workunit.client.0.smithi076.stdout:7/11: write - no filename 2024-03-28T13:01:23.557 INFO:tasks.workunit.client.0.smithi076.stdout:6/14: creat f4 x:0 0 0 2024-03-28T13:01:23.557 INFO:tasks.workunit.client.0.smithi076.stdout:6/15: chown c2 6 1 2024-03-28T13:01:23.557 INFO:tasks.workunit.client.0.smithi076.stdout:6/16: write f0 [318567,37275] 0 2024-03-28T13:01:23.557 INFO:tasks.workunit.client.0.smithi076.stdout:6/17: chown f1 53036930 1 2024-03-28T13:01:24.316 INFO:tasks.workunit.client.0.smithi076.stdout:5/14: getdents . 0 2024-03-28T13:01:24.349 INFO:tasks.workunit.client.0.smithi076.stdout:5/15: dwrite f4 [0,4194304] 0 2024-03-28T13:01:24.825 INFO:tasks.workunit.client.0.smithi076.stdout:3/14: symlink d1/d2/l5 0 2024-03-28T13:01:24.826 INFO:tasks.workunit.client.0.smithi076.stdout:4/17: creat d0/f5 x:0 0 0 2024-03-28T13:01:24.826 INFO:tasks.workunit.client.0.smithi076.stdout:4/18: truncate d0/f2 1334312 0 2024-03-28T13:01:24.937 INFO:tasks.workunit.client.0.smithi076.stdout:0/18: symlink l9 0 2024-03-28T13:01:24.937 INFO:tasks.workunit.client.0.smithi076.stdout:0/19: stat l3 0 2024-03-28T13:01:41.465 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:01:41.469 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:02:01.034 INFO:tasks.workunit.client.0.smithi076.stdout:9/5: symlink l2 0 2024-03-28T13:02:01.034 INFO:tasks.workunit.client.0.smithi076.stdout:9/6: readlink l2 0 2024-03-28T13:02:01.088 INFO:tasks.workunit.client.0.smithi076.stdout:9/7: dwrite f1 [0,4194304] 0 2024-03-28T13:02:01.094 INFO:tasks.workunit.client.0.smithi076.stdout:8/4: rmdir d1 0 2024-03-28T13:02:01.183 INFO:tasks.workunit.client.0.smithi076.stdout:1/23: link f0 f7 0 2024-03-28T13:02:01.227 INFO:tasks.workunit.client.0.smithi076.stdout:7/12: symlink d1/l3 0 2024-03-28T13:02:01.227 INFO:tasks.workunit.client.0.smithi076.stdout:7/13: truncate - no filename 2024-03-28T13:02:01.229 INFO:tasks.workunit.client.0.smithi076.stdout:1/24: dwrite f7 [0,4194304] 0 2024-03-28T13:02:01.229 INFO:tasks.workunit.client.0.smithi076.stdout:1/25: dread - f3 zero size 2024-03-28T13:02:01.257 INFO:tasks.workunit.client.0.smithi076.stdout:6/18: symlink l5 0 2024-03-28T13:02:01.402 INFO:tasks.workunit.client.0.smithi076.stdout:5/16: mkdir d5 0 2024-03-28T13:02:01.402 INFO:tasks.workunit.client.0.smithi076.stdout:3/15: mkdir d1/d2/d6 0 2024-03-28T13:02:01.402 INFO:tasks.workunit.client.0.smithi076.stdout:3/16: fdatasync f0 0 2024-03-28T13:02:01.460 INFO:tasks.workunit.client.0.smithi076.stdout:4/19: symlink d0/l6 0 2024-03-28T13:02:01.474 INFO:tasks.workunit.client.0.smithi076.stdout:5/17: dwrite f1 [0,4194304] 0 2024-03-28T13:02:01.474 INFO:tasks.workunit.client.0.smithi076.stdout:5/18: chown f1 218 1 2024-03-28T13:02:01.490 INFO:tasks.workunit.client.0.smithi076.stdout:0/20: symlink la 0 2024-03-28T13:02:01.526 INFO:tasks.workunit.client.0.smithi076.stdout:5/19: dwrite f1 [0,4194304] 0 2024-03-28T13:02:01.526 INFO:tasks.workunit.client.0.smithi076.stdout:5/20: dread - f3 zero size 2024-03-28T13:02:01.653 INFO:tasks.workunit.client.0.smithi076.stdout:9/8: rename f1 to f3 0 2024-03-28T13:02:01.738 INFO:tasks.workunit.client.0.smithi076.stdout:7/14: creat d1/f4 x:0 0 0 2024-03-28T13:02:01.794 INFO:tasks.workunit.client.0.smithi076.stdout:1/26: rename f4 to f8 0 2024-03-28T13:02:01.795 INFO:tasks.workunit.client.0.smithi076.stdout:7/15: dwrite d1/f4 [0,4194304] 0 2024-03-28T13:02:01.902 INFO:tasks.workunit.client.0.smithi076.stdout:6/19: unlink f4 0 2024-03-28T13:02:01.951 INFO:tasks.workunit.client.0.smithi076.stdout:3/17: mkdir d1/d7 0 2024-03-28T13:02:01.952 INFO:tasks.workunit.client.0.smithi076.stdout:3/18: chown d1 1 1 2024-03-28T13:02:02.000 INFO:tasks.workunit.client.0.smithi076.stdout:4/20: symlink d0/l7 0 2024-03-28T13:02:02.147 INFO:tasks.workunit.client.0.smithi076.stdout:0/21: mkdir db 0 2024-03-28T13:02:02.235 INFO:tasks.workunit.client.0.smithi076.stdout:5/21: unlink f1 0 2024-03-28T13:02:02.359 INFO:tasks.workunit.client.0.smithi076.stdout:1/27: link l6 l9 0 2024-03-28T13:02:02.359 INFO:tasks.workunit.client.0.smithi076.stdout:1/28: rmdir - no directory 2024-03-28T13:02:02.359 INFO:tasks.workunit.client.0.smithi076.stdout:1/29: chown l6 11 1 2024-03-28T13:02:02.359 INFO:tasks.workunit.client.0.smithi076.stdout:1/30: stat f5 0 2024-03-28T13:02:02.359 INFO:tasks.workunit.client.0.smithi076.stdout:1/31: stat f8 0 2024-03-28T13:02:02.359 INFO:tasks.workunit.client.0.smithi076.stdout:1/32: chown l6 0 1 2024-03-28T13:02:02.359 INFO:tasks.workunit.client.0.smithi076.stdout:1/33: read - f3 zero size 2024-03-28T13:02:02.499 INFO:tasks.workunit.client.0.smithi076.stdout:7/16: creat d1/f5 x:0 0 0 2024-03-28T13:02:02.499 INFO:tasks.workunit.client.0.smithi076.stdout:7/17: chown d1 4342606 1 2024-03-28T13:02:02.499 INFO:tasks.workunit.client.0.smithi076.stdout:6/20: mkdir d6 0 2024-03-28T13:02:02.519 INFO:tasks.workunit.client.0.smithi076.stdout:7/18: write d1/f4 [3471906,5759] 0 2024-03-28T13:02:02.561 INFO:tasks.workunit.client.0.smithi076.stdout:3/19: mkdir d1/d2/d8 0 2024-03-28T13:02:02.602 INFO:tasks.workunit.client.0.smithi076.stdout:3/20: dwrite f0 [0,4194304] 0 2024-03-28T13:02:02.650 INFO:tasks.workunit.client.0.smithi076.stdout:3/21: dwrite f0 [0,4194304] 0 2024-03-28T13:02:02.658 INFO:tasks.workunit.client.0.smithi076.stdout:0/22: mkdir db/dc 0 2024-03-28T13:02:02.658 INFO:tasks.workunit.client.0.smithi076.stdout:4/21: creat d0/f8 x:0 0 0 2024-03-28T13:02:02.658 INFO:tasks.workunit.client.0.smithi076.stdout:4/22: write d0/f8 [909462,38176] 0 2024-03-28T13:02:02.692 INFO:tasks.workunit.client.0.smithi076.stdout:0/23: dwrite f5 [0,4194304] 0 2024-03-28T13:02:02.756 INFO:tasks.workunit.client.0.smithi076.stdout:5/22: creat d5/f6 x:0 0 0 2024-03-28T13:02:02.795 INFO:tasks.workunit.client.0.smithi076.stdout:1/34: mkdir da 0 2024-03-28T13:02:02.795 INFO:tasks.workunit.client.0.smithi076.stdout:6/21: mknod d6/c7 0 2024-03-28T13:02:02.795 INFO:tasks.workunit.client.0.smithi076.stdout:6/22: chown f0 145 1 2024-03-28T13:02:02.795 INFO:tasks.workunit.client.0.smithi076.stdout:6/23: readlink l5 0 2024-03-28T13:02:02.795 INFO:tasks.workunit.client.0.smithi076.stdout:6/24: stat c3 0 2024-03-28T13:02:02.795 INFO:tasks.workunit.client.0.smithi076.stdout:6/25: readlink l5 0 2024-03-28T13:02:02.848 INFO:tasks.workunit.client.0.smithi076.stdout:1/35: dwrite f7 [0,4194304] 0 2024-03-28T13:02:02.849 INFO:tasks.workunit.client.0.smithi076.stdout:1/36: write f3 [468848,118042] 0 2024-03-28T13:02:02.869 INFO:tasks.workunit.client.0.smithi076.stdout:7/19: creat d1/f6 x:0 0 0 2024-03-28T13:02:02.971 INFO:tasks.workunit.client.0.smithi076.stdout:3/22: rmdir d1 39 2024-03-28T13:02:03.041 INFO:tasks.workunit.client.0.smithi076.stdout:4/23: dwrite d0/f2 [0,4194304] 0 2024-03-28T13:02:03.111 INFO:tasks.workunit.client.0.smithi076.stdout:0/24: creat db/dc/fd x:0 0 0 2024-03-28T13:02:03.111 INFO:tasks.workunit.client.0.smithi076.stdout:5/23: creat d5/f7 x:0 0 0 2024-03-28T13:02:03.114 INFO:tasks.workunit.client.0.smithi076.stdout:6/26: write f0 [553816,108419] 0 2024-03-28T13:02:03.115 INFO:tasks.workunit.client.0.smithi076.stdout:6/27: write f1 [339500,18630] 0 2024-03-28T13:02:03.170 INFO:tasks.workunit.client.0.smithi076.stdout:1/37: rmdir da 0 2024-03-28T13:02:03.216 INFO:tasks.workunit.client.0.smithi076.stdout:7/20: creat d1/f7 x:0 0 0 2024-03-28T13:02:03.283 INFO:tasks.workunit.client.0.smithi076.stdout:3/23: creat d1/d2/d8/f9 x:0 0 0 2024-03-28T13:02:03.299 INFO:tasks.workunit.client.0.smithi076.stdout:3/24: dread f0 [0,4194304] 0 2024-03-28T13:02:03.300 INFO:tasks.workunit.client.0.smithi076.stdout:3/25: write d1/d2/d8/f9 [1041115,110856] 0 2024-03-28T13:02:03.302 INFO:tasks.workunit.client.0.smithi076.stdout:3/26: read d1/d2/d8/f9 [772528,93691] 0 2024-03-28T13:02:03.302 INFO:tasks.workunit.client.0.smithi076.stdout:3/27: write d1/d2/d8/f9 [416255,115881] 0 2024-03-28T13:02:03.302 INFO:tasks.workunit.client.0.smithi076.stdout:3/28: readlink d1/d2/l5 0 2024-03-28T13:02:03.384 INFO:tasks.workunit.client.0.smithi076.stdout:4/24: rename d0/f8 to d0/f9 0 2024-03-28T13:02:03.590 INFO:tasks.workunit.client.0.smithi076.stdout:1/38: creat fb x:0 0 0 2024-03-28T13:02:03.630 INFO:tasks.workunit.client.0.smithi076.stdout:7/21: mkdir d1/d8 0 2024-03-28T13:02:03.630 INFO:tasks.workunit.client.0.smithi076.stdout:7/22: write d1/f5 [865087,4960] 0 2024-03-28T13:02:03.630 INFO:tasks.workunit.client.0.smithi076.stdout:7/23: chown d1/f6 25348 1 2024-03-28T13:02:03.630 INFO:tasks.workunit.client.0.smithi076.stdout:7/24: readlink d1/l3 0 2024-03-28T13:02:03.783 INFO:tasks.workunit.client.0.smithi076.stdout:4/25: rmdir d0 39 2024-03-28T13:02:03.783 INFO:tasks.workunit.client.0.smithi076.stdout:4/26: write d0/f9 [1569080,46333] 0 2024-03-28T13:02:03.850 INFO:tasks.workunit.client.0.smithi076.stdout:1/39: creat fc x:0 0 0 2024-03-28T13:02:03.896 INFO:tasks.workunit.client.0.smithi076.stdout:7/25: mknod d1/c9 0 2024-03-28T13:02:03.948 INFO:tasks.workunit.client.0.smithi076.stdout:4/27: mknod d0/ca 0 2024-03-28T13:02:03.948 INFO:tasks.workunit.client.0.smithi076.stdout:4/28: dread - d0/f5 zero size 2024-03-28T13:02:04.149 INFO:tasks.workunit.client.0.smithi076.stdout:1/40: creat fd x:0 0 0 2024-03-28T13:02:05.396 INFO:tasks.workunit.client.0.smithi076.stdout:7/26: symlink d1/la 0 2024-03-28T13:02:05.396 INFO:tasks.workunit.client.0.smithi076.stdout:7/27: truncate d1/f5 946647 0 2024-03-28T13:02:05.396 INFO:tasks.workunit.client.0.smithi076.stdout:7/28: read - d1/f6 zero size 2024-03-28T13:02:05.412 INFO:tasks.workunit.client.0.smithi076.stdout:4/29: mkdir d0/db 0 2024-03-28T13:02:06.126 INFO:tasks.workunit.client.0.smithi076.stdout:2/22: sync 2024-03-28T13:02:06.126 INFO:tasks.workunit.client.0.smithi076.stdout:2/23: write d2/f4 [684493,40283] 0 2024-03-28T13:02:06.150 INFO:tasks.workunit.client.0.smithi076.stdout:9/9: fsync f3 0 2024-03-28T13:02:06.156 INFO:tasks.workunit.client.0.smithi076.stdout:8/5: sync 2024-03-28T13:02:06.156 INFO:tasks.workunit.client.0.smithi076.stdout:8/6: link - no file 2024-03-28T13:02:06.156 INFO:tasks.workunit.client.0.smithi076.stdout:8/7: truncate - no filename 2024-03-28T13:02:06.308 INFO:tasks.workunit.client.0.smithi076.stdout:5/24: getdents d5 0 2024-03-28T13:02:06.310 INFO:tasks.workunit.client.0.smithi076.stdout:3/29: fsync d1/d2/d8/f9 0 2024-03-28T13:02:06.312 INFO:tasks.workunit.client.0.smithi076.stdout:0/25: truncate f5 2979585 0 2024-03-28T13:02:06.313 INFO:tasks.workunit.client.0.smithi076.stdout:0/26: fsync db/dc/fd 0 2024-03-28T13:02:06.313 INFO:tasks.workunit.client.0.smithi076.stdout:0/27: readlink la 0 2024-03-28T13:02:06.339 INFO:tasks.workunit.client.0.smithi076.stdout:0/28: dwrite f1 [0,4194304] 0 2024-03-28T13:02:06.608 INFO:tasks.workunit.client.0.smithi076.stdout:1/41: creat fe x:0 0 0 2024-03-28T13:02:06.608 INFO:tasks.workunit.client.0.smithi076.stdout:7/29: mknod d1/d8/cb 0 2024-03-28T13:02:06.608 INFO:tasks.workunit.client.0.smithi076.stdout:7/30: write d1/f4 [4587461,112240] 0 2024-03-28T13:02:06.608 INFO:tasks.workunit.client.0.smithi076.stdout:2/24: mkdir d2/d5 0 2024-03-28T13:02:06.608 INFO:tasks.workunit.client.0.smithi076.stdout:2/25: write d2/f4 [978292,22734] 0 2024-03-28T13:02:06.608 INFO:tasks.workunit.client.0.smithi076.stdout:9/10: symlink l4 0 2024-03-28T13:02:06.608 INFO:tasks.workunit.client.0.smithi076.stdout:9/11: fsync f3 0 2024-03-28T13:02:06.613 INFO:tasks.workunit.client.0.smithi076.stdout:8/8: getdents . 0 2024-03-28T13:02:06.613 INFO:tasks.workunit.client.0.smithi076.stdout:8/9: rename - no filename 2024-03-28T13:02:06.613 INFO:tasks.workunit.client.0.smithi076.stdout:5/25: creat d5/f8 x:0 0 0 2024-03-28T13:02:06.613 INFO:tasks.workunit.client.0.smithi076.stdout:3/30: symlink d1/la 0 2024-03-28T13:02:06.676 INFO:tasks.workunit.client.0.smithi076.stdout:2/26: creat d2/d5/f6 x:0 0 0 2024-03-28T13:02:06.687 INFO:tasks.workunit.client.0.smithi076.stdout:1/42: dwrite fd [0,4194304] 0 2024-03-28T13:02:06.690 INFO:tasks.workunit.client.0.smithi076.stdout:9/12: dwrite f3 [0,4194304] 0 2024-03-28T13:02:07.246 INFO:tasks.workunit.client.0.smithi076.stdout:0/29: write f5 [3123300,66204] 0 2024-03-28T13:02:07.246 INFO:tasks.workunit.client.0.smithi076.stdout:8/10: creat f2 x:0 0 0 2024-03-28T13:02:07.246 INFO:tasks.workunit.client.0.smithi076.stdout:5/26: mkdir d5/d9 0 2024-03-28T13:02:07.248 INFO:tasks.workunit.client.0.smithi076.stdout:6/28: sync 2024-03-28T13:02:07.248 INFO:tasks.workunit.client.0.smithi076.stdout:6/29: readlink l5 0 2024-03-28T13:02:07.252 INFO:tasks.workunit.client.0.smithi076.stdout:6/30: dread f0 [0,4194304] 0 2024-03-28T13:02:07.384 INFO:tasks.workunit.client.0.smithi076.stdout:3/31: link f0 d1/d7/fb 0 2024-03-28T13:02:07.384 INFO:tasks.workunit.client.0.smithi076.stdout:4/30: sync 2024-03-28T13:02:07.458 INFO:tasks.workunit.client.0.smithi076.stdout:2/27: mkdir d2/d5/d7 0 2024-03-28T13:02:07.464 INFO:tasks.workunit.client.0.smithi076.stdout:2/28: dread d2/f4 [0,4194304] 0 2024-03-28T13:02:07.490 INFO:tasks.workunit.client.0.smithi076.stdout:2/29: dwrite d2/f4 [0,4194304] 0 2024-03-28T13:02:07.490 INFO:tasks.workunit.client.0.smithi076.stdout:2/30: readlink - no filename 2024-03-28T13:02:07.527 INFO:tasks.workunit.client.0.smithi076.stdout:2/31: dwrite d2/d5/f6 [0,4194304] 0 2024-03-28T13:02:07.603 INFO:tasks.workunit.client.0.smithi076.stdout:1/43: symlink lf 0 2024-03-28T13:02:07.682 INFO:tasks.workunit.client.0.smithi076.stdout:9/13: getdents . 0 2024-03-28T13:02:07.710 INFO:tasks.workunit.client.0.smithi076.stdout:8/11: mknod c3 0 2024-03-28T13:02:07.710 INFO:tasks.workunit.client.0.smithi076.stdout:8/12: rmdir - no directory 2024-03-28T13:02:07.739 INFO:tasks.workunit.client.0.smithi076.stdout:8/13: dwrite f2 [0,4194304] 0 2024-03-28T13:02:07.756 INFO:tasks.workunit.client.0.smithi076.stdout:8/14: read f2 [3196536,70531] 0 2024-03-28T13:02:07.768 INFO:tasks.workunit.client.0.smithi076.stdout:0/30: creat db/dc/fe x:0 0 0 2024-03-28T13:02:07.768 INFO:tasks.workunit.client.0.smithi076.stdout:0/31: truncate f5 3294063 0 2024-03-28T13:02:07.852 INFO:tasks.workunit.client.0.smithi076.stdout:6/31: creat d6/f8 x:0 0 0 2024-03-28T13:02:07.985 INFO:tasks.workunit.client.0.smithi076.stdout:4/31: creat d0/fc x:0 0 0 2024-03-28T13:02:08.049 INFO:tasks.workunit.client.0.smithi076.stdout:3/32: fsync f0 0 2024-03-28T13:02:08.143 INFO:tasks.workunit.client.0.smithi076.stdout:1/44: link f8 f10 0 2024-03-28T13:02:08.186 INFO:tasks.workunit.client.0.smithi076.stdout:9/14: mknod c5 0 2024-03-28T13:02:08.215 INFO:tasks.workunit.client.0.smithi076.stdout:2/32: getdents d2/d5 0 2024-03-28T13:02:08.307 INFO:tasks.workunit.client.0.smithi076.stdout:8/15: mknod c4 0 2024-03-28T13:02:08.330 INFO:tasks.workunit.client.0.smithi076.stdout:7/31: sync 2024-03-28T13:02:08.330 INFO:tasks.workunit.client.0.smithi076.stdout:7/32: dread - d1/f6 zero size 2024-03-28T13:02:08.373 INFO:tasks.workunit.client.0.smithi076.stdout:0/32: mkdir db/dc/df 0 2024-03-28T13:02:08.449 INFO:tasks.workunit.client.0.smithi076.stdout:5/27: rename d5/f8 to d5/fa 0 2024-03-28T13:02:08.450 INFO:tasks.workunit.client.0.smithi076.stdout:5/28: write d5/f6 [962994,126669] 0 2024-03-28T13:02:08.450 INFO:tasks.workunit.client.0.smithi076.stdout:5/29: read - d5/fa zero size 2024-03-28T13:02:08.523 INFO:tasks.workunit.client.0.smithi076.stdout:4/32: rename d0/c3 to d0/cd 0 2024-03-28T13:02:08.523 INFO:tasks.workunit.client.0.smithi076.stdout:4/33: readlink d0/l6 0 2024-03-28T13:02:08.523 INFO:tasks.workunit.client.0.smithi076.stdout:4/34: truncate d0/f5 839442 0 2024-03-28T13:02:08.697 INFO:tasks.workunit.client.0.smithi076.stdout:3/33: creat d1/d2/d8/fc x:0 0 0 2024-03-28T13:02:08.698 INFO:tasks.workunit.client.0.smithi076.stdout:6/32: getdents d6 0 2024-03-28T13:02:08.725 INFO:tasks.workunit.client.0.smithi076.stdout:1/45: symlink l11 0 2024-03-28T13:02:08.725 INFO:tasks.workunit.client.0.smithi076.stdout:1/46: truncate fb 1000073 0 2024-03-28T13:02:08.725 INFO:tasks.workunit.client.0.smithi076.stdout:3/34: dwrite f0 [0,4194304] 0 2024-03-28T13:02:08.792 INFO:tasks.workunit.client.0.smithi076.stdout:2/33: mkdir d2/d5/d7/d8 0 2024-03-28T13:02:08.792 INFO:tasks.workunit.client.0.smithi076.stdout:2/34: chown d2 27162 1 2024-03-28T13:02:08.810 INFO:tasks.workunit.client.0.smithi076.stdout:2/35: write d2/f4 [160056,25226] 0 2024-03-28T13:02:08.825 INFO:tasks.workunit.client.0.smithi076.stdout:2/36: dread d2/d5/f6 [0,4194304] 0 2024-03-28T13:02:08.839 INFO:tasks.workunit.client.0.smithi076.stdout:2/37: dread d2/f4 [0,4194304] 0 2024-03-28T13:02:09.042 INFO:tasks.workunit.client.0.smithi076.stdout:0/33: mknod db/dc/c10 0 2024-03-28T13:02:09.042 INFO:tasks.workunit.client.0.smithi076.stdout:5/30: mkdir d5/db 0 2024-03-28T13:02:09.042 INFO:tasks.workunit.client.0.smithi076.stdout:5/31: fsync f4 0 2024-03-28T13:02:09.054 INFO:tasks.workunit.client.0.smithi076.stdout:4/35: symlink d0/db/le 0 2024-03-28T13:02:09.054 INFO:tasks.workunit.client.0.smithi076.stdout:6/33: rename d6/c7 to d6/c9 0 2024-03-28T13:02:09.072 INFO:tasks.workunit.client.0.smithi076.stdout:1/47: creat f12 x:0 0 0 2024-03-28T13:02:09.072 INFO:tasks.workunit.client.0.smithi076.stdout:1/48: chown l11 87274627 1 2024-03-28T13:02:09.401 INFO:tasks.workunit.client.0.smithi076.stdout:3/35: symlink d1/d2/d6/ld 0 2024-03-28T13:02:09.401 INFO:tasks.workunit.client.0.smithi076.stdout:9/15: truncate f3 3487826 0 2024-03-28T13:02:09.420 INFO:tasks.workunit.client.0.smithi076.stdout:0/34: rmdir db/dc 39 2024-03-28T13:02:09.420 INFO:tasks.workunit.client.0.smithi076.stdout:5/32: creat d5/fc x:0 0 0 2024-03-28T13:02:09.420 INFO:tasks.workunit.client.0.smithi076.stdout:5/33: dread - f3 zero size 2024-03-28T13:02:09.437 INFO:tasks.workunit.client.0.smithi076.stdout:4/36: creat d0/ff x:0 0 0 2024-03-28T13:02:09.437 INFO:tasks.workunit.client.0.smithi076.stdout:1/49: rename f10 to f13 0 2024-03-28T13:02:09.725 INFO:tasks.workunit.client.0.smithi076.stdout:8/16: truncate f2 2441646 0 2024-03-28T13:02:09.821 INFO:tasks.workunit.client.0.smithi076.stdout:3/36: unlink d1/d2/d8/f9 0 2024-03-28T13:02:09.821 INFO:tasks.workunit.client.0.smithi076.stdout:9/16: write f3 [3543086,9616] 0 2024-03-28T13:02:09.840 INFO:tasks.workunit.client.0.smithi076.stdout:3/37: write f0 [4002728,86255] 0 2024-03-28T13:02:09.845 INFO:tasks.workunit.client.0.smithi076.stdout:9/17: write f3 [1164136,72928] 0 2024-03-28T13:02:09.845 INFO:tasks.workunit.client.0.smithi076.stdout:9/18: write f3 [814864,39413] 0 2024-03-28T13:02:09.850 INFO:tasks.workunit.client.0.smithi076.stdout:9/19: write f3 [3496132,111831] 0 2024-03-28T13:02:09.868 INFO:tasks.workunit.client.0.smithi076.stdout:9/20: fsync f3 0 2024-03-28T13:02:09.870 INFO:tasks.workunit.client.0.smithi076.stdout:0/35: mkdir db/dc/df/d11 0 2024-03-28T13:02:09.888 INFO:tasks.workunit.client.0.smithi076.stdout:0/36: write f5 [1262959,27601] 0 2024-03-28T13:02:09.888 INFO:tasks.workunit.client.0.smithi076.stdout:0/37: write db/dc/fd [487069,10600] 0 2024-03-28T13:02:09.909 INFO:tasks.workunit.client.0.smithi076.stdout:0/38: write f1 [1999309,130377] 0 2024-03-28T13:02:09.922 INFO:tasks.workunit.client.0.smithi076.stdout:5/34: creat d5/db/fd x:0 0 0 2024-03-28T13:02:09.922 INFO:tasks.workunit.client.0.smithi076.stdout:5/35: rename d5/d9 to d5/d9/de 22 2024-03-28T13:02:09.993 INFO:tasks.workunit.client.0.smithi076.stdout:6/34: mkdir d6/da 0 2024-03-28T13:02:10.204 INFO:tasks.workunit.client.0.smithi076.stdout:4/37: link d0/l6 d0/db/l10 0 2024-03-28T13:02:10.255 INFO:tasks.workunit.client.0.smithi076.stdout:1/50: mkdir d14 0 2024-03-28T13:02:10.256 INFO:tasks.workunit.client.0.smithi076.stdout:4/38: dwrite d0/ff [0,4194304] 0 2024-03-28T13:02:10.257 INFO:tasks.workunit.client.0.smithi076.stdout:4/39: dread - d0/fc zero size 2024-03-28T13:02:10.257 INFO:tasks.workunit.client.0.smithi076.stdout:4/40: dread - d0/fc zero size 2024-03-28T13:02:10.474 INFO:tasks.workunit.client.0.smithi076.stdout:5/36: mkdir d5/db/df 0 2024-03-28T13:02:10.492 INFO:tasks.workunit.client.0.smithi076.stdout:1/51: symlink d14/l15 0 2024-03-28T13:02:10.539 INFO:tasks.workunit.client.0.smithi076.stdout:1/52: dwrite f13 [0,4194304] 0 2024-03-28T13:02:10.831 INFO:tasks.workunit.client.0.smithi076.stdout:9/21: symlink l6 0 2024-03-28T13:02:10.832 INFO:tasks.workunit.client.0.smithi076.stdout:2/38: sync 2024-03-28T13:02:10.834 INFO:tasks.workunit.client.0.smithi076.stdout:7/33: sync 2024-03-28T13:02:10.870 INFO:tasks.workunit.client.0.smithi076.stdout:4/41: dwrite d0/f5 [0,4194304] 0 2024-03-28T13:02:10.870 INFO:tasks.workunit.client.0.smithi076.stdout:4/42: chown d0/f2 184693238 1 2024-03-28T13:02:10.877 INFO:tasks.workunit.client.0.smithi076.stdout:5/37: mknod d5/d9/c10 0 2024-03-28T13:02:10.877 INFO:tasks.workunit.client.0.smithi076.stdout:5/38: chown f3 1568 1 2024-03-28T13:02:10.877 INFO:tasks.workunit.client.0.smithi076.stdout:7/34: dread d1/f5 [0,4194304] 0 2024-03-28T13:02:10.885 INFO:tasks.workunit.client.0.smithi076.stdout:8/17: dwrite f2 [0,4194304] 0 2024-03-28T13:02:10.888 INFO:tasks.workunit.client.0.smithi076.stdout:9/22: dwrite f3 [0,4194304] 0 2024-03-28T13:02:11.021 INFO:tasks.workunit.client.0.smithi076.stdout:1/53: mknod d14/c16 0 2024-03-28T13:02:11.055 INFO:tasks.workunit.client.0.smithi076.stdout:2/39: mknod d2/c9 0 2024-03-28T13:02:11.064 INFO:tasks.workunit.client.0.smithi076.stdout:2/40: dread d2/d5/f6 [0,4194304] 0 2024-03-28T13:02:11.064 INFO:tasks.workunit.client.0.smithi076.stdout:2/41: fsync d2/f4 0 2024-03-28T13:02:11.229 INFO:tasks.workunit.client.0.smithi076.stdout:4/43: creat d0/db/f11 x:0 0 0 2024-03-28T13:02:11.229 INFO:tasks.workunit.client.0.smithi076.stdout:4/44: write d0/fc [73716,94183] 0 2024-03-28T13:02:11.229 INFO:tasks.workunit.client.0.smithi076.stdout:4/45: chown d0/ca 2 1 2024-03-28T13:02:11.229 INFO:tasks.workunit.client.0.smithi076.stdout:4/46: chown d0/f2 0 1 2024-03-28T13:02:11.260 INFO:tasks.workunit.client.0.smithi076.stdout:4/47: dwrite d0/fc [0,4194304] 0 2024-03-28T13:02:11.260 INFO:tasks.workunit.client.0.smithi076.stdout:4/48: chown d0/f5 13 1 2024-03-28T13:02:11.268 INFO:tasks.workunit.client.0.smithi076.stdout:5/39: mknod d5/c11 0 2024-03-28T13:02:11.293 INFO:tasks.workunit.client.0.smithi076.stdout:4/49: dwrite d0/fc [0,4194304] 0 2024-03-28T13:02:11.312 INFO:tasks.workunit.client.0.smithi076.stdout:4/50: write d0/f2 [573254,112534] 0 2024-03-28T13:02:11.353 INFO:tasks.workunit.client.0.smithi076.stdout:4/51: dwrite d0/ff [0,4194304] 0 2024-03-28T13:02:11.353 INFO:tasks.workunit.client.0.smithi076.stdout:4/52: readlink d0/db/l10 0 2024-03-28T13:02:11.393 INFO:tasks.workunit.client.0.smithi076.stdout:6/35: rename d6/f8 to d6/fb 0 2024-03-28T13:02:11.393 INFO:tasks.workunit.client.0.smithi076.stdout:7/35: mkdir d1/dc 0 2024-03-28T13:02:11.393 INFO:tasks.workunit.client.0.smithi076.stdout:6/36: readlink l5 0 2024-03-28T13:02:11.472 INFO:tasks.workunit.client.0.smithi076.stdout:8/18: symlink l5 0 2024-03-28T13:02:11.510 INFO:tasks.workunit.client.0.smithi076.stdout:1/54: rmdir d14 39 2024-03-28T13:02:11.510 INFO:tasks.workunit.client.0.smithi076.stdout:1/55: readlink l9 0 2024-03-28T13:02:11.510 INFO:tasks.workunit.client.0.smithi076.stdout:1/56: write f5 [986593,44970] 0 2024-03-28T13:02:11.530 INFO:tasks.workunit.client.0.smithi076.stdout:1/57: write f0 [2894303,81516] 0 2024-03-28T13:02:11.547 INFO:tasks.workunit.client.0.smithi076.stdout:2/42: unlink d2/d5/f6 0 2024-03-28T13:02:11.562 INFO:tasks.workunit.client.0.smithi076.stdout:2/43: dread d2/f4 [0,4194304] 0 2024-03-28T13:02:11.574 INFO:tasks.workunit.client.0.smithi076.stdout:2/44: dread d2/f4 [0,4194304] 0 2024-03-28T13:02:11.577 INFO:tasks.workunit.client.0.smithi076.stdout:1/58: dwrite f12 [0,4194304] 0 2024-03-28T13:02:11.586 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:02:11.589 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:02:11.671 INFO:tasks.workunit.client.0.smithi076.stdout:5/40: rename d5/db/fd to d5/db/f12 0 2024-03-28T13:02:11.671 INFO:tasks.workunit.client.0.smithi076.stdout:5/41: dread - d5/f7 zero size 2024-03-28T13:02:11.671 INFO:tasks.workunit.client.0.smithi076.stdout:5/42: readlink l0 0 2024-03-28T13:02:11.720 INFO:tasks.workunit.client.0.smithi076.stdout:5/43: dwrite f3 [0,4194304] 0 2024-03-28T13:02:11.786 INFO:tasks.workunit.client.0.smithi076.stdout:4/53: mkdir d0/db/d12 0 2024-03-28T13:02:11.786 INFO:tasks.workunit.client.0.smithi076.stdout:4/54: chown d0 3558795 1 2024-03-28T13:02:11.856 INFO:tasks.workunit.client.0.smithi076.stdout:7/36: creat d1/d8/fd x:0 0 0 2024-03-28T13:02:11.856 INFO:tasks.workunit.client.0.smithi076.stdout:7/37: dread - d1/d8/fd zero size 2024-03-28T13:02:11.911 INFO:tasks.workunit.client.0.smithi076.stdout:7/38: dwrite d1/f5 [0,4194304] 0 2024-03-28T13:02:12.040 INFO:tasks.workunit.client.0.smithi076.stdout:8/19: symlink l6 0 2024-03-28T13:02:12.074 INFO:tasks.workunit.client.0.smithi076.stdout:8/20: dwrite f2 [4194304,4194304] 0 2024-03-28T13:02:12.101 INFO:tasks.workunit.client.0.smithi076.stdout:6/37: dwrite d6/fb [0,4194304] 0 2024-03-28T13:02:12.104 INFO:tasks.workunit.client.0.smithi076.stdout:2/45: creat d2/d5/d7/fa x:0 0 0 2024-03-28T13:02:12.104 INFO:tasks.workunit.client.0.smithi076.stdout:1/59: symlink d14/l17 0 2024-03-28T13:02:12.104 INFO:tasks.workunit.client.0.smithi076.stdout:2/46: write d2/d5/d7/fa [95791,49158] 0 2024-03-28T13:02:12.137 INFO:tasks.workunit.client.0.smithi076.stdout:5/44: rename d5/fc to d5/db/f13 0 2024-03-28T13:02:12.137 INFO:tasks.workunit.client.0.smithi076.stdout:5/45: stat d5/db/df 0 2024-03-28T13:02:12.356 INFO:tasks.workunit.client.0.smithi076.stdout:4/55: creat d0/db/f13 x:0 0 0 2024-03-28T13:02:12.668 INFO:tasks.workunit.client.0.smithi076.stdout:0/39: creat db/f12 x:0 0 0 2024-03-28T13:02:12.799 INFO:tasks.workunit.client.0.smithi076.stdout:7/39: link d1/la d1/le 0 2024-03-28T13:02:12.917 INFO:tasks.workunit.client.0.smithi076.stdout:8/21: unlink l6 0 2024-03-28T13:02:12.930 INFO:tasks.workunit.client.0.smithi076.stdout:8/22: dread f2 [0,4194304] 0 2024-03-28T13:02:12.994 INFO:tasks.workunit.client.0.smithi076.stdout:9/23: truncate f3 4105529 0 2024-03-28T13:02:13.064 INFO:tasks.workunit.client.0.smithi076.stdout:6/38: creat d6/da/fc x:0 0 0 2024-03-28T13:02:13.064 INFO:tasks.workunit.client.0.smithi076.stdout:6/39: rename d6/da to d6/da/dd 22 2024-03-28T13:02:13.104 INFO:tasks.workunit.client.0.smithi076.stdout:6/40: dwrite f1 [0,4194304] 0 2024-03-28T13:02:13.104 INFO:tasks.workunit.client.0.smithi076.stdout:6/41: dread - d6/da/fc zero size 2024-03-28T13:02:13.104 INFO:tasks.workunit.client.0.smithi076.stdout:6/42: write f0 [1665255,58888] 0 2024-03-28T13:02:13.113 INFO:tasks.workunit.client.0.smithi076.stdout:1/60: mknod d14/c18 0 2024-03-28T13:02:13.134 INFO:tasks.workunit.client.0.smithi076.stdout:1/61: dread f12 [0,4194304] 0 2024-03-28T13:02:13.134 INFO:tasks.workunit.client.0.smithi076.stdout:1/62: chown l9 34469 1 2024-03-28T13:02:13.177 INFO:tasks.workunit.client.0.smithi076.stdout:1/63: dwrite f8 [0,4194304] 0 2024-03-28T13:02:13.177 INFO:tasks.workunit.client.0.smithi076.stdout:1/64: chown f12 255246 1 2024-03-28T13:02:13.177 INFO:tasks.workunit.client.0.smithi076.stdout:1/65: readlink l11 0 2024-03-28T13:02:13.177 INFO:tasks.workunit.client.0.smithi076.stdout:1/66: dread - fc zero size 2024-03-28T13:02:13.177 INFO:tasks.workunit.client.0.smithi076.stdout:1/67: dread - fc zero size 2024-03-28T13:02:13.272 INFO:tasks.workunit.client.0.smithi076.stdout:2/47: mkdir d2/d5/db 0 2024-03-28T13:02:13.272 INFO:tasks.workunit.client.0.smithi076.stdout:5/46: mknod d5/db/df/c14 0 2024-03-28T13:02:13.280 INFO:tasks.workunit.client.0.smithi076.stdout:4/56: mknod d0/db/c14 0 2024-03-28T13:02:13.304 INFO:tasks.workunit.client.0.smithi076.stdout:0/40: truncate f5 1684622 0 2024-03-28T13:02:13.304 INFO:tasks.workunit.client.0.smithi076.stdout:0/41: dread - db/f12 zero size 2024-03-28T13:02:13.563 INFO:tasks.workunit.client.0.smithi076.stdout:9/24: creat f7 x:0 0 0 2024-03-28T13:02:13.593 INFO:tasks.workunit.client.0.smithi076.stdout:3/38: sync 2024-03-28T13:02:13.593 INFO:tasks.workunit.client.0.smithi076.stdout:3/39: chown d1/la 7718 1 2024-03-28T13:02:13.593 INFO:tasks.workunit.client.0.smithi076.stdout:3/40: truncate d1/d2/d8/fc 29030 0 2024-03-28T13:02:13.593 INFO:tasks.workunit.client.0.smithi076.stdout:3/41: write f0 [943645,117491] 0 2024-03-28T13:02:13.593 INFO:tasks.workunit.client.0.smithi076.stdout:3/42: write f0 [694267,12463] 0 2024-03-28T13:02:13.593 INFO:tasks.workunit.client.0.smithi076.stdout:3/43: write d1/d7/fb [4230232,51961] 0 2024-03-28T13:02:13.636 INFO:tasks.workunit.client.0.smithi076.stdout:3/44: dwrite f0 [0,4194304] 0 2024-03-28T13:02:13.821 INFO:tasks.workunit.client.0.smithi076.stdout:6/43: creat d6/da/fe x:0 0 0 2024-03-28T13:02:13.821 INFO:tasks.workunit.client.0.smithi076.stdout:1/68: mkdir d14/d19 0 2024-03-28T13:02:13.821 INFO:tasks.workunit.client.0.smithi076.stdout:1/69: write fd [4272057,127685] 0 2024-03-28T13:02:13.835 INFO:tasks.workunit.client.0.smithi076.stdout:2/48: symlink d2/d5/d7/d8/lc 0 2024-03-28T13:02:13.835 INFO:tasks.workunit.client.0.smithi076.stdout:5/47: creat d5/f15 x:0 0 0 2024-03-28T13:02:13.835 INFO:tasks.workunit.client.0.smithi076.stdout:2/49: write d2/d5/d7/fa [1010979,68864] 0 2024-03-28T13:02:13.836 INFO:tasks.workunit.client.0.smithi076.stdout:4/57: stat d0/db/l10 0 2024-03-28T13:02:13.836 INFO:tasks.workunit.client.0.smithi076.stdout:4/58: truncate d0/db/f11 392097 0 2024-03-28T13:02:13.841 INFO:tasks.workunit.client.0.smithi076.stdout:0/42: mkdir db/d13 0 2024-03-28T13:02:13.895 INFO:tasks.workunit.client.0.smithi076.stdout:3/45: mknod d1/ce 0 2024-03-28T13:02:13.895 INFO:tasks.workunit.client.0.smithi076.stdout:3/46: fdatasync d1/d2/d8/fc 0 2024-03-28T13:02:13.934 INFO:tasks.workunit.client.0.smithi076.stdout:3/47: dwrite d1/d2/d8/fc [0,4194304] 0 2024-03-28T13:02:13.968 INFO:tasks.workunit.client.0.smithi076.stdout:6/44: getdents d6 0 2024-03-28T13:02:13.991 INFO:tasks.workunit.client.0.smithi076.stdout:8/23: getdents . 0 2024-03-28T13:02:14.032 INFO:tasks.workunit.client.0.smithi076.stdout:8/24: dwrite f2 [0,4194304] 0 2024-03-28T13:02:14.047 INFO:tasks.workunit.client.0.smithi076.stdout:1/70: mknod d14/c1a 0 2024-03-28T13:02:14.048 INFO:tasks.workunit.client.0.smithi076.stdout:8/25: write f2 [3959465,9664] 0 2024-03-28T13:02:14.065 INFO:tasks.workunit.client.0.smithi076.stdout:1/71: dread f12 [0,4194304] 0 2024-03-28T13:02:14.098 INFO:tasks.workunit.client.0.smithi076.stdout:1/72: dwrite f12 [4194304,4194304] 0 2024-03-28T13:02:14.120 INFO:tasks.workunit.client.0.smithi076.stdout:5/48: mknod d5/c16 0 2024-03-28T13:02:14.141 INFO:tasks.workunit.client.0.smithi076.stdout:9/25: write f3 [314063,35240] 0 2024-03-28T13:02:14.141 INFO:tasks.workunit.client.0.smithi076.stdout:9/26: write f3 [3594252,56518] 0 2024-03-28T13:02:14.141 INFO:tasks.workunit.client.0.smithi076.stdout:9/27: read f3 [678159,108557] 0 2024-03-28T13:02:14.150 INFO:tasks.workunit.client.0.smithi076.stdout:2/50: mkdir d2/d5/d7/dd 0 2024-03-28T13:02:14.226 INFO:tasks.workunit.client.0.smithi076.stdout:4/59: creat d0/f15 x:0 0 0 2024-03-28T13:02:14.296 INFO:tasks.workunit.client.0.smithi076.stdout:0/43: rmdir db/d13 0 2024-03-28T13:02:14.296 INFO:tasks.workunit.client.0.smithi076.stdout:0/44: chown db/dc/fe 116845 1 2024-03-28T13:02:14.296 INFO:tasks.workunit.client.0.smithi076.stdout:0/45: chown l8 335267383 1 2024-03-28T13:02:14.458 INFO:tasks.workunit.client.0.smithi076.stdout:6/45: symlink d6/lf 0 2024-03-28T13:02:14.527 INFO:tasks.workunit.client.0.smithi076.stdout:8/26: link f2 f7 0 2024-03-28T13:02:14.560 INFO:tasks.workunit.client.0.smithi076.stdout:8/27: dwrite f2 [4194304,4194304] 0 2024-03-28T13:02:14.605 INFO:tasks.workunit.client.0.smithi076.stdout:1/73: mknod d14/d19/c1b 0 2024-03-28T13:02:14.710 INFO:tasks.workunit.client.0.smithi076.stdout:5/49: rename d5/f15 to d5/db/f17 0 2024-03-28T13:02:14.820 INFO:tasks.workunit.client.0.smithi076.stdout:2/51: creat d2/d5/d7/fe x:0 0 0 2024-03-28T13:02:14.923 INFO:tasks.workunit.client.0.smithi076.stdout:4/60: rename d0/db/d12 to d0/db/d16 0 2024-03-28T13:02:14.982 INFO:tasks.workunit.client.0.smithi076.stdout:0/46: creat db/f14 x:0 0 0 2024-03-28T13:02:14.982 INFO:tasks.workunit.client.0.smithi076.stdout:0/47: dread - db/dc/fe zero size 2024-03-28T13:02:15.055 INFO:tasks.workunit.client.0.smithi076.stdout:9/28: getdents . 0 2024-03-28T13:02:15.068 INFO:tasks.workunit.client.0.smithi076.stdout:7/40: sync 2024-03-28T13:02:15.068 INFO:tasks.workunit.client.0.smithi076.stdout:7/41: write d1/d8/fd [653639,104881] 0 2024-03-28T13:02:15.090 INFO:tasks.workunit.client.0.smithi076.stdout:9/29: dwrite f3 [0,4194304] 0 2024-03-28T13:02:15.094 INFO:tasks.workunit.client.0.smithi076.stdout:7/42: dwrite d1/f7 [0,4194304] 0 2024-03-28T13:02:15.227 INFO:tasks.workunit.client.0.smithi076.stdout:6/46: creat d6/f10 x:0 0 0 2024-03-28T13:02:15.245 INFO:tasks.workunit.client.0.smithi076.stdout:6/47: dread f0 [0,4194304] 0 2024-03-28T13:02:15.245 INFO:tasks.workunit.client.0.smithi076.stdout:6/48: stat l5 0 2024-03-28T13:02:15.254 INFO:tasks.workunit.client.0.smithi076.stdout:8/28: creat f8 x:0 0 0 2024-03-28T13:02:15.324 INFO:tasks.workunit.client.0.smithi076.stdout:1/74: symlink d14/l1c 0 2024-03-28T13:02:15.370 INFO:tasks.workunit.client.0.smithi076.stdout:5/50: mknod d5/db/df/c18 0 2024-03-28T13:02:15.416 INFO:tasks.workunit.client.0.smithi076.stdout:2/52: mknod d2/d5/db/cf 0 2024-03-28T13:02:15.486 INFO:tasks.workunit.client.0.smithi076.stdout:4/61: creat d0/db/d16/f17 x:0 0 0 2024-03-28T13:02:15.530 INFO:tasks.workunit.client.0.smithi076.stdout:0/48: truncate db/dc/fd 401100 0 2024-03-28T13:02:15.530 INFO:tasks.workunit.client.0.smithi076.stdout:0/49: write f5 [1440260,70574] 0 2024-03-28T13:02:15.574 INFO:tasks.workunit.client.0.smithi076.stdout:9/30: rename c5 to c8 0 2024-03-28T13:02:15.689 INFO:tasks.workunit.client.0.smithi076.stdout:7/43: creat d1/dc/ff x:0 0 0 2024-03-28T13:02:15.726 INFO:tasks.workunit.client.0.smithi076.stdout:6/49: dread - d6/da/fc zero size 2024-03-28T13:02:15.726 INFO:tasks.workunit.client.0.smithi076.stdout:6/50: fdatasync f1 0 2024-03-28T13:02:15.763 INFO:tasks.workunit.client.0.smithi076.stdout:8/29: rename c3 to c9 0 2024-03-28T13:02:15.838 INFO:tasks.workunit.client.0.smithi076.stdout:1/75: unlink f3 0 2024-03-28T13:02:15.838 INFO:tasks.workunit.client.0.smithi076.stdout:1/76: fsync fe 0 2024-03-28T13:02:15.945 INFO:tasks.workunit.client.0.smithi076.stdout:5/51: rmdir d5/db/df 39 2024-03-28T13:02:15.948 INFO:tasks.workunit.client.0.smithi076.stdout:3/48: truncate d1/d2/d8/fc 132025 0 2024-03-28T13:02:15.987 INFO:tasks.workunit.client.0.smithi076.stdout:4/62: creat d0/db/f18 x:0 0 0 2024-03-28T13:02:15.987 INFO:tasks.workunit.client.0.smithi076.stdout:4/63: chown d0/l6 2033362 1 2024-03-28T13:02:16.122 INFO:tasks.workunit.client.0.smithi076.stdout:9/31: mkdir d9 0 2024-03-28T13:02:16.122 INFO:tasks.workunit.client.0.smithi076.stdout:9/32: chown f3 519693 1 2024-03-28T13:02:16.212 INFO:tasks.workunit.client.0.smithi076.stdout:7/44: stat d1/le 0 2024-03-28T13:02:16.212 INFO:tasks.workunit.client.0.smithi076.stdout:7/45: write d1/dc/ff [337577,65661] 0 2024-03-28T13:02:16.214 INFO:tasks.workunit.client.0.smithi076.stdout:6/51: link c2 d6/da/c11 0 2024-03-28T13:02:16.217 INFO:tasks.workunit.client.0.smithi076.stdout:7/46: dread d1/d8/fd [0,4194304] 0 2024-03-28T13:02:16.459 INFO:tasks.workunit.client.0.smithi076.stdout:1/77: mknod d14/c1d 0 2024-03-28T13:02:16.500 INFO:tasks.workunit.client.0.smithi076.stdout:5/52: mkdir d5/db/d19 0 2024-03-28T13:02:16.516 INFO:tasks.workunit.client.0.smithi076.stdout:1/78: dwrite f0 [0,4194304] 0 2024-03-28T13:02:16.615 INFO:tasks.workunit.client.0.smithi076.stdout:3/49: creat d1/d2/ff x:0 0 0 2024-03-28T13:02:16.686 INFO:tasks.workunit.client.0.smithi076.stdout:4/64: creat d0/db/d16/f19 x:0 0 0 2024-03-28T13:02:16.686 INFO:tasks.workunit.client.0.smithi076.stdout:4/65: truncate d0/f9 1924070 0 2024-03-28T13:02:16.960 INFO:tasks.workunit.client.0.smithi076.stdout:9/33: mkdir d9/da 0 2024-03-28T13:02:17.032 INFO:tasks.workunit.client.0.smithi076.stdout:6/52: chown d6/fb 2058566 1 2024-03-28T13:02:17.093 INFO:tasks.workunit.client.0.smithi076.stdout:7/47: symlink d1/l10 0 2024-03-28T13:02:17.140 INFO:tasks.workunit.client.0.smithi076.stdout:5/53: symlink d5/db/l1a 0 2024-03-28T13:02:17.162 INFO:tasks.workunit.client.0.smithi076.stdout:5/54: write f4 [2188158,119859] 0 2024-03-28T13:02:17.209 INFO:tasks.workunit.client.0.smithi076.stdout:5/55: dwrite d5/f7 [0,4194304] 0 2024-03-28T13:02:17.537 INFO:tasks.workunit.client.0.smithi076.stdout:1/79: getdents d14 0 2024-03-28T13:02:17.550 INFO:tasks.workunit.client.0.smithi076.stdout:3/50: creat d1/d7/f10 x:0 0 0 2024-03-28T13:02:17.550 INFO:tasks.workunit.client.0.smithi076.stdout:3/51: chown d1/d2/d8/fc 1395 1 2024-03-28T13:02:17.565 INFO:tasks.workunit.client.0.smithi076.stdout:1/80: read f8 [1587518,109315] 0 2024-03-28T13:02:17.583 INFO:tasks.workunit.client.0.smithi076.stdout:1/81: dread f7 [0,4194304] 0 2024-03-28T13:02:17.583 INFO:tasks.workunit.client.0.smithi076.stdout:1/82: getdents d14 0 2024-03-28T13:02:17.670 INFO:tasks.workunit.client.0.smithi076.stdout:9/34: symlink d9/lb 0 2024-03-28T13:02:17.670 INFO:tasks.workunit.client.0.smithi076.stdout:9/35: fsync f7 0 2024-03-28T13:02:17.709 INFO:tasks.workunit.client.0.smithi076.stdout:9/36: dwrite f3 [0,4194304] 0 2024-03-28T13:02:17.758 INFO:tasks.workunit.client.0.smithi076.stdout:7/48: unlink d1/le 0 2024-03-28T13:02:17.762 INFO:tasks.workunit.client.0.smithi076.stdout:7/49: dread d1/d8/fd [0,4194304] 0 2024-03-28T13:02:17.783 INFO:tasks.workunit.client.0.smithi076.stdout:7/50: dread d1/f7 [0,4194304] 0 2024-03-28T13:02:17.893 INFO:tasks.workunit.client.0.smithi076.stdout:0/50: creat db/dc/f15 x:0 0 0 2024-03-28T13:02:17.974 INFO:tasks.workunit.client.0.smithi076.stdout:3/52: creat d1/d2/f11 x:0 0 0 2024-03-28T13:02:18.038 INFO:tasks.workunit.client.0.smithi076.stdout:1/83: rmdir d14 39 2024-03-28T13:02:18.112 INFO:tasks.workunit.client.0.smithi076.stdout:6/53: rename f1 to d6/f12 0 2024-03-28T13:02:18.112 INFO:tasks.workunit.client.0.smithi076.stdout:6/54: readlink d6/lf 0 2024-03-28T13:02:18.207 INFO:tasks.workunit.client.0.smithi076.stdout:7/51: mknod d1/c11 0 2024-03-28T13:02:18.207 INFO:tasks.workunit.client.0.smithi076.stdout:0/51: mkdir db/d16 0 2024-03-28T13:02:18.293 INFO:tasks.workunit.client.0.smithi076.stdout:3/53: symlink d1/d2/l12 0 2024-03-28T13:02:18.345 INFO:tasks.workunit.client.0.smithi076.stdout:1/84: rename d14/c16 to d14/c1e 0 2024-03-28T13:02:18.345 INFO:tasks.workunit.client.0.smithi076.stdout:2/53: mknod d2/d5/c10 0 2024-03-28T13:02:18.345 INFO:tasks.workunit.client.0.smithi076.stdout:2/54: readlink d2/d5/d7/d8/lc 0 2024-03-28T13:02:18.373 INFO:tasks.workunit.client.0.smithi076.stdout:1/85: read fd [972317,60976] 0 2024-03-28T13:02:18.423 INFO:tasks.workunit.client.0.smithi076.stdout:4/66: mknod d0/c1a 0 2024-03-28T13:02:18.423 INFO:tasks.workunit.client.0.smithi076.stdout:7/52: creat d1/f12 x:0 0 0 2024-03-28T13:02:18.423 INFO:tasks.workunit.client.0.smithi076.stdout:7/53: stat d1/f7 0 2024-03-28T13:02:18.492 INFO:tasks.workunit.client.0.smithi076.stdout:0/52: rename db/dc/f15 to db/f17 0 2024-03-28T13:02:18.492 INFO:tasks.workunit.client.0.smithi076.stdout:0/53: stat l6 0 2024-03-28T13:02:18.492 INFO:tasks.workunit.client.0.smithi076.stdout:0/54: dread - db/dc/fe zero size 2024-03-28T13:02:18.492 INFO:tasks.workunit.client.0.smithi076.stdout:0/55: fsync f1 0 2024-03-28T13:02:18.778 INFO:tasks.workunit.client.0.smithi076.stdout:3/54: symlink d1/d2/l13 0 2024-03-28T13:02:18.797 INFO:tasks.workunit.client.0.smithi076.stdout:3/55: dread d1/d7/fb [0,4194304] 0 2024-03-28T13:02:18.806 INFO:tasks.workunit.client.0.smithi076.stdout:2/55: symlink d2/d5/d7/l11 0 2024-03-28T13:02:18.807 INFO:tasks.workunit.client.0.smithi076.stdout:2/56: dread - d2/d5/d7/fe zero size 2024-03-28T13:02:18.815 INFO:tasks.workunit.client.0.smithi076.stdout:1/86: rmdir d14/d19 39 2024-03-28T13:02:18.816 INFO:tasks.workunit.client.0.smithi076.stdout:1/87: chown f13 333 1 2024-03-28T13:02:18.816 INFO:tasks.workunit.client.0.smithi076.stdout:4/67: link d0/f2 d0/db/d16/f1b 0 2024-03-28T13:02:18.816 INFO:tasks.workunit.client.0.smithi076.stdout:7/54: unlink d1/c2 0 2024-03-28T13:02:18.816 INFO:tasks.workunit.client.0.smithi076.stdout:7/55: dread - d1/f12 zero size 2024-03-28T13:02:18.816 INFO:tasks.workunit.client.0.smithi076.stdout:4/68: write d0/db/f11 [1429670,122160] 0 2024-03-28T13:02:18.816 INFO:tasks.workunit.client.0.smithi076.stdout:4/69: stat d0/ca 0 2024-03-28T13:02:18.819 INFO:tasks.workunit.client.0.smithi076.stdout:2/57: dread d2/f4 [0,4194304] 0 2024-03-28T13:02:18.846 INFO:tasks.workunit.client.0.smithi076.stdout:1/88: dwrite fe [0,4194304] 0 2024-03-28T13:02:19.097 INFO:tasks.workunit.client.0.smithi076.stdout:3/56: rmdir d1/d2 39 2024-03-28T13:02:19.097 INFO:tasks.workunit.client.0.smithi076.stdout:4/70: symlink d0/db/l1c 0 2024-03-28T13:02:19.097 INFO:tasks.workunit.client.0.smithi076.stdout:7/56: creat d1/f13 x:0 0 0 2024-03-28T13:02:19.097 INFO:tasks.workunit.client.0.smithi076.stdout:7/57: chown d1/f4 16191105 1 2024-03-28T13:02:19.098 INFO:tasks.workunit.client.0.smithi076.stdout:2/58: creat d2/d5/f12 x:0 0 0 2024-03-28T13:02:19.098 INFO:tasks.workunit.client.0.smithi076.stdout:1/89: creat d14/d19/f1f x:0 0 0 2024-03-28T13:02:19.120 INFO:tasks.workunit.client.0.smithi076.stdout:7/58: read d1/f7 [3065852,78617] 0 2024-03-28T13:02:19.145 INFO:tasks.workunit.client.0.smithi076.stdout:1/90: dwrite f13 [0,4194304] 0 2024-03-28T13:02:19.165 INFO:tasks.workunit.client.0.smithi076.stdout:8/30: sync 2024-03-28T13:02:19.237 INFO:tasks.workunit.client.0.smithi076.stdout:9/37: truncate f3 1627512 0 2024-03-28T13:02:19.280 INFO:tasks.workunit.client.0.smithi076.stdout:9/38: dwrite f7 [0,4194304] 0 2024-03-28T13:02:19.284 INFO:tasks.workunit.client.0.smithi076.stdout:3/57: unlink d1/d7/f10 0 2024-03-28T13:02:19.347 INFO:tasks.workunit.client.0.smithi076.stdout:4/71: rename d0/db/l10 to d0/db/d16/l1d 0 2024-03-28T13:02:19.373 INFO:tasks.workunit.client.0.smithi076.stdout:5/56: sync 2024-03-28T13:02:19.492 INFO:tasks.workunit.client.0.smithi076.stdout:7/59: mkdir d1/d8/d14 0 2024-03-28T13:02:19.528 INFO:tasks.workunit.client.0.smithi076.stdout:7/60: dwrite d1/f13 [0,4194304] 0 2024-03-28T13:02:19.541 INFO:tasks.workunit.client.0.smithi076.stdout:7/61: dread d1/f4 [0,4194304] 0 2024-03-28T13:02:19.541 INFO:tasks.workunit.client.0.smithi076.stdout:7/62: write d1/f6 [232031,89219] 0 2024-03-28T13:02:19.546 INFO:tasks.workunit.client.0.smithi076.stdout:1/91: mkdir d14/d19/d20 0 2024-03-28T13:02:19.662 INFO:tasks.workunit.client.0.smithi076.stdout:8/31: creat fa x:0 0 0 2024-03-28T13:02:19.663 INFO:tasks.workunit.client.0.smithi076.stdout:8/32: fsync f8 0 2024-03-28T13:02:19.663 INFO:tasks.workunit.client.0.smithi076.stdout:8/33: write f8 [372700,27500] 0 2024-03-28T13:02:20.245 INFO:tasks.workunit.client.0.smithi076.stdout:6/55: sync 2024-03-28T13:02:20.245 INFO:tasks.workunit.client.0.smithi076.stdout:0/56: sync 2024-03-28T13:02:20.245 INFO:tasks.workunit.client.0.smithi076.stdout:0/57: read f5 [902447,105576] 0 2024-03-28T13:02:20.245 INFO:tasks.workunit.client.0.smithi076.stdout:9/39: mknod d9/cc 0 2024-03-28T13:02:20.253 INFO:tasks.workunit.client.0.smithi076.stdout:3/58: mkdir d1/d2/d8/d14 0 2024-03-28T13:02:20.253 INFO:tasks.workunit.client.0.smithi076.stdout:4/72: creat d0/f1e x:0 0 0 2024-03-28T13:02:20.271 INFO:tasks.workunit.client.0.smithi076.stdout:4/73: write d0/db/f11 [595865,108227] 0 2024-03-28T13:02:20.271 INFO:tasks.workunit.client.0.smithi076.stdout:4/74: write d0/db/d16/f1b [5224001,101279] 0 2024-03-28T13:02:20.272 INFO:tasks.workunit.client.0.smithi076.stdout:5/57: mknod d5/db/d19/c1b 0 2024-03-28T13:02:20.283 INFO:tasks.workunit.client.0.smithi076.stdout:4/75: fsync d0/f2 0 2024-03-28T13:02:20.291 INFO:tasks.workunit.client.0.smithi076.stdout:6/56: dwrite d6/fb [0,4194304] 0 2024-03-28T13:02:20.295 INFO:tasks.workunit.client.0.smithi076.stdout:7/63: unlink d1/d8/fd 0 2024-03-28T13:02:20.295 INFO:tasks.workunit.client.0.smithi076.stdout:1/92: creat d14/f21 x:0 0 0 2024-03-28T13:02:20.295 INFO:tasks.workunit.client.0.smithi076.stdout:7/64: write d1/f4 [4634687,95789] 0 2024-03-28T13:02:20.295 INFO:tasks.workunit.client.0.smithi076.stdout:8/34: mkdir db 0 2024-03-28T13:02:20.295 INFO:tasks.workunit.client.0.smithi076.stdout:7/65: chown d1/d8 12 1 2024-03-28T13:02:20.302 INFO:tasks.workunit.client.0.smithi076.stdout:4/76: dread d0/db/d16/f1b [0,4194304] 0 2024-03-28T13:02:20.302 INFO:tasks.workunit.client.0.smithi076.stdout:4/77: readlink d0/db/l1c 0 2024-03-28T13:02:20.303 INFO:tasks.workunit.client.0.smithi076.stdout:3/59: dwrite d1/d2/ff [0,4194304] 0 2024-03-28T13:02:20.308 INFO:tasks.workunit.client.0.smithi076.stdout:3/60: dread d1/d2/d8/fc [0,4194304] 0 2024-03-28T13:02:20.308 INFO:tasks.workunit.client.0.smithi076.stdout:3/61: stat d1/d7/fb 0 2024-03-28T13:02:20.308 INFO:tasks.workunit.client.0.smithi076.stdout:3/62: readlink d1/d2/d6/ld 0 2024-03-28T13:02:20.460 INFO:tasks.workunit.client.0.smithi076.stdout:9/40: mkdir d9/dd 0 2024-03-28T13:02:20.530 INFO:tasks.workunit.client.0.smithi076.stdout:0/58: mkdir db/dc/df/d18 0 2024-03-28T13:02:20.530 INFO:tasks.workunit.client.0.smithi076.stdout:0/59: fdatasync f1 0 2024-03-28T13:02:20.530 INFO:tasks.workunit.client.0.smithi076.stdout:0/60: dread - db/f12 zero size 2024-03-28T13:02:20.530 INFO:tasks.workunit.client.0.smithi076.stdout:0/61: chown f1 1329386 1 2024-03-28T13:02:20.612 INFO:tasks.workunit.client.0.smithi076.stdout:5/58: mkdir d5/d9/d1c 0 2024-03-28T13:02:20.612 INFO:tasks.workunit.client.0.smithi076.stdout:2/59: sync 2024-03-28T13:02:20.612 INFO:tasks.workunit.client.0.smithi076.stdout:2/60: fdatasync d2/d5/d7/fa 0 2024-03-28T13:02:20.664 INFO:tasks.workunit.client.0.smithi076.stdout:6/57: creat d6/da/f13 x:0 0 0 2024-03-28T13:02:20.700 INFO:tasks.workunit.client.0.smithi076.stdout:1/93: creat d14/d19/f22 x:0 0 0 2024-03-28T13:02:20.749 INFO:tasks.workunit.client.0.smithi076.stdout:8/35: rmdir db 0 2024-03-28T13:02:20.750 INFO:tasks.workunit.client.0.smithi076.stdout:8/36: write fa [1015050,70564] 0 2024-03-28T13:02:20.915 INFO:tasks.workunit.client.0.smithi076.stdout:4/78: unlink d0/f5 0 2024-03-28T13:02:21.014 INFO:tasks.workunit.client.0.smithi076.stdout:9/41: mkdir d9/da/de 0 2024-03-28T13:02:21.039 INFO:tasks.workunit.client.0.smithi076.stdout:9/42: dwrite f3 [0,4194304] 0 2024-03-28T13:02:21.148 INFO:tasks.workunit.client.0.smithi076.stdout:0/62: creat db/dc/df/f19 x:0 0 0 2024-03-28T13:02:21.168 INFO:tasks.workunit.client.0.smithi076.stdout:5/59: mkdir d5/d9/d1c/d1d 0 2024-03-28T13:02:21.168 INFO:tasks.workunit.client.0.smithi076.stdout:5/60: dread - d5/db/f13 zero size 2024-03-28T13:02:21.294 INFO:tasks.workunit.client.0.smithi076.stdout:2/61: mknod d2/d5/c13 0 2024-03-28T13:02:21.294 INFO:tasks.workunit.client.0.smithi076.stdout:6/58: creat d6/da/f14 x:0 0 0 2024-03-28T13:02:21.298 INFO:tasks.workunit.client.0.smithi076.stdout:6/59: read f0 [254115,6432] 0 2024-03-28T13:02:21.431 INFO:tasks.workunit.client.0.smithi076.stdout:8/37: mknod cc 0 2024-03-28T13:02:21.431 INFO:tasks.workunit.client.0.smithi076.stdout:8/38: stat fa 0 2024-03-28T13:02:21.441 INFO:tasks.workunit.client.0.smithi076.stdout:8/39: dread f8 [0,4194304] 0 2024-03-28T13:02:21.441 INFO:tasks.workunit.client.0.smithi076.stdout:8/40: truncate fa 1394205 0 2024-03-28T13:02:21.453 INFO:tasks.workunit.client.0.smithi076.stdout:8/41: dread f7 [0,4194304] 0 2024-03-28T13:02:21.469 INFO:tasks.workunit.client.0.smithi076.stdout:8/42: dread f2 [4194304,4194304] 0 2024-03-28T13:02:21.469 INFO:tasks.workunit.client.0.smithi076.stdout:8/43: chown f7 2835650 1 2024-03-28T13:02:21.619 INFO:tasks.workunit.client.0.smithi076.stdout:4/79: link d0/db/f18 d0/f1f 0 2024-03-28T13:02:21.619 INFO:tasks.workunit.client.0.smithi076.stdout:9/43: mkdir d9/dd/df 0 2024-03-28T13:02:21.636 INFO:tasks.workunit.client.0.smithi076.stdout:5/61: unlink d5/db/f17 0 2024-03-28T13:02:21.636 INFO:tasks.workunit.client.0.smithi076.stdout:0/63: creat db/dc/df/f1a x:0 0 0 2024-03-28T13:02:21.636 INFO:tasks.workunit.client.0.smithi076.stdout:5/62: fsync d5/fa 0 2024-03-28T13:02:21.636 INFO:tasks.workunit.client.0.smithi076.stdout:5/63: dread - d5/fa zero size 2024-03-28T13:02:21.642 INFO:tasks.workunit.client.0.smithi076.stdout:5/64: dread d5/f6 [0,4194304] 0 2024-03-28T13:02:21.716 INFO:tasks.workunit.client.0.smithi076.stdout:2/62: link d2/d5/d7/l11 d2/d5/d7/l14 0 2024-03-28T13:02:21.716 INFO:tasks.workunit.client.0.smithi076.stdout:2/63: stat d2/d5/f12 0 2024-03-28T13:02:21.740 INFO:tasks.workunit.client.0.smithi076.stdout:6/60: truncate f0 703037 0 2024-03-28T13:02:21.751 INFO:tasks.workunit.client.0.smithi076.stdout:2/64: dwrite d2/d5/d7/fa [0,4194304] 0 2024-03-28T13:02:21.871 INFO:tasks.workunit.client.0.smithi076.stdout:9/44: rmdir d9 39 2024-03-28T13:02:21.871 INFO:tasks.workunit.client.0.smithi076.stdout:9/45: stat d9/dd 0 2024-03-28T13:02:21.893 INFO:tasks.workunit.client.0.smithi076.stdout:9/46: dread f3 [0,4194304] 0 2024-03-28T13:02:21.927 INFO:tasks.workunit.client.0.smithi076.stdout:0/64: symlink db/dc/df/l1b 0 2024-03-28T13:02:21.979 INFO:tasks.workunit.client.0.smithi076.stdout:6/61: creat d6/da/f15 x:0 0 0 2024-03-28T13:02:21.979 INFO:tasks.workunit.client.0.smithi076.stdout:6/62: chown d6/da 0 1 2024-03-28T13:02:22.018 INFO:tasks.workunit.client.0.smithi076.stdout:6/63: dwrite d6/da/fc [0,4194304] 0 2024-03-28T13:02:22.018 INFO:tasks.workunit.client.0.smithi076.stdout:6/64: write d6/f12 [4270163,37741] 0 2024-03-28T13:02:22.037 INFO:tasks.workunit.client.0.smithi076.stdout:6/65: write d6/f12 [4128029,4882] 0 2024-03-28T13:02:22.330 INFO:tasks.workunit.client.0.smithi076.stdout:2/65: link d2/d5/c13 d2/d5/d7/c15 0 2024-03-28T13:02:22.330 INFO:tasks.workunit.client.0.smithi076.stdout:9/47: creat d9/dd/f10 x:0 0 0 2024-03-28T13:02:22.334 INFO:tasks.workunit.client.0.smithi076.stdout:0/65: creat db/dc/df/d11/f1c x:0 0 0 2024-03-28T13:02:22.342 INFO:tasks.workunit.client.0.smithi076.stdout:2/66: dread d2/d5/d7/fa [0,4194304] 0 2024-03-28T13:02:22.412 INFO:tasks.workunit.client.0.smithi076.stdout:7/66: rename d1/la to d1/d8/l15 0 2024-03-28T13:02:23.206 INFO:tasks.workunit.client.0.smithi076.stdout:0/66: mkdir db/dc/df/d18/d1d 0 2024-03-28T13:02:23.206 INFO:tasks.workunit.client.0.smithi076.stdout:2/67: unlink d2/d5/d7/l11 0 2024-03-28T13:02:23.216 INFO:tasks.workunit.client.0.smithi076.stdout:7/67: creat d1/f16 x:0 0 0 2024-03-28T13:02:23.236 INFO:tasks.workunit.client.0.smithi076.stdout:6/66: mknod d6/c16 0 2024-03-28T13:02:23.241 INFO:tasks.workunit.client.0.smithi076.stdout:8/44: truncate fa 2237 0 2024-03-28T13:02:23.242 INFO:tasks.workunit.client.0.smithi076.stdout:3/63: rename d1/d2/ff to d1/d2/d8/d14/f15 0 2024-03-28T13:02:23.243 INFO:tasks.workunit.client.0.smithi076.stdout:4/80: write d0/f9 [1089806,67684] 0 2024-03-28T13:02:23.267 INFO:tasks.workunit.client.0.smithi076.stdout:4/81: dread d0/ff [0,4194304] 0 2024-03-28T13:02:23.509 INFO:tasks.workunit.client.0.smithi076.stdout:2/68: unlink d2/f4 0 2024-03-28T13:02:23.509 INFO:tasks.workunit.client.0.smithi076.stdout:0/67: link db/f17 db/dc/df/f1e 0 2024-03-28T13:02:23.510 INFO:tasks.workunit.client.0.smithi076.stdout:0/68: dread - db/dc/fe zero size 2024-03-28T13:02:23.519 INFO:tasks.workunit.client.0.smithi076.stdout:2/69: dread d2/d5/d7/fa [0,4194304] 0 2024-03-28T13:02:23.519 INFO:tasks.workunit.client.0.smithi076.stdout:2/70: truncate d2/d5/f12 131957 0 2024-03-28T13:02:23.525 INFO:tasks.workunit.client.0.smithi076.stdout:7/68: link d1/f16 d1/dc/f17 0 2024-03-28T13:02:23.526 INFO:tasks.workunit.client.0.smithi076.stdout:7/69: chown d1/f13 1574 1 2024-03-28T13:02:23.526 INFO:tasks.workunit.client.0.smithi076.stdout:6/67: truncate d6/fb 3382969 0 2024-03-28T13:02:23.526 INFO:tasks.workunit.client.0.smithi076.stdout:6/68: truncate f0 1497541 0 2024-03-28T13:02:23.526 INFO:tasks.workunit.client.0.smithi076.stdout:6/69: chown d6/da/f14 810079 1 2024-03-28T13:02:23.526 INFO:tasks.workunit.client.0.smithi076.stdout:8/45: creat fd x:0 0 0 2024-03-28T13:02:23.544 INFO:tasks.workunit.client.0.smithi076.stdout:5/65: rename d5/c11 to d5/db/c1e 0 2024-03-28T13:02:23.566 INFO:tasks.workunit.client.0.smithi076.stdout:2/71: dwrite d2/d5/d7/fe [0,4194304] 0 2024-03-28T13:02:23.575 INFO:tasks.workunit.client.0.smithi076.stdout:2/72: dread d2/d5/d7/fa [0,4194304] 0 2024-03-28T13:02:23.583 INFO:tasks.workunit.client.0.smithi076.stdout:3/64: creat d1/d2/d6/f16 x:0 0 0 2024-03-28T13:02:23.603 INFO:tasks.workunit.client.0.smithi076.stdout:3/65: read d1/d2/d8/d14/f15 [1587226,48068] 0 2024-03-28T13:02:23.648 INFO:tasks.workunit.client.0.smithi076.stdout:1/94: creat d14/f23 x:0 0 0 2024-03-28T13:02:23.648 INFO:tasks.workunit.client.0.smithi076.stdout:1/95: truncate d14/d19/f22 207867 0 2024-03-28T13:02:23.712 INFO:tasks.workunit.client.0.smithi076.stdout:4/82: mkdir d0/d20 0 2024-03-28T13:02:23.826 INFO:tasks.workunit.client.0.smithi076.stdout:7/70: mkdir d1/d18 0 2024-03-28T13:02:23.871 INFO:tasks.workunit.client.0.smithi076.stdout:6/70: chown d6/c9 15 1 2024-03-28T13:02:23.871 INFO:tasks.workunit.client.0.smithi076.stdout:6/71: write d6/da/fe [885295,105681] 0 2024-03-28T13:02:23.871 INFO:tasks.workunit.client.0.smithi076.stdout:6/72: chown d6 60 1 2024-03-28T13:02:23.922 INFO:tasks.workunit.client.0.smithi076.stdout:6/73: dwrite d6/da/fe [0,4194304] 0 2024-03-28T13:02:24.119 INFO:tasks.workunit.client.0.smithi076.stdout:9/48: rename d9/da/de to d9/dd/df/d11 0 2024-03-28T13:02:24.184 INFO:tasks.workunit.client.0.smithi076.stdout:2/73: creat d2/f16 x:0 0 0 2024-03-28T13:02:24.269 INFO:tasks.workunit.client.0.smithi076.stdout:3/66: creat d1/d7/f17 x:0 0 0 2024-03-28T13:02:24.459 INFO:tasks.workunit.client.0.smithi076.stdout:8/46: getdents . 0 2024-03-28T13:02:24.459 INFO:tasks.workunit.client.0.smithi076.stdout:8/47: readlink l5 0 2024-03-28T13:02:24.460 INFO:tasks.workunit.client.0.smithi076.stdout:8/48: write f2 [2446818,43587] 0 2024-03-28T13:02:24.460 INFO:tasks.workunit.client.0.smithi076.stdout:8/49: write f8 [1300571,11232] 0 2024-03-28T13:02:24.669 INFO:tasks.workunit.client.0.smithi076.stdout:4/83: mkdir d0/d20/d21 0 2024-03-28T13:02:24.714 INFO:tasks.workunit.client.0.smithi076.stdout:4/84: dwrite d0/f1f [0,4194304] 0 2024-03-28T13:02:24.939 INFO:tasks.workunit.client.0.smithi076.stdout:9/49: mknod d9/c12 0 2024-03-28T13:02:24.942 INFO:tasks.workunit.client.0.smithi076.stdout:0/69: rename l2 to db/dc/df/d18/d1d/l1f 0 2024-03-28T13:02:24.942 INFO:tasks.workunit.client.0.smithi076.stdout:5/66: rename d5/d9 to d5/d9/d1f 22 2024-03-28T13:02:24.942 INFO:tasks.workunit.client.0.smithi076.stdout:0/70: fsync db/dc/df/f1a 0 2024-03-28T13:02:24.942 INFO:tasks.workunit.client.0.smithi076.stdout:5/67: fsync d5/db/f13 0 2024-03-28T13:02:24.942 INFO:tasks.workunit.client.0.smithi076.stdout:5/68: fdatasync d5/db/f12 0 2024-03-28T13:02:24.942 INFO:tasks.workunit.client.0.smithi076.stdout:5/69: chown d5/db/d19 1333 1 2024-03-28T13:02:24.956 INFO:tasks.workunit.client.0.smithi076.stdout:9/50: dread f3 [0,4194304] 0 2024-03-28T13:02:24.956 INFO:tasks.workunit.client.0.smithi076.stdout:9/51: getdents d9/dd/df/d11 0 2024-03-28T13:02:24.973 INFO:tasks.workunit.client.0.smithi076.stdout:0/71: dwrite f1 [0,4194304] 0 2024-03-28T13:02:25.054 INFO:tasks.workunit.client.0.smithi076.stdout:3/67: mkdir d1/d2/d8/d14/d18 0 2024-03-28T13:02:25.054 INFO:tasks.workunit.client.0.smithi076.stdout:3/68: chown d1/d2/d8 1107339 1 2024-03-28T13:02:25.054 INFO:tasks.workunit.client.0.smithi076.stdout:3/69: dread - d1/d7/f17 zero size 2024-03-28T13:02:25.074 INFO:tasks.workunit.client.0.smithi076.stdout:3/70: write d1/d7/fb [2939017,58842] 0 2024-03-28T13:02:25.113 INFO:tasks.workunit.client.0.smithi076.stdout:8/50: mkdir de 0 2024-03-28T13:02:25.201 INFO:tasks.workunit.client.0.smithi076.stdout:4/85: mknod d0/d20/c22 0 2024-03-28T13:02:25.229 INFO:tasks.workunit.client.0.smithi076.stdout:4/86: read d0/db/f18 [333930,56696] 0 2024-03-28T13:02:25.283 INFO:tasks.workunit.client.0.smithi076.stdout:7/71: link d1/f16 d1/d8/f19 0 2024-03-28T13:02:25.283 INFO:tasks.workunit.client.0.smithi076.stdout:7/72: readlink d1/l3 0 2024-03-28T13:02:25.284 INFO:tasks.workunit.client.0.smithi076.stdout:7/73: stat d1/f7 0 2024-03-28T13:02:25.284 INFO:tasks.workunit.client.0.smithi076.stdout:7/74: read - d1/d8/f19 zero size 2024-03-28T13:02:25.284 INFO:tasks.workunit.client.0.smithi076.stdout:7/75: write d1/dc/f17 [503739,74887] 0 2024-03-28T13:02:25.301 INFO:tasks.workunit.client.0.smithi076.stdout:7/76: dread d1/f13 [0,4194304] 0 2024-03-28T13:02:25.331 INFO:tasks.workunit.client.0.smithi076.stdout:6/74: symlink d6/l17 0 2024-03-28T13:02:25.331 INFO:tasks.workunit.client.0.smithi076.stdout:6/75: fdatasync d6/fb 0 2024-03-28T13:02:25.331 INFO:tasks.workunit.client.0.smithi076.stdout:6/76: chown d6/l17 676813 1 2024-03-28T13:02:25.503 INFO:tasks.workunit.client.0.smithi076.stdout:5/70: creat d5/db/d19/f20 x:0 0 0 2024-03-28T13:02:25.503 INFO:tasks.workunit.client.0.smithi076.stdout:5/71: readlink l0 0 2024-03-28T13:02:25.532 INFO:tasks.workunit.client.0.smithi076.stdout:9/52: getdents d9/dd/df 0 2024-03-28T13:02:25.637 INFO:tasks.workunit.client.0.smithi076.stdout:0/72: symlink db/dc/df/l20 0 2024-03-28T13:02:25.717 INFO:tasks.workunit.client.0.smithi076.stdout:3/71: creat d1/d2/d6/f19 x:0 0 0 2024-03-28T13:02:25.717 INFO:tasks.workunit.client.0.smithi076.stdout:3/72: stat d1/d2/l13 0 2024-03-28T13:02:25.748 INFO:tasks.workunit.client.0.smithi076.stdout:3/73: dwrite d1/d2/d6/f16 [0,4194304] 0 2024-03-28T13:02:25.748 INFO:tasks.workunit.client.0.smithi076.stdout:3/74: truncate d1/d7/f17 1030679 0 2024-03-28T13:02:25.748 INFO:tasks.workunit.client.0.smithi076.stdout:3/75: chown d1/d2/l12 246969818 1 2024-03-28T13:02:25.771 INFO:tasks.workunit.client.0.smithi076.stdout:8/51: mknod de/cf 0 2024-03-28T13:02:26.242 INFO:tasks.workunit.client.0.smithi076.stdout:7/77: mknod d1/dc/c1a 0 2024-03-28T13:02:26.246 INFO:tasks.workunit.client.0.smithi076.stdout:7/78: dread d1/dc/ff [0,4194304] 0 2024-03-28T13:02:26.249 INFO:tasks.workunit.client.0.smithi076.stdout:6/77: creat d6/da/f18 x:0 0 0 2024-03-28T13:02:26.249 INFO:tasks.workunit.client.0.smithi076.stdout:5/72: mknod d5/db/df/c21 0 2024-03-28T13:02:26.255 INFO:tasks.workunit.client.0.smithi076.stdout:9/53: creat d9/dd/df/f13 x:0 0 0 2024-03-28T13:02:26.255 INFO:tasks.workunit.client.0.smithi076.stdout:0/73: mkdir db/dc/df/d18/d1d/d21 0 2024-03-28T13:02:26.261 INFO:tasks.workunit.client.0.smithi076.stdout:3/76: getdents d1/d2 0 2024-03-28T13:02:26.262 INFO:tasks.workunit.client.0.smithi076.stdout:3/77: readlink d1/d2/l13 0 2024-03-28T13:02:26.313 INFO:tasks.workunit.client.0.smithi076.stdout:9/54: dwrite f3 [0,4194304] 0 2024-03-28T13:02:26.466 INFO:tasks.workunit.client.0.smithi076.stdout:8/52: creat de/f10 x:0 0 0 2024-03-28T13:02:26.468 INFO:tasks.workunit.client.0.smithi076.stdout:1/96: sync 2024-03-28T13:02:26.469 INFO:tasks.workunit.client.0.smithi076.stdout:2/74: sync 2024-03-28T13:02:26.565 INFO:tasks.workunit.client.0.smithi076.stdout:7/79: truncate d1/dc/ff 98177 0 2024-03-28T13:02:26.613 INFO:tasks.workunit.client.0.smithi076.stdout:6/78: unlink c3 0 2024-03-28T13:02:26.613 INFO:tasks.workunit.client.0.smithi076.stdout:6/79: dread - d6/da/f15 zero size 2024-03-28T13:02:26.699 INFO:tasks.workunit.client.0.smithi076.stdout:5/73: mkdir d5/d9/d1c/d1d/d22 0 2024-03-28T13:02:26.699 INFO:tasks.workunit.client.0.smithi076.stdout:5/74: write f4 [2853991,126711] 0 2024-03-28T13:02:26.850 INFO:tasks.workunit.client.0.smithi076.stdout:0/74: creat db/dc/df/f22 x:0 0 0 2024-03-28T13:02:26.850 INFO:tasks.workunit.client.0.smithi076.stdout:3/78: unlink d1/d2/l12 0 2024-03-28T13:02:26.942 INFO:tasks.workunit.client.0.smithi076.stdout:8/53: dwrite f8 [0,4194304] 0 2024-03-28T13:02:26.954 INFO:tasks.workunit.client.0.smithi076.stdout:1/97: rmdir d14/d19 39 2024-03-28T13:02:26.954 INFO:tasks.workunit.client.0.smithi076.stdout:1/98: truncate d14/d19/f22 912486 0 2024-03-28T13:02:26.981 INFO:tasks.workunit.client.0.smithi076.stdout:1/99: dwrite d14/f21 [0,4194304] 0 2024-03-28T13:02:26.981 INFO:tasks.workunit.client.0.smithi076.stdout:1/100: chown fd 31206 1 2024-03-28T13:02:27.018 INFO:tasks.workunit.client.0.smithi076.stdout:2/75: dread d2/d5/d7/fe [0,4194304] 0 2024-03-28T13:02:27.019 INFO:tasks.workunit.client.0.smithi076.stdout:2/76: fdatasync d2/f16 0 2024-03-28T13:02:27.327 INFO:tasks.workunit.client.0.smithi076.stdout:7/80: truncate d1/f13 453232 0 2024-03-28T13:02:27.327 INFO:tasks.workunit.client.0.smithi076.stdout:5/75: creat d5/db/d19/f23 x:0 0 0 2024-03-28T13:02:27.327 INFO:tasks.workunit.client.0.smithi076.stdout:5/76: readlink l0 0 2024-03-28T13:02:27.368 INFO:tasks.workunit.client.0.smithi076.stdout:0/75: creat db/dc/df/f23 x:0 0 0 2024-03-28T13:02:27.369 INFO:tasks.workunit.client.0.smithi076.stdout:0/76: write db/dc/df/f22 [1022738,118968] 0 2024-03-28T13:02:27.369 INFO:tasks.workunit.client.0.smithi076.stdout:7/81: dwrite d1/f6 [0,4194304] 0 2024-03-28T13:02:27.390 INFO:tasks.workunit.client.0.smithi076.stdout:9/55: mkdir d9/dd/df/d11/d14 0 2024-03-28T13:02:27.391 INFO:tasks.workunit.client.0.smithi076.stdout:8/54: creat de/f11 x:0 0 0 2024-03-28T13:02:27.424 INFO:tasks.workunit.client.0.smithi076.stdout:9/56: write f3 [959962,26333] 0 2024-03-28T13:02:27.428 INFO:tasks.workunit.client.0.smithi076.stdout:3/79: dwrite d1/d2/d6/f19 [0,4194304] 0 2024-03-28T13:02:27.552 INFO:tasks.workunit.client.0.smithi076.stdout:1/101: mknod d14/d19/c24 0 2024-03-28T13:02:27.585 INFO:tasks.workunit.client.0.smithi076.stdout:2/77: creat d2/d5/d7/f17 x:0 0 0 2024-03-28T13:02:27.585 INFO:tasks.workunit.client.0.smithi076.stdout:2/78: dread - d2/d5/d7/f17 zero size 2024-03-28T13:02:27.626 INFO:tasks.workunit.client.0.smithi076.stdout:6/80: rename d6/l17 to d6/l19 0 2024-03-28T13:02:27.709 INFO:tasks.workunit.client.0.smithi076.stdout:5/77: rename d5/db/df/c18 to d5/db/df/c24 0 2024-03-28T13:02:27.744 INFO:tasks.workunit.client.0.smithi076.stdout:5/78: dwrite d5/db/d19/f23 [0,4194304] 0 2024-03-28T13:02:27.830 INFO:tasks.workunit.client.0.smithi076.stdout:4/87: rmdir d0/db/d16 39 2024-03-28T13:02:27.830 INFO:tasks.workunit.client.0.smithi076.stdout:7/82: creat d1/f1b x:0 0 0 2024-03-28T13:02:27.857 INFO:tasks.workunit.client.0.smithi076.stdout:7/83: write d1/f5 [2486299,24328] 0 2024-03-28T13:02:28.133 INFO:tasks.workunit.client.0.smithi076.stdout:9/57: creat d9/dd/df/d11/f15 x:0 0 0 2024-03-28T13:02:28.133 INFO:tasks.workunit.client.0.smithi076.stdout:9/58: stat l4 0 2024-03-28T13:02:28.271 INFO:tasks.workunit.client.0.smithi076.stdout:3/80: dwrite d1/d2/f11 [0,4194304] 0 2024-03-28T13:02:28.468 INFO:tasks.workunit.client.0.smithi076.stdout:0/77: creat db/dc/f24 x:0 0 0 2024-03-28T13:02:28.569 INFO:tasks.workunit.client.0.smithi076.stdout:2/79: link d2/d5/f12 d2/f18 0 2024-03-28T13:02:28.704 INFO:tasks.workunit.client.0.smithi076.stdout:5/79: mkdir d5/d9/d1c/d25 0 2024-03-28T13:02:28.704 INFO:tasks.workunit.client.0.smithi076.stdout:5/80: chown d5/d9/d1c 2 1 2024-03-28T13:02:28.832 INFO:tasks.workunit.client.0.smithi076.stdout:4/88: getdents d0/db 0 2024-03-28T13:02:28.838 INFO:tasks.workunit.client.0.smithi076.stdout:4/89: dread d0/db/f11 [0,4194304] 0 2024-03-28T13:02:28.883 INFO:tasks.workunit.client.0.smithi076.stdout:7/84: creat d1/dc/f1c x:0 0 0 2024-03-28T13:02:28.883 INFO:tasks.workunit.client.0.smithi076.stdout:9/59: creat d9/dd/df/d11/d14/f16 x:0 0 0 2024-03-28T13:02:28.938 INFO:tasks.workunit.client.0.smithi076.stdout:0/78: symlink db/dc/df/d18/d1d/l25 0 2024-03-28T13:02:28.938 INFO:tasks.workunit.client.0.smithi076.stdout:0/79: chown db/dc/fd 384420 1 2024-03-28T13:02:29.033 INFO:tasks.workunit.client.0.smithi076.stdout:2/80: readlink d2/d5/d7/l14 0 2024-03-28T13:02:29.166 INFO:tasks.workunit.client.0.smithi076.stdout:5/81: unlink d5/db/d19/f23 0 2024-03-28T13:02:29.166 INFO:tasks.workunit.client.0.smithi076.stdout:6/81: getdents d6 0 2024-03-28T13:02:29.201 INFO:tasks.workunit.client.0.smithi076.stdout:6/82: dwrite f0 [0,4194304] 0 2024-03-28T13:02:29.201 INFO:tasks.workunit.client.0.smithi076.stdout:6/83: fsync d6/da/f18 0 2024-03-28T13:02:29.201 INFO:tasks.workunit.client.0.smithi076.stdout:6/84: truncate d6/da/f18 590672 0 2024-03-28T13:02:29.201 INFO:tasks.workunit.client.0.smithi076.stdout:6/85: stat d6 0 2024-03-28T13:02:29.212 INFO:tasks.workunit.client.0.smithi076.stdout:6/86: dread d6/f12 [0,4194304] 0 2024-03-28T13:02:29.213 INFO:tasks.workunit.client.0.smithi076.stdout:4/90: rename d0/db/d16/f17 to d0/db/f23 0 2024-03-28T13:02:29.213 INFO:tasks.workunit.client.0.smithi076.stdout:4/91: write d0/db/f18 [1271418,104217] 0 2024-03-28T13:02:29.213 INFO:tasks.workunit.client.0.smithi076.stdout:4/92: read - d0/db/f23 zero size 2024-03-28T13:02:29.321 INFO:tasks.workunit.client.0.smithi076.stdout:9/60: creat d9/f17 x:0 0 0 2024-03-28T13:02:29.450 INFO:tasks.workunit.client.0.smithi076.stdout:3/81: getdents d1/d2/d8 0 2024-03-28T13:02:29.467 INFO:tasks.workunit.client.0.smithi076.stdout:3/82: dread d1/d2/f11 [0,4194304] 0 2024-03-28T13:02:29.501 INFO:tasks.workunit.client.0.smithi076.stdout:7/85: getdents d1 0 2024-03-28T13:02:29.514 INFO:tasks.workunit.client.0.smithi076.stdout:0/80: link db/dc/df/l1b db/dc/df/l26 0 2024-03-28T13:02:29.528 INFO:tasks.workunit.client.0.smithi076.stdout:5/82: getdents d5/db/df 0 2024-03-28T13:02:29.528 INFO:tasks.workunit.client.0.smithi076.stdout:5/83: chown d5/db/df/c14 505744 1 2024-03-28T13:02:29.548 INFO:tasks.workunit.client.0.smithi076.stdout:5/84: dread f3 [0,4194304] 0 2024-03-28T13:02:29.548 INFO:tasks.workunit.client.0.smithi076.stdout:5/85: truncate d5/f7 4271868 0 2024-03-28T13:02:29.713 INFO:tasks.workunit.client.0.smithi076.stdout:6/87: mknod d6/da/c1a 0 2024-03-28T13:02:29.760 INFO:tasks.workunit.client.0.smithi076.stdout:4/93: creat d0/db/d16/f24 x:0 0 0 2024-03-28T13:02:29.761 INFO:tasks.workunit.client.0.smithi076.stdout:9/61: mkdir d9/dd/df/d11/d18 0 2024-03-28T13:02:29.798 INFO:tasks.workunit.client.0.smithi076.stdout:4/94: dwrite d0/db/f13 [0,4194304] 0 2024-03-28T13:02:29.798 INFO:tasks.workunit.client.0.smithi076.stdout:4/95: dread - d0/db/d16/f19 zero size 2024-03-28T13:02:29.856 INFO:tasks.workunit.client.0.smithi076.stdout:3/83: rename d1/d2/f11 to d1/d2/d8/f1a 0 2024-03-28T13:02:29.904 INFO:tasks.workunit.client.0.smithi076.stdout:7/86: creat d1/dc/f1d x:0 0 0 2024-03-28T13:02:29.936 INFO:tasks.workunit.client.0.smithi076.stdout:0/81: mknod db/dc/df/d18/d1d/d21/c27 0 2024-03-28T13:02:30.117 INFO:tasks.workunit.client.0.smithi076.stdout:1/102: truncate d14/d19/f22 120308 0 2024-03-28T13:02:30.117 INFO:tasks.workunit.client.0.smithi076.stdout:5/86: link f3 d5/db/df/f26 0 2024-03-28T13:02:30.117 INFO:tasks.workunit.client.0.smithi076.stdout:6/88: rename d6/da/fc to d6/da/f1b 0 2024-03-28T13:02:30.119 INFO:tasks.workunit.client.0.smithi076.stdout:6/89: dread d6/da/f18 [0,4194304] 0 2024-03-28T13:02:30.119 INFO:tasks.workunit.client.0.smithi076.stdout:6/90: chown d6/f12 27455009 1 2024-03-28T13:02:30.277 INFO:tasks.workunit.client.0.smithi076.stdout:8/55: sync 2024-03-28T13:02:30.277 INFO:tasks.workunit.client.0.smithi076.stdout:8/56: write de/f10 [309305,46420] 0 2024-03-28T13:02:30.357 INFO:tasks.workunit.client.0.smithi076.stdout:4/96: mknod d0/db/d16/c25 0 2024-03-28T13:02:30.379 INFO:tasks.workunit.client.0.smithi076.stdout:3/84: readlink d1/d2/l5 0 2024-03-28T13:02:30.599 INFO:tasks.workunit.client.0.smithi076.stdout:7/87: link d1/f1b d1/d8/f1e 0 2024-03-28T13:02:30.599 INFO:tasks.workunit.client.0.smithi076.stdout:7/88: readlink d1/l10 0 2024-03-28T13:02:30.599 INFO:tasks.workunit.client.0.smithi076.stdout:0/82: symlink db/dc/df/d18/d1d/l28 0 2024-03-28T13:02:30.599 INFO:tasks.workunit.client.0.smithi076.stdout:0/83: dread - db/dc/fe zero size 2024-03-28T13:02:30.605 INFO:tasks.workunit.client.0.smithi076.stdout:1/103: mknod d14/d19/d20/c25 0 2024-03-28T13:02:30.605 INFO:tasks.workunit.client.0.smithi076.stdout:1/104: readlink d14/l15 0 2024-03-28T13:02:30.606 INFO:tasks.workunit.client.0.smithi076.stdout:1/105: chown f5 10 1 2024-03-28T13:02:30.606 INFO:tasks.workunit.client.0.smithi076.stdout:1/106: chown d14/c18 27886585 1 2024-03-28T13:02:30.683 INFO:tasks.workunit.client.0.smithi076.stdout:5/87: mknod d5/d9/d1c/d1d/d22/c27 0 2024-03-28T13:02:30.736 INFO:tasks.workunit.client.0.smithi076.stdout:6/91: creat d6/da/f1c x:0 0 0 2024-03-28T13:02:30.767 INFO:tasks.workunit.client.0.smithi076.stdout:6/92: dwrite d6/da/f1b [0,4194304] 0 2024-03-28T13:02:30.768 INFO:tasks.workunit.client.0.smithi076.stdout:6/93: chown d6/f12 39795 1 2024-03-28T13:02:30.768 INFO:tasks.workunit.client.0.smithi076.stdout:6/94: chown d6/fb 449394529 1 2024-03-28T13:02:30.784 INFO:tasks.workunit.client.0.smithi076.stdout:6/95: dread f0 [0,4194304] 0 2024-03-28T13:02:30.856 INFO:tasks.workunit.client.0.smithi076.stdout:8/57: mkdir de/d12 0 2024-03-28T13:02:30.856 INFO:tasks.workunit.client.0.smithi076.stdout:4/97: mknod d0/db/c26 0 2024-03-28T13:02:30.876 INFO:tasks.workunit.client.0.smithi076.stdout:4/98: read d0/fc [237981,70524] 0 2024-03-28T13:02:30.876 INFO:tasks.workunit.client.0.smithi076.stdout:4/99: chown d0/d20/c22 6165 1 2024-03-28T13:02:30.876 INFO:tasks.workunit.client.0.smithi076.stdout:4/100: stat d0/d20/c22 0 2024-03-28T13:02:30.899 INFO:tasks.workunit.client.0.smithi076.stdout:4/101: dwrite d0/db/f23 [0,4194304] 0 2024-03-28T13:02:30.899 INFO:tasks.workunit.client.0.smithi076.stdout:4/102: truncate d0/db/d16/f24 89351 0 2024-03-28T13:02:30.899 INFO:tasks.workunit.client.0.smithi076.stdout:4/103: getdents d0/d20/d21 0 2024-03-28T13:02:30.904 INFO:tasks.workunit.client.0.smithi076.stdout:4/104: write d0/f9 [582818,51059] 0 2024-03-28T13:02:30.946 INFO:tasks.workunit.client.0.smithi076.stdout:4/105: dwrite d0/db/f11 [0,4194304] 0 2024-03-28T13:02:31.272 INFO:tasks.workunit.client.0.smithi076.stdout:3/85: truncate d1/d2/d6/f16 3763818 0 2024-03-28T13:02:31.272 INFO:tasks.workunit.client.0.smithi076.stdout:0/84: creat db/dc/df/d18/d1d/f29 x:0 0 0 2024-03-28T13:02:31.272 INFO:tasks.workunit.client.0.smithi076.stdout:0/85: dread - db/dc/df/f23 zero size 2024-03-28T13:02:31.272 INFO:tasks.workunit.client.0.smithi076.stdout:0/86: rename db to db/dc/df/d2a 22 2024-03-28T13:02:31.297 INFO:tasks.workunit.client.0.smithi076.stdout:1/107: creat d14/f26 x:0 0 0 2024-03-28T13:02:31.316 INFO:tasks.workunit.client.0.smithi076.stdout:0/87: dwrite db/f14 [0,4194304] 0 2024-03-28T13:02:31.341 INFO:tasks.workunit.client.0.smithi076.stdout:0/88: write db/f14 [2968919,37960] 0 2024-03-28T13:02:32.040 INFO:tasks.workunit.client.0.smithi076.stdout:2/81: sync 2024-03-28T13:02:32.177 INFO:tasks.workunit.client.0.smithi076.stdout:9/62: sync 2024-03-28T13:02:32.177 INFO:tasks.workunit.client.0.smithi076.stdout:1/108: creat d14/d19/d20/f27 x:0 0 0 2024-03-28T13:02:32.195 INFO:tasks.workunit.client.0.smithi076.stdout:0/89: link db/dc/df/d18/d1d/l1f db/dc/df/d11/l2b 0 2024-03-28T13:02:32.292 INFO:tasks.workunit.client.0.smithi076.stdout:9/63: symlink d9/l19 0 2024-03-28T13:02:32.292 INFO:tasks.workunit.client.0.smithi076.stdout:2/82: creat d2/d5/d7/f19 x:0 0 0 2024-03-28T13:02:32.292 INFO:tasks.workunit.client.0.smithi076.stdout:9/64: write f3 [2875974,98073] 0 2024-03-28T13:02:32.386 INFO:tasks.workunit.client.0.smithi076.stdout:1/109: symlink d14/l28 0 2024-03-28T13:02:32.386 INFO:tasks.workunit.client.0.smithi076.stdout:0/90: mknod db/dc/df/d18/c2c 0 2024-03-28T13:02:32.386 INFO:tasks.workunit.client.0.smithi076.stdout:0/91: rename db/dc/df to db/dc/df/d11/d2d 22 2024-03-28T13:02:32.386 INFO:tasks.workunit.client.0.smithi076.stdout:0/92: write db/dc/df/f19 [180889,87287] 0 2024-03-28T13:02:32.466 INFO:tasks.workunit.client.0.smithi076.stdout:9/65: mkdir d9/dd/df/d11/d1a 0 2024-03-28T13:02:32.620 INFO:tasks.workunit.client.0.smithi076.stdout:1/110: rmdir d14/d19/d20 39 2024-03-28T13:02:32.620 INFO:tasks.workunit.client.0.smithi076.stdout:0/93: mknod db/d16/c2e 0 2024-03-28T13:02:32.626 INFO:tasks.workunit.client.0.smithi076.stdout:2/83: link d2/d5/d7/d8/lc d2/d5/db/l1a 0 2024-03-28T13:02:32.636 INFO:tasks.workunit.client.0.smithi076.stdout:0/94: dread db/f14 [0,4194304] 0 2024-03-28T13:02:32.851 INFO:tasks.workunit.client.0.smithi076.stdout:9/66: link d9/c12 d9/dd/c1b 0 2024-03-28T13:02:32.851 INFO:tasks.workunit.client.0.smithi076.stdout:5/88: creat d5/d9/f28 x:0 0 0 2024-03-28T13:02:32.851 INFO:tasks.workunit.client.0.smithi076.stdout:9/67: read - d9/dd/df/d11/f15 zero size 2024-03-28T13:02:32.851 INFO:tasks.workunit.client.0.smithi076.stdout:5/89: dread - d5/db/f12 zero size 2024-03-28T13:02:32.851 INFO:tasks.workunit.client.0.smithi076.stdout:5/90: dread - d5/d9/f28 zero size 2024-03-28T13:02:32.963 INFO:tasks.workunit.client.0.smithi076.stdout:2/84: creat d2/d5/db/f1b x:0 0 0 2024-03-28T13:02:33.001 INFO:tasks.workunit.client.0.smithi076.stdout:4/106: truncate d0/db/f11 2283457 0 2024-03-28T13:02:33.021 INFO:tasks.workunit.client.0.smithi076.stdout:4/107: dread d0/f1f [0,4194304] 0 2024-03-28T13:02:33.232 INFO:tasks.workunit.client.0.smithi076.stdout:0/95: symlink db/d16/l2f 0 2024-03-28T13:02:33.318 INFO:tasks.workunit.client.0.smithi076.stdout:3/86: creat d1/f1b x:0 0 0 2024-03-28T13:02:33.333 INFO:tasks.workunit.client.0.smithi076.stdout:3/87: dread d1/d2/d8/f1a [0,4194304] 0 2024-03-28T13:02:33.358 INFO:tasks.workunit.client.0.smithi076.stdout:7/89: mknod d1/c1f 0 2024-03-28T13:02:33.358 INFO:tasks.workunit.client.0.smithi076.stdout:9/68: creat d9/dd/df/d11/d1a/f1c x:0 0 0 2024-03-28T13:02:33.359 INFO:tasks.workunit.client.0.smithi076.stdout:9/69: write d9/dd/f10 [845040,48419] 0 2024-03-28T13:02:33.359 INFO:tasks.workunit.client.0.smithi076.stdout:9/70: dread - d9/dd/df/f13 zero size 2024-03-28T13:02:33.361 INFO:tasks.workunit.client.0.smithi076.stdout:5/91: getdents d5 0 2024-03-28T13:02:33.380 INFO:tasks.workunit.client.0.smithi076.stdout:7/90: dread d1/f5 [0,4194304] 0 2024-03-28T13:02:33.407 INFO:tasks.workunit.client.0.smithi076.stdout:9/71: dwrite d9/dd/df/d11/d1a/f1c [0,4194304] 0 2024-03-28T13:02:33.438 INFO:tasks.workunit.client.0.smithi076.stdout:7/91: dwrite d1/f7 [0,4194304] 0 2024-03-28T13:02:33.439 INFO:tasks.workunit.client.0.smithi076.stdout:7/92: stat d1/f6 0 2024-03-28T13:02:33.455 INFO:tasks.workunit.client.0.smithi076.stdout:1/111: rename d14/d19/f22 to d14/d19/d20/f29 0 2024-03-28T13:02:33.470 INFO:tasks.workunit.client.0.smithi076.stdout:1/112: dread f0 [0,4194304] 0 2024-03-28T13:02:33.471 INFO:tasks.workunit.client.0.smithi076.stdout:1/113: fsync f8 0 2024-03-28T13:02:33.507 INFO:tasks.workunit.client.0.smithi076.stdout:2/85: mknod d2/d5/d7/d8/c1c 0 2024-03-28T13:02:33.549 INFO:tasks.workunit.client.0.smithi076.stdout:2/86: dwrite d2/f18 [0,4194304] 0 2024-03-28T13:02:33.550 INFO:tasks.workunit.client.0.smithi076.stdout:2/87: readlink d2/d5/db/l1a 0 2024-03-28T13:02:33.550 INFO:tasks.workunit.client.0.smithi076.stdout:2/88: stat d2/d5/d7/fe 0 2024-03-28T13:02:33.550 INFO:tasks.workunit.client.0.smithi076.stdout:2/89: fsync d2/d5/d7/f19 0 2024-03-28T13:02:33.673 INFO:tasks.workunit.client.0.smithi076.stdout:0/96: mknod db/dc/df/d18/d1d/d21/c30 0 2024-03-28T13:02:33.673 INFO:tasks.workunit.client.0.smithi076.stdout:3/88: symlink d1/d7/l1c 0 2024-03-28T13:02:33.805 INFO:tasks.workunit.client.0.smithi076.stdout:6/96: rmdir d6/da 39 2024-03-28T13:02:33.805 INFO:tasks.workunit.client.0.smithi076.stdout:6/97: fsync d6/da/f18 0 2024-03-28T13:02:33.805 INFO:tasks.workunit.client.0.smithi076.stdout:6/98: getdents d6 0 2024-03-28T13:02:33.805 INFO:tasks.workunit.client.0.smithi076.stdout:6/99: fsync d6/da/f13 0 2024-03-28T13:02:33.869 INFO:tasks.workunit.client.0.smithi076.stdout:9/72: creat d9/dd/df/d11/d1a/f1d x:0 0 0 2024-03-28T13:02:33.995 INFO:tasks.workunit.client.0.smithi076.stdout:4/108: write d0/db/f11 [2285123,992] 0 2024-03-28T13:02:33.995 INFO:tasks.workunit.client.0.smithi076.stdout:4/109: write d0/db/f18 [1292221,60667] 0 2024-03-28T13:02:34.263 INFO:tasks.workunit.client.0.smithi076.stdout:7/93: creat d1/d8/d14/f20 x:0 0 0 2024-03-28T13:02:34.263 INFO:tasks.workunit.client.0.smithi076.stdout:1/114: getdents d14 0 2024-03-28T13:02:34.263 INFO:tasks.workunit.client.0.smithi076.stdout:1/115: write d14/f21 [4869316,46934] 0 2024-03-28T13:02:34.263 INFO:tasks.workunit.client.0.smithi076.stdout:1/116: fsync fd 0 2024-03-28T13:02:34.263 INFO:tasks.workunit.client.0.smithi076.stdout:1/117: write f7 [4950087,93102] 0 2024-03-28T13:02:34.311 INFO:tasks.workunit.client.0.smithi076.stdout:2/90: mkdir d2/d1d 0 2024-03-28T13:02:34.311 INFO:tasks.workunit.client.0.smithi076.stdout:2/91: write d2/d5/d7/f19 [826754,55593] 0 2024-03-28T13:02:34.311 INFO:tasks.workunit.client.0.smithi076.stdout:0/97: mknod db/c31 0 2024-03-28T13:02:34.312 INFO:tasks.workunit.client.0.smithi076.stdout:3/89: creat d1/d2/d8/f1d x:0 0 0 2024-03-28T13:02:34.433 INFO:tasks.workunit.client.0.smithi076.stdout:6/100: symlink d6/da/l1d 0 2024-03-28T13:02:34.433 INFO:tasks.workunit.client.0.smithi076.stdout:6/101: readlink l5 0 2024-03-28T13:02:34.464 INFO:tasks.workunit.client.0.smithi076.stdout:9/73: mknod d9/dd/df/d11/c1e 0 2024-03-28T13:02:34.477 INFO:tasks.workunit.client.0.smithi076.stdout:6/102: dwrite d6/da/f1b [0,4194304] 0 2024-03-28T13:02:34.477 INFO:tasks.workunit.client.0.smithi076.stdout:6/103: write d6/f10 [1031983,47641] 0 2024-03-28T13:02:34.494 INFO:tasks.workunit.client.0.smithi076.stdout:8/58: sync 2024-03-28T13:02:34.496 INFO:tasks.workunit.client.0.smithi076.stdout:6/104: dread d6/fb [0,4194304] 0 2024-03-28T13:02:34.538 INFO:tasks.workunit.client.0.smithi076.stdout:4/110: mknod d0/db/d16/c27 0 2024-03-28T13:02:34.577 INFO:tasks.workunit.client.0.smithi076.stdout:7/94: mknod d1/c21 0 2024-03-28T13:02:34.668 INFO:tasks.workunit.client.0.smithi076.stdout:1/118: mkdir d14/d2a 0 2024-03-28T13:02:34.811 INFO:tasks.workunit.client.0.smithi076.stdout:5/92: sync 2024-03-28T13:02:34.811 INFO:tasks.workunit.client.0.smithi076.stdout:5/93: write d5/fa [230341,77435] 0 2024-03-28T13:02:34.849 INFO:tasks.workunit.client.0.smithi076.stdout:9/74: mknod d9/dd/c1f 0 2024-03-28T13:02:34.935 INFO:tasks.workunit.client.0.smithi076.stdout:8/59: mkdir de/d13 0 2024-03-28T13:02:34.939 INFO:tasks.workunit.client.0.smithi076.stdout:8/60: dread de/f10 [0,4194304] 0 2024-03-28T13:02:34.976 INFO:tasks.workunit.client.0.smithi076.stdout:6/105: mkdir d6/da/d1e 0 2024-03-28T13:02:35.026 INFO:tasks.workunit.client.0.smithi076.stdout:4/111: mkdir d0/db/d16/d28 0 2024-03-28T13:02:35.275 INFO:tasks.workunit.client.0.smithi076.stdout:7/95: truncate d1/d8/f19 486756 0 2024-03-28T13:02:35.312 INFO:tasks.workunit.client.0.smithi076.stdout:2/92: unlink d2/d5/d7/c15 0 2024-03-28T13:02:35.312 INFO:tasks.workunit.client.0.smithi076.stdout:3/90: link d1/d2/d6/f16 d1/d2/f1e 0 2024-03-28T13:02:35.315 INFO:tasks.workunit.client.0.smithi076.stdout:7/96: dwrite d1/f4 [0,4194304] 0 2024-03-28T13:02:35.315 INFO:tasks.workunit.client.0.smithi076.stdout:7/97: dread - d1/dc/f1d zero size 2024-03-28T13:02:35.320 INFO:tasks.workunit.client.0.smithi076.stdout:1/119: dwrite d14/f21 [0,4194304] 0 2024-03-28T13:02:35.325 INFO:tasks.workunit.client.0.smithi076.stdout:5/94: symlink d5/d9/l29 0 2024-03-28T13:02:35.334 INFO:tasks.workunit.client.0.smithi076.stdout:3/91: write d1/d2/d6/f19 [1704004,78592] 0 2024-03-28T13:02:35.334 INFO:tasks.workunit.client.0.smithi076.stdout:3/92: chown d1/c4 15711747 1 2024-03-28T13:02:35.352 INFO:tasks.workunit.client.0.smithi076.stdout:5/95: write f3 [3796087,48895] 0 2024-03-28T13:02:35.352 INFO:tasks.workunit.client.0.smithi076.stdout:5/96: dread - d5/db/f12 zero size 2024-03-28T13:02:35.384 INFO:tasks.workunit.client.0.smithi076.stdout:9/75: mkdir d9/dd/d20 0 2024-03-28T13:02:35.405 INFO:tasks.workunit.client.0.smithi076.stdout:9/76: read f7 [4031385,12089] 0 2024-03-28T13:02:35.423 INFO:tasks.workunit.client.0.smithi076.stdout:9/77: dread f3 [0,4194304] 0 2024-03-28T13:02:35.532 INFO:tasks.workunit.client.0.smithi076.stdout:6/106: creat d6/da/d1e/f1f x:0 0 0 2024-03-28T13:02:35.532 INFO:tasks.workunit.client.0.smithi076.stdout:6/107: dread - d6/da/f15 zero size 2024-03-28T13:02:35.564 INFO:tasks.workunit.client.0.smithi076.stdout:6/108: dwrite d6/f12 [0,4194304] 0 2024-03-28T13:02:35.621 INFO:tasks.workunit.client.0.smithi076.stdout:4/112: getdents d0/db 0 2024-03-28T13:02:35.621 INFO:tasks.workunit.client.0.smithi076.stdout:4/113: read - d0/db/d16/f19 zero size 2024-03-28T13:02:35.686 INFO:tasks.workunit.client.0.smithi076.stdout:0/98: write db/dc/fd [1415019,30015] 0 2024-03-28T13:02:35.835 INFO:tasks.workunit.client.0.smithi076.stdout:8/61: getdents de 0 2024-03-28T13:02:35.991 INFO:tasks.workunit.client.0.smithi076.stdout:2/93: rename d2/d5/d7/d8/lc to d2/d5/d7/d8/l1e 0 2024-03-28T13:02:36.028 INFO:tasks.workunit.client.0.smithi076.stdout:2/94: dwrite d2/f18 [4194304,4194304] 0 2024-03-28T13:02:36.071 INFO:tasks.workunit.client.0.smithi076.stdout:2/95: dwrite d2/d5/db/f1b [0,4194304] 0 2024-03-28T13:02:36.089 INFO:tasks.workunit.client.0.smithi076.stdout:2/96: write d2/d5/f12 [4006850,41860] 0 2024-03-28T13:02:36.798 INFO:tasks.workunit.client.0.smithi076.stdout:9/78: creat d9/dd/df/d11/d18/f21 x:0 0 0 2024-03-28T13:02:36.798 INFO:tasks.workunit.client.0.smithi076.stdout:9/79: write f3 [2928933,18601] 0 2024-03-28T13:02:36.798 INFO:tasks.workunit.client.0.smithi076.stdout:9/80: read - d9/dd/df/d11/d18/f21 zero size 2024-03-28T13:02:36.849 INFO:tasks.workunit.client.0.smithi076.stdout:6/109: symlink d6/da/d1e/l20 0 2024-03-28T13:02:36.924 INFO:tasks.workunit.client.0.smithi076.stdout:4/114: link d0/db/l1c d0/db/l29 0 2024-03-28T13:02:36.994 INFO:tasks.workunit.client.0.smithi076.stdout:0/99: link db/dc/fd db/dc/df/d18/d1d/f32 0 2024-03-28T13:02:36.994 INFO:tasks.workunit.client.0.smithi076.stdout:0/100: dread - db/dc/df/d18/d1d/f29 zero size 2024-03-28T13:02:37.022 INFO:tasks.workunit.client.0.smithi076.stdout:0/101: write f1 [1575828,38346] 0 2024-03-28T13:02:37.022 INFO:tasks.workunit.client.0.smithi076.stdout:0/102: write db/dc/df/f1e [617546,44575] 0 2024-03-28T13:02:37.022 INFO:tasks.workunit.client.0.smithi076.stdout:0/103: write db/dc/f24 [551692,129500] 0 2024-03-28T13:02:37.059 INFO:tasks.workunit.client.0.smithi076.stdout:8/62: unlink f8 0 2024-03-28T13:02:37.139 INFO:tasks.workunit.client.0.smithi076.stdout:7/98: dwrite d1/dc/f17 [0,4194304] 0 2024-03-28T13:02:37.279 INFO:tasks.workunit.client.0.smithi076.stdout:2/97: rmdir d2/d5/db 39 2024-03-28T13:02:37.279 INFO:tasks.workunit.client.0.smithi076.stdout:1/120: link fd d14/f2b 0 2024-03-28T13:02:37.279 INFO:tasks.workunit.client.0.smithi076.stdout:1/121: stat f8 0 2024-03-28T13:02:37.280 INFO:tasks.workunit.client.0.smithi076.stdout:1/122: write fd [3713654,76718] 0 2024-03-28T13:02:37.304 INFO:tasks.workunit.client.0.smithi076.stdout:1/123: write d14/f21 [3550124,117328] 0 2024-03-28T13:02:37.304 INFO:tasks.workunit.client.0.smithi076.stdout:1/124: getdents d14/d2a 0 2024-03-28T13:02:37.357 INFO:tasks.workunit.client.0.smithi076.stdout:9/81: rename d9/dd/df/d11/f15 to d9/dd/df/d11/f22 0 2024-03-28T13:02:37.413 INFO:tasks.workunit.client.0.smithi076.stdout:6/110: creat d6/da/f21 x:0 0 0 2024-03-28T13:02:37.461 INFO:tasks.workunit.client.0.smithi076.stdout:4/115: truncate d0/fc 971234 0 2024-03-28T13:02:37.599 INFO:tasks.workunit.client.0.smithi076.stdout:5/97: rename f4 to d5/db/f2a 0 2024-03-28T13:02:37.636 INFO:tasks.workunit.client.0.smithi076.stdout:5/98: dwrite d5/db/d19/f20 [0,4194304] 0 2024-03-28T13:02:37.652 INFO:tasks.workunit.client.0.smithi076.stdout:5/99: read d5/db/d19/f20 [3650603,73786] 0 2024-03-28T13:02:37.652 INFO:tasks.workunit.client.0.smithi076.stdout:5/100: chown d5/d9/d1c 1 1 2024-03-28T13:02:37.977 INFO:tasks.workunit.client.0.smithi076.stdout:7/99: symlink d1/d8/d14/l22 0 2024-03-28T13:02:37.977 INFO:tasks.workunit.client.0.smithi076.stdout:7/100: chown d1/c9 114 1 2024-03-28T13:02:38.049 INFO:tasks.workunit.client.0.smithi076.stdout:1/125: dread - d14/d19/f1f zero size 2024-03-28T13:02:38.125 INFO:tasks.workunit.client.0.smithi076.stdout:9/82: getdents d9/dd/df/d11 0 2024-03-28T13:02:38.192 INFO:tasks.workunit.client.0.smithi076.stdout:6/111: creat d6/f22 x:0 0 0 2024-03-28T13:02:38.221 INFO:tasks.workunit.client.0.smithi076.stdout:6/112: dwrite d6/f10 [0,4194304] 0 2024-03-28T13:02:38.221 INFO:tasks.workunit.client.0.smithi076.stdout:6/113: chown d6/lf 8005 1 2024-03-28T13:02:38.222 INFO:tasks.workunit.client.0.smithi076.stdout:6/114: fdatasync d6/da/d1e/f1f 0 2024-03-28T13:02:38.222 INFO:tasks.workunit.client.0.smithi076.stdout:6/115: truncate d6/da/f15 260532 0 2024-03-28T13:02:38.223 INFO:tasks.workunit.client.0.smithi076.stdout:6/116: dread d6/da/f18 [0,4194304] 0 2024-03-28T13:02:38.288 INFO:tasks.workunit.client.0.smithi076.stdout:3/93: sync 2024-03-28T13:02:38.288 INFO:tasks.workunit.client.0.smithi076.stdout:3/94: dread - d1/d2/d8/f1d zero size 2024-03-28T13:02:38.299 INFO:tasks.workunit.client.0.smithi076.stdout:4/116: readlink d0/db/l1c 0 2024-03-28T13:02:38.388 INFO:tasks.workunit.client.0.smithi076.stdout:0/104: rename db/dc/df/d18/d1d/f32 to db/dc/df/f33 0 2024-03-28T13:02:38.395 INFO:tasks.workunit.client.0.smithi076.stdout:0/105: read db/dc/df/f1e [530101,26525] 0 2024-03-28T13:02:38.395 INFO:tasks.workunit.client.0.smithi076.stdout:0/106: write db/dc/f24 [1204625,19388] 0 2024-03-28T13:02:38.483 INFO:tasks.workunit.client.0.smithi076.stdout:5/101: creat d5/d9/d1c/d25/f2b x:0 0 0 2024-03-28T13:02:38.483 INFO:tasks.workunit.client.0.smithi076.stdout:5/102: readlink d5/db/l1a 0 2024-03-28T13:02:38.483 INFO:tasks.workunit.client.0.smithi076.stdout:5/103: chown d5/db 1825 1 2024-03-28T13:02:38.484 INFO:tasks.workunit.client.0.smithi076.stdout:5/104: truncate d5/db/f13 459509 0 2024-03-28T13:02:38.484 INFO:tasks.workunit.client.0.smithi076.stdout:5/105: getdents d5 0 2024-03-28T13:02:38.484 INFO:tasks.workunit.client.0.smithi076.stdout:5/106: readlink l0 0 2024-03-28T13:02:38.529 INFO:tasks.workunit.client.0.smithi076.stdout:7/101: mknod d1/dc/c23 0 2024-03-28T13:02:38.529 INFO:tasks.workunit.client.0.smithi076.stdout:7/102: chown d1/f12 52 1 2024-03-28T13:02:38.584 INFO:tasks.workunit.client.0.smithi076.stdout:2/98: truncate d2/d5/db/f1b 3923311 0 2024-03-28T13:02:38.610 INFO:tasks.workunit.client.0.smithi076.stdout:2/99: dwrite d2/d5/f12 [8388608,4194304] 0 2024-03-28T13:02:38.653 INFO:tasks.workunit.client.0.smithi076.stdout:1/126: fsync d14/f26 0 2024-03-28T13:02:38.725 INFO:tasks.workunit.client.0.smithi076.stdout:8/63: sync 2024-03-28T13:02:38.774 INFO:tasks.workunit.client.0.smithi076.stdout:6/117: mkdir d6/da/d23 0 2024-03-28T13:02:38.774 INFO:tasks.workunit.client.0.smithi076.stdout:6/118: truncate d6/f22 462882 0 2024-03-28T13:02:38.774 INFO:tasks.workunit.client.0.smithi076.stdout:6/119: read - d6/da/f21 zero size 2024-03-28T13:02:39.024 INFO:tasks.workunit.client.0.smithi076.stdout:9/83: rename l6 to d9/da/l23 0 2024-03-28T13:02:39.024 INFO:tasks.workunit.client.0.smithi076.stdout:9/84: dread - d9/dd/df/d11/f22 zero size 2024-03-28T13:02:39.024 INFO:tasks.workunit.client.0.smithi076.stdout:9/85: chown l2 258 1 2024-03-28T13:02:39.024 INFO:tasks.workunit.client.0.smithi076.stdout:9/86: read - d9/dd/df/f13 zero size 2024-03-28T13:02:39.024 INFO:tasks.workunit.client.0.smithi076.stdout:9/87: readlink d9/l19 0 2024-03-28T13:02:39.025 INFO:tasks.workunit.client.0.smithi076.stdout:0/107: symlink db/dc/df/d18/d1d/d21/l34 0 2024-03-28T13:02:39.060 INFO:tasks.workunit.client.0.smithi076.stdout:5/107: symlink d5/db/l2c 0 2024-03-28T13:02:39.145 INFO:tasks.workunit.client.0.smithi076.stdout:7/103: getdents d1 0 2024-03-28T13:02:39.145 INFO:tasks.workunit.client.0.smithi076.stdout:7/104: chown d1 0 1 2024-03-28T13:02:39.146 INFO:tasks.workunit.client.0.smithi076.stdout:7/105: write d1/f6 [4216351,2015] 0 2024-03-28T13:02:39.312 INFO:tasks.workunit.client.0.smithi076.stdout:2/100: link d2/d5/d7/f17 d2/d1d/f1f 0 2024-03-28T13:02:39.312 INFO:tasks.workunit.client.0.smithi076.stdout:1/127: symlink d14/d19/d20/l2c 0 2024-03-28T13:02:39.312 INFO:tasks.workunit.client.0.smithi076.stdout:2/101: chown d2/d5/db/l1a 2482 1 2024-03-28T13:02:39.317 INFO:tasks.workunit.client.0.smithi076.stdout:6/120: creat d6/f24 x:0 0 0 2024-03-28T13:02:39.363 INFO:tasks.workunit.client.0.smithi076.stdout:1/128: dwrite f13 [0,4194304] 0 2024-03-28T13:02:39.377 INFO:tasks.workunit.client.0.smithi076.stdout:3/95: creat d1/d2/d8/d14/f1f x:0 0 0 2024-03-28T13:02:39.377 INFO:tasks.workunit.client.0.smithi076.stdout:3/96: fdatasync d1/d7/fb 0 2024-03-28T13:02:39.381 INFO:tasks.workunit.client.0.smithi076.stdout:2/102: dwrite d2/d1d/f1f [0,4194304] 0 2024-03-28T13:02:39.388 INFO:tasks.workunit.client.0.smithi076.stdout:3/97: dread f0 [0,4194304] 0 2024-03-28T13:02:39.403 INFO:tasks.workunit.client.0.smithi076.stdout:4/117: mknod d0/db/c2a 0 2024-03-28T13:02:39.421 INFO:tasks.workunit.client.0.smithi076.stdout:3/98: dwrite d1/d2/d8/f1d [0,4194304] 0 2024-03-28T13:02:39.421 INFO:tasks.workunit.client.0.smithi076.stdout:3/99: chown d1/ce 1 1 2024-03-28T13:02:39.434 INFO:tasks.workunit.client.0.smithi076.stdout:3/100: write d1/d2/d8/f1a [4125732,9359] 0 2024-03-28T13:02:39.435 INFO:tasks.workunit.client.0.smithi076.stdout:3/101: dread - d1/f1b zero size 2024-03-28T13:02:39.716 INFO:tasks.workunit.client.0.smithi076.stdout:9/88: symlink d9/dd/df/d11/l24 0 2024-03-28T13:02:39.716 INFO:tasks.workunit.client.0.smithi076.stdout:9/89: chown d9/cc 60529072 1 2024-03-28T13:02:39.716 INFO:tasks.workunit.client.0.smithi076.stdout:9/90: write d9/f17 [250410,24796] 0 2024-03-28T13:02:39.737 INFO:tasks.workunit.client.0.smithi076.stdout:5/108: creat d5/db/d19/f2d x:0 0 0 2024-03-28T13:02:39.738 INFO:tasks.workunit.client.0.smithi076.stdout:7/106: link d1/d8/d14/f20 d1/d8/d14/f24 0 2024-03-28T13:02:39.738 INFO:tasks.workunit.client.0.smithi076.stdout:5/109: truncate d5/d9/d1c/d25/f2b 1041695 0 2024-03-28T13:02:39.738 INFO:tasks.workunit.client.0.smithi076.stdout:5/110: chown d5/d9/d1c/d1d/d22/c27 97942183 1 2024-03-28T13:02:39.760 INFO:tasks.workunit.client.0.smithi076.stdout:6/121: unlink d6/da/f13 0 2024-03-28T13:02:39.761 INFO:tasks.workunit.client.0.smithi076.stdout:1/129: symlink d14/d2a/l2d 0 2024-03-28T13:02:39.782 INFO:tasks.workunit.client.0.smithi076.stdout:5/111: dwrite d5/d9/d1c/d25/f2b [0,4194304] 0 2024-03-28T13:02:39.782 INFO:tasks.workunit.client.0.smithi076.stdout:5/112: chown d5/db/d19 5 1 2024-03-28T13:02:39.798 INFO:tasks.workunit.client.0.smithi076.stdout:2/103: creat d2/d5/db/f20 x:0 0 0 2024-03-28T13:02:39.799 INFO:tasks.workunit.client.0.smithi076.stdout:6/122: dwrite d6/da/d1e/f1f [0,4194304] 0 2024-03-28T13:02:39.803 INFO:tasks.workunit.client.0.smithi076.stdout:5/113: dread d5/db/df/f26 [0,4194304] 0 2024-03-28T13:02:39.817 INFO:tasks.workunit.client.0.smithi076.stdout:2/104: dread d2/d5/d7/fe [0,4194304] 0 2024-03-28T13:02:39.830 INFO:tasks.workunit.client.0.smithi076.stdout:2/105: dread d2/f18 [0,4194304] 0 2024-03-28T13:02:39.830 INFO:tasks.workunit.client.0.smithi076.stdout:2/106: truncate d2/d5/db/f20 355784 0 2024-03-28T13:02:39.830 INFO:tasks.workunit.client.0.smithi076.stdout:2/107: chown d2/d1d 216225 1 2024-03-28T13:02:39.831 INFO:tasks.workunit.client.0.smithi076.stdout:2/108: chown d2/d5/db/f20 0 1 2024-03-28T13:02:39.911 INFO:tasks.workunit.client.0.smithi076.stdout:9/91: creat d9/dd/df/f25 x:0 0 0 2024-03-28T13:02:39.934 INFO:tasks.workunit.client.0.smithi076.stdout:9/92: dwrite d9/dd/df/f25 [0,4194304] 0 2024-03-28T13:02:39.954 INFO:tasks.workunit.client.0.smithi076.stdout:7/107: creat d1/d8/f25 x:0 0 0 2024-03-28T13:02:39.985 INFO:tasks.workunit.client.0.smithi076.stdout:9/93: dwrite d9/dd/df/d11/d1a/f1d [0,4194304] 0 2024-03-28T13:02:39.992 INFO:tasks.workunit.client.0.smithi076.stdout:1/130: mkdir d14/d2a/d2e 0 2024-03-28T13:02:40.148 INFO:tasks.workunit.client.0.smithi076.stdout:4/118: mknod d0/db/c2b 0 2024-03-28T13:02:40.148 INFO:tasks.workunit.client.0.smithi076.stdout:4/119: chown d0/l7 12304 1 2024-03-28T13:02:40.188 INFO:tasks.workunit.client.0.smithi076.stdout:0/108: getdents db/dc/df/d18/d1d/d21 0 2024-03-28T13:02:40.202 INFO:tasks.workunit.client.0.smithi076.stdout:0/109: dread db/dc/f24 [0,4194304] 0 2024-03-28T13:02:40.339 INFO:tasks.workunit.client.0.smithi076.stdout:6/123: symlink d6/da/d23/l25 0 2024-03-28T13:02:40.445 INFO:tasks.workunit.client.0.smithi076.stdout:5/114: getdents d5/d9/d1c/d1d/d22 0 2024-03-28T13:02:40.445 INFO:tasks.workunit.client.0.smithi076.stdout:8/64: write fd [231864,82727] 0 2024-03-28T13:02:40.480 INFO:tasks.workunit.client.0.smithi076.stdout:8/65: dwrite de/f10 [0,4194304] 0 2024-03-28T13:02:40.492 INFO:tasks.workunit.client.0.smithi076.stdout:5/115: dwrite d5/db/df/f26 [0,4194304] 0 2024-03-28T13:02:40.492 INFO:tasks.workunit.client.0.smithi076.stdout:5/116: truncate d5/fa 1252678 0 2024-03-28T13:02:40.613 INFO:tasks.workunit.client.0.smithi076.stdout:2/109: mkdir d2/d5/d7/d8/d21 0 2024-03-28T13:02:40.613 INFO:tasks.workunit.client.0.smithi076.stdout:3/102: rename d1/d7/fb to d1/d2/f20 0 2024-03-28T13:02:40.917 INFO:tasks.workunit.client.0.smithi076.stdout:1/131: creat d14/f2f x:0 0 0 2024-03-28T13:02:40.917 INFO:tasks.workunit.client.0.smithi076.stdout:9/94: truncate f7 3991800 0 2024-03-28T13:02:40.940 INFO:tasks.workunit.client.0.smithi076.stdout:9/95: dwrite d9/dd/df/d11/d1a/f1d [0,4194304] 0 2024-03-28T13:02:41.043 INFO:tasks.workunit.client.0.smithi076.stdout:0/110: mkdir db/dc/df/d18/d1d/d35 0 2024-03-28T13:02:41.044 INFO:tasks.workunit.client.0.smithi076.stdout:0/111: write f1 [144527,1661] 0 2024-03-28T13:02:41.198 INFO:tasks.workunit.client.0.smithi076.stdout:8/66: dread f2 [0,4194304] 0 2024-03-28T13:02:41.226 INFO:tasks.workunit.client.0.smithi076.stdout:5/117: symlink d5/d9/l2e 0 2024-03-28T13:02:41.260 INFO:tasks.workunit.client.0.smithi076.stdout:5/118: dwrite d5/d9/d1c/d25/f2b [0,4194304] 0 2024-03-28T13:02:41.656 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:02:41.659 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:02:42.016 INFO:tasks.workunit.client.0.smithi076.stdout:1/132: link d14/d19/c24 d14/d19/c30 0 2024-03-28T13:02:42.143 INFO:tasks.workunit.client.0.smithi076.stdout:9/96: creat d9/dd/df/d11/d14/f26 x:0 0 0 2024-03-28T13:02:42.205 INFO:tasks.workunit.client.0.smithi076.stdout:4/120: getdents d0/db/d16 0 2024-03-28T13:02:42.588 INFO:tasks.workunit.client.0.smithi076.stdout:0/112: mknod db/c36 0 2024-03-28T13:02:42.589 INFO:tasks.workunit.client.0.smithi076.stdout:0/113: readlink db/dc/df/d18/d1d/l1f 0 2024-03-28T13:02:42.589 INFO:tasks.workunit.client.0.smithi076.stdout:8/67: read fa [402,16570] 0 2024-03-28T13:02:42.625 INFO:tasks.workunit.client.0.smithi076.stdout:2/110: link d2/d5/db/f20 d2/d1d/f22 0 2024-03-28T13:02:42.625 INFO:tasks.workunit.client.0.smithi076.stdout:5/119: mknod d5/d9/d1c/d1d/d22/c2f 0 2024-03-28T13:02:42.651 INFO:tasks.workunit.client.0.smithi076.stdout:5/120: dwrite d5/d9/f28 [0,4194304] 0 2024-03-28T13:02:42.765 INFO:tasks.workunit.client.0.smithi076.stdout:1/133: mkdir d14/d2a/d2e/d31 0 2024-03-28T13:02:42.765 INFO:tasks.workunit.client.0.smithi076.stdout:9/97: truncate d9/dd/df/d11/d1a/f1c 3362686 0 2024-03-28T13:02:42.902 INFO:tasks.workunit.client.0.smithi076.stdout:4/121: rename d0/db/l29 to d0/db/d16/d28/l2c 0 2024-03-28T13:02:42.979 INFO:tasks.workunit.client.0.smithi076.stdout:0/114: link db/dc/df/d11/f1c db/dc/df/f37 0 2024-03-28T13:02:43.003 INFO:tasks.workunit.client.0.smithi076.stdout:8/68: chown c4 8 1 2024-03-28T13:02:43.016 INFO:tasks.workunit.client.0.smithi076.stdout:8/69: dread f2 [4194304,4194304] 0 2024-03-28T13:02:43.030 INFO:tasks.workunit.client.0.smithi076.stdout:2/111: truncate d2/d5/db/f1b 352818 0 2024-03-28T13:02:43.259 INFO:tasks.workunit.client.0.smithi076.stdout:5/121: symlink d5/l30 0 2024-03-28T13:02:43.273 INFO:tasks.workunit.client.0.smithi076.stdout:5/122: dread d5/d9/f28 [0,4194304] 0 2024-03-28T13:02:43.292 INFO:tasks.workunit.client.0.smithi076.stdout:5/123: write d5/db/df/f26 [3564499,107768] 0 2024-03-28T13:02:43.293 INFO:tasks.workunit.client.0.smithi076.stdout:5/124: stat f3 0 2024-03-28T13:02:43.489 INFO:tasks.workunit.client.0.smithi076.stdout:9/98: symlink d9/dd/df/d11/d14/l27 0 2024-03-28T13:02:43.512 INFO:tasks.workunit.client.0.smithi076.stdout:6/124: unlink f0 0 2024-03-28T13:02:43.547 INFO:tasks.workunit.client.0.smithi076.stdout:6/125: dwrite d6/da/f1c [0,4194304] 0 2024-03-28T13:02:43.561 INFO:tasks.workunit.client.0.smithi076.stdout:0/115: rmdir db/dc/df/d11 39 2024-03-28T13:02:43.595 INFO:tasks.workunit.client.0.smithi076.stdout:8/70: symlink de/d12/l14 0 2024-03-28T13:02:43.595 INFO:tasks.workunit.client.0.smithi076.stdout:8/71: fsync de/f11 0 2024-03-28T13:02:43.596 INFO:tasks.workunit.client.0.smithi076.stdout:6/126: dwrite d6/da/fe [0,4194304] 0 2024-03-28T13:02:43.678 INFO:tasks.workunit.client.0.smithi076.stdout:2/112: creat d2/d5/d7/f23 x:0 0 0 2024-03-28T13:02:43.678 INFO:tasks.workunit.client.0.smithi076.stdout:5/125: truncate d5/f7 4312009 0 2024-03-28T13:02:43.708 INFO:tasks.workunit.client.0.smithi076.stdout:2/113: dwrite d2/d5/d7/f17 [0,4194304] 0 2024-03-28T13:02:43.725 INFO:tasks.workunit.client.0.smithi076.stdout:7/108: link d1/f7 d1/f26 0 2024-03-28T13:02:43.725 INFO:tasks.workunit.client.0.smithi076.stdout:7/109: write d1/dc/f1d [376394,79427] 0 2024-03-28T13:02:43.728 INFO:tasks.workunit.client.0.smithi076.stdout:2/114: read d2/d5/d7/f17 [1563502,42376] 0 2024-03-28T13:02:43.804 INFO:tasks.workunit.client.0.smithi076.stdout:9/99: creat d9/dd/df/f28 x:0 0 0 2024-03-28T13:02:43.860 INFO:tasks.workunit.client.0.smithi076.stdout:4/122: mkdir d0/db/d2d 0 2024-03-28T13:02:43.937 INFO:tasks.workunit.client.0.smithi076.stdout:0/116: getdents db/d16 0 2024-03-28T13:02:43.983 INFO:tasks.workunit.client.0.smithi076.stdout:8/72: creat de/d12/f15 x:0 0 0 2024-03-28T13:02:43.983 INFO:tasks.workunit.client.0.smithi076.stdout:8/73: write f2 [2291750,85426] 0 2024-03-28T13:02:43.983 INFO:tasks.workunit.client.0.smithi076.stdout:8/74: stat c4 0 2024-03-28T13:02:43.983 INFO:tasks.workunit.client.0.smithi076.stdout:8/75: chown de 570 1 2024-03-28T13:02:44.098 INFO:tasks.workunit.client.0.smithi076.stdout:6/127: mknod d6/c26 0 2024-03-28T13:02:44.099 INFO:tasks.workunit.client.0.smithi076.stdout:6/128: fsync d6/da/f14 0 2024-03-28T13:02:44.099 INFO:tasks.workunit.client.0.smithi076.stdout:6/129: write d6/f22 [1382193,59716] 0 2024-03-28T13:02:44.373 INFO:tasks.workunit.client.0.smithi076.stdout:2/115: symlink d2/d5/d7/d8/d21/l24 0 2024-03-28T13:02:44.446 INFO:tasks.workunit.client.0.smithi076.stdout:9/100: creat d9/dd/d20/f29 x:0 0 0 2024-03-28T13:02:44.487 INFO:tasks.workunit.client.0.smithi076.stdout:9/101: dwrite d9/dd/df/f28 [0,4194304] 0 2024-03-28T13:02:44.487 INFO:tasks.workunit.client.0.smithi076.stdout:9/102: readlink l4 0 2024-03-28T13:02:44.542 INFO:tasks.workunit.client.0.smithi076.stdout:9/103: write d9/dd/df/f25 [1049234,51136] 0 2024-03-28T13:02:44.544 INFO:tasks.workunit.client.0.smithi076.stdout:4/123: dwrite d0/db/f23 [0,4194304] 0 2024-03-28T13:02:44.547 INFO:tasks.workunit.client.0.smithi076.stdout:0/117: rename db/d16/c2e to db/d16/c38 0 2024-03-28T13:02:44.733 INFO:tasks.workunit.client.0.smithi076.stdout:8/76: mknod de/c16 0 2024-03-28T13:02:44.734 INFO:tasks.workunit.client.0.smithi076.stdout:2/116: symlink d2/l25 0 2024-03-28T13:02:44.734 INFO:tasks.workunit.client.0.smithi076.stdout:8/77: getdents de/d13 0 2024-03-28T13:02:44.734 INFO:tasks.workunit.client.0.smithi076.stdout:6/130: dread d6/da/f15 [0,4194304] 0 2024-03-28T13:02:44.798 INFO:tasks.workunit.client.0.smithi076.stdout:9/104: mkdir d9/dd/df/d11/d18/d2a 0 2024-03-28T13:02:44.798 INFO:tasks.workunit.client.0.smithi076.stdout:9/105: truncate d9/dd/df/d11/f22 923739 0 2024-03-28T13:02:44.798 INFO:tasks.workunit.client.0.smithi076.stdout:9/106: chown d9/dd/f10 7768 1 2024-03-28T13:02:44.798 INFO:tasks.workunit.client.0.smithi076.stdout:9/107: dread - d9/dd/df/d11/d18/f21 zero size 2024-03-28T13:02:44.843 INFO:tasks.workunit.client.0.smithi076.stdout:1/134: unlink l6 0 2024-03-28T13:02:44.872 INFO:tasks.workunit.client.0.smithi076.stdout:1/135: dwrite fe [0,4194304] 0 2024-03-28T13:02:44.890 INFO:tasks.workunit.client.0.smithi076.stdout:1/136: write f12 [6375813,47830] 0 2024-03-28T13:02:44.906 INFO:tasks.workunit.client.0.smithi076.stdout:1/137: dread f13 [0,4194304] 0 2024-03-28T13:02:44.906 INFO:tasks.workunit.client.0.smithi076.stdout:1/138: stat fc 0 2024-03-28T13:02:44.906 INFO:tasks.workunit.client.0.smithi076.stdout:1/139: dread - fc zero size 2024-03-28T13:02:44.927 INFO:tasks.workunit.client.0.smithi076.stdout:4/124: dread d0/fc [0,4194304] 0 2024-03-28T13:02:44.999 INFO:tasks.workunit.client.0.smithi076.stdout:0/118: creat db/dc/df/d18/d1d/d35/f39 x:0 0 0 2024-03-28T13:02:44.999 INFO:tasks.workunit.client.0.smithi076.stdout:0/119: read - db/f12 zero size 2024-03-28T13:02:45.103 INFO:tasks.workunit.client.0.smithi076.stdout:6/131: mknod d6/da/d1e/c27 0 2024-03-28T13:02:45.113 INFO:tasks.workunit.client.0.smithi076.stdout:8/78: dread f7 [0,4194304] 0 2024-03-28T13:02:45.156 INFO:tasks.workunit.client.0.smithi076.stdout:9/108: symlink d9/dd/df/d11/d18/d2a/l2b 0 2024-03-28T13:02:45.162 INFO:tasks.workunit.client.0.smithi076.stdout:9/109: write d9/dd/f10 [647850,44903] 0 2024-03-28T13:02:45.191 INFO:tasks.workunit.client.0.smithi076.stdout:9/110: dwrite d9/dd/df/d11/f22 [0,4194304] 0 2024-03-28T13:02:45.191 INFO:tasks.workunit.client.0.smithi076.stdout:9/111: truncate d9/dd/df/d11/d14/f16 751381 0 2024-03-28T13:02:45.337 INFO:tasks.workunit.client.0.smithi076.stdout:1/140: creat d14/f32 x:0 0 0 2024-03-28T13:02:45.337 INFO:tasks.workunit.client.0.smithi076.stdout:1/141: dread - d14/f26 zero size 2024-03-28T13:02:45.337 INFO:tasks.workunit.client.0.smithi076.stdout:4/125: creat d0/db/d16/d28/f2e x:0 0 0 2024-03-28T13:02:45.382 INFO:tasks.workunit.client.0.smithi076.stdout:2/117: mknod d2/d5/d7/c26 0 2024-03-28T13:02:45.382 INFO:tasks.workunit.client.0.smithi076.stdout:2/118: truncate d2/d5/d7/f23 174493 0 2024-03-28T13:02:45.387 INFO:tasks.workunit.client.0.smithi076.stdout:2/119: write d2/d5/d7/f19 [506033,68508] 0 2024-03-28T13:02:45.507 INFO:tasks.workunit.client.0.smithi076.stdout:0/120: symlink db/dc/l3a 0 2024-03-28T13:02:45.537 INFO:tasks.workunit.client.0.smithi076.stdout:6/132: creat d6/da/d1e/f28 x:0 0 0 2024-03-28T13:02:45.537 INFO:tasks.workunit.client.0.smithi076.stdout:6/133: chown d6/da/d1e 1408404 1 2024-03-28T13:02:45.537 INFO:tasks.workunit.client.0.smithi076.stdout:6/134: fdatasync d6/f10 0 2024-03-28T13:02:45.555 INFO:tasks.workunit.client.0.smithi076.stdout:3/103: sync 2024-03-28T13:02:45.818 INFO:tasks.workunit.client.0.smithi076.stdout:7/110: write d1/f7 [4298867,120079] 0 2024-03-28T13:02:45.979 INFO:tasks.workunit.client.0.smithi076.stdout:1/142: mknod d14/d2a/c33 0 2024-03-28T13:02:45.996 INFO:tasks.workunit.client.0.smithi076.stdout:4/126: symlink d0/d20/l2f 0 2024-03-28T13:02:45.996 INFO:tasks.workunit.client.0.smithi076.stdout:4/127: fdatasync d0/f9 0 2024-03-28T13:02:46.253 INFO:tasks.workunit.client.0.smithi076.stdout:2/120: link d2/d1d/f22 d2/d5/d7/d8/d21/f27 0 2024-03-28T13:02:46.253 INFO:tasks.workunit.client.0.smithi076.stdout:0/121: unlink db/dc/df/l20 0 2024-03-28T13:02:46.253 INFO:tasks.workunit.client.0.smithi076.stdout:2/121: fdatasync d2/d5/d7/fe 0 2024-03-28T13:02:46.275 INFO:tasks.workunit.client.0.smithi076.stdout:2/122: dread d2/d5/f12 [4194304,4194304] 0 2024-03-28T13:02:46.276 INFO:tasks.workunit.client.0.smithi076.stdout:2/123: truncate d2/d5/db/f20 656097 0 2024-03-28T13:02:46.276 INFO:tasks.workunit.client.0.smithi076.stdout:2/124: chown d2/d1d/f1f 1139851886 1 2024-03-28T13:02:46.299 INFO:tasks.workunit.client.0.smithi076.stdout:6/135: mknod d6/da/d23/c29 0 2024-03-28T13:02:46.321 INFO:tasks.workunit.client.0.smithi076.stdout:2/125: dwrite d2/d5/f12 [0,4194304] 0 2024-03-28T13:02:46.334 INFO:tasks.workunit.client.0.smithi076.stdout:3/104: truncate d1/d2/d8/fc 977619 0 2024-03-28T13:02:46.361 INFO:tasks.workunit.client.0.smithi076.stdout:7/111: mknod d1/c27 0 2024-03-28T13:02:46.361 INFO:tasks.workunit.client.0.smithi076.stdout:7/112: chown d1/f26 2316223 1 2024-03-28T13:02:46.431 INFO:tasks.workunit.client.0.smithi076.stdout:1/143: creat d14/d19/f34 x:0 0 0 2024-03-28T13:02:46.431 INFO:tasks.workunit.client.0.smithi076.stdout:1/144: write f0 [5716497,79084] 0 2024-03-28T13:02:46.514 INFO:tasks.workunit.client.0.smithi076.stdout:4/128: chown d0/db/le 1554178 1 2024-03-28T13:02:46.547 INFO:tasks.workunit.client.0.smithi076.stdout:0/122: creat db/dc/df/d11/f3b x:0 0 0 2024-03-28T13:02:46.548 INFO:tasks.workunit.client.0.smithi076.stdout:0/123: readlink l8 0 2024-03-28T13:02:46.584 INFO:tasks.workunit.client.0.smithi076.stdout:5/126: sync 2024-03-28T13:02:46.732 INFO:tasks.workunit.client.0.smithi076.stdout:3/105: mknod d1/c21 0 2024-03-28T13:02:46.909 INFO:tasks.workunit.client.0.smithi076.stdout:7/113: symlink d1/l28 0 2024-03-28T13:02:46.909 INFO:tasks.workunit.client.0.smithi076.stdout:7/114: chown d1/f16 51946 1 2024-03-28T13:02:46.910 INFO:tasks.workunit.client.0.smithi076.stdout:1/145: link fc d14/d2a/d2e/d31/f35 0 2024-03-28T13:02:46.910 INFO:tasks.workunit.client.0.smithi076.stdout:7/115: fdatasync d1/d8/f25 0 2024-03-28T13:02:46.939 INFO:tasks.workunit.client.0.smithi076.stdout:5/127: mkdir d5/d9/d1c/d1d/d31 0 2024-03-28T13:02:47.579 INFO:tasks.workunit.client.0.smithi076.stdout:8/79: sync 2024-03-28T13:02:47.579 INFO:tasks.workunit.client.0.smithi076.stdout:2/126: mkdir d2/d5/d7/d28 0 2024-03-28T13:02:47.625 INFO:tasks.workunit.client.0.smithi076.stdout:3/106: mknod d1/d2/d8/d14/d18/c22 0 2024-03-28T13:02:47.640 INFO:tasks.workunit.client.0.smithi076.stdout:1/146: write d14/f26 [265229,42104] 0 2024-03-28T13:02:48.183 INFO:tasks.workunit.client.0.smithi076.stdout:8/80: creat de/d12/f17 x:0 0 0 2024-03-28T13:02:48.183 INFO:tasks.workunit.client.0.smithi076.stdout:3/107: symlink d1/d2/d8/d14/d18/l23 0 2024-03-28T13:02:48.185 INFO:tasks.workunit.client.0.smithi076.stdout:0/124: mknod db/dc/df/d18/d1d/c3c 0 2024-03-28T13:02:48.185 INFO:tasks.workunit.client.0.smithi076.stdout:5/128: creat d5/d9/d1c/f32 x:0 0 0 2024-03-28T13:02:48.233 INFO:tasks.workunit.client.0.smithi076.stdout:0/125: dwrite db/dc/df/f37 [0,4194304] 0 2024-03-28T13:02:48.336 INFO:tasks.workunit.client.0.smithi076.stdout:8/81: mkdir de/d12/d18 0 2024-03-28T13:02:48.337 INFO:tasks.workunit.client.0.smithi076.stdout:3/108: creat d1/d2/d8/d14/d18/f24 x:0 0 0 2024-03-28T13:02:48.424 INFO:tasks.workunit.client.0.smithi076.stdout:5/129: creat d5/d9/d1c/d1d/d22/f33 x:0 0 0 2024-03-28T13:02:48.438 INFO:tasks.workunit.client.0.smithi076.stdout:1/147: unlink fb 0 2024-03-28T13:02:48.457 INFO:tasks.workunit.client.0.smithi076.stdout:5/130: dwrite d5/f6 [0,4194304] 0 2024-03-28T13:02:48.521 INFO:tasks.workunit.client.0.smithi076.stdout:9/112: rename l4 to d9/dd/df/l2c 0 2024-03-28T13:02:48.803 INFO:tasks.workunit.client.0.smithi076.stdout:8/82: symlink de/d12/l19 0 2024-03-28T13:02:48.804 INFO:tasks.workunit.client.0.smithi076.stdout:1/148: symlink d14/d19/d20/l36 0 2024-03-28T13:02:48.804 INFO:tasks.workunit.client.0.smithi076.stdout:8/83: truncate de/f11 94020 0 2024-03-28T13:02:48.805 INFO:tasks.workunit.client.0.smithi076.stdout:4/129: creat d0/f30 x:0 0 0 2024-03-28T13:02:48.879 INFO:tasks.workunit.client.0.smithi076.stdout:5/131: mkdir d5/db/d19/d34 0 2024-03-28T13:02:48.879 INFO:tasks.workunit.client.0.smithi076.stdout:5/132: chown d5/c16 492 1 2024-03-28T13:02:48.907 INFO:tasks.workunit.client.0.smithi076.stdout:0/126: mkdir db/dc/d3d 0 2024-03-28T13:02:48.979 INFO:tasks.workunit.client.0.smithi076.stdout:6/136: rename d6/c9 to d6/da/d1e/c2a 0 2024-03-28T13:02:48.979 INFO:tasks.workunit.client.0.smithi076.stdout:6/137: chown d6/da/d1e/f1f 7 1 2024-03-28T13:02:49.021 INFO:tasks.workunit.client.0.smithi076.stdout:1/149: dread f12 [4194304,4194304] 0 2024-03-28T13:02:49.148 INFO:tasks.workunit.client.0.smithi076.stdout:8/84: rmdir de 39 2024-03-28T13:02:49.148 INFO:tasks.workunit.client.0.smithi076.stdout:4/130: mkdir d0/db/d16/d31 0 2024-03-28T13:02:49.161 INFO:tasks.workunit.client.0.smithi076.stdout:2/127: truncate d2/f18 11478734 0 2024-03-28T13:02:49.161 INFO:tasks.workunit.client.0.smithi076.stdout:5/133: getdents d5/db 0 2024-03-28T13:02:49.161 INFO:tasks.workunit.client.0.smithi076.stdout:5/134: readlink d5/db/l1a 0 2024-03-28T13:02:49.186 INFO:tasks.workunit.client.0.smithi076.stdout:5/135: write d5/d9/d1c/d25/f2b [3136477,50207] 0 2024-03-28T13:02:49.186 INFO:tasks.workunit.client.0.smithi076.stdout:5/136: write d5/db/d19/f20 [999629,75280] 0 2024-03-28T13:02:49.218 INFO:tasks.workunit.client.0.smithi076.stdout:2/128: dwrite d2/d5/d7/f23 [0,4194304] 0 2024-03-28T13:02:49.218 INFO:tasks.workunit.client.0.smithi076.stdout:2/129: chown d2/d5/c13 596847489 1 2024-03-28T13:02:49.228 INFO:tasks.workunit.client.0.smithi076.stdout:0/127: creat db/f3e x:0 0 0 2024-03-28T13:02:49.228 INFO:tasks.workunit.client.0.smithi076.stdout:0/128: chown db/dc/df/d18/d1d/d21/c30 111 1 2024-03-28T13:02:49.274 INFO:tasks.workunit.client.0.smithi076.stdout:0/129: dwrite db/dc/df/f37 [0,4194304] 0 2024-03-28T13:02:49.281 INFO:tasks.workunit.client.0.smithi076.stdout:0/130: dread f5 [0,4194304] 0 2024-03-28T13:02:49.291 INFO:tasks.workunit.client.0.smithi076.stdout:7/116: rename d1/dc/c1a to d1/d18/c29 0 2024-03-28T13:02:49.320 INFO:tasks.workunit.client.0.smithi076.stdout:0/131: dwrite db/dc/fd [0,4194304] 0 2024-03-28T13:02:49.332 INFO:tasks.workunit.client.0.smithi076.stdout:0/132: dread db/dc/df/f33 [0,4194304] 0 2024-03-28T13:02:49.353 INFO:tasks.workunit.client.0.smithi076.stdout:6/138: creat d6/da/d1e/f2b x:0 0 0 2024-03-28T13:02:49.580 INFO:tasks.workunit.client.0.smithi076.stdout:8/85: chown cc 113025 1 2024-03-28T13:02:49.580 INFO:tasks.workunit.client.0.smithi076.stdout:4/131: truncate d0/db/f18 4673029 0 2024-03-28T13:02:49.712 INFO:tasks.workunit.client.0.smithi076.stdout:5/137: mkdir d5/d9/d35 0 2024-03-28T13:02:50.202 INFO:tasks.workunit.client.0.smithi076.stdout:7/117: truncate d1/f6 3965578 0 2024-03-28T13:02:50.202 INFO:tasks.workunit.client.0.smithi076.stdout:0/133: getdents db/dc/df/d11 0 2024-03-28T13:02:50.202 INFO:tasks.workunit.client.0.smithi076.stdout:7/118: read - d1/d8/d14/f24 zero size 2024-03-28T13:02:50.292 INFO:tasks.workunit.client.0.smithi076.stdout:6/139: truncate d6/da/f1c 2604179 0 2024-03-28T13:02:50.292 INFO:tasks.workunit.client.0.smithi076.stdout:8/86: creat de/d12/d18/f1a x:0 0 0 2024-03-28T13:02:50.292 INFO:tasks.workunit.client.0.smithi076.stdout:6/140: chown d6/da/d1e/c27 450447 1 2024-03-28T13:02:50.301 INFO:tasks.workunit.client.0.smithi076.stdout:4/132: creat d0/db/d16/d28/f32 x:0 0 0 2024-03-28T13:02:50.301 INFO:tasks.workunit.client.0.smithi076.stdout:5/138: link d5/d9/c10 d5/d9/d1c/d1d/c36 0 2024-03-28T13:02:50.301 INFO:tasks.workunit.client.0.smithi076.stdout:5/139: readlink d5/db/l2c 0 2024-03-28T13:02:50.301 INFO:tasks.workunit.client.0.smithi076.stdout:5/140: write d5/db/f12 [413908,125916] 0 2024-03-28T13:02:50.315 INFO:tasks.workunit.client.0.smithi076.stdout:5/141: dread d5/d9/f28 [0,4194304] 0 2024-03-28T13:02:50.315 INFO:tasks.workunit.client.0.smithi076.stdout:5/142: stat d5/d9/f28 0 2024-03-28T13:02:50.323 INFO:tasks.workunit.client.0.smithi076.stdout:2/130: link d2/c9 d2/d5/d7/c29 0 2024-03-28T13:02:50.323 INFO:tasks.workunit.client.0.smithi076.stdout:2/131: chown d2/d5/d7/d8/d21 90083 1 2024-03-28T13:02:50.324 INFO:tasks.workunit.client.0.smithi076.stdout:5/143: dread d5/d9/f28 [0,4194304] 0 2024-03-28T13:02:50.324 INFO:tasks.workunit.client.0.smithi076.stdout:5/144: chown d5/db/d19 6343944 1 2024-03-28T13:02:50.325 INFO:tasks.workunit.client.0.smithi076.stdout:5/145: dread d5/db/f13 [0,4194304] 0 2024-03-28T13:02:50.326 INFO:tasks.workunit.client.0.smithi076.stdout:5/146: read d5/db/f13 [298940,113336] 0 2024-03-28T13:02:50.357 INFO:tasks.workunit.client.0.smithi076.stdout:8/87: dwrite f2 [8388608,4194304] 0 2024-03-28T13:02:50.440 INFO:tasks.workunit.client.0.smithi076.stdout:3/109: rename d1/d2/d6/ld to d1/d2/l25 0 2024-03-28T13:02:50.440 INFO:tasks.workunit.client.0.smithi076.stdout:9/113: rename d9/dd/d20 to d9/dd/d20/d2d 22 2024-03-28T13:02:50.747 INFO:tasks.workunit.client.0.smithi076.stdout:0/134: unlink l9 0 2024-03-28T13:02:50.747 INFO:tasks.workunit.client.0.smithi076.stdout:7/119: creat d1/d18/f2a x:0 0 0 2024-03-28T13:02:50.747 INFO:tasks.workunit.client.0.smithi076.stdout:7/120: dread - d1/d8/d14/f20 zero size 2024-03-28T13:02:50.747 INFO:tasks.workunit.client.0.smithi076.stdout:7/121: stat d1 0 2024-03-28T13:02:50.754 INFO:tasks.workunit.client.0.smithi076.stdout:4/133: symlink d0/db/d16/d31/l33 0 2024-03-28T13:02:50.754 INFO:tasks.workunit.client.0.smithi076.stdout:6/141: mkdir d6/da/d1e/d2c 0 2024-03-28T13:02:50.754 INFO:tasks.workunit.client.0.smithi076.stdout:4/134: dread - d0/f1e zero size 2024-03-28T13:02:50.777 INFO:tasks.workunit.client.0.smithi076.stdout:6/142: dwrite d6/f22 [0,4194304] 0 2024-03-28T13:02:50.865 INFO:tasks.workunit.client.0.smithi076.stdout:5/147: creat d5/d9/d1c/d1d/d31/f37 x:0 0 0 2024-03-28T13:02:50.993 INFO:tasks.workunit.client.0.smithi076.stdout:9/114: rename d9/dd/f10 to d9/dd/f2e 0 2024-03-28T13:02:51.079 INFO:tasks.workunit.client.0.smithi076.stdout:0/135: symlink db/dc/df/d18/l3f 0 2024-03-28T13:02:51.080 INFO:tasks.workunit.client.0.smithi076.stdout:7/122: creat d1/dc/f2b x:0 0 0 2024-03-28T13:02:51.147 INFO:tasks.workunit.client.0.smithi076.stdout:4/135: mknod d0/c34 0 2024-03-28T13:02:51.152 INFO:tasks.workunit.client.0.smithi076.stdout:4/136: dread d0/fc [0,4194304] 0 2024-03-28T13:02:51.325 INFO:tasks.workunit.client.0.smithi076.stdout:5/148: dread d5/fa [0,4194304] 0 2024-03-28T13:02:51.334 INFO:tasks.workunit.client.0.smithi076.stdout:5/149: dread d5/d9/f28 [0,4194304] 0 2024-03-28T13:02:51.334 INFO:tasks.workunit.client.0.smithi076.stdout:5/150: truncate d5/d9/d1c/f32 147959 0 2024-03-28T13:02:51.433 INFO:tasks.workunit.client.0.smithi076.stdout:9/115: creat d9/dd/d20/f2f x:0 0 0 2024-03-28T13:02:51.606 INFO:tasks.workunit.client.0.smithi076.stdout:0/136: mkdir db/dc/df/d11/d40 0 2024-03-28T13:02:51.606 INFO:tasks.workunit.client.0.smithi076.stdout:4/137: creat d0/db/d2d/f35 x:0 0 0 2024-03-28T13:02:51.607 INFO:tasks.workunit.client.0.smithi076.stdout:4/138: readlink d0/db/d16/l1d 0 2024-03-28T13:02:51.607 INFO:tasks.workunit.client.0.smithi076.stdout:5/151: truncate d5/d9/d1c/d25/f2b 3649459 0 2024-03-28T13:02:51.609 INFO:tasks.workunit.client.0.smithi076.stdout:1/150: sync 2024-03-28T13:02:51.609 INFO:tasks.workunit.client.0.smithi076.stdout:1/151: fsync d14/f21 0 2024-03-28T13:02:51.609 INFO:tasks.workunit.client.0.smithi076.stdout:1/152: write d14/f2b [1789993,8369] 0 2024-03-28T13:02:51.708 INFO:tasks.workunit.client.0.smithi076.stdout:6/143: truncate d6/da/f1c 3173092 0 2024-03-28T13:02:52.050 INFO:tasks.workunit.client.0.smithi076.stdout:6/144: getdents d6 0 2024-03-28T13:02:52.085 INFO:tasks.workunit.client.0.smithi076.stdout:1/153: dwrite fe [0,4194304] 0 2024-03-28T13:02:52.139 INFO:tasks.workunit.client.0.smithi076.stdout:0/137: truncate db/dc/df/f33 328606 0 2024-03-28T13:02:52.139 INFO:tasks.workunit.client.0.smithi076.stdout:0/138: write db/f17 [427604,7844] 0 2024-03-28T13:02:52.185 INFO:tasks.workunit.client.0.smithi076.stdout:6/145: stat d6/da/d1e/c2a 0 2024-03-28T13:02:52.185 INFO:tasks.workunit.client.0.smithi076.stdout:6/146: chown d6/da/f18 1781541 1 2024-03-28T13:02:52.185 INFO:tasks.workunit.client.0.smithi076.stdout:6/147: chown d6/da/d1e/c2a 19858773 1 2024-03-28T13:02:52.375 INFO:tasks.workunit.client.0.smithi076.stdout:1/154: getdents d14 0 2024-03-28T13:02:52.514 INFO:tasks.workunit.client.0.smithi076.stdout:0/139: creat db/dc/df/d18/f41 x:0 0 0 2024-03-28T13:02:52.523 INFO:tasks.workunit.client.0.smithi076.stdout:6/148: truncate d6/da/d1e/f1f 1778927 0 2024-03-28T13:02:52.523 INFO:tasks.workunit.client.0.smithi076.stdout:6/149: dread - d6/f24 zero size 2024-03-28T13:02:52.575 INFO:tasks.workunit.client.0.smithi076.stdout:6/150: dwrite d6/fb [0,4194304] 0 2024-03-28T13:02:52.967 INFO:tasks.workunit.client.0.smithi076.stdout:8/88: mkdir de/d1b 0 2024-03-28T13:02:52.967 INFO:tasks.workunit.client.0.smithi076.stdout:8/89: fdatasync fd 0 2024-03-28T13:02:52.983 INFO:tasks.workunit.client.0.smithi076.stdout:2/132: mknod d2/d5/d7/c2a 0 2024-03-28T13:02:53.047 INFO:tasks.workunit.client.0.smithi076.stdout:2/133: dwrite d2/d5/d7/fe [0,4194304] 0 2024-03-28T13:02:53.186 INFO:tasks.workunit.client.0.smithi076.stdout:1/155: link d14/d19/d20/l2c d14/d2a/d2e/l37 0 2024-03-28T13:02:53.186 INFO:tasks.workunit.client.0.smithi076.stdout:1/156: fsync d14/f21 0 2024-03-28T13:02:53.186 INFO:tasks.workunit.client.0.smithi076.stdout:0/140: creat db/dc/df/d11/d40/f42 x:0 0 0 2024-03-28T13:02:53.192 INFO:tasks.workunit.client.0.smithi076.stdout:0/141: fsync db/dc/df/f1e 0 2024-03-28T13:02:53.341 INFO:tasks.workunit.client.0.smithi076.stdout:6/151: dwrite d6/da/f1c [0,4194304] 0 2024-03-28T13:02:53.380 INFO:tasks.workunit.client.0.smithi076.stdout:8/90: mknod de/d12/c1c 0 2024-03-28T13:02:53.481 INFO:tasks.workunit.client.0.smithi076.stdout:2/134: rename d2/d5/db/cf to d2/d5/db/c2b 0 2024-03-28T13:02:53.500 INFO:tasks.workunit.client.0.smithi076.stdout:2/135: write d2/d5/d7/fe [3149436,52773] 0 2024-03-28T13:02:53.571 INFO:tasks.workunit.client.0.smithi076.stdout:1/157: dwrite f0 [0,4194304] 0 2024-03-28T13:02:53.571 INFO:tasks.workunit.client.0.smithi076.stdout:1/158: dread - d14/f2f zero size 2024-03-28T13:02:53.620 INFO:tasks.workunit.client.0.smithi076.stdout:0/142: truncate db/f14 683863 0 2024-03-28T13:02:53.621 INFO:tasks.workunit.client.0.smithi076.stdout:0/143: truncate db/dc/df/d11/f3b 272472 0 2024-03-28T13:02:53.670 INFO:tasks.workunit.client.0.smithi076.stdout:8/91: link de/d12/f15 de/f1d 0 2024-03-28T13:02:53.759 INFO:tasks.workunit.client.0.smithi076.stdout:3/110: rename f0 to d1/d2/d8/d14/f26 0 2024-03-28T13:02:53.759 INFO:tasks.workunit.client.0.smithi076.stdout:3/111: readlink d1/d2/l5 0 2024-03-28T13:02:53.881 INFO:tasks.workunit.client.0.smithi076.stdout:1/159: readlink l9 0 2024-03-28T13:02:53.945 INFO:tasks.workunit.client.0.smithi076.stdout:0/144: symlink db/dc/df/d11/l43 0 2024-03-28T13:02:53.947 INFO:tasks.workunit.client.0.smithi076.stdout:0/145: dread db/dc/df/d11/f3b [0,4194304] 0 2024-03-28T13:02:53.947 INFO:tasks.workunit.client.0.smithi076.stdout:0/146: write f1 [3004329,112988] 0 2024-03-28T13:02:54.052 INFO:tasks.workunit.client.0.smithi076.stdout:2/136: link d2/l25 d2/d5/l2c 0 2024-03-28T13:02:54.110 INFO:tasks.workunit.client.0.smithi076.stdout:3/112: dread d1/d2/f1e [0,4194304] 0 2024-03-28T13:02:54.169 INFO:tasks.workunit.client.0.smithi076.stdout:1/160: unlink d14/l17 0 2024-03-28T13:02:54.169 INFO:tasks.workunit.client.0.smithi076.stdout:1/161: write d14/d19/d20/f27 [520570,32997] 0 2024-03-28T13:02:54.233 INFO:tasks.workunit.client.0.smithi076.stdout:0/147: creat db/dc/df/f44 x:0 0 0 2024-03-28T13:02:54.267 INFO:tasks.workunit.client.0.smithi076.stdout:2/137: dread d2/d5/d7/fa [0,4194304] 0 2024-03-28T13:02:54.317 INFO:tasks.workunit.client.0.smithi076.stdout:3/113: unlink d1/d2/d8/d14/f15 0 2024-03-28T13:02:54.317 INFO:tasks.workunit.client.0.smithi076.stdout:3/114: truncate d1/d2/d8/d14/d18/f24 10921 0 2024-03-28T13:02:54.317 INFO:tasks.workunit.client.0.smithi076.stdout:3/115: chown d1/d7 120748467 1 2024-03-28T13:02:54.352 INFO:tasks.workunit.client.0.smithi076.stdout:3/116: dwrite d1/f1b [0,4194304] 0 2024-03-28T13:02:54.381 INFO:tasks.workunit.client.0.smithi076.stdout:3/117: dwrite d1/f1b [0,4194304] 0 2024-03-28T13:02:54.458 INFO:tasks.workunit.client.0.smithi076.stdout:7/123: rename d1/l3 to d1/d18/l2c 0 2024-03-28T13:02:54.458 INFO:tasks.workunit.client.0.smithi076.stdout:7/124: dread - d1/d8/d14/f20 zero size 2024-03-28T13:02:54.599 INFO:tasks.workunit.client.0.smithi076.stdout:6/152: symlink d6/da/l2d 0 2024-03-28T13:02:54.643 INFO:tasks.workunit.client.0.smithi076.stdout:0/148: rmdir db 39 2024-03-28T13:02:54.902 INFO:tasks.workunit.client.0.smithi076.stdout:2/138: mknod d2/d5/d7/d8/c2d 0 2024-03-28T13:02:54.902 INFO:tasks.workunit.client.0.smithi076.stdout:2/139: fdatasync d2/d5/d7/f23 0 2024-03-28T13:02:55.111 INFO:tasks.workunit.client.0.smithi076.stdout:3/118: rmdir d1/d2/d6 39 2024-03-28T13:02:55.114 INFO:tasks.workunit.client.0.smithi076.stdout:9/116: sync 2024-03-28T13:02:55.114 INFO:tasks.workunit.client.0.smithi076.stdout:9/117: fsync d9/dd/df/f25 0 2024-03-28T13:02:55.114 INFO:tasks.workunit.client.0.smithi076.stdout:9/118: chown d9/dd 3597 1 2024-03-28T13:02:55.126 INFO:tasks.workunit.client.0.smithi076.stdout:3/119: dread d1/d2/f1e [0,4194304] 0 2024-03-28T13:02:55.170 INFO:tasks.workunit.client.0.smithi076.stdout:7/125: mkdir d1/d18/d2d 0 2024-03-28T13:02:55.170 INFO:tasks.workunit.client.0.smithi076.stdout:7/126: write d1/dc/ff [364804,77574] 0 2024-03-28T13:02:55.171 INFO:tasks.workunit.client.0.smithi076.stdout:7/127: write d1/f4 [5096968,73994] 0 2024-03-28T13:02:55.171 INFO:tasks.workunit.client.0.smithi076.stdout:7/128: dread - d1/f1b zero size 2024-03-28T13:02:55.171 INFO:tasks.workunit.client.0.smithi076.stdout:7/129: dread - d1/d8/d14/f20 zero size 2024-03-28T13:02:55.245 INFO:tasks.workunit.client.0.smithi076.stdout:6/153: dread d6/da/d1e/f1f [0,4194304] 0 2024-03-28T13:02:55.311 INFO:tasks.workunit.client.0.smithi076.stdout:2/140: dread d2/d1d/f22 [0,4194304] 0 2024-03-28T13:02:55.312 INFO:tasks.workunit.client.0.smithi076.stdout:2/141: chown d2/d1d/f22 2 1 2024-03-28T13:02:55.334 INFO:tasks.workunit.client.0.smithi076.stdout:2/142: dwrite d2/d5/d7/f17 [0,4194304] 0 2024-03-28T13:02:55.425 INFO:tasks.workunit.client.0.smithi076.stdout:4/139: rename d0/db/c26 to d0/d20/d21/c36 0 2024-03-28T13:02:55.425 INFO:tasks.workunit.client.0.smithi076.stdout:5/152: rename d5/d9/d1c to d5/d9/d1c/d38 22 2024-03-28T13:02:55.425 INFO:tasks.workunit.client.0.smithi076.stdout:4/140: fdatasync d0/db/d16/d28/f32 0 2024-03-28T13:02:55.425 INFO:tasks.workunit.client.0.smithi076.stdout:4/141: write d0/db/d16/f24 [87736,130927] 0 2024-03-28T13:02:55.490 INFO:tasks.workunit.client.0.smithi076.stdout:9/119: getdents d9/dd 0 2024-03-28T13:02:55.496 INFO:tasks.workunit.client.0.smithi076.stdout:3/120: dread d1/d2/d8/fc [0,4194304] 0 2024-03-28T13:02:55.554 INFO:tasks.workunit.client.0.smithi076.stdout:7/130: mknod d1/dc/c2e 0 2024-03-28T13:02:55.554 INFO:tasks.workunit.client.0.smithi076.stdout:7/131: truncate d1/f1b 735914 0 2024-03-28T13:02:55.554 INFO:tasks.workunit.client.0.smithi076.stdout:7/132: fsync d1/f16 0 2024-03-28T13:02:55.555 INFO:tasks.workunit.client.0.smithi076.stdout:7/133: dread d1/f1b [0,4194304] 0 2024-03-28T13:02:55.555 INFO:tasks.workunit.client.0.smithi076.stdout:7/134: write d1/dc/ff [1196687,83448] 0 2024-03-28T13:02:55.556 INFO:tasks.workunit.client.0.smithi076.stdout:7/135: write d1/dc/f1c [426882,73336] 0 2024-03-28T13:02:55.610 INFO:tasks.workunit.client.0.smithi076.stdout:6/154: creat d6/da/f2e x:0 0 0 2024-03-28T13:02:55.711 INFO:tasks.workunit.client.0.smithi076.stdout:2/143: symlink d2/l2e 0 2024-03-28T13:02:55.725 INFO:tasks.workunit.client.0.smithi076.stdout:2/144: dread d2/d5/d7/fa [0,4194304] 0 2024-03-28T13:02:55.816 INFO:tasks.workunit.client.0.smithi076.stdout:8/92: rename de/d12/f17 to de/d1b/f1e 0 2024-03-28T13:02:55.816 INFO:tasks.workunit.client.0.smithi076.stdout:8/93: chown de/d1b/f1e 3319295 1 2024-03-28T13:02:56.127 INFO:tasks.workunit.client.0.smithi076.stdout:1/162: sync 2024-03-28T13:02:56.239 INFO:tasks.workunit.client.0.smithi076.stdout:9/120: creat d9/dd/df/d11/d18/d2a/f30 x:0 0 0 2024-03-28T13:02:56.239 INFO:tasks.workunit.client.0.smithi076.stdout:9/121: dread - d9/dd/df/d11/d14/f26 zero size 2024-03-28T13:02:56.261 INFO:tasks.workunit.client.0.smithi076.stdout:9/122: dwrite d9/dd/d20/f29 [0,4194304] 0 2024-03-28T13:02:56.287 INFO:tasks.workunit.client.0.smithi076.stdout:3/121: rmdir d1 39 2024-03-28T13:02:56.325 INFO:tasks.workunit.client.0.smithi076.stdout:0/149: sync 2024-03-28T13:02:56.553 INFO:tasks.workunit.client.0.smithi076.stdout:7/136: rmdir d1/dc 39 2024-03-28T13:02:56.553 INFO:tasks.workunit.client.0.smithi076.stdout:6/155: rmdir d6/da/d1e 39 2024-03-28T13:02:56.576 INFO:tasks.workunit.client.0.smithi076.stdout:7/137: write d1/f26 [3304512,108822] 0 2024-03-28T13:02:56.671 INFO:tasks.workunit.client.0.smithi076.stdout:8/94: mknod de/c1f 0 2024-03-28T13:02:56.696 INFO:tasks.workunit.client.0.smithi076.stdout:8/95: dwrite fd [0,4194304] 0 2024-03-28T13:02:56.696 INFO:tasks.workunit.client.0.smithi076.stdout:8/96: truncate f2 13478888 0 2024-03-28T13:02:56.738 INFO:tasks.workunit.client.0.smithi076.stdout:1/163: creat d14/d2a/f38 x:0 0 0 2024-03-28T13:02:56.890 INFO:tasks.workunit.client.0.smithi076.stdout:9/123: dread f7 [0,4194304] 0 2024-03-28T13:02:56.890 INFO:tasks.workunit.client.0.smithi076.stdout:9/124: read - d9/dd/df/d11/d18/d2a/f30 zero size 2024-03-28T13:02:57.034 INFO:tasks.workunit.client.0.smithi076.stdout:6/156: creat d6/f2f x:0 0 0 2024-03-28T13:02:57.034 INFO:tasks.workunit.client.0.smithi076.stdout:7/138: mknod d1/d8/c2f 0 2024-03-28T13:02:57.034 INFO:tasks.workunit.client.0.smithi076.stdout:6/157: read - d6/da/f14 zero size 2024-03-28T13:02:57.055 INFO:tasks.workunit.client.0.smithi076.stdout:6/158: dread d6/da/f1b [0,4194304] 0 2024-03-28T13:02:57.136 INFO:tasks.workunit.client.0.smithi076.stdout:8/97: rmdir de 39 2024-03-28T13:02:57.136 INFO:tasks.workunit.client.0.smithi076.stdout:8/98: dread - de/d1b/f1e zero size 2024-03-28T13:02:57.190 INFO:tasks.workunit.client.0.smithi076.stdout:1/164: creat d14/d2a/d2e/d31/f39 x:0 0 0 2024-03-28T13:02:57.203 INFO:tasks.workunit.client.0.smithi076.stdout:9/125: stat d9/dd/df/l2c 0 2024-03-28T13:02:57.203 INFO:tasks.workunit.client.0.smithi076.stdout:9/126: write f3 [66961,76920] 0 2024-03-28T13:02:57.292 INFO:tasks.workunit.client.0.smithi076.stdout:0/150: mknod db/d16/c45 0 2024-03-28T13:02:57.364 INFO:tasks.workunit.client.0.smithi076.stdout:3/122: mkdir d1/d2/d8/d14/d27 0 2024-03-28T13:02:57.486 INFO:tasks.workunit.client.0.smithi076.stdout:6/159: creat d6/da/d1e/d2c/f30 x:0 0 0 2024-03-28T13:02:57.626 INFO:tasks.workunit.client.0.smithi076.stdout:8/99: rmdir de 39 2024-03-28T13:02:57.846 INFO:tasks.workunit.client.0.smithi076.stdout:0/151: mkdir db/dc/d3d/d46 0 2024-03-28T13:02:57.855 INFO:tasks.workunit.client.0.smithi076.stdout:2/145: dwrite d2/d5/db/f1b [0,4194304] 0 2024-03-28T13:02:57.855 INFO:tasks.workunit.client.0.smithi076.stdout:2/146: chown d2/d5/f12 3 1 2024-03-28T13:02:57.855 INFO:tasks.workunit.client.0.smithi076.stdout:2/147: stat d2/d5/db 0 2024-03-28T13:02:57.859 INFO:tasks.workunit.client.0.smithi076.stdout:1/165: dwrite f7 [0,4194304] 0 2024-03-28T13:02:58.124 INFO:tasks.workunit.client.0.smithi076.stdout:3/123: symlink d1/d2/d8/d14/d27/l28 0 2024-03-28T13:02:58.124 INFO:tasks.workunit.client.0.smithi076.stdout:3/124: chown d1/d2/d8/d14 1370650 1 2024-03-28T13:02:58.218 INFO:tasks.workunit.client.0.smithi076.stdout:4/142: creat d0/db/d16/f37 x:0 0 0 2024-03-28T13:02:58.218 INFO:tasks.workunit.client.0.smithi076.stdout:4/143: fdatasync d0/f9 0 2024-03-28T13:02:58.218 INFO:tasks.workunit.client.0.smithi076.stdout:6/160: creat d6/da/d1e/f31 x:0 0 0 2024-03-28T13:02:58.410 INFO:tasks.workunit.client.0.smithi076.stdout:2/148: symlink d2/d5/d7/d8/l2f 0 2024-03-28T13:02:58.410 INFO:tasks.workunit.client.0.smithi076.stdout:2/149: truncate d2/d5/d7/f19 1613303 0 2024-03-28T13:02:58.411 INFO:tasks.workunit.client.0.smithi076.stdout:2/150: dread d2/d5/d7/d8/d21/f27 [0,4194304] 0 2024-03-28T13:02:58.491 INFO:tasks.workunit.client.0.smithi076.stdout:1/166: creat d14/d2a/d2e/f3a x:0 0 0 2024-03-28T13:02:58.572 INFO:tasks.workunit.client.0.smithi076.stdout:3/125: creat d1/d2/d8/f29 x:0 0 0 2024-03-28T13:02:58.572 INFO:tasks.workunit.client.0.smithi076.stdout:3/126: dread - d1/d2/d8/d14/f1f zero size 2024-03-28T13:02:58.647 INFO:tasks.workunit.client.0.smithi076.stdout:6/161: creat d6/da/d23/f32 x:0 0 0 2024-03-28T13:02:58.725 INFO:tasks.workunit.client.0.smithi076.stdout:0/152: symlink db/d16/l47 0 2024-03-28T13:02:58.726 INFO:tasks.workunit.client.0.smithi076.stdout:8/100: unlink c9 0 2024-03-28T13:02:58.726 INFO:tasks.workunit.client.0.smithi076.stdout:8/101: chown de/f1d 9195 1 2024-03-28T13:02:58.774 INFO:tasks.workunit.client.0.smithi076.stdout:0/153: dwrite db/dc/df/f22 [0,4194304] 0 2024-03-28T13:02:58.817 INFO:tasks.workunit.client.0.smithi076.stdout:2/151: symlink d2/d1d/l30 0 2024-03-28T13:02:58.818 INFO:tasks.workunit.client.0.smithi076.stdout:9/127: dwrite d9/dd/df/d11/d1a/f1c [0,4194304] 0 2024-03-28T13:02:58.818 INFO:tasks.workunit.client.0.smithi076.stdout:9/128: readlink d9/dd/df/d11/d14/l27 0 2024-03-28T13:02:58.848 INFO:tasks.workunit.client.0.smithi076.stdout:1/167: mkdir d14/d2a/d2e/d31/d3b 0 2024-03-28T13:02:58.949 INFO:tasks.workunit.client.0.smithi076.stdout:6/162: creat d6/f33 x:0 0 0 2024-03-28T13:02:59.283 INFO:tasks.workunit.client.0.smithi076.stdout:5/153: sync 2024-03-28T13:02:59.283 INFO:tasks.workunit.client.0.smithi076.stdout:7/139: sync 2024-03-28T13:02:59.283 INFO:tasks.workunit.client.0.smithi076.stdout:5/154: truncate d5/d9/d1c/d1d/d22/f33 483727 0 2024-03-28T13:02:59.324 INFO:tasks.workunit.client.0.smithi076.stdout:0/154: mkdir db/dc/df/d18/d48 0 2024-03-28T13:02:59.324 INFO:tasks.workunit.client.0.smithi076.stdout:4/144: write d0/fc [730053,106795] 0 2024-03-28T13:02:59.324 INFO:tasks.workunit.client.0.smithi076.stdout:0/155: write f5 [1386175,58449] 0 2024-03-28T13:02:59.327 INFO:tasks.workunit.client.0.smithi076.stdout:9/129: unlink d9/f17 0 2024-03-28T13:02:59.327 INFO:tasks.workunit.client.0.smithi076.stdout:1/168: mkdir d14/d2a/d2e/d3c 0 2024-03-28T13:02:59.327 INFO:tasks.workunit.client.0.smithi076.stdout:6/163: creat d6/da/d1e/d2c/f34 x:0 0 0 2024-03-28T13:02:59.327 INFO:tasks.workunit.client.0.smithi076.stdout:6/164: dread - d6/da/d1e/d2c/f30 zero size 2024-03-28T13:02:59.327 INFO:tasks.workunit.client.0.smithi076.stdout:6/165: chown d6/da/d1e/d2c/f30 127 1 2024-03-28T13:02:59.353 INFO:tasks.workunit.client.0.smithi076.stdout:6/166: dread d6/da/f1b [0,4194304] 0 2024-03-28T13:02:59.360 INFO:tasks.workunit.client.0.smithi076.stdout:4/145: dwrite d0/db/d16/d28/f2e [0,4194304] 0 2024-03-28T13:02:59.360 INFO:tasks.workunit.client.0.smithi076.stdout:4/146: readlink d0/db/le 0 2024-03-28T13:02:59.360 INFO:tasks.workunit.client.0.smithi076.stdout:4/147: dread - d0/db/d16/f37 zero size 2024-03-28T13:02:59.365 INFO:tasks.workunit.client.0.smithi076.stdout:0/156: write db/dc/df/d11/f1c [2732426,61668] 0 2024-03-28T13:02:59.367 INFO:tasks.workunit.client.0.smithi076.stdout:9/130: dread f3 [0,4194304] 0 2024-03-28T13:02:59.410 INFO:tasks.workunit.client.0.smithi076.stdout:6/167: dwrite d6/da/d1e/f28 [0,4194304] 0 2024-03-28T13:02:59.410 INFO:tasks.workunit.client.0.smithi076.stdout:6/168: truncate d6/da/d1e/d2c/f30 1017285 0 2024-03-28T13:02:59.410 INFO:tasks.workunit.client.0.smithi076.stdout:6/169: chown d6/fb 5555 1 2024-03-28T13:02:59.410 INFO:tasks.workunit.client.0.smithi076.stdout:6/170: chown d6/da/f18 367455587 1 2024-03-28T13:02:59.508 INFO:tasks.workunit.client.0.smithi076.stdout:2/152: symlink d2/d5/d7/dd/l31 0 2024-03-28T13:02:59.508 INFO:tasks.workunit.client.0.smithi076.stdout:7/140: creat d1/d8/d14/f30 x:0 0 0 2024-03-28T13:02:59.513 INFO:tasks.workunit.client.0.smithi076.stdout:7/141: dread d1/dc/f1d [0,4194304] 0 2024-03-28T13:02:59.517 INFO:tasks.workunit.client.0.smithi076.stdout:1/169: unlink f0 0 2024-03-28T13:02:59.528 INFO:tasks.workunit.client.0.smithi076.stdout:2/153: write d2/d5/d7/f23 [2355543,54752] 0 2024-03-28T13:02:59.694 INFO:tasks.workunit.client.0.smithi076.stdout:4/148: getdents d0/d20/d21 0 2024-03-28T13:02:59.694 INFO:tasks.workunit.client.0.smithi076.stdout:4/149: dread - d0/db/d2d/f35 zero size 2024-03-28T13:02:59.721 INFO:tasks.workunit.client.0.smithi076.stdout:4/150: write d0/db/f23 [893583,101720] 0 2024-03-28T13:02:59.755 INFO:tasks.workunit.client.0.smithi076.stdout:0/157: mkdir db/dc/d49 0 2024-03-28T13:02:59.811 INFO:tasks.workunit.client.0.smithi076.stdout:9/131: rmdir d9/dd 39 2024-03-28T13:02:59.812 INFO:tasks.workunit.client.0.smithi076.stdout:9/132: chown d9/dd 13962112 1 2024-03-28T13:02:59.862 INFO:tasks.workunit.client.0.smithi076.stdout:3/127: dwrite d1/d2/d8/d14/d18/f24 [0,4194304] 0 2024-03-28T13:02:59.973 INFO:tasks.workunit.client.0.smithi076.stdout:6/171: truncate d6/da/f15 276632 0 2024-03-28T13:02:59.975 INFO:tasks.workunit.client.0.smithi076.stdout:7/142: mknod d1/d8/c31 0 2024-03-28T13:03:00.011 INFO:tasks.workunit.client.0.smithi076.stdout:8/102: dwrite de/f11 [0,4194304] 0 2024-03-28T13:03:00.016 INFO:tasks.workunit.client.0.smithi076.stdout:7/143: dread d1/dc/f1c [0,4194304] 0 2024-03-28T13:03:00.020 INFO:tasks.workunit.client.0.smithi076.stdout:6/172: dwrite d6/da/f2e [0,4194304] 0 2024-03-28T13:03:00.031 INFO:tasks.workunit.client.0.smithi076.stdout:1/170: getdents d14/d19/d20 0 2024-03-28T13:03:00.041 INFO:tasks.workunit.client.0.smithi076.stdout:6/173: dread d6/da/f2e [0,4194304] 0 2024-03-28T13:03:00.128 INFO:tasks.workunit.client.0.smithi076.stdout:2/154: truncate d2/f18 9604724 0 2024-03-28T13:03:00.128 INFO:tasks.workunit.client.0.smithi076.stdout:2/155: readlink d2/d5/d7/d8/d21/l24 0 2024-03-28T13:03:00.206 INFO:tasks.workunit.client.0.smithi076.stdout:0/158: mkdir db/dc/d3d/d46/d4a 0 2024-03-28T13:03:00.287 INFO:tasks.workunit.client.0.smithi076.stdout:9/133: creat d9/dd/df/d11/d14/f31 x:0 0 0 2024-03-28T13:03:00.352 INFO:tasks.workunit.client.0.smithi076.stdout:5/155: dwrite d5/fa [0,4194304] 0 2024-03-28T13:03:00.376 INFO:tasks.workunit.client.0.smithi076.stdout:5/156: dwrite f3 [4194304,4194304] 0 2024-03-28T13:03:00.376 INFO:tasks.workunit.client.0.smithi076.stdout:5/157: fsync d5/f7 0 2024-03-28T13:03:00.403 INFO:tasks.workunit.client.0.smithi076.stdout:5/158: dwrite d5/d9/d1c/d25/f2b [0,4194304] 0 2024-03-28T13:03:00.403 INFO:tasks.workunit.client.0.smithi076.stdout:5/159: write f3 [2421150,10124] 0 2024-03-28T13:03:00.454 INFO:tasks.workunit.client.0.smithi076.stdout:3/128: rename d1/d2/d8/d14/d27/l28 to d1/d2/d8/d14/d18/l2a 0 2024-03-28T13:03:00.693 INFO:tasks.workunit.client.0.smithi076.stdout:8/103: mknod de/d1b/c20 0 2024-03-28T13:03:00.693 INFO:tasks.workunit.client.0.smithi076.stdout:8/104: read - de/d1b/f1e zero size 2024-03-28T13:03:00.721 INFO:tasks.workunit.client.0.smithi076.stdout:8/105: dwrite de/d12/f15 [0,4194304] 0 2024-03-28T13:03:00.741 INFO:tasks.workunit.client.0.smithi076.stdout:8/106: read de/f11 [803244,28588] 0 2024-03-28T13:03:00.747 INFO:tasks.workunit.client.0.smithi076.stdout:7/144: creat d1/dc/f32 x:0 0 0 2024-03-28T13:03:01.664 INFO:tasks.workunit.client.0.smithi076.stdout:2/156: creat d2/d5/d7/dd/f32 x:0 0 0 2024-03-28T13:03:01.664 INFO:tasks.workunit.client.0.smithi076.stdout:2/157: chown d2/d1d/f22 23769 1 2024-03-28T13:03:01.664 INFO:tasks.workunit.client.0.smithi076.stdout:4/151: mkdir d0/db/d38 0 2024-03-28T13:03:01.707 INFO:tasks.workunit.client.0.smithi076.stdout:0/159: link db/f3e db/f4b 0 2024-03-28T13:03:01.707 INFO:tasks.workunit.client.0.smithi076.stdout:0/160: chown db/dc/df/d11/f1c 3293 1 2024-03-28T13:03:01.713 INFO:tasks.workunit.client.0.smithi076.stdout:1/171: dwrite f7 [0,4194304] 0 2024-03-28T13:03:01.727 INFO:tasks.workunit.client.0.smithi076.stdout:9/134: stat c8 0 2024-03-28T13:03:01.727 INFO:tasks.workunit.client.0.smithi076.stdout:5/160: creat d5/db/df/f39 x:0 0 0 2024-03-28T13:03:01.728 INFO:tasks.workunit.client.0.smithi076.stdout:5/161: dread - d5/db/d19/f2d zero size 2024-03-28T13:03:01.750 INFO:tasks.workunit.client.0.smithi076.stdout:3/129: mknod d1/d2/d8/d14/d18/c2b 0 2024-03-28T13:03:01.750 INFO:tasks.workunit.client.0.smithi076.stdout:8/107: creat de/d12/f21 x:0 0 0 2024-03-28T13:03:01.751 INFO:tasks.workunit.client.0.smithi076.stdout:7/145: creat d1/d8/d14/f33 x:0 0 0 2024-03-28T13:03:01.751 INFO:tasks.workunit.client.0.smithi076.stdout:7/146: write d1/f7 [2311113,29485] 0 2024-03-28T13:03:01.751 INFO:tasks.workunit.client.0.smithi076.stdout:7/147: fdatasync d1/f12 0 2024-03-28T13:03:02.104 INFO:tasks.workunit.client.0.smithi076.stdout:9/135: unlink d9/dd/c1b 0 2024-03-28T13:03:02.104 INFO:tasks.workunit.client.0.smithi076.stdout:0/161: symlink db/l4c 0 2024-03-28T13:03:02.105 INFO:tasks.workunit.client.0.smithi076.stdout:0/162: chown db/dc/df/d18/d1d/f29 631388548 1 2024-03-28T13:03:02.105 INFO:tasks.workunit.client.0.smithi076.stdout:0/163: write db/dc/df/f44 [370062,9929] 0 2024-03-28T13:03:02.267 INFO:tasks.workunit.client.0.smithi076.stdout:5/162: unlink d5/db/l2c 0 2024-03-28T13:03:02.353 INFO:tasks.workunit.client.0.smithi076.stdout:8/108: mknod de/d13/c22 0 2024-03-28T13:03:02.353 INFO:tasks.workunit.client.0.smithi076.stdout:8/109: dread - de/d1b/f1e zero size 2024-03-28T13:03:02.375 INFO:tasks.workunit.client.0.smithi076.stdout:8/110: dread de/f1d [0,4194304] 0 2024-03-28T13:03:02.425 INFO:tasks.workunit.client.0.smithi076.stdout:4/152: unlink d0/db/f13 0 2024-03-28T13:03:02.607 INFO:tasks.workunit.client.0.smithi076.stdout:9/136: creat d9/dd/d20/f32 x:0 0 0 2024-03-28T13:03:02.607 INFO:tasks.workunit.client.0.smithi076.stdout:0/164: symlink db/dc/d3d/l4d 0 2024-03-28T13:03:02.607 INFO:tasks.workunit.client.0.smithi076.stdout:0/165: fdatasync db/dc/df/f33 0 2024-03-28T13:03:02.684 INFO:tasks.workunit.client.0.smithi076.stdout:5/163: creat d5/d9/d1c/d25/f3a x:0 0 0 2024-03-28T13:03:02.701 INFO:tasks.workunit.client.0.smithi076.stdout:8/111: dread f7 [4194304,4194304] 0 2024-03-28T13:03:02.701 INFO:tasks.workunit.client.0.smithi076.stdout:8/112: fsync de/d12/f15 0 2024-03-28T13:03:02.750 INFO:tasks.workunit.client.0.smithi076.stdout:4/153: unlink d0/ff 0 2024-03-28T13:03:02.765 INFO:tasks.workunit.client.0.smithi076.stdout:4/154: dread d0/db/d16/f1b [0,4194304] 0 2024-03-28T13:03:02.789 INFO:tasks.workunit.client.0.smithi076.stdout:4/155: dread d0/db/d16/d28/f2e [0,4194304] 0 2024-03-28T13:03:02.825 INFO:tasks.workunit.client.0.smithi076.stdout:9/137: mknod d9/c33 0 2024-03-28T13:03:02.826 INFO:tasks.workunit.client.0.smithi076.stdout:4/156: dwrite d0/f2 [0,4194304] 0 2024-03-28T13:03:02.826 INFO:tasks.workunit.client.0.smithi076.stdout:4/157: chown d0/fc 2264170 1 2024-03-28T13:03:02.886 INFO:tasks.workunit.client.0.smithi076.stdout:0/166: getdents db/dc/df/d11 0 2024-03-28T13:03:02.916 INFO:tasks.workunit.client.0.smithi076.stdout:5/164: mkdir d5/d9/d35/d3b 0 2024-03-28T13:03:02.916 INFO:tasks.workunit.client.0.smithi076.stdout:5/165: truncate d5/db/d19/f2d 48800 0 2024-03-28T13:03:03.037 INFO:tasks.workunit.client.0.smithi076.stdout:9/138: rename d9/lb to d9/l34 0 2024-03-28T13:03:03.051 INFO:tasks.workunit.client.0.smithi076.stdout:0/167: creat db/dc/df/d18/f4e x:0 0 0 2024-03-28T13:03:03.079 INFO:tasks.workunit.client.0.smithi076.stdout:9/139: dwrite d9/dd/df/d11/d1a/f1d [0,4194304] 0 2024-03-28T13:03:03.131 INFO:tasks.workunit.client.0.smithi076.stdout:6/174: sync 2024-03-28T13:03:03.165 INFO:tasks.workunit.client.0.smithi076.stdout:0/168: rmdir db/dc/df/d11/d40 39 2024-03-28T13:03:03.197 INFO:tasks.workunit.client.0.smithi076.stdout:9/140: symlink d9/dd/df/d11/d1a/l35 0 2024-03-28T13:03:03.197 INFO:tasks.workunit.client.0.smithi076.stdout:9/141: readlink d9/dd/df/d11/l24 0 2024-03-28T13:03:03.230 INFO:tasks.workunit.client.0.smithi076.stdout:9/142: dwrite d9/dd/f2e [0,4194304] 0 2024-03-28T13:03:03.280 INFO:tasks.workunit.client.0.smithi076.stdout:6/175: creat d6/da/d1e/f35 x:0 0 0 2024-03-28T13:03:03.302 INFO:tasks.workunit.client.0.smithi076.stdout:0/169: mknod db/dc/d3d/d46/c4f 0 2024-03-28T13:03:03.486 INFO:tasks.workunit.client.0.smithi076.stdout:9/143: link d9/dd/df/d11/d14/f26 d9/f36 0 2024-03-28T13:03:03.534 INFO:tasks.workunit.client.0.smithi076.stdout:9/144: dwrite d9/dd/d20/f2f [0,4194304] 0 2024-03-28T13:03:04.223 INFO:tasks.workunit.client.0.smithi076.stdout:2/158: rmdir d2/d5/db 39 2024-03-28T13:03:04.228 INFO:tasks.workunit.client.0.smithi076.stdout:3/130: mknod d1/d2/d8/c2c 0 2024-03-28T13:03:04.228 INFO:tasks.workunit.client.0.smithi076.stdout:3/131: stat d1/d2/d8/d14/d18 0 2024-03-28T13:03:04.655 INFO:tasks.workunit.client.0.smithi076.stdout:9/145: rename d9/dd/df/d11/d1a to d9/dd/df/d11/d37 0 2024-03-28T13:03:04.670 INFO:tasks.workunit.client.0.smithi076.stdout:9/146: dread d9/dd/df/d11/d37/f1c [0,4194304] 0 2024-03-28T13:03:04.688 INFO:tasks.workunit.client.0.smithi076.stdout:9/147: dread f7 [0,4194304] 0 2024-03-28T13:03:04.690 INFO:tasks.workunit.client.0.smithi076.stdout:5/166: dwrite d5/db/f13 [0,4194304] 0 2024-03-28T13:03:04.690 INFO:tasks.workunit.client.0.smithi076.stdout:5/167: chown d5/d9/d1c/d1d/d22 24228 1 2024-03-28T13:03:04.692 INFO:tasks.workunit.client.0.smithi076.stdout:5/168: dread d5/db/d19/f2d [0,4194304] 0 2024-03-28T13:03:04.699 INFO:tasks.workunit.client.0.smithi076.stdout:6/176: creat d6/f36 x:0 0 0 2024-03-28T13:03:04.699 INFO:tasks.workunit.client.0.smithi076.stdout:8/113: rename de/d1b to de/d23 0 2024-03-28T13:03:04.699 INFO:tasks.workunit.client.0.smithi076.stdout:6/177: fdatasync d6/da/f1b 0 2024-03-28T13:03:04.731 INFO:tasks.workunit.client.0.smithi076.stdout:1/172: rename fe to d14/d2a/d2e/d31/d3b/f3d 0 2024-03-28T13:03:04.780 INFO:tasks.workunit.client.0.smithi076.stdout:1/173: dwrite d14/d2a/d2e/d31/f39 [0,4194304] 0 2024-03-28T13:03:04.794 INFO:tasks.workunit.client.0.smithi076.stdout:2/159: truncate d2/d1d/f1f 34244 0 2024-03-28T13:03:04.976 INFO:tasks.workunit.client.0.smithi076.stdout:3/132: symlink d1/l2d 0 2024-03-28T13:03:04.986 INFO:tasks.workunit.client.0.smithi076.stdout:9/148: truncate d9/dd/df/f28 3388508 0 2024-03-28T13:03:04.986 INFO:tasks.workunit.client.0.smithi076.stdout:8/114: symlink de/d12/l24 0 2024-03-28T13:03:05.003 INFO:tasks.workunit.client.0.smithi076.stdout:8/115: write de/f1d [1056567,59275] 0 2024-03-28T13:03:05.159 INFO:tasks.workunit.client.0.smithi076.stdout:7/148: rename d1/f12 to d1/d18/d2d/f34 0 2024-03-28T13:03:05.286 INFO:tasks.workunit.client.0.smithi076.stdout:1/174: creat d14/d2a/d2e/f3e x:0 0 0 2024-03-28T13:03:05.392 INFO:tasks.workunit.client.0.smithi076.stdout:2/160: unlink d2/d1d/f22 0 2024-03-28T13:03:05.420 INFO:tasks.workunit.client.0.smithi076.stdout:2/161: dwrite d2/d5/db/f1b [0,4194304] 0 2024-03-28T13:03:05.420 INFO:tasks.workunit.client.0.smithi076.stdout:2/162: write d2/d5/d7/fe [5025303,62647] 0 2024-03-28T13:03:05.420 INFO:tasks.workunit.client.0.smithi076.stdout:2/163: fdatasync d2/d5/d7/d8/d21/f27 0 2024-03-28T13:03:05.459 INFO:tasks.workunit.client.0.smithi076.stdout:2/164: dwrite d2/d5/d7/dd/f32 [0,4194304] 0 2024-03-28T13:03:05.627 INFO:tasks.workunit.client.0.smithi076.stdout:3/133: creat d1/d2/f2e x:0 0 0 2024-03-28T13:03:05.666 INFO:tasks.workunit.client.0.smithi076.stdout:9/149: symlink d9/l38 0 2024-03-28T13:03:05.666 INFO:tasks.workunit.client.0.smithi076.stdout:9/150: readlink d9/l19 0 2024-03-28T13:03:05.666 INFO:tasks.workunit.client.0.smithi076.stdout:9/151: stat d9/dd/df/d11/d18/d2a/f30 0 2024-03-28T13:03:05.666 INFO:tasks.workunit.client.0.smithi076.stdout:9/152: dread - d9/dd/df/d11/d18/d2a/f30 zero size 2024-03-28T13:03:05.757 INFO:tasks.workunit.client.0.smithi076.stdout:8/116: mkdir de/d25 0 2024-03-28T13:03:05.757 INFO:tasks.workunit.client.0.smithi076.stdout:8/117: chown de/d12/f21 49 1 2024-03-28T13:03:05.826 INFO:tasks.workunit.client.0.smithi076.stdout:4/158: rename d0/d20/c22 to d0/db/d16/d31/c39 0 2024-03-28T13:03:05.826 INFO:tasks.workunit.client.0.smithi076.stdout:4/159: truncate d0/db/d2d/f35 578247 0 2024-03-28T13:03:05.826 INFO:tasks.workunit.client.0.smithi076.stdout:4/160: truncate d0/db/d16/f37 374794 0 2024-03-28T13:03:05.936 INFO:tasks.workunit.client.0.smithi076.stdout:1/175: mkdir d14/d2a/d3f 0 2024-03-28T13:03:06.232 INFO:tasks.workunit.client.0.smithi076.stdout:5/169: sync 2024-03-28T13:03:06.306 INFO:tasks.workunit.client.0.smithi076.stdout:2/165: mknod d2/d5/db/c33 0 2024-03-28T13:03:06.306 INFO:tasks.workunit.client.0.smithi076.stdout:2/166: dread - d2/f16 zero size 2024-03-28T13:03:06.306 INFO:tasks.workunit.client.0.smithi076.stdout:2/167: chown d2/d5/d7/d8/d21/f27 48903 1 2024-03-28T13:03:06.306 INFO:tasks.workunit.client.0.smithi076.stdout:2/168: readlink d2/d5/d7/l14 0 2024-03-28T13:03:06.332 INFO:tasks.workunit.client.0.smithi076.stdout:2/169: dwrite d2/d5/db/f1b [0,4194304] 0 2024-03-28T13:03:06.584 INFO:tasks.workunit.client.0.smithi076.stdout:9/153: creat d9/da/f39 x:0 0 0 2024-03-28T13:03:06.585 INFO:tasks.workunit.client.0.smithi076.stdout:7/149: sync 2024-03-28T13:03:06.606 INFO:tasks.workunit.client.0.smithi076.stdout:7/150: write d1/f16 [827540,24351] 0 2024-03-28T13:03:06.607 INFO:tasks.workunit.client.0.smithi076.stdout:7/151: stat d1/l10 0 2024-03-28T13:03:06.607 INFO:tasks.workunit.client.0.smithi076.stdout:7/152: write d1/d8/f19 [1799463,46205] 0 2024-03-28T13:03:06.607 INFO:tasks.workunit.client.0.smithi076.stdout:7/153: read - d1/d8/d14/f33 zero size 2024-03-28T13:03:06.619 INFO:tasks.workunit.client.0.smithi076.stdout:9/154: dwrite d9/dd/d20/f32 [0,4194304] 0 2024-03-28T13:03:06.667 INFO:tasks.workunit.client.0.smithi076.stdout:9/155: dwrite d9/dd/df/f13 [0,4194304] 0 2024-03-28T13:03:06.951 INFO:tasks.workunit.client.0.smithi076.stdout:5/170: creat d5/f3c x:0 0 0 2024-03-28T13:03:07.049 INFO:tasks.workunit.client.0.smithi076.stdout:2/170: dread d2/d5/f12 [0,4194304] 0 2024-03-28T13:03:07.117 INFO:tasks.workunit.client.0.smithi076.stdout:7/154: creat d1/d8/f35 x:0 0 0 2024-03-28T13:03:07.331 INFO:tasks.workunit.client.0.smithi076.stdout:9/156: getdents d9/dd/df 0 2024-03-28T13:03:07.355 INFO:tasks.workunit.client.0.smithi076.stdout:9/157: dwrite d9/dd/df/d11/d14/f26 [0,4194304] 0 2024-03-28T13:03:07.356 INFO:tasks.workunit.client.0.smithi076.stdout:9/158: write f3 [2153427,118505] 0 2024-03-28T13:03:07.541 INFO:tasks.workunit.client.0.smithi076.stdout:7/155: creat d1/f36 x:0 0 0 2024-03-28T13:03:07.574 INFO:tasks.workunit.client.0.smithi076.stdout:8/118: dwrite f2 [4194304,4194304] 0 2024-03-28T13:03:07.574 INFO:tasks.workunit.client.0.smithi076.stdout:8/119: dread - de/d12/f21 zero size 2024-03-28T13:03:07.584 INFO:tasks.workunit.client.0.smithi076.stdout:7/156: dwrite d1/d8/f35 [0,4194304] 0 2024-03-28T13:03:07.584 INFO:tasks.workunit.client.0.smithi076.stdout:7/157: readlink d1/d8/l15 0 2024-03-28T13:03:07.685 INFO:tasks.workunit.client.0.smithi076.stdout:0/170: rename db/dc/df/l1b to db/l50 0 2024-03-28T13:03:07.685 INFO:tasks.workunit.client.0.smithi076.stdout:0/171: readlink l3 0 2024-03-28T13:03:07.716 INFO:tasks.workunit.client.0.smithi076.stdout:9/159: mknod d9/dd/df/d11/d18/d2a/c3a 0 2024-03-28T13:03:07.790 INFO:tasks.workunit.client.0.smithi076.stdout:8/120: creat de/d23/f26 x:0 0 0 2024-03-28T13:03:07.790 INFO:tasks.workunit.client.0.smithi076.stdout:8/121: dread - de/d23/f26 zero size 2024-03-28T13:03:07.826 INFO:tasks.workunit.client.0.smithi076.stdout:8/122: dwrite f7 [8388608,4194304] 0 2024-03-28T13:03:07.957 INFO:tasks.workunit.client.0.smithi076.stdout:7/158: getdents d1/d18 0 2024-03-28T13:03:07.997 INFO:tasks.workunit.client.0.smithi076.stdout:6/178: rename d6/da/f2e to d6/da/d23/f37 0 2024-03-28T13:03:08.103 INFO:tasks.workunit.client.0.smithi076.stdout:0/172: mkdir db/dc/df/d18/d1d/d35/d51 0 2024-03-28T13:03:08.150 INFO:tasks.workunit.client.0.smithi076.stdout:9/160: mknod d9/dd/df/d11/c3b 0 2024-03-28T13:03:08.166 INFO:tasks.workunit.client.0.smithi076.stdout:3/134: write d1/d2/d8/d14/f26 [2150570,55510] 0 2024-03-28T13:03:08.167 INFO:tasks.workunit.client.0.smithi076.stdout:9/161: dread d9/dd/df/f25 [0,4194304] 0 2024-03-28T13:03:08.171 INFO:tasks.workunit.client.0.smithi076.stdout:3/135: fsync d1/d2/d8/d14/f26 0 2024-03-28T13:03:08.172 INFO:tasks.workunit.client.0.smithi076.stdout:3/136: dread - d1/d2/d8/d14/f1f zero size 2024-03-28T13:03:08.172 INFO:tasks.workunit.client.0.smithi076.stdout:3/137: chown d1/d2/f1e 1923514510 1 2024-03-28T13:03:08.210 INFO:tasks.workunit.client.0.smithi076.stdout:8/123: unlink de/d23/f26 0 2024-03-28T13:03:08.211 INFO:tasks.workunit.client.0.smithi076.stdout:8/124: chown de/d13/c22 0 1 2024-03-28T13:03:08.271 INFO:tasks.workunit.client.0.smithi076.stdout:7/159: mkdir d1/d8/d37 0 2024-03-28T13:03:08.400 INFO:tasks.workunit.client.0.smithi076.stdout:5/171: rename d5/d9/d1c/d1d/d22/c27 to d5/c3d 0 2024-03-28T13:03:08.424 INFO:tasks.workunit.client.0.smithi076.stdout:5/172: dwrite d5/db/df/f39 [0,4194304] 0 2024-03-28T13:03:08.456 INFO:tasks.workunit.client.0.smithi076.stdout:0/173: mknod db/dc/df/d18/d1d/d35/d51/c52 0 2024-03-28T13:03:08.456 INFO:tasks.workunit.client.0.smithi076.stdout:0/174: fdatasync db/f12 0 2024-03-28T13:03:08.456 INFO:tasks.workunit.client.0.smithi076.stdout:0/175: fdatasync db/dc/df/f44 0 2024-03-28T13:03:08.460 INFO:tasks.workunit.client.0.smithi076.stdout:0/176: dread db/dc/df/f19 [0,4194304] 0 2024-03-28T13:03:08.460 INFO:tasks.workunit.client.0.smithi076.stdout:0/177: dread - db/dc/df/d18/d1d/f29 zero size 2024-03-28T13:03:08.460 INFO:tasks.workunit.client.0.smithi076.stdout:0/178: write db/f17 [762049,64175] 0 2024-03-28T13:03:08.460 INFO:tasks.workunit.client.0.smithi076.stdout:0/179: chown db/dc/df/d18/d1d/c3c 3790570 1 2024-03-28T13:03:08.460 INFO:tasks.workunit.client.0.smithi076.stdout:0/180: chown db/dc/df/d18/l3f 5077 1 2024-03-28T13:03:08.460 INFO:tasks.workunit.client.0.smithi076.stdout:0/181: write db/f17 [1742473,66213] 0 2024-03-28T13:03:08.554 INFO:tasks.workunit.client.0.smithi076.stdout:3/138: mkdir d1/d2/d8/d14/d18/d2f 0 2024-03-28T13:03:08.554 INFO:tasks.workunit.client.0.smithi076.stdout:3/139: readlink d1/d2/d8/d14/d18/l2a 0 2024-03-28T13:03:08.586 INFO:tasks.workunit.client.0.smithi076.stdout:3/140: dwrite d1/d2/d8/f29 [0,4194304] 0 2024-03-28T13:03:08.675 INFO:tasks.workunit.client.0.smithi076.stdout:7/160: mknod d1/d8/d14/c38 0 2024-03-28T13:03:08.675 INFO:tasks.workunit.client.0.smithi076.stdout:7/161: dread - d1/d18/f2a zero size 2024-03-28T13:03:08.676 INFO:tasks.workunit.client.0.smithi076.stdout:7/162: read - d1/d18/f2a zero size 2024-03-28T13:03:08.827 INFO:tasks.workunit.client.0.smithi076.stdout:6/179: rename d6/da/d1e/c27 to d6/da/d1e/d2c/c38 0 2024-03-28T13:03:08.827 INFO:tasks.workunit.client.0.smithi076.stdout:6/180: chown d6/da/f21 481 1 2024-03-28T13:03:08.827 INFO:tasks.workunit.client.0.smithi076.stdout:6/181: chown d6/f12 11399409 1 2024-03-28T13:03:08.833 INFO:tasks.workunit.client.0.smithi076.stdout:5/173: mknod d5/d9/d1c/d1d/d22/c3e 0 2024-03-28T13:03:08.833 INFO:tasks.workunit.client.0.smithi076.stdout:5/174: fsync d5/db/d19/f20 0 2024-03-28T13:03:08.979 INFO:tasks.workunit.client.0.smithi076.stdout:2/171: sync 2024-03-28T13:03:08.979 INFO:tasks.workunit.client.0.smithi076.stdout:1/176: sync 2024-03-28T13:03:08.979 INFO:tasks.workunit.client.0.smithi076.stdout:4/161: sync 2024-03-28T13:03:08.980 INFO:tasks.workunit.client.0.smithi076.stdout:4/162: write d0/db/d16/d28/f32 [544769,35494] 0 2024-03-28T13:03:08.980 INFO:tasks.workunit.client.0.smithi076.stdout:1/177: write d14/f2b [5125856,98498] 0 2024-03-28T13:03:09.159 INFO:tasks.workunit.client.0.smithi076.stdout:0/182: link db/dc/df/f1a db/dc/df/d18/d1d/d35/f53 0 2024-03-28T13:03:09.324 INFO:tasks.workunit.client.0.smithi076.stdout:3/141: mkdir d1/d7/d30 0 2024-03-28T13:03:09.387 INFO:tasks.workunit.client.0.smithi076.stdout:7/163: symlink d1/d18/l39 0 2024-03-28T13:03:09.457 INFO:tasks.workunit.client.0.smithi076.stdout:9/162: rename d9/dd/d20 to d9/d3c 0 2024-03-28T13:03:09.457 INFO:tasks.workunit.client.0.smithi076.stdout:9/163: fdatasync d9/dd/df/d11/d14/f31 0 2024-03-28T13:03:09.513 INFO:tasks.workunit.client.0.smithi076.stdout:6/182: dread d6/da/f15 [0,4194304] 0 2024-03-28T13:03:09.544 INFO:tasks.workunit.client.0.smithi076.stdout:6/183: dwrite d6/f10 [4194304,4194304] 0 2024-03-28T13:03:09.544 INFO:tasks.workunit.client.0.smithi076.stdout:6/184: fsync d6/fb 0 2024-03-28T13:03:09.544 INFO:tasks.workunit.client.0.smithi076.stdout:6/185: chown d6/da/d1e/d2c/f30 116463832 1 2024-03-28T13:03:09.544 INFO:tasks.workunit.client.0.smithi076.stdout:6/186: dread - d6/f33 zero size 2024-03-28T13:03:09.544 INFO:tasks.workunit.client.0.smithi076.stdout:6/187: read - d6/da/f14 zero size 2024-03-28T13:03:09.544 INFO:tasks.workunit.client.0.smithi076.stdout:6/188: chown d6/da/d1e/f2b 42 1 2024-03-28T13:03:09.568 INFO:tasks.workunit.client.0.smithi076.stdout:5/175: mkdir d5/db/d3f 0 2024-03-28T13:03:09.604 INFO:tasks.workunit.client.0.smithi076.stdout:8/125: sync 2024-03-28T13:03:09.639 INFO:tasks.workunit.client.0.smithi076.stdout:1/178: mknod d14/d2a/d2e/c40 0 2024-03-28T13:03:09.640 INFO:tasks.workunit.client.0.smithi076.stdout:1/179: truncate d14/f26 466594 0 2024-03-28T13:03:09.640 INFO:tasks.workunit.client.0.smithi076.stdout:1/180: chown d14/f2f 13867 1 2024-03-28T13:03:09.846 INFO:tasks.workunit.client.0.smithi076.stdout:0/183: rmdir db/dc/df/d18/d48 0 2024-03-28T13:03:09.846 INFO:tasks.workunit.client.0.smithi076.stdout:0/184: truncate db/f4b 504878 0 2024-03-28T13:03:09.846 INFO:tasks.workunit.client.0.smithi076.stdout:7/164: link d1/c1f d1/d18/d2d/c3a 0 2024-03-28T13:03:09.886 INFO:tasks.workunit.client.0.smithi076.stdout:0/185: dwrite db/dc/fd [0,4194304] 0 2024-03-28T13:03:09.966 INFO:tasks.workunit.client.0.smithi076.stdout:9/164: creat d9/dd/df/d11/d18/f3d x:0 0 0 2024-03-28T13:03:09.991 INFO:tasks.workunit.client.0.smithi076.stdout:6/189: mkdir d6/da/d39 0 2024-03-28T13:03:10.079 INFO:tasks.workunit.client.0.smithi076.stdout:5/176: creat d5/d9/f40 x:0 0 0 2024-03-28T13:03:10.132 INFO:tasks.workunit.client.0.smithi076.stdout:8/126: mkdir de/d13/d27 0 2024-03-28T13:03:10.165 INFO:tasks.workunit.client.0.smithi076.stdout:1/181: mknod d14/c41 0 2024-03-28T13:03:10.263 INFO:tasks.workunit.client.0.smithi076.stdout:3/142: rename d1/d2/f20 to d1/d2/f31 0 2024-03-28T13:03:10.334 INFO:tasks.workunit.client.0.smithi076.stdout:7/165: rmdir d1/d18 39 2024-03-28T13:03:10.386 INFO:tasks.workunit.client.0.smithi076.stdout:0/186: creat db/d16/f54 x:0 0 0 2024-03-28T13:03:10.446 INFO:tasks.workunit.client.0.smithi076.stdout:9/165: mknod d9/d3c/c3e 0 2024-03-28T13:03:10.446 INFO:tasks.workunit.client.0.smithi076.stdout:9/166: chown d9/c33 16527 1 2024-03-28T13:03:10.447 INFO:tasks.workunit.client.0.smithi076.stdout:9/167: dread - d9/dd/df/d11/d18/f21 zero size 2024-03-28T13:03:10.484 INFO:tasks.workunit.client.0.smithi076.stdout:6/190: creat d6/f3a x:0 0 0 2024-03-28T13:03:10.484 INFO:tasks.workunit.client.0.smithi076.stdout:6/191: dread - d6/f24 zero size 2024-03-28T13:03:10.489 INFO:tasks.workunit.client.0.smithi076.stdout:6/192: dread d6/da/d1e/f1f [0,4194304] 0 2024-03-28T13:03:10.534 INFO:tasks.workunit.client.0.smithi076.stdout:5/177: mknod d5/db/d19/d34/c41 0 2024-03-28T13:03:10.576 INFO:tasks.workunit.client.0.smithi076.stdout:8/127: mknod de/d13/d27/c28 0 2024-03-28T13:03:10.576 INFO:tasks.workunit.client.0.smithi076.stdout:4/163: dwrite d0/db/d2d/f35 [0,4194304] 0 2024-03-28T13:03:10.576 INFO:tasks.workunit.client.0.smithi076.stdout:4/164: fsync d0/db/f18 0 2024-03-28T13:03:10.596 INFO:tasks.workunit.client.0.smithi076.stdout:4/165: dread d0/f2 [0,4194304] 0 2024-03-28T13:03:10.599 INFO:tasks.workunit.client.0.smithi076.stdout:4/166: write d0/f9 [1188418,28613] 0 2024-03-28T13:03:10.630 INFO:tasks.workunit.client.0.smithi076.stdout:1/182: symlink d14/d2a/l42 0 2024-03-28T13:03:10.630 INFO:tasks.workunit.client.0.smithi076.stdout:1/183: chown d14/d2a/d2e/c40 20 1 2024-03-28T13:03:10.630 INFO:tasks.workunit.client.0.smithi076.stdout:1/184: dread - d14/d2a/d2e/f3e zero size 2024-03-28T13:03:10.772 INFO:tasks.workunit.client.0.smithi076.stdout:7/166: mknod d1/d18/c3b 0 2024-03-28T13:03:10.772 INFO:tasks.workunit.client.0.smithi076.stdout:2/172: sync 2024-03-28T13:03:10.772 INFO:tasks.workunit.client.0.smithi076.stdout:7/167: readlink d1/l10 0 2024-03-28T13:03:10.779 INFO:tasks.workunit.client.0.smithi076.stdout:0/187: link db/dc/df/l26 db/dc/d3d/d46/l55 0 2024-03-28T13:03:10.779 INFO:tasks.workunit.client.0.smithi076.stdout:0/188: write db/dc/df/d11/d40/f42 [777638,126544] 0 2024-03-28T13:03:10.811 INFO:tasks.workunit.client.0.smithi076.stdout:7/168: dwrite d1/f16 [0,4194304] 0 2024-03-28T13:03:10.835 INFO:tasks.workunit.client.0.smithi076.stdout:9/168: rename d9/dd/c1f to d9/dd/df/d11/d14/c3f 0 2024-03-28T13:03:10.854 INFO:tasks.workunit.client.0.smithi076.stdout:9/169: dread d9/dd/df/f13 [0,4194304] 0 2024-03-28T13:03:10.881 INFO:tasks.workunit.client.0.smithi076.stdout:9/170: dwrite d9/dd/df/d11/d18/f3d [0,4194304] 0 2024-03-28T13:03:10.908 INFO:tasks.workunit.client.0.smithi076.stdout:9/171: write d9/dd/df/d11/d37/f1d [310586,74933] 0 2024-03-28T13:03:10.930 INFO:tasks.workunit.client.0.smithi076.stdout:9/172: write d9/dd/df/d11/d14/f26 [2815733,94046] 0 2024-03-28T13:03:10.947 INFO:tasks.workunit.client.0.smithi076.stdout:9/173: dread d9/f36 [0,4194304] 0 2024-03-28T13:03:10.947 INFO:tasks.workunit.client.0.smithi076.stdout:9/174: chown d9/dd/df/d11/c3b 1548 1 2024-03-28T13:03:10.962 INFO:tasks.workunit.client.0.smithi076.stdout:6/193: creat d6/da/d39/f3b x:0 0 0 2024-03-28T13:03:10.965 INFO:tasks.workunit.client.0.smithi076.stdout:9/175: write d9/dd/f2e [1715384,78659] 0 2024-03-28T13:03:10.991 INFO:tasks.workunit.client.0.smithi076.stdout:6/194: dwrite d6/f10 [4194304,4194304] 0 2024-03-28T13:03:11.041 INFO:tasks.workunit.client.0.smithi076.stdout:5/178: mkdir d5/db/d3f/d42 0 2024-03-28T13:03:11.611 INFO:tasks.workunit.client.0.smithi076.stdout:8/128: getdents de/d12 0 2024-03-28T13:03:11.612 INFO:tasks.workunit.client.0.smithi076.stdout:8/129: read de/d12/f15 [3817229,40768] 0 2024-03-28T13:03:11.612 INFO:tasks.workunit.client.0.smithi076.stdout:8/130: fdatasync f2 0 2024-03-28T13:03:11.614 INFO:tasks.workunit.client.0.smithi076.stdout:2/173: mknod d2/d5/d7/d28/c34 0 2024-03-28T13:03:11.614 INFO:tasks.workunit.client.0.smithi076.stdout:0/189: mknod db/dc/df/d18/d1d/d35/d51/c56 0 2024-03-28T13:03:11.616 INFO:tasks.workunit.client.0.smithi076.stdout:4/167: rename d0/db/d16/d28/f2e to d0/db/d2d/f3a 0 2024-03-28T13:03:11.617 INFO:tasks.workunit.client.0.smithi076.stdout:6/195: link d6/da/d1e/d2c/f34 d6/f3c 0 2024-03-28T13:03:11.653 INFO:tasks.workunit.client.0.smithi076.stdout:1/185: dwrite f5 [0,4194304] 0 2024-03-28T13:03:11.660 INFO:tasks.workunit.client.0.smithi076.stdout:2/174: dwrite d2/d5/db/f1b [0,4194304] 0 2024-03-28T13:03:11.706 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:03:11.709 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:03:11.896 INFO:tasks.workunit.client.0.smithi076.stdout:8/131: creat de/d13/d27/f29 x:0 0 0 2024-03-28T13:03:11.896 INFO:tasks.workunit.client.0.smithi076.stdout:8/132: chown de/d25 1186471 1 2024-03-28T13:03:11.896 INFO:tasks.workunit.client.0.smithi076.stdout:8/133: fsync de/d12/f21 0 2024-03-28T13:03:11.896 INFO:tasks.workunit.client.0.smithi076.stdout:8/134: readlink de/d12/l24 0 2024-03-28T13:03:11.987 INFO:tasks.workunit.client.0.smithi076.stdout:4/168: mkdir d0/d3b 0 2024-03-28T13:03:12.042 INFO:tasks.workunit.client.0.smithi076.stdout:6/196: creat d6/da/d1e/f3d x:0 0 0 2024-03-28T13:03:12.075 INFO:tasks.workunit.client.0.smithi076.stdout:6/197: dwrite d6/da/d1e/d2c/f30 [0,4194304] 0 2024-03-28T13:03:12.075 INFO:tasks.workunit.client.0.smithi076.stdout:6/198: chown d6/da/l1d 3409 1 2024-03-28T13:03:12.075 INFO:tasks.workunit.client.0.smithi076.stdout:6/199: write d6/da/d1e/f31 [38926,104934] 0 2024-03-28T13:03:12.802 INFO:tasks.workunit.client.0.smithi076.stdout:8/135: mknod de/d12/d18/c2a 0 2024-03-28T13:03:12.827 INFO:tasks.workunit.client.0.smithi076.stdout:8/136: dwrite de/d12/f21 [0,4194304] 0 2024-03-28T13:03:12.860 INFO:tasks.workunit.client.0.smithi076.stdout:4/169: truncate d0/db/d16/f37 72577 0 2024-03-28T13:03:13.233 INFO:tasks.workunit.client.0.smithi076.stdout:6/200: link d6/da/d1e/f28 d6/da/d1e/d2c/f3e 0 2024-03-28T13:03:13.261 INFO:tasks.workunit.client.0.smithi076.stdout:6/201: write d6/f22 [3011910,40776] 0 2024-03-28T13:03:13.280 INFO:tasks.workunit.client.0.smithi076.stdout:6/202: dread d6/f22 [0,4194304] 0 2024-03-28T13:03:13.280 INFO:tasks.workunit.client.0.smithi076.stdout:6/203: write d6/fb [4492306,63499] 0 2024-03-28T13:03:13.280 INFO:tasks.workunit.client.0.smithi076.stdout:6/204: stat d6/da/d23/f32 0 2024-03-28T13:03:13.347 INFO:tasks.workunit.client.0.smithi076.stdout:3/143: write d1/d2/f1e [2860691,46955] 0 2024-03-28T13:03:13.347 INFO:tasks.workunit.client.0.smithi076.stdout:3/144: write d1/d2/d6/f19 [1639468,2016] 0 2024-03-28T13:03:13.510 INFO:tasks.workunit.client.0.smithi076.stdout:5/179: dwrite d5/db/f2a [0,4194304] 0 2024-03-28T13:03:13.541 INFO:tasks.workunit.client.0.smithi076.stdout:5/180: dwrite d5/d9/f40 [0,4194304] 0 2024-03-28T13:03:13.789 INFO:tasks.workunit.client.0.smithi076.stdout:1/186: dwrite f5 [4194304,4194304] 0 2024-03-28T13:03:13.789 INFO:tasks.workunit.client.0.smithi076.stdout:0/190: mkdir db/dc/d3d/d57 0 2024-03-28T13:03:13.802 INFO:tasks.workunit.client.0.smithi076.stdout:0/191: dread db/dc/fd [0,4194304] 0 2024-03-28T13:03:14.140 INFO:tasks.workunit.client.0.smithi076.stdout:4/170: rename d0/db/d38 to d0/db/d3c 0 2024-03-28T13:03:14.140 INFO:tasks.workunit.client.0.smithi076.stdout:6/205: symlink d6/da/d1e/l3f 0 2024-03-28T13:03:14.140 INFO:tasks.workunit.client.0.smithi076.stdout:6/206: dread - d6/f3a zero size 2024-03-28T13:03:14.140 INFO:tasks.workunit.client.0.smithi076.stdout:6/207: chown d6/c16 342 1 2024-03-28T13:03:14.140 INFO:tasks.workunit.client.0.smithi076.stdout:6/208: write d6/da/f1c [4817374,91477] 0 2024-03-28T13:03:14.143 INFO:tasks.workunit.client.0.smithi076.stdout:4/171: dread d0/db/d16/f24 [0,4194304] 0 2024-03-28T13:03:14.162 INFO:tasks.workunit.client.0.smithi076.stdout:5/181: mkdir d5/db/d3f/d42/d43 0 2024-03-28T13:03:14.162 INFO:tasks.workunit.client.0.smithi076.stdout:3/145: rmdir d1/d2/d8 39 2024-03-28T13:03:14.162 INFO:tasks.workunit.client.0.smithi076.stdout:1/187: creat d14/d2a/d2e/d31/d3b/f43 x:0 0 0 2024-03-28T13:03:14.162 INFO:tasks.workunit.client.0.smithi076.stdout:3/146: write d1/d2/f1e [4191760,23427] 0 2024-03-28T13:03:14.162 INFO:tasks.workunit.client.0.smithi076.stdout:3/147: chown d1 119899067 1 2024-03-28T13:03:14.174 INFO:tasks.workunit.client.0.smithi076.stdout:6/209: dwrite d6/f12 [0,4194304] 0 2024-03-28T13:03:14.186 INFO:tasks.workunit.client.0.smithi076.stdout:5/182: dread d5/fa [0,4194304] 0 2024-03-28T13:03:14.205 INFO:tasks.workunit.client.0.smithi076.stdout:0/192: link db/dc/df/d18/d1d/d35/f39 db/dc/d3d/d46/f58 0 2024-03-28T13:03:14.258 INFO:tasks.workunit.client.0.smithi076.stdout:0/193: dwrite db/dc/fe [0,4194304] 0 2024-03-28T13:03:14.261 INFO:tasks.workunit.client.0.smithi076.stdout:0/194: write db/f17 [870848,16142] 0 2024-03-28T13:03:14.590 INFO:tasks.workunit.client.0.smithi076.stdout:4/172: mknod d0/c3d 0 2024-03-28T13:03:14.590 INFO:tasks.workunit.client.0.smithi076.stdout:3/148: creat d1/d7/f32 x:0 0 0 2024-03-28T13:03:14.591 INFO:tasks.workunit.client.0.smithi076.stdout:4/173: write d0/f1f [62223,67683] 0 2024-03-28T13:03:14.593 INFO:tasks.workunit.client.0.smithi076.stdout:3/149: dread d1/d2/d8/fc [0,4194304] 0 2024-03-28T13:03:14.607 INFO:tasks.workunit.client.0.smithi076.stdout:4/174: dread d0/db/f18 [0,4194304] 0 2024-03-28T13:03:14.607 INFO:tasks.workunit.client.0.smithi076.stdout:4/175: write d0/db/d16/f24 [1190870,62932] 0 2024-03-28T13:03:14.607 INFO:tasks.workunit.client.0.smithi076.stdout:4/176: chown d0/db/d16/d28/f32 3015 1 2024-03-28T13:03:14.619 INFO:tasks.workunit.client.0.smithi076.stdout:4/177: dread d0/db/d16/f1b [0,4194304] 0 2024-03-28T13:03:14.619 INFO:tasks.workunit.client.0.smithi076.stdout:4/178: chown d0/db/d16/f19 220199 1 2024-03-28T13:03:14.619 INFO:tasks.workunit.client.0.smithi076.stdout:4/179: write d0/f9 [232242,107940] 0 2024-03-28T13:03:14.619 INFO:tasks.workunit.client.0.smithi076.stdout:4/180: chown d0/db/d16 11782 1 2024-03-28T13:03:14.632 INFO:tasks.workunit.client.0.smithi076.stdout:6/210: mkdir d6/da/d40 0 2024-03-28T13:03:14.642 INFO:tasks.workunit.client.0.smithi076.stdout:7/169: rmdir d1/dc 39 2024-03-28T13:03:14.642 INFO:tasks.workunit.client.0.smithi076.stdout:7/170: stat d1/d8/d37 0 2024-03-28T13:03:14.642 INFO:tasks.workunit.client.0.smithi076.stdout:9/176: rename d9/cc to d9/dd/df/d11/d14/c40 0 2024-03-28T13:03:14.642 INFO:tasks.workunit.client.0.smithi076.stdout:5/183: link d5/d9/d1c/f32 d5/d9/d35/d3b/f44 0 2024-03-28T13:03:14.898 INFO:tasks.workunit.client.0.smithi076.stdout:0/195: symlink db/dc/df/d18/d1d/d35/l59 0 2024-03-28T13:03:14.898 INFO:tasks.workunit.client.0.smithi076.stdout:3/150: mknod d1/d7/d30/c33 0 2024-03-28T13:03:14.898 INFO:tasks.workunit.client.0.smithi076.stdout:4/181: creat d0/db/d3c/f3e x:0 0 0 2024-03-28T13:03:14.898 INFO:tasks.workunit.client.0.smithi076.stdout:4/182: fdatasync d0/f15 0 2024-03-28T13:03:14.898 INFO:tasks.workunit.client.0.smithi076.stdout:0/196: write db/dc/df/d11/d40/f42 [1087633,64064] 0 2024-03-28T13:03:14.898 INFO:tasks.workunit.client.0.smithi076.stdout:0/197: dread - db/dc/df/d18/f4e zero size 2024-03-28T13:03:14.899 INFO:tasks.workunit.client.0.smithi076.stdout:9/177: creat d9/dd/df/d11/d18/f41 x:0 0 0 2024-03-28T13:03:14.899 INFO:tasks.workunit.client.0.smithi076.stdout:0/198: dread db/dc/df/d11/f3b [0,4194304] 0 2024-03-28T13:03:14.899 INFO:tasks.workunit.client.0.smithi076.stdout:5/184: rmdir d5/d9/d35/d3b 39 2024-03-28T13:03:14.912 INFO:tasks.workunit.client.0.smithi076.stdout:9/178: dread d9/dd/df/d11/d37/f1d [0,4194304] 0 2024-03-28T13:03:15.480 INFO:tasks.workunit.client.0.smithi076.stdout:3/151: symlink d1/d7/l34 0 2024-03-28T13:03:15.524 INFO:tasks.workunit.client.0.smithi076.stdout:4/183: creat d0/db/d16/f3f x:0 0 0 2024-03-28T13:03:15.641 INFO:tasks.workunit.client.0.smithi076.stdout:1/188: rename f13 to d14/d2a/d2e/d31/d3b/f44 0 2024-03-28T13:03:15.710 INFO:tasks.workunit.client.0.smithi076.stdout:5/185: link d5/db/c1e d5/db/d3f/d42/c45 0 2024-03-28T13:03:15.720 INFO:tasks.workunit.client.0.smithi076.stdout:9/179: dread d9/dd/df/d11/d14/f16 [0,4194304] 0 2024-03-28T13:03:15.736 INFO:tasks.workunit.client.0.smithi076.stdout:5/186: dwrite d5/d9/d1c/d25/f2b [0,4194304] 0 2024-03-28T13:03:15.826 INFO:tasks.workunit.client.0.smithi076.stdout:3/152: creat d1/d2/d8/f35 x:0 0 0 2024-03-28T13:03:15.828 INFO:tasks.workunit.client.0.smithi076.stdout:2/175: sync 2024-03-28T13:03:15.829 INFO:tasks.workunit.client.0.smithi076.stdout:8/137: sync 2024-03-28T13:03:15.856 INFO:tasks.workunit.client.0.smithi076.stdout:4/184: mkdir d0/d3b/d40 0 2024-03-28T13:03:15.857 INFO:tasks.workunit.client.0.smithi076.stdout:4/185: readlink d0/db/l1c 0 2024-03-28T13:03:15.857 INFO:tasks.workunit.client.0.smithi076.stdout:4/186: write d0/db/d3c/f3e [104971,96559] 0 2024-03-28T13:03:15.857 INFO:tasks.workunit.client.0.smithi076.stdout:4/187: truncate d0/f1e 582532 0 2024-03-28T13:03:15.937 INFO:tasks.workunit.client.0.smithi076.stdout:7/171: rename d1/d8/d14 to d1/d18/d3c 0 2024-03-28T13:03:16.044 INFO:tasks.workunit.client.0.smithi076.stdout:0/199: rename db/d16/l47 to db/d16/l5a 0 2024-03-28T13:03:16.044 INFO:tasks.workunit.client.0.smithi076.stdout:0/200: truncate db/dc/d3d/d46/f58 156431 0 2024-03-28T13:03:16.045 INFO:tasks.workunit.client.0.smithi076.stdout:0/201: truncate db/dc/df/d18/d1d/d35/f39 1015849 0 2024-03-28T13:03:16.060 INFO:tasks.workunit.client.0.smithi076.stdout:0/202: dread db/dc/fe [0,4194304] 0 2024-03-28T13:03:16.414 INFO:tasks.workunit.client.0.smithi076.stdout:9/180: stat d9/da/l23 0 2024-03-28T13:03:16.415 INFO:tasks.workunit.client.0.smithi076.stdout:9/181: read f7 [17983,21574] 0 2024-03-28T13:03:16.437 INFO:tasks.workunit.client.0.smithi076.stdout:9/182: dwrite d9/dd/df/d11/d18/f41 [0,4194304] 0 2024-03-28T13:03:16.561 INFO:tasks.workunit.client.0.smithi076.stdout:8/138: mkdir de/d23/d2b 0 2024-03-28T13:03:16.561 INFO:tasks.workunit.client.0.smithi076.stdout:8/139: readlink de/d12/l19 0 2024-03-28T13:03:16.561 INFO:tasks.workunit.client.0.smithi076.stdout:8/140: fsync fa 0 2024-03-28T13:03:16.616 INFO:tasks.workunit.client.0.smithi076.stdout:4/188: symlink d0/db/d16/d31/l41 0 2024-03-28T13:03:16.616 INFO:tasks.workunit.client.0.smithi076.stdout:4/189: stat d0/db/d16/d31/l33 0 2024-03-28T13:03:16.630 INFO:tasks.workunit.client.0.smithi076.stdout:4/190: dread d0/db/d3c/f3e [0,4194304] 0 2024-03-28T13:03:16.630 INFO:tasks.workunit.client.0.smithi076.stdout:4/191: chown d0/d3b/d40 28684341 1 2024-03-28T13:03:16.709 INFO:tasks.workunit.client.0.smithi076.stdout:0/203: creat db/dc/d3d/d57/f5b x:0 0 0 2024-03-28T13:03:16.736 INFO:tasks.workunit.client.0.smithi076.stdout:6/211: sync 2024-03-28T13:03:16.977 INFO:tasks.workunit.client.0.smithi076.stdout:9/183: truncate d9/d3c/f32 2694225 0 2024-03-28T13:03:17.111 INFO:tasks.workunit.client.0.smithi076.stdout:8/141: mkdir de/d23/d2b/d2c 0 2024-03-28T13:03:17.125 INFO:tasks.workunit.client.0.smithi076.stdout:1/189: rename l9 to d14/d2a/d2e/d3c/l45 0 2024-03-28T13:03:17.465 INFO:tasks.workunit.client.0.smithi076.stdout:2/176: mknod d2/d5/d7/c35 0 2024-03-28T13:03:17.645 INFO:tasks.workunit.client.0.smithi076.stdout:9/184: symlink d9/d3c/l42 0 2024-03-28T13:03:17.742 INFO:tasks.workunit.client.0.smithi076.stdout:5/187: rename d5/db/df/f39 to d5/db/f46 0 2024-03-28T13:03:17.772 INFO:tasks.workunit.client.0.smithi076.stdout:1/190: stat d14/d19/c24 0 2024-03-28T13:03:17.927 INFO:tasks.workunit.client.0.smithi076.stdout:5/188: creat d5/d9/d1c/d25/f47 x:0 0 0 2024-03-28T13:03:18.228 INFO:tasks.workunit.client.0.smithi076.stdout:1/191: mkdir d14/d2a/d2e/d31/d46 0 2024-03-28T13:03:18.269 INFO:tasks.workunit.client.0.smithi076.stdout:5/189: mknod d5/d9/d35/d3b/c48 0 2024-03-28T13:03:18.298 INFO:tasks.workunit.client.0.smithi076.stdout:5/190: dwrite f3 [4194304,4194304] 0 2024-03-28T13:03:18.298 INFO:tasks.workunit.client.0.smithi076.stdout:5/191: dread - d5/d9/d1c/d25/f3a zero size 2024-03-28T13:03:18.320 INFO:tasks.workunit.client.0.smithi076.stdout:5/192: dread d5/db/f2a [0,4194304] 0 2024-03-28T13:03:18.362 INFO:tasks.workunit.client.0.smithi076.stdout:5/193: dwrite d5/fa [0,4194304] 0 2024-03-28T13:03:18.614 INFO:tasks.workunit.client.0.smithi076.stdout:1/192: creat d14/d19/f47 x:0 0 0 2024-03-28T13:03:18.791 INFO:tasks.workunit.client.0.smithi076.stdout:8/142: sync 2024-03-28T13:03:18.792 INFO:tasks.workunit.client.0.smithi076.stdout:0/204: sync 2024-03-28T13:03:18.792 INFO:tasks.workunit.client.0.smithi076.stdout:8/143: write de/d12/d18/f1a [482741,33770] 0 2024-03-28T13:03:18.792 INFO:tasks.workunit.client.0.smithi076.stdout:8/144: fdatasync fd 0 2024-03-28T13:03:19.126 INFO:tasks.workunit.client.0.smithi076.stdout:5/194: mknod d5/db/d19/c49 0 2024-03-28T13:03:19.126 INFO:tasks.workunit.client.0.smithi076.stdout:1/193: rmdir d14/d2a/d2e 39 2024-03-28T13:03:19.126 INFO:tasks.workunit.client.0.smithi076.stdout:0/205: creat db/dc/d3d/d46/d4a/f5c x:0 0 0 2024-03-28T13:03:19.147 INFO:tasks.workunit.client.0.smithi076.stdout:8/145: mknod de/d23/d2b/c2d 0 2024-03-28T13:03:19.147 INFO:tasks.workunit.client.0.smithi076.stdout:3/153: rename d1/d2/d6 to d1/d2/d8/d14/d36 0 2024-03-28T13:03:19.148 INFO:tasks.workunit.client.0.smithi076.stdout:3/154: stat d1/d2/d8 0 2024-03-28T13:03:19.158 INFO:tasks.workunit.client.0.smithi076.stdout:2/177: symlink d2/l36 0 2024-03-28T13:03:19.172 INFO:tasks.workunit.client.0.smithi076.stdout:1/194: dwrite d14/d19/f34 [0,4194304] 0 2024-03-28T13:03:19.304 INFO:tasks.workunit.client.0.smithi076.stdout:8/146: creat de/d13/d27/f2e x:0 0 0 2024-03-28T13:03:19.306 INFO:tasks.workunit.client.0.smithi076.stdout:0/206: dread db/f4b [0,4194304] 0 2024-03-28T13:03:19.308 INFO:tasks.workunit.client.0.smithi076.stdout:7/172: rename d1/d18/f2a to d1/f3d 0 2024-03-28T13:03:19.308 INFO:tasks.workunit.client.0.smithi076.stdout:7/173: truncate d1/f4 6052151 0 2024-03-28T13:03:19.348 INFO:tasks.workunit.client.0.smithi076.stdout:8/147: dwrite de/d13/d27/f29 [0,4194304] 0 2024-03-28T13:03:19.348 INFO:tasks.workunit.client.0.smithi076.stdout:8/148: chown de/cf 452004562 1 2024-03-28T13:03:19.392 INFO:tasks.workunit.client.0.smithi076.stdout:8/149: dwrite de/d13/d27/f29 [0,4194304] 0 2024-03-28T13:03:19.494 INFO:tasks.workunit.client.0.smithi076.stdout:7/174: rmdir d1/dc 39 2024-03-28T13:03:19.494 INFO:tasks.workunit.client.0.smithi076.stdout:7/175: stat d1/d18/c29 0 2024-03-28T13:03:19.494 INFO:tasks.workunit.client.0.smithi076.stdout:4/192: rename d0/db/d16 to d0/d3b/d40/d42 0 2024-03-28T13:03:19.494 INFO:tasks.workunit.client.0.smithi076.stdout:4/193: write d0/db/f23 [942889,121983] 0 2024-03-28T13:03:19.690 INFO:tasks.workunit.client.0.smithi076.stdout:8/150: symlink de/d12/d18/l2f 0 2024-03-28T13:03:19.706 INFO:tasks.workunit.client.0.smithi076.stdout:7/176: creat d1/dc/f3e x:0 0 0 2024-03-28T13:03:19.706 INFO:tasks.workunit.client.0.smithi076.stdout:4/194: creat d0/f43 x:0 0 0 2024-03-28T13:03:19.706 INFO:tasks.workunit.client.0.smithi076.stdout:4/195: readlink d0/d3b/d40/d42/d31/l41 0 2024-03-28T13:03:19.706 INFO:tasks.workunit.client.0.smithi076.stdout:6/212: rename d6/da/d1e/d2c to d6/da/d39/d41 0 2024-03-28T13:03:19.785 INFO:tasks.workunit.client.0.smithi076.stdout:4/196: dwrite d0/db/d2d/f35 [0,4194304] 0 2024-03-28T13:03:19.937 INFO:tasks.workunit.client.0.smithi076.stdout:2/178: write d2/d5/f12 [8128911,48903] 0 2024-03-28T13:03:19.959 INFO:tasks.workunit.client.0.smithi076.stdout:2/179: write d2/d5/db/f1b [840980,57362] 0 2024-03-28T13:03:19.975 INFO:tasks.workunit.client.0.smithi076.stdout:7/177: mknod d1/d18/c3f 0 2024-03-28T13:03:19.975 INFO:tasks.workunit.client.0.smithi076.stdout:7/178: write d1/dc/f2b [306214,59327] 0 2024-03-28T13:03:19.975 INFO:tasks.workunit.client.0.smithi076.stdout:7/179: dread - d1/dc/f3e zero size 2024-03-28T13:03:19.975 INFO:tasks.workunit.client.0.smithi076.stdout:7/180: readlink d1/d18/l39 0 2024-03-28T13:03:19.975 INFO:tasks.workunit.client.0.smithi076.stdout:7/181: chown d1/d8/f35 5294 1 2024-03-28T13:03:19.975 INFO:tasks.workunit.client.0.smithi076.stdout:7/182: write d1/f13 [1304925,11084] 0 2024-03-28T13:03:20.067 INFO:tasks.workunit.client.0.smithi076.stdout:1/195: truncate d14/d19/f34 3677646 0 2024-03-28T13:03:20.067 INFO:tasks.workunit.client.0.smithi076.stdout:6/213: unlink d6/f10 0 2024-03-28T13:03:20.067 INFO:tasks.workunit.client.0.smithi076.stdout:6/214: stat d6/f33 0 2024-03-28T13:03:20.085 INFO:tasks.workunit.client.0.smithi076.stdout:1/196: dread d14/d2a/d2e/d31/f39 [0,4194304] 0 2024-03-28T13:03:20.180 INFO:tasks.workunit.client.0.smithi076.stdout:9/185: rename d9/dd/df/d11/d18/f41 to d9/d3c/f43 0 2024-03-28T13:03:20.181 INFO:tasks.workunit.client.0.smithi076.stdout:5/195: rename d5/d9/d35 to d5/d9/d35/d3b/d4a 22 2024-03-28T13:03:20.384 INFO:tasks.workunit.client.0.smithi076.stdout:4/197: link d0/c1 d0/c44 0 2024-03-28T13:03:20.384 INFO:tasks.workunit.client.0.smithi076.stdout:2/180: mknod d2/d5/d7/d28/c37 0 2024-03-28T13:03:20.384 INFO:tasks.workunit.client.0.smithi076.stdout:4/198: write d0/db/f23 [1777623,72537] 0 2024-03-28T13:03:20.384 INFO:tasks.workunit.client.0.smithi076.stdout:2/181: write d2/d5/f12 [7162846,129480] 0 2024-03-28T13:03:20.399 INFO:tasks.workunit.client.0.smithi076.stdout:4/199: dread d0/f1f [0,4194304] 0 2024-03-28T13:03:20.547 INFO:tasks.workunit.client.0.smithi076.stdout:7/183: creat d1/f40 x:0 0 0 2024-03-28T13:03:20.547 INFO:tasks.workunit.client.0.smithi076.stdout:7/184: chown d1/f26 921418772 1 2024-03-28T13:03:20.575 INFO:tasks.workunit.client.0.smithi076.stdout:1/197: dwrite f8 [4194304,4194304] 0 2024-03-28T13:03:20.587 INFO:tasks.workunit.client.0.smithi076.stdout:7/185: dwrite d1/f13 [0,4194304] 0 2024-03-28T13:03:20.587 INFO:tasks.workunit.client.0.smithi076.stdout:7/186: truncate d1/d8/f1e 1561729 0 2024-03-28T13:03:20.640 INFO:tasks.workunit.client.0.smithi076.stdout:9/186: link d9/dd/df/d11/d18/d2a/f30 d9/dd/df/d11/d18/d2a/f44 0 2024-03-28T13:03:20.708 INFO:tasks.workunit.client.0.smithi076.stdout:3/155: rename d1/d2/l25 to d1/d2/d8/d14/d27/l37 0 2024-03-28T13:03:20.721 INFO:tasks.workunit.client.0.smithi076.stdout:3/156: dread d1/f1b [0,4194304] 0 2024-03-28T13:03:20.721 INFO:tasks.workunit.client.0.smithi076.stdout:3/157: fsync d1/d2/d8/d14/f26 0 2024-03-28T13:03:20.721 INFO:tasks.workunit.client.0.smithi076.stdout:3/158: chown d1/d2/d8/d14/d18/l2a 0 1 2024-03-28T13:03:20.934 INFO:tasks.workunit.client.0.smithi076.stdout:5/196: mknod d5/db/d19/c4b 0 2024-03-28T13:03:20.934 INFO:tasks.workunit.client.0.smithi076.stdout:5/197: stat d5/db/df/c21 0 2024-03-28T13:03:20.934 INFO:tasks.workunit.client.0.smithi076.stdout:2/182: mknod d2/d1d/c38 0 2024-03-28T13:03:20.947 INFO:tasks.workunit.client.0.smithi076.stdout:4/200: getdents d0/db/d2d 0 2024-03-28T13:03:21.020 INFO:tasks.workunit.client.0.smithi076.stdout:1/198: chown l11 109236 1 2024-03-28T13:03:21.035 INFO:tasks.workunit.client.0.smithi076.stdout:7/187: mknod d1/d8/c41 0 2024-03-28T13:03:21.035 INFO:tasks.workunit.client.0.smithi076.stdout:7/188: write d1/dc/ff [1727987,12031] 0 2024-03-28T13:03:21.035 INFO:tasks.workunit.client.0.smithi076.stdout:7/189: dread - d1/d18/d2d/f34 zero size 2024-03-28T13:03:21.044 INFO:tasks.workunit.client.0.smithi076.stdout:9/187: unlink d9/d3c/c3e 0 2024-03-28T13:03:21.044 INFO:tasks.workunit.client.0.smithi076.stdout:0/207: rename l6 to db/dc/df/d18/d1d/d21/l5d 0 2024-03-28T13:03:21.582 INFO:tasks.workunit.client.0.smithi076.stdout:2/183: rmdir d2/d5/d7/d28 39 2024-03-28T13:03:21.643 INFO:tasks.workunit.client.0.smithi076.stdout:4/201: symlink d0/d3b/d40/d42/d31/l45 0 2024-03-28T13:03:21.985 INFO:tasks.workunit.client.0.smithi076.stdout:7/190: symlink d1/d8/d37/l42 0 2024-03-28T13:03:21.985 INFO:tasks.workunit.client.0.smithi076.stdout:7/191: dread - d1/d18/d3c/f33 zero size 2024-03-28T13:03:22.007 INFO:tasks.workunit.client.0.smithi076.stdout:7/192: dwrite d1/f5 [4194304,4194304] 0 2024-03-28T13:03:22.309 INFO:tasks.workunit.client.0.smithi076.stdout:5/198: mkdir d5/d9/d4c 0 2024-03-28T13:03:22.415 INFO:tasks.workunit.client.0.smithi076.stdout:2/184: mkdir d2/d1d/d39 0 2024-03-28T13:03:22.631 INFO:tasks.workunit.client.0.smithi076.stdout:7/193: creat d1/d8/d37/f43 x:0 0 0 2024-03-28T13:03:22.631 INFO:tasks.workunit.client.0.smithi076.stdout:5/199: unlink d5/d9/d1c/d1d/d22/c3e 0 2024-03-28T13:03:22.763 INFO:tasks.workunit.client.0.smithi076.stdout:7/194: creat d1/d18/d3c/f44 x:0 0 0 2024-03-28T13:03:22.790 INFO:tasks.workunit.client.0.smithi076.stdout:7/195: dwrite d1/d18/d2d/f34 [0,4194304] 0 2024-03-28T13:03:23.200 INFO:tasks.workunit.client.0.smithi076.stdout:7/196: creat d1/d8/d37/f45 x:0 0 0 2024-03-28T13:03:23.200 INFO:tasks.workunit.client.0.smithi076.stdout:7/197: fdatasync d1/dc/f1c 0 2024-03-28T13:03:23.230 INFO:tasks.workunit.client.0.smithi076.stdout:7/198: read d1/d8/f19 [147014,74480] 0 2024-03-28T13:03:23.231 INFO:tasks.workunit.client.0.smithi076.stdout:4/202: dwrite d0/db/f11 [0,4194304] 0 2024-03-28T13:03:23.278 INFO:tasks.workunit.client.0.smithi076.stdout:4/203: dwrite d0/db/f23 [0,4194304] 0 2024-03-28T13:03:23.337 INFO:tasks.workunit.client.0.smithi076.stdout:9/188: rename d9/c33 to d9/dd/df/d11/d37/c45 0 2024-03-28T13:03:23.397 INFO:tasks.workunit.client.0.smithi076.stdout:7/199: mknod d1/dc/c46 0 2024-03-28T13:03:23.401 INFO:tasks.workunit.client.0.smithi076.stdout:7/200: dread d1/dc/f1d [0,4194304] 0 2024-03-28T13:03:23.401 INFO:tasks.workunit.client.0.smithi076.stdout:7/201: chown d1/d8/f19 3 1 2024-03-28T13:03:23.401 INFO:tasks.workunit.client.0.smithi076.stdout:7/202: readlink d1/d18/l2c 0 2024-03-28T13:03:23.401 INFO:tasks.workunit.client.0.smithi076.stdout:7/203: fsync d1/dc/f2b 0 2024-03-28T13:03:23.415 INFO:tasks.workunit.client.0.smithi076.stdout:7/204: read d1/f13 [560875,52791] 0 2024-03-28T13:03:23.493 INFO:tasks.workunit.client.0.smithi076.stdout:4/204: rmdir d0/d3b 39 2024-03-28T13:03:23.494 INFO:tasks.workunit.client.0.smithi076.stdout:8/151: rename de/d13/d27/f2e to de/d23/d2b/f30 0 2024-03-28T13:03:23.494 INFO:tasks.workunit.client.0.smithi076.stdout:9/189: symlink d9/dd/df/d11/d18/l46 0 2024-03-28T13:03:23.494 INFO:tasks.workunit.client.0.smithi076.stdout:9/190: fdatasync d9/dd/df/d11/f22 0 2024-03-28T13:03:23.518 INFO:tasks.workunit.client.0.smithi076.stdout:4/205: dwrite d0/d3b/d40/d42/d28/f32 [0,4194304] 0 2024-03-28T13:03:23.519 INFO:tasks.workunit.client.0.smithi076.stdout:4/206: chown d0/d3b/d40/d42/c25 156014545 1 2024-03-28T13:03:23.519 INFO:tasks.workunit.client.0.smithi076.stdout:4/207: chown d0/d3b/d40/d42 9328 1 2024-03-28T13:03:23.519 INFO:tasks.workunit.client.0.smithi076.stdout:4/208: chown d0/d3b/d40/d42/d28 874641 1 2024-03-28T13:03:23.519 INFO:tasks.workunit.client.0.smithi076.stdout:4/209: stat d0/db/d2d/f3a 0 2024-03-28T13:03:23.536 INFO:tasks.workunit.client.0.smithi076.stdout:8/152: dwrite de/f11 [0,4194304] 0 2024-03-28T13:03:23.559 INFO:tasks.workunit.client.0.smithi076.stdout:7/205: creat d1/d8/d37/f47 x:0 0 0 2024-03-28T13:03:23.559 INFO:tasks.workunit.client.0.smithi076.stdout:7/206: chown d1/dc 0 1 2024-03-28T13:03:23.704 INFO:tasks.workunit.client.0.smithi076.stdout:6/215: rename d6/f3a to d6/da/d1e/f42 0 2024-03-28T13:03:23.705 INFO:tasks.workunit.client.0.smithi076.stdout:4/210: truncate d0/db/d2d/f35 1975162 0 2024-03-28T13:03:23.705 INFO:tasks.workunit.client.0.smithi076.stdout:6/216: fdatasync d6/fb 0 2024-03-28T13:03:23.705 INFO:tasks.workunit.client.0.smithi076.stdout:4/211: readlink d0/d3b/d40/d42/l1d 0 2024-03-28T13:03:23.705 INFO:tasks.workunit.client.0.smithi076.stdout:6/217: fdatasync d6/da/d39/d41/f30 0 2024-03-28T13:03:23.726 INFO:tasks.workunit.client.0.smithi076.stdout:4/212: read d0/d3b/d40/d42/f1b [2876927,37397] 0 2024-03-28T13:03:23.726 INFO:tasks.workunit.client.0.smithi076.stdout:4/213: fsync d0/d3b/d40/d42/f24 0 2024-03-28T13:03:23.761 INFO:tasks.workunit.client.0.smithi076.stdout:7/207: dread d1/d8/f1e [0,4194304] 0 2024-03-28T13:03:23.881 INFO:tasks.workunit.client.0.smithi076.stdout:3/159: rename d1/d2/d8 to d1/d7/d30/d38 0 2024-03-28T13:03:23.921 INFO:tasks.workunit.client.0.smithi076.stdout:6/218: getdents d6/da/d39/d41 0 2024-03-28T13:03:23.923 INFO:tasks.workunit.client.0.smithi076.stdout:1/199: sync 2024-03-28T13:03:23.923 INFO:tasks.workunit.client.0.smithi076.stdout:0/208: sync 2024-03-28T13:03:23.923 INFO:tasks.workunit.client.0.smithi076.stdout:2/185: sync 2024-03-28T13:03:23.937 INFO:tasks.workunit.client.0.smithi076.stdout:1/200: dread d14/d2a/d2e/d31/d3b/f44 [0,4194304] 0 2024-03-28T13:03:23.996 INFO:tasks.workunit.client.0.smithi076.stdout:1/201: dwrite d14/f2b [0,4194304] 0 2024-03-28T13:03:23.996 INFO:tasks.workunit.client.0.smithi076.stdout:1/202: truncate d14/d2a/d2e/d31/f35 314498 0 2024-03-28T13:03:23.996 INFO:tasks.workunit.client.0.smithi076.stdout:1/203: chown d14/c1d 48331 1 2024-03-28T13:03:24.007 INFO:tasks.workunit.client.0.smithi076.stdout:7/208: mkdir d1/d18/d3c/d48 0 2024-03-28T13:03:24.037 INFO:tasks.workunit.client.0.smithi076.stdout:7/209: dwrite d1/f26 [0,4194304] 0 2024-03-28T13:03:24.383 INFO:tasks.workunit.client.0.smithi076.stdout:5/200: rename d5/f3c to d5/d9/f4d 0 2024-03-28T13:03:24.383 INFO:tasks.workunit.client.0.smithi076.stdout:3/160: creat d1/d7/d30/d38/d14/d18/f39 x:0 0 0 2024-03-28T13:03:24.387 INFO:tasks.workunit.client.0.smithi076.stdout:2/186: getdents d2/d5 0 2024-03-28T13:03:24.388 INFO:tasks.workunit.client.0.smithi076.stdout:4/214: link d0/db/c14 d0/d3b/c46 0 2024-03-28T13:03:24.388 INFO:tasks.workunit.client.0.smithi076.stdout:1/204: getdents d14/d2a/d2e/d31 0 2024-03-28T13:03:24.388 INFO:tasks.workunit.client.0.smithi076.stdout:1/205: dread - d14/f2f zero size 2024-03-28T13:03:24.404 INFO:tasks.workunit.client.0.smithi076.stdout:2/187: dread d2/d5/db/f1b [0,4194304] 0 2024-03-28T13:03:24.413 INFO:tasks.workunit.client.0.smithi076.stdout:2/188: dread d2/d5/f12 [8388608,4194304] 0 2024-03-28T13:03:24.444 INFO:tasks.workunit.client.0.smithi076.stdout:4/215: dwrite d0/d3b/d40/d42/f3f [0,4194304] 0 2024-03-28T13:03:24.444 INFO:tasks.workunit.client.0.smithi076.stdout:4/216: write d0/f2 [255756,47092] 0 2024-03-28T13:03:24.447 INFO:tasks.workunit.client.0.smithi076.stdout:5/201: dwrite d5/d9/d1c/d25/f3a [0,4194304] 0 2024-03-28T13:03:24.468 INFO:tasks.workunit.client.0.smithi076.stdout:9/191: rename l2 to d9/dd/df/d11/d18/d2a/l47 0 2024-03-28T13:03:24.468 INFO:tasks.workunit.client.0.smithi076.stdout:9/192: write f3 [927495,57342] 0 2024-03-28T13:03:24.585 INFO:tasks.workunit.client.0.smithi076.stdout:3/161: mkdir d1/d7/d30/d38/d14/d18/d3a 0 2024-03-28T13:03:24.585 INFO:tasks.workunit.client.0.smithi076.stdout:1/206: stat f12 0 2024-03-28T13:03:24.590 INFO:tasks.workunit.client.0.smithi076.stdout:2/189: link d2/l36 d2/d5/d7/d8/d21/l3a 0 2024-03-28T13:03:24.590 INFO:tasks.workunit.client.0.smithi076.stdout:2/190: chown d2/d5/d7/f19 6 1 2024-03-28T13:03:24.590 INFO:tasks.workunit.client.0.smithi076.stdout:2/191: write d2/f16 [109501,83015] 0 2024-03-28T13:03:24.626 INFO:tasks.workunit.client.0.smithi076.stdout:2/192: dwrite d2/d5/d7/f23 [0,4194304] 0 2024-03-28T13:03:24.783 INFO:tasks.workunit.client.0.smithi076.stdout:4/217: mkdir d0/d3b/d40/d42/d47 0 2024-03-28T13:03:24.783 INFO:tasks.workunit.client.0.smithi076.stdout:5/202: symlink d5/db/d3f/d42/d43/l4e 0 2024-03-28T13:03:24.784 INFO:tasks.workunit.client.0.smithi076.stdout:5/203: fdatasync d5/d9/f28 0 2024-03-28T13:03:24.784 INFO:tasks.workunit.client.0.smithi076.stdout:4/218: fsync d0/d3b/d40/d42/d28/f32 0 2024-03-28T13:03:24.840 INFO:tasks.workunit.client.0.smithi076.stdout:8/153: rename de/d12/d18/c2a to de/d12/c31 0 2024-03-28T13:03:24.858 INFO:tasks.workunit.client.0.smithi076.stdout:8/154: dread fd [0,4194304] 0 2024-03-28T13:03:24.858 INFO:tasks.workunit.client.0.smithi076.stdout:8/155: write de/d23/d2b/f30 [269049,13536] 0 2024-03-28T13:03:24.947 INFO:tasks.workunit.client.0.smithi076.stdout:9/193: unlink d9/dd/df/d11/d18/d2a/l2b 0 2024-03-28T13:03:24.993 INFO:tasks.workunit.client.0.smithi076.stdout:9/194: dwrite d9/d3c/f29 [0,4194304] 0 2024-03-28T13:03:25.009 INFO:tasks.workunit.client.0.smithi076.stdout:9/195: write d9/dd/df/d11/d18/f3d [2508201,116063] 0 2024-03-28T13:03:25.010 INFO:tasks.workunit.client.0.smithi076.stdout:9/196: dread - d9/dd/df/d11/d14/f31 zero size 2024-03-28T13:03:25.121 INFO:tasks.workunit.client.0.smithi076.stdout:3/162: creat d1/d7/d30/d38/d14/d18/f3b x:0 0 0 2024-03-28T13:03:25.121 INFO:tasks.workunit.client.0.smithi076.stdout:3/163: fsync d1/d7/d30/d38/d14/d18/f39 0 2024-03-28T13:03:25.186 INFO:tasks.workunit.client.0.smithi076.stdout:1/207: dread d14/f26 [0,4194304] 0 2024-03-28T13:03:25.359 INFO:tasks.workunit.client.0.smithi076.stdout:5/204: rmdir d5/d9/d35/d3b 39 2024-03-28T13:03:25.359 INFO:tasks.workunit.client.0.smithi076.stdout:4/219: creat d0/d20/f48 x:0 0 0 2024-03-28T13:03:25.359 INFO:tasks.workunit.client.0.smithi076.stdout:4/220: chown d0/db/d3c/f3e 81437 1 2024-03-28T13:03:25.385 INFO:tasks.workunit.client.0.smithi076.stdout:4/221: write d0/db/f23 [2881830,7264] 0 2024-03-28T13:03:25.437 INFO:tasks.workunit.client.0.smithi076.stdout:6/219: rename d6/da/f1b to d6/da/d23/f43 0 2024-03-28T13:03:25.437 INFO:tasks.workunit.client.0.smithi076.stdout:0/209: rename db/dc/df/d18 to db/dc/df/d18/d5e 22 2024-03-28T13:03:25.437 INFO:tasks.workunit.client.0.smithi076.stdout:6/220: chown d6/fb 257749 1 2024-03-28T13:03:25.437 INFO:tasks.workunit.client.0.smithi076.stdout:7/210: rename d1/d8/d37 to d1/d8/d37/d49 22 2024-03-28T13:03:25.438 INFO:tasks.workunit.client.0.smithi076.stdout:7/211: chown d1/f26 112936 1 2024-03-28T13:03:25.469 INFO:tasks.workunit.client.0.smithi076.stdout:8/156: creat de/d12/d18/f32 x:0 0 0 2024-03-28T13:03:25.469 INFO:tasks.workunit.client.0.smithi076.stdout:8/157: chown de/f1d 13 1 2024-03-28T13:03:25.469 INFO:tasks.workunit.client.0.smithi076.stdout:8/158: fdatasync de/f11 0 2024-03-28T13:03:25.469 INFO:tasks.workunit.client.0.smithi076.stdout:8/159: chown de/d23/d2b/f30 114 1 2024-03-28T13:03:25.483 INFO:tasks.workunit.client.0.smithi076.stdout:8/160: dread de/d12/f15 [0,4194304] 0 2024-03-28T13:03:25.658 INFO:tasks.workunit.client.0.smithi076.stdout:9/197: getdents d9/dd/df/d11/d18 0 2024-03-28T13:03:25.700 INFO:tasks.workunit.client.0.smithi076.stdout:9/198: dwrite d9/dd/df/d11/d18/d2a/f44 [0,4194304] 0 2024-03-28T13:03:25.765 INFO:tasks.workunit.client.0.smithi076.stdout:3/164: getdents d1/d7/d30/d38/d14 0 2024-03-28T13:03:25.780 INFO:tasks.workunit.client.0.smithi076.stdout:1/208: mknod d14/d2a/d2e/d3c/c48 0 2024-03-28T13:03:25.805 INFO:tasks.workunit.client.0.smithi076.stdout:1/209: dwrite d14/d19/f47 [0,4194304] 0 2024-03-28T13:03:25.845 INFO:tasks.workunit.client.0.smithi076.stdout:5/205: link d5/db/d19/d34/c41 d5/c4f 0 2024-03-28T13:03:25.873 INFO:tasks.workunit.client.0.smithi076.stdout:2/193: write d2/d1d/f1f [264432,122353] 0 2024-03-28T13:03:25.873 INFO:tasks.workunit.client.0.smithi076.stdout:2/194: fsync d2/d5/d7/f23 0 2024-03-28T13:03:25.894 INFO:tasks.workunit.client.0.smithi076.stdout:2/195: dread d2/d5/d7/f23 [0,4194304] 0 2024-03-28T13:03:25.894 INFO:tasks.workunit.client.0.smithi076.stdout:2/196: chown d2/d5/d7/d28 44963 1 2024-03-28T13:03:25.923 INFO:tasks.workunit.client.0.smithi076.stdout:4/222: unlink d0/d3b/d40/d42/f1b 0 2024-03-28T13:03:26.081 INFO:tasks.workunit.client.0.smithi076.stdout:7/212: symlink d1/d18/d3c/d48/l4a 0 2024-03-28T13:03:26.081 INFO:tasks.workunit.client.0.smithi076.stdout:0/210: creat db/dc/df/d18/f5f x:0 0 0 2024-03-28T13:03:26.081 INFO:tasks.workunit.client.0.smithi076.stdout:7/213: chown d1/f36 231 1 2024-03-28T13:03:26.082 INFO:tasks.workunit.client.0.smithi076.stdout:6/221: rename d6/f33 to d6/f44 0 2024-03-28T13:03:26.082 INFO:tasks.workunit.client.0.smithi076.stdout:7/214: dread - d1/f3d zero size 2024-03-28T13:03:26.117 INFO:tasks.workunit.client.0.smithi076.stdout:8/161: creat de/d12/d18/f33 x:0 0 0 2024-03-28T13:03:26.117 INFO:tasks.workunit.client.0.smithi076.stdout:8/162: write de/d12/d18/f32 [959878,37920] 0 2024-03-28T13:03:26.215 INFO:tasks.workunit.client.0.smithi076.stdout:9/199: mkdir d9/dd/d48 0 2024-03-28T13:03:26.230 INFO:tasks.workunit.client.0.smithi076.stdout:9/200: read d9/dd/df/d11/d18/d2a/f44 [2228087,31634] 0 2024-03-28T13:03:26.250 INFO:tasks.workunit.client.0.smithi076.stdout:9/201: write d9/d3c/f2f [1412771,3236] 0 2024-03-28T13:03:26.251 INFO:tasks.workunit.client.0.smithi076.stdout:9/202: write d9/dd/df/d11/d18/f21 [182348,113926] 0 2024-03-28T13:03:26.358 INFO:tasks.workunit.client.0.smithi076.stdout:3/165: mknod d1/d7/d30/d38/d14/d27/c3c 0 2024-03-28T13:03:26.358 INFO:tasks.workunit.client.0.smithi076.stdout:1/210: mkdir d14/d2a/d2e/d31/d49 0 2024-03-28T13:03:26.358 INFO:tasks.workunit.client.0.smithi076.stdout:1/211: truncate d14/d19/f47 5092447 0 2024-03-28T13:03:26.374 INFO:tasks.workunit.client.0.smithi076.stdout:5/206: symlink d5/db/d3f/d42/l50 0 2024-03-28T13:03:26.377 INFO:tasks.workunit.client.0.smithi076.stdout:1/212: dwrite d14/f2b [0,4194304] 0 2024-03-28T13:03:26.411 INFO:tasks.workunit.client.0.smithi076.stdout:1/213: dwrite d14/f21 [0,4194304] 0 2024-03-28T13:03:26.433 INFO:tasks.workunit.client.0.smithi076.stdout:1/214: read d14/d19/f47 [43374,12307] 0 2024-03-28T13:03:26.489 INFO:tasks.workunit.client.0.smithi076.stdout:1/215: dwrite d14/f2b [0,4194304] 0 2024-03-28T13:03:26.840 INFO:tasks.workunit.client.0.smithi076.stdout:4/223: link d0/db/d3c/f3e d0/d3b/d40/d42/d28/f49 0 2024-03-28T13:03:26.840 INFO:tasks.workunit.client.0.smithi076.stdout:4/224: readlink d0/d3b/d40/d42/d31/l33 0 2024-03-28T13:03:26.851 INFO:tasks.workunit.client.0.smithi076.stdout:6/222: creat d6/da/d23/f45 x:0 0 0 2024-03-28T13:03:26.851 INFO:tasks.workunit.client.0.smithi076.stdout:7/215: mknod d1/d18/d2d/c4b 0 2024-03-28T13:03:26.851 INFO:tasks.workunit.client.0.smithi076.stdout:8/163: creat de/d13/d27/f34 x:0 0 0 2024-03-28T13:03:26.851 INFO:tasks.workunit.client.0.smithi076.stdout:8/164: chown de 227271580 1 2024-03-28T13:03:26.851 INFO:tasks.workunit.client.0.smithi076.stdout:9/203: creat d9/dd/df/d11/d18/d2a/f49 x:0 0 0 2024-03-28T13:03:26.852 INFO:tasks.workunit.client.0.smithi076.stdout:5/207: symlink d5/l51 0 2024-03-28T13:03:26.852 INFO:tasks.workunit.client.0.smithi076.stdout:1/216: symlink d14/d2a/l4a 0 2024-03-28T13:03:26.852 INFO:tasks.workunit.client.0.smithi076.stdout:5/208: chown d5/db/f13 14 1 2024-03-28T13:03:26.888 INFO:tasks.workunit.client.0.smithi076.stdout:6/223: dwrite d6/da/f14 [0,4194304] 0 2024-03-28T13:03:27.223 INFO:tasks.workunit.client.0.smithi076.stdout:4/225: creat d0/d3b/d40/d42/d31/f4a x:0 0 0 2024-03-28T13:03:27.223 INFO:tasks.workunit.client.0.smithi076.stdout:7/216: getdents d1/d18 0 2024-03-28T13:03:27.223 INFO:tasks.workunit.client.0.smithi076.stdout:7/217: fsync d1/d8/f25 0 2024-03-28T13:03:27.223 INFO:tasks.workunit.client.0.smithi076.stdout:7/218: truncate d1/d8/d37/f45 564650 0 2024-03-28T13:03:27.246 INFO:tasks.workunit.client.0.smithi076.stdout:3/166: mkdir d1/d7/d30/d38/d3d 0 2024-03-28T13:03:27.253 INFO:tasks.workunit.client.0.smithi076.stdout:5/209: creat d5/db/d19/f52 x:0 0 0 2024-03-28T13:03:27.255 INFO:tasks.workunit.client.0.smithi076.stdout:9/204: dread d9/d3c/f32 [0,4194304] 0 2024-03-28T13:03:27.255 INFO:tasks.workunit.client.0.smithi076.stdout:1/217: dread fc [0,4194304] 0 2024-03-28T13:03:27.276 INFO:tasks.workunit.client.0.smithi076.stdout:9/205: dread d9/d3c/f29 [0,4194304] 0 2024-03-28T13:03:27.577 INFO:tasks.workunit.client.0.smithi076.stdout:6/224: mkdir d6/da/d39/d41/d46 0 2024-03-28T13:03:27.625 INFO:tasks.workunit.client.0.smithi076.stdout:4/226: truncate d0/f9 40978 0 2024-03-28T13:03:27.766 INFO:tasks.workunit.client.0.smithi076.stdout:7/219: symlink d1/d8/l4c 0 2024-03-28T13:03:27.815 INFO:tasks.workunit.client.0.smithi076.stdout:3/167: symlink d1/d7/d30/d38/d14/d36/l3e 0 2024-03-28T13:03:27.866 INFO:tasks.workunit.client.0.smithi076.stdout:5/210: symlink d5/d9/d1c/d1d/d31/l53 0 2024-03-28T13:03:27.985 INFO:tasks.workunit.client.0.smithi076.stdout:1/218: creat d14/d19/f4b x:0 0 0 2024-03-28T13:03:28.035 INFO:tasks.workunit.client.0.smithi076.stdout:9/206: symlink d9/dd/df/d11/l4a 0 2024-03-28T13:03:28.036 INFO:tasks.workunit.client.0.smithi076.stdout:6/225: creat d6/da/d1e/f47 x:0 0 0 2024-03-28T13:03:28.037 INFO:tasks.workunit.client.0.smithi076.stdout:6/226: write d6/da/d1e/f2b [780726,14228] 0 2024-03-28T13:03:28.037 INFO:tasks.workunit.client.0.smithi076.stdout:6/227: read - d6/f44 zero size 2024-03-28T13:03:28.059 INFO:tasks.workunit.client.0.smithi076.stdout:6/228: write d6/fb [2345233,105213] 0 2024-03-28T13:03:28.059 INFO:tasks.workunit.client.0.smithi076.stdout:6/229: write d6/da/d1e/f35 [866625,27069] 0 2024-03-28T13:03:28.160 INFO:tasks.workunit.client.0.smithi076.stdout:2/197: write d2/d5/d7/f19 [1090101,109834] 0 2024-03-28T13:03:28.486 INFO:tasks.workunit.client.0.smithi076.stdout:7/220: unlink d1/c27 0 2024-03-28T13:03:28.516 INFO:tasks.workunit.client.0.smithi076.stdout:7/221: dwrite d1/dc/f17 [0,4194304] 0 2024-03-28T13:03:28.516 INFO:tasks.workunit.client.0.smithi076.stdout:7/222: fdatasync d1/f4 0 2024-03-28T13:03:28.516 INFO:tasks.workunit.client.0.smithi076.stdout:7/223: dread - d1/d18/d3c/f20 zero size 2024-03-28T13:03:28.516 INFO:tasks.workunit.client.0.smithi076.stdout:7/224: chown d1/d8/d37/f45 778285534 1 2024-03-28T13:03:28.516 INFO:tasks.workunit.client.0.smithi076.stdout:7/225: write d1/f13 [4349115,65633] 0 2024-03-28T13:03:28.516 INFO:tasks.workunit.client.0.smithi076.stdout:7/226: chown d1/dc/f2b 0 1 2024-03-28T13:03:28.516 INFO:tasks.workunit.client.0.smithi076.stdout:7/227: truncate d1/d8/f35 4406614 0 2024-03-28T13:03:28.560 INFO:tasks.workunit.client.0.smithi076.stdout:7/228: dwrite d1/d8/f19 [0,4194304] 0 2024-03-28T13:03:28.666 INFO:tasks.workunit.client.0.smithi076.stdout:0/211: dwrite db/f14 [0,4194304] 0 2024-03-28T13:03:28.723 INFO:tasks.workunit.client.0.smithi076.stdout:3/168: stat d1/d7/d30/d38/d14/d18/l2a 0 2024-03-28T13:03:28.777 INFO:tasks.workunit.client.0.smithi076.stdout:5/211: rmdir d5/db 39 2024-03-28T13:03:28.892 INFO:tasks.workunit.client.0.smithi076.stdout:1/219: rename d14/d2a/l4a to d14/d19/l4c 0 2024-03-28T13:03:28.944 INFO:tasks.workunit.client.0.smithi076.stdout:9/207: rmdir d9/dd/df 39 2024-03-28T13:03:28.945 INFO:tasks.workunit.client.0.smithi076.stdout:9/208: fsync d9/da/f39 0 2024-03-28T13:03:29.050 INFO:tasks.workunit.client.0.smithi076.stdout:2/198: mkdir d2/d5/db/d3b 0 2024-03-28T13:03:29.050 INFO:tasks.workunit.client.0.smithi076.stdout:6/230: creat d6/da/d40/f48 x:0 0 0 2024-03-28T13:03:29.050 INFO:tasks.workunit.client.0.smithi076.stdout:6/231: dread - d6/da/d23/f45 zero size 2024-03-28T13:03:29.053 INFO:tasks.workunit.client.0.smithi076.stdout:2/199: dread d2/f16 [0,4194304] 0 2024-03-28T13:03:29.097 INFO:tasks.workunit.client.0.smithi076.stdout:6/232: dwrite d6/f36 [0,4194304] 0 2024-03-28T13:03:29.210 INFO:tasks.workunit.client.0.smithi076.stdout:7/229: creat d1/f4d x:0 0 0 2024-03-28T13:03:29.249 INFO:tasks.workunit.client.0.smithi076.stdout:0/212: mkdir db/dc/df/d18/d1d/d35/d51/d60 0 2024-03-28T13:03:29.275 INFO:tasks.workunit.client.0.smithi076.stdout:0/213: dwrite db/dc/f24 [0,4194304] 0 2024-03-28T13:03:29.486 INFO:tasks.workunit.client.0.smithi076.stdout:5/212: unlink d5/c16 0 2024-03-28T13:03:29.486 INFO:tasks.workunit.client.0.smithi076.stdout:1/220: symlink d14/d2a/l4d 0 2024-03-28T13:03:29.549 INFO:tasks.workunit.client.0.smithi076.stdout:9/209: creat d9/dd/df/d11/f4b x:0 0 0 2024-03-28T13:03:29.570 INFO:tasks.workunit.client.0.smithi076.stdout:9/210: dwrite d9/dd/df/d11/d14/f31 [0,4194304] 0 2024-03-28T13:03:29.570 INFO:tasks.workunit.client.0.smithi076.stdout:9/211: read d9/dd/df/d11/d18/f3d [2929233,104865] 0 2024-03-28T13:03:29.570 INFO:tasks.workunit.client.0.smithi076.stdout:9/212: chown d9/dd/df/d11/d14/f26 5988 1 2024-03-28T13:03:29.570 INFO:tasks.workunit.client.0.smithi076.stdout:9/213: readlink d9/dd/df/d11/d18/d2a/l47 0 2024-03-28T13:03:29.570 INFO:tasks.workunit.client.0.smithi076.stdout:9/214: write d9/dd/df/d11/d37/f1d [1981632,33959] 0 2024-03-28T13:03:29.624 INFO:tasks.workunit.client.0.smithi076.stdout:2/200: rmdir d2/d5/db 39 2024-03-28T13:03:29.977 INFO:tasks.workunit.client.0.smithi076.stdout:6/233: rename d6/da/d1e/c2a to d6/c49 0 2024-03-28T13:03:29.978 INFO:tasks.workunit.client.0.smithi076.stdout:0/214: symlink db/dc/df/d18/l61 0 2024-03-28T13:03:29.978 INFO:tasks.workunit.client.0.smithi076.stdout:0/215: chown db/c31 109296 1 2024-03-28T13:03:30.090 INFO:tasks.workunit.client.0.smithi076.stdout:1/221: truncate d14/d19/f34 571898 0 2024-03-28T13:03:30.090 INFO:tasks.workunit.client.0.smithi076.stdout:5/213: truncate d5/db/d19/f20 1440545 0 2024-03-28T13:03:30.227 INFO:tasks.workunit.client.0.smithi076.stdout:2/201: symlink d2/d5/l3c 0 2024-03-28T13:03:30.227 INFO:tasks.workunit.client.0.smithi076.stdout:2/202: write d2/d5/d7/f17 [825734,82102] 0 2024-03-28T13:03:30.285 INFO:tasks.workunit.client.0.smithi076.stdout:2/203: dwrite d2/d5/d7/f17 [0,4194304] 0 2024-03-28T13:03:30.434 INFO:tasks.workunit.client.0.smithi076.stdout:7/230: rename d1/d18/d2d/c3a to d1/d18/d3c/c4e 0 2024-03-28T13:03:30.467 INFO:tasks.workunit.client.0.smithi076.stdout:6/234: link d6/da/d39/f3b d6/da/d1e/f4a 0 2024-03-28T13:03:30.467 INFO:tasks.workunit.client.0.smithi076.stdout:1/222: creat d14/d2a/d2e/d31/d3b/f4e x:0 0 0 2024-03-28T13:03:30.579 INFO:tasks.workunit.client.0.smithi076.stdout:5/214: creat d5/d9/d1c/f54 x:0 0 0 2024-03-28T13:03:30.693 INFO:tasks.workunit.client.0.smithi076.stdout:9/215: rename d9/dd/df/d11/d18/d2a/c3a to d9/dd/d48/c4c 0 2024-03-28T13:03:30.699 INFO:tasks.workunit.client.0.smithi076.stdout:7/231: creat d1/f4f x:0 0 0 2024-03-28T13:03:30.712 INFO:tasks.workunit.client.0.smithi076.stdout:9/216: dread d9/dd/df/d11/d14/f31 [0,4194304] 0 2024-03-28T13:03:30.716 INFO:tasks.workunit.client.0.smithi076.stdout:9/217: dread d9/dd/df/d11/d18/f21 [0,4194304] 0 2024-03-28T13:03:30.716 INFO:tasks.workunit.client.0.smithi076.stdout:9/218: write d9/dd/df/d11/d18/f3d [3519274,117488] 0 2024-03-28T13:03:30.756 INFO:tasks.workunit.client.0.smithi076.stdout:8/165: creat de/d13/f35 x:0 0 0 2024-03-28T13:03:30.811 INFO:tasks.workunit.client.0.smithi076.stdout:6/235: rename d6/f44 to d6/f4b 0 2024-03-28T13:03:30.812 INFO:tasks.workunit.client.0.smithi076.stdout:6/236: dread - d6/f4b zero size 2024-03-28T13:03:30.886 INFO:tasks.workunit.client.0.smithi076.stdout:5/215: getdents d5/d9/d1c/d25 0 2024-03-28T13:03:31.027 INFO:tasks.workunit.client.0.smithi076.stdout:2/204: rename d2/d5/db/f20 to d2/d5/f3d 0 2024-03-28T13:03:31.027 INFO:tasks.workunit.client.0.smithi076.stdout:2/205: fdatasync d2/d5/d7/d8/d21/f27 0 2024-03-28T13:03:31.029 INFO:tasks.workunit.client.0.smithi076.stdout:7/232: symlink d1/d18/d3c/l50 0 2024-03-28T13:03:31.165 INFO:tasks.workunit.client.0.smithi076.stdout:9/219: symlink d9/da/l4d 0 2024-03-28T13:03:31.166 INFO:tasks.workunit.client.0.smithi076.stdout:9/220: readlink d9/dd/df/d11/d14/l27 0 2024-03-28T13:03:31.166 INFO:tasks.workunit.client.0.smithi076.stdout:9/221: write d9/dd/df/d11/d37/f1c [4562641,42024] 0 2024-03-28T13:03:31.193 INFO:tasks.workunit.client.0.smithi076.stdout:8/166: creat de/d25/f36 x:0 0 0 2024-03-28T13:03:31.193 INFO:tasks.workunit.client.0.smithi076.stdout:8/167: write de/d12/f15 [1837816,48609] 0 2024-03-28T13:03:31.216 INFO:tasks.workunit.client.0.smithi076.stdout:6/237: unlink l5 0 2024-03-28T13:03:31.244 INFO:tasks.workunit.client.0.smithi076.stdout:8/168: dwrite de/d12/f15 [4194304,4194304] 0 2024-03-28T13:03:31.247 INFO:tasks.workunit.client.0.smithi076.stdout:5/216: truncate d5/db/f2a 588000 0 2024-03-28T13:03:31.264 INFO:tasks.workunit.client.0.smithi076.stdout:8/169: write de/f1d [6885895,68179] 0 2024-03-28T13:03:31.269 INFO:tasks.workunit.client.0.smithi076.stdout:8/170: fsync de/f1d 0 2024-03-28T13:03:31.279 INFO:tasks.workunit.client.0.smithi076.stdout:8/171: dread f7 [0,4194304] 0 2024-03-28T13:03:31.285 INFO:tasks.workunit.client.0.smithi076.stdout:2/206: getdents d2/d1d 0 2024-03-28T13:03:31.289 INFO:tasks.workunit.client.0.smithi076.stdout:8/172: dread f7 [0,4194304] 0 2024-03-28T13:03:31.289 INFO:tasks.workunit.client.0.smithi076.stdout:8/173: stat de/d12/d18/f1a 0 2024-03-28T13:03:31.289 INFO:tasks.workunit.client.0.smithi076.stdout:8/174: write de/f1d [4131484,115302] 0 2024-03-28T13:03:31.303 INFO:tasks.workunit.client.0.smithi076.stdout:2/207: dread d2/d5/d7/dd/f32 [0,4194304] 0 2024-03-28T13:03:31.316 INFO:tasks.workunit.client.0.smithi076.stdout:2/208: dread d2/d5/f12 [4194304,4194304] 0 2024-03-28T13:03:31.336 INFO:tasks.workunit.client.0.smithi076.stdout:2/209: dread d2/d5/d7/f17 [0,4194304] 0 2024-03-28T13:03:31.363 INFO:tasks.workunit.client.0.smithi076.stdout:7/233: symlink d1/d18/l51 0 2024-03-28T13:03:31.363 INFO:tasks.workunit.client.0.smithi076.stdout:7/234: fdatasync d1/d8/f25 0 2024-03-28T13:03:31.400 INFO:tasks.workunit.client.0.smithi076.stdout:7/235: dwrite d1/d8/d37/f45 [0,4194304] 0 2024-03-28T13:03:31.445 INFO:tasks.workunit.client.0.smithi076.stdout:9/222: unlink d9/dd/df/d11/c3b 0 2024-03-28T13:03:31.519 INFO:tasks.workunit.client.0.smithi076.stdout:6/238: mknod d6/c4c 0 2024-03-28T13:03:31.520 INFO:tasks.workunit.client.0.smithi076.stdout:6/239: dread - d6/da/d23/f45 zero size 2024-03-28T13:03:31.866 INFO:tasks.workunit.client.0.smithi076.stdout:0/216: creat db/dc/f62 x:0 0 0 2024-03-28T13:03:31.867 INFO:tasks.workunit.client.0.smithi076.stdout:0/217: read - db/dc/df/d18/f5f zero size 2024-03-28T13:03:31.867 INFO:tasks.workunit.client.0.smithi076.stdout:0/218: dread - db/dc/df/d18/d1d/f29 zero size 2024-03-28T13:03:31.972 INFO:tasks.workunit.client.0.smithi076.stdout:9/223: creat d9/dd/df/d11/d14/f4e x:0 0 0 2024-03-28T13:03:31.972 INFO:tasks.workunit.client.0.smithi076.stdout:9/224: write f3 [1525687,67979] 0 2024-03-28T13:03:32.013 INFO:tasks.workunit.client.0.smithi076.stdout:6/240: link d6/f2f d6/da/d23/f4d 0 2024-03-28T13:03:32.045 INFO:tasks.workunit.client.0.smithi076.stdout:2/210: mkdir d2/d5/d7/d3e 0 2024-03-28T13:03:32.063 INFO:tasks.workunit.client.0.smithi076.stdout:2/211: write d2/d5/d7/f23 [1996023,61454] 0 2024-03-28T13:03:32.122 INFO:tasks.workunit.client.0.smithi076.stdout:0/219: rmdir db/d16 39 2024-03-28T13:03:32.374 INFO:tasks.workunit.client.0.smithi076.stdout:6/241: creat d6/da/d39/f4e x:0 0 0 2024-03-28T13:03:32.390 INFO:tasks.workunit.client.0.smithi076.stdout:6/242: write d6/da/f14 [6554,5527] 0 2024-03-28T13:03:32.513 INFO:tasks.workunit.client.0.smithi076.stdout:1/223: unlink d14/f23 0 2024-03-28T13:03:32.513 INFO:tasks.workunit.client.0.smithi076.stdout:1/224: fsync d14/f2f 0 2024-03-28T13:03:32.513 INFO:tasks.workunit.client.0.smithi076.stdout:1/225: write d14/d19/d20/f27 [1390984,59076] 0 2024-03-28T13:03:32.513 INFO:tasks.workunit.client.0.smithi076.stdout:1/226: chown d14/l28 891234 1 2024-03-28T13:03:32.532 INFO:tasks.workunit.client.0.smithi076.stdout:2/212: mkdir d2/d5/db/d3b/d3f 0 2024-03-28T13:03:32.533 INFO:tasks.workunit.client.0.smithi076.stdout:0/220: rmdir db/dc/d49 0 2024-03-28T13:03:32.543 INFO:tasks.workunit.client.0.smithi076.stdout:1/227: dwrite d14/f2f [0,4194304] 0 2024-03-28T13:03:32.543 INFO:tasks.workunit.client.0.smithi076.stdout:1/228: fsync d14/d2a/d2e/d31/d3b/f43 0 2024-03-28T13:03:32.543 INFO:tasks.workunit.client.0.smithi076.stdout:1/229: fsync fc 0 2024-03-28T13:03:32.544 INFO:tasks.workunit.client.0.smithi076.stdout:1/230: dread - d14/d19/f4b zero size 2024-03-28T13:03:32.544 INFO:tasks.workunit.client.0.smithi076.stdout:1/231: write d14/d2a/d2e/d31/d3b/f4e [458355,81058] 0 2024-03-28T13:03:32.580 INFO:tasks.workunit.client.0.smithi076.stdout:2/213: dwrite d2/d5/d7/f19 [0,4194304] 0 2024-03-28T13:03:32.589 INFO:tasks.workunit.client.0.smithi076.stdout:1/232: dwrite d14/d19/f47 [0,4194304] 0 2024-03-28T13:03:32.881 INFO:tasks.workunit.client.0.smithi076.stdout:6/243: rmdir d6/da/d1e 39 2024-03-28T13:03:32.881 INFO:tasks.workunit.client.0.smithi076.stdout:0/221: stat db/dc/df/d18/d1d/d21/l5d 0 2024-03-28T13:03:32.904 INFO:tasks.workunit.client.0.smithi076.stdout:0/222: dwrite db/dc/df/d18/f5f [0,4194304] 0 2024-03-28T13:03:32.904 INFO:tasks.workunit.client.0.smithi076.stdout:6/244: dread d6/da/f14 [0,4194304] 0 2024-03-28T13:03:32.913 INFO:tasks.workunit.client.0.smithi076.stdout:1/233: mknod d14/d2a/d2e/d31/d46/c4f 0 2024-03-28T13:03:33.108 INFO:tasks.workunit.client.0.smithi076.stdout:3/169: sync 2024-03-28T13:03:33.108 INFO:tasks.workunit.client.0.smithi076.stdout:4/227: sync 2024-03-28T13:03:33.108 INFO:tasks.workunit.client.0.smithi076.stdout:3/170: chown d1/d7/d30/d38/d14/d36/l3e 4 1 2024-03-28T13:03:33.108 INFO:tasks.workunit.client.0.smithi076.stdout:4/228: write d0/db/f23 [132515,50123] 0 2024-03-28T13:03:33.108 INFO:tasks.workunit.client.0.smithi076.stdout:3/171: read d1/d2/f1e [2774554,3398] 0 2024-03-28T13:03:33.108 INFO:tasks.workunit.client.0.smithi076.stdout:4/229: readlink d0/d3b/d40/d42/l1d 0 2024-03-28T13:03:33.108 INFO:tasks.workunit.client.0.smithi076.stdout:4/230: stat d0/db 0 2024-03-28T13:03:33.108 INFO:tasks.workunit.client.0.smithi076.stdout:4/231: readlink d0/db/l1c 0 2024-03-28T13:03:33.355 INFO:tasks.workunit.client.0.smithi076.stdout:0/223: creat db/dc/df/d11/f63 x:0 0 0 2024-03-28T13:03:33.417 INFO:tasks.workunit.client.0.smithi076.stdout:2/214: link d2/d5/d7/d8/d21/f27 d2/d5/d7/f40 0 2024-03-28T13:03:33.474 INFO:tasks.workunit.client.0.smithi076.stdout:1/234: symlink d14/l50 0 2024-03-28T13:03:33.656 INFO:tasks.workunit.client.0.smithi076.stdout:4/232: creat d0/d20/d21/f4b x:0 0 0 2024-03-28T13:03:33.656 INFO:tasks.workunit.client.0.smithi076.stdout:4/233: fdatasync d0/d20/f48 0 2024-03-28T13:03:33.683 INFO:tasks.workunit.client.0.smithi076.stdout:0/224: rmdir db/dc/df/d11 39 2024-03-28T13:03:33.684 INFO:tasks.workunit.client.0.smithi076.stdout:4/234: dwrite d0/d20/d21/f4b [0,4194304] 0 2024-03-28T13:03:33.685 INFO:tasks.workunit.client.0.smithi076.stdout:4/235: read d0/db/f18 [2356295,26277] 0 2024-03-28T13:03:33.938 INFO:tasks.workunit.client.0.smithi076.stdout:2/215: symlink d2/d1d/d39/l41 0 2024-03-28T13:03:33.938 INFO:tasks.workunit.client.0.smithi076.stdout:2/216: read d2/d5/d7/f23 [2999749,121206] 0 2024-03-28T13:03:33.954 INFO:tasks.workunit.client.0.smithi076.stdout:1/235: getdents d14/d2a/d2e/d31/d3b 0 2024-03-28T13:03:33.955 INFO:tasks.workunit.client.0.smithi076.stdout:1/236: chown d14/c1e 2 1 2024-03-28T13:03:33.955 INFO:tasks.workunit.client.0.smithi076.stdout:1/237: readlink d14/l1c 0 2024-03-28T13:03:33.956 INFO:tasks.workunit.client.0.smithi076.stdout:3/172: symlink d1/d7/d30/d38/l3f 0 2024-03-28T13:03:33.956 INFO:tasks.workunit.client.0.smithi076.stdout:3/173: write d1/d7/d30/d38/d14/f26 [3890376,21937] 0 2024-03-28T13:03:33.967 INFO:tasks.workunit.client.0.smithi076.stdout:2/217: dwrite d2/d5/d7/dd/f32 [0,4194304] 0 2024-03-28T13:03:33.993 INFO:tasks.workunit.client.0.smithi076.stdout:1/238: dwrite d14/d2a/d2e/d31/f39 [0,4194304] 0 2024-03-28T13:03:33.996 INFO:tasks.workunit.client.0.smithi076.stdout:2/218: dwrite d2/d5/db/f1b [0,4194304] 0 2024-03-28T13:03:33.996 INFO:tasks.workunit.client.0.smithi076.stdout:2/219: chown d2/d5/d7/c29 59 1 2024-03-28T13:03:34.027 INFO:tasks.workunit.client.0.smithi076.stdout:0/225: creat db/dc/df/d11/d40/f64 x:0 0 0 2024-03-28T13:03:34.183 INFO:tasks.workunit.client.0.smithi076.stdout:3/174: creat d1/d7/d30/d38/d14/d18/d3a/f40 x:0 0 0 2024-03-28T13:03:34.329 INFO:tasks.workunit.client.0.smithi076.stdout:1/239: truncate d14/d2a/d2e/d31/d3b/f44 4181366 0 2024-03-28T13:03:34.355 INFO:tasks.workunit.client.0.smithi076.stdout:2/220: mkdir d2/d5/db/d3b/d42 0 2024-03-28T13:03:34.355 INFO:tasks.workunit.client.0.smithi076.stdout:2/221: stat d2/d5/d7/d8/d21/f27 0 2024-03-28T13:03:34.490 INFO:tasks.workunit.client.0.smithi076.stdout:0/226: unlink db/l4c 0 2024-03-28T13:03:34.490 INFO:tasks.workunit.client.0.smithi076.stdout:3/175: creat d1/d7/d30/d38/d14/d18/f41 x:0 0 0 2024-03-28T13:03:34.490 INFO:tasks.workunit.client.0.smithi076.stdout:0/227: write db/dc/df/f19 [987467,113854] 0 2024-03-28T13:03:34.490 INFO:tasks.workunit.client.0.smithi076.stdout:0/228: readlink db/dc/df/d18/l3f 0 2024-03-28T13:03:34.533 INFO:tasks.workunit.client.0.smithi076.stdout:3/176: dwrite d1/d7/d30/d38/d14/f26 [0,4194304] 0 2024-03-28T13:03:34.533 INFO:tasks.workunit.client.0.smithi076.stdout:3/177: write d1/d7/d30/d38/d14/d18/f3b [1024779,74098] 0 2024-03-28T13:03:34.551 INFO:tasks.workunit.client.0.smithi076.stdout:3/178: dwrite d1/d7/f17 [0,4194304] 0 2024-03-28T13:03:34.725 INFO:tasks.workunit.client.0.smithi076.stdout:3/179: mkdir d1/d7/d30/d38/d14/d27/d42 0 2024-03-28T13:03:35.178 INFO:tasks.workunit.client.0.smithi076.stdout:5/217: rename d5/d9/d1c/d1d/d31/l53 to d5/d9/l55 0 2024-03-28T13:03:35.574 INFO:tasks.workunit.client.0.smithi076.stdout:7/236: rename d1/d18/l2c to d1/dc/l52 0 2024-03-28T13:03:35.620 INFO:tasks.workunit.client.0.smithi076.stdout:5/218: getdents d5/d9/d1c/d1d/d22 0 2024-03-28T13:03:35.663 INFO:tasks.workunit.client.0.smithi076.stdout:6/245: rename d6/da/c1a to d6/da/d39/d41/d46/c4f 0 2024-03-28T13:03:35.663 INFO:tasks.workunit.client.0.smithi076.stdout:6/246: chown d6/fb 1511487 1 2024-03-28T13:03:35.663 INFO:tasks.workunit.client.0.smithi076.stdout:6/247: write d6/da/d23/f32 [645008,4454] 0 2024-03-28T13:03:35.663 INFO:tasks.workunit.client.0.smithi076.stdout:6/248: chown d6/da/d1e/l20 3290 1 2024-03-28T13:03:35.663 INFO:tasks.workunit.client.0.smithi076.stdout:6/249: stat d6/f12 0 2024-03-28T13:03:35.730 INFO:tasks.workunit.client.0.smithi076.stdout:7/237: mkdir d1/d8/d37/d53 0 2024-03-28T13:03:35.730 INFO:tasks.workunit.client.0.smithi076.stdout:7/238: fsync d1/dc/f1c 0 2024-03-28T13:03:35.730 INFO:tasks.workunit.client.0.smithi076.stdout:7/239: readlink d1/l10 0 2024-03-28T13:03:35.828 INFO:tasks.workunit.client.0.smithi076.stdout:5/219: symlink d5/db/d3f/d42/d43/l56 0 2024-03-28T13:03:35.828 INFO:tasks.workunit.client.0.smithi076.stdout:5/220: getdents d5/d9/d1c/d25 0 2024-03-28T13:03:35.833 INFO:tasks.workunit.client.0.smithi076.stdout:5/221: dread d5/db/d19/f2d [0,4194304] 0 2024-03-28T13:03:35.833 INFO:tasks.workunit.client.0.smithi076.stdout:5/222: fdatasync d5/db/f12 0 2024-03-28T13:03:35.974 INFO:tasks.workunit.client.0.smithi076.stdout:6/250: getdents d6/da/d39 0 2024-03-28T13:03:35.974 INFO:tasks.workunit.client.0.smithi076.stdout:7/240: mknod d1/d18/d2d/c54 0 2024-03-28T13:03:36.011 INFO:tasks.workunit.client.0.smithi076.stdout:6/251: dwrite d6/da/d1e/f35 [0,4194304] 0 2024-03-28T13:03:36.012 INFO:tasks.workunit.client.0.smithi076.stdout:6/252: stat d6/da/d23/c29 0 2024-03-28T13:03:36.021 INFO:tasks.workunit.client.0.smithi076.stdout:7/241: dwrite d1/f26 [0,4194304] 0 2024-03-28T13:03:36.021 INFO:tasks.workunit.client.0.smithi076.stdout:7/242: chown d1/d8/l4c 19249 1 2024-03-28T13:03:36.021 INFO:tasks.workunit.client.0.smithi076.stdout:7/243: fdatasync d1/f5 0 2024-03-28T13:03:36.022 INFO:tasks.workunit.client.0.smithi076.stdout:5/223: dread d5/db/f2a [0,4194304] 0 2024-03-28T13:03:36.022 INFO:tasks.workunit.client.0.smithi076.stdout:5/224: write d5/db/df/f26 [9401628,124013] 0 2024-03-28T13:03:36.035 INFO:tasks.workunit.client.0.smithi076.stdout:5/225: dread d5/f7 [0,4194304] 0 2024-03-28T13:03:36.067 INFO:tasks.workunit.client.0.smithi076.stdout:8/175: link de/d13/c22 de/d12/c37 0 2024-03-28T13:03:36.344 INFO:tasks.workunit.client.0.smithi076.stdout:8/176: symlink de/d13/l38 0 2024-03-28T13:03:36.344 INFO:tasks.workunit.client.0.smithi076.stdout:5/226: creat d5/d9/d1c/d1d/d31/f57 x:0 0 0 2024-03-28T13:03:36.344 INFO:tasks.workunit.client.0.smithi076.stdout:8/177: chown c4 0 1 2024-03-28T13:03:36.559 INFO:tasks.workunit.client.0.smithi076.stdout:1/240: write d14/d19/f34 [1002947,88259] 0 2024-03-28T13:03:36.559 INFO:tasks.workunit.client.0.smithi076.stdout:1/241: fsync d14/d19/f47 0 2024-03-28T13:03:36.562 INFO:tasks.workunit.client.0.smithi076.stdout:0/229: write db/f3e [462644,24147] 0 2024-03-28T13:03:36.562 INFO:tasks.workunit.client.0.smithi076.stdout:0/230: write db/dc/df/f1a [910752,9105] 0 2024-03-28T13:03:36.562 INFO:tasks.workunit.client.0.smithi076.stdout:0/231: fdatasync db/dc/df/d11/f1c 0 2024-03-28T13:03:36.566 INFO:tasks.workunit.client.0.smithi076.stdout:4/236: rename d0/fc to d0/db/d3c/f4c 0 2024-03-28T13:03:36.569 INFO:tasks.workunit.client.0.smithi076.stdout:0/232: fdatasync db/dc/df/f1a 0 2024-03-28T13:03:36.822 INFO:tasks.workunit.client.0.smithi076.stdout:8/178: link de/d13/c22 de/d12/c39 0 2024-03-28T13:03:37.012 INFO:tasks.workunit.client.0.smithi076.stdout:9/225: creat d9/dd/df/d11/f4f x:0 0 0 2024-03-28T13:03:37.013 INFO:tasks.workunit.client.0.smithi076.stdout:9/226: read d9/dd/df/d11/d14/f16 [275247,105241] 0 2024-03-28T13:03:37.529 INFO:tasks.workunit.client.0.smithi076.stdout:4/237: rmdir d0/d3b 39 2024-03-28T13:03:37.530 INFO:tasks.workunit.client.0.smithi076.stdout:2/222: rename d2/d5/db/f1b to d2/d5/d7/d28/f43 0 2024-03-28T13:03:37.544 INFO:tasks.workunit.client.0.smithi076.stdout:4/238: write d0/db/d2d/f35 [1697808,80720] 0 2024-03-28T13:03:37.578 INFO:tasks.workunit.client.0.smithi076.stdout:0/233: link db/dc/df/d18/f41 db/dc/df/d11/d40/f65 0 2024-03-28T13:03:37.578 INFO:tasks.workunit.client.0.smithi076.stdout:0/234: fdatasync db/d16/f54 0 2024-03-28T13:03:37.578 INFO:tasks.workunit.client.0.smithi076.stdout:0/235: read db/dc/df/d11/f1c [1928178,103619] 0 2024-03-28T13:03:37.626 INFO:tasks.workunit.client.0.smithi076.stdout:0/236: dwrite db/f3e [0,4194304] 0 2024-03-28T13:03:37.626 INFO:tasks.workunit.client.0.smithi076.stdout:0/237: dread - db/dc/df/d18/d1d/f29 zero size 2024-03-28T13:03:37.849 INFO:tasks.workunit.client.0.smithi076.stdout:3/180: rename d1/d2/f31 to d1/d7/d30/f43 0 2024-03-28T13:03:37.860 INFO:tasks.workunit.client.0.smithi076.stdout:2/223: creat d2/d5/d7/d8/f44 x:0 0 0 2024-03-28T13:03:37.875 INFO:tasks.workunit.client.0.smithi076.stdout:2/224: dread d2/d5/d7/fe [0,4194304] 0 2024-03-28T13:03:37.946 INFO:tasks.workunit.client.0.smithi076.stdout:7/244: write d1/f6 [1767315,42928] 0 2024-03-28T13:03:38.322 INFO:tasks.workunit.client.0.smithi076.stdout:4/239: fsync d0/db/d3c/f4c 0 2024-03-28T13:03:38.323 INFO:tasks.workunit.client.0.smithi076.stdout:4/240: chown d0/d3b/c46 4518457 1 2024-03-28T13:03:38.323 INFO:tasks.workunit.client.0.smithi076.stdout:6/253: rename d6/f36 to d6/da/d1e/f50 0 2024-03-28T13:03:38.323 INFO:tasks.workunit.client.0.smithi076.stdout:8/179: rename de to de/d12/d3a 22 2024-03-28T13:03:38.323 INFO:tasks.workunit.client.0.smithi076.stdout:2/225: creat d2/d5/d7/d3e/f45 x:0 0 0 2024-03-28T13:03:38.324 INFO:tasks.workunit.client.0.smithi076.stdout:4/241: dread d0/f1f [4194304,4194304] 0 2024-03-28T13:03:38.324 INFO:tasks.workunit.client.0.smithi076.stdout:4/242: fdatasync d0/db/f11 0 2024-03-28T13:03:38.336 INFO:tasks.workunit.client.0.smithi076.stdout:8/180: dread de/f11 [0,4194304] 0 2024-03-28T13:03:38.354 INFO:tasks.workunit.client.0.smithi076.stdout:4/243: dwrite d0/db/f23 [0,4194304] 0 2024-03-28T13:03:38.390 INFO:tasks.workunit.client.0.smithi076.stdout:8/181: dwrite de/d13/d27/f29 [0,4194304] 0 2024-03-28T13:03:38.683 INFO:tasks.workunit.client.0.smithi076.stdout:7/245: creat d1/dc/f55 x:0 0 0 2024-03-28T13:03:38.684 INFO:tasks.workunit.client.0.smithi076.stdout:6/254: symlink d6/da/d40/l51 0 2024-03-28T13:03:38.965 INFO:tasks.workunit.client.0.smithi076.stdout:2/226: mknod d2/d5/d7/dd/c46 0 2024-03-28T13:03:38.966 INFO:tasks.workunit.client.0.smithi076.stdout:4/244: rename d0/db/d3c to d0/d3b/d40/d42/d31/d4d 0 2024-03-28T13:03:38.993 INFO:tasks.workunit.client.0.smithi076.stdout:8/182: creat de/d23/d2b/d2c/f3b x:0 0 0 2024-03-28T13:03:38.994 INFO:tasks.workunit.client.0.smithi076.stdout:8/183: write de/d12/d18/f32 [1914543,101837] 0 2024-03-28T13:03:38.994 INFO:tasks.workunit.client.0.smithi076.stdout:8/184: chown de/c16 999299994 1 2024-03-28T13:03:38.994 INFO:tasks.workunit.client.0.smithi076.stdout:8/185: dread - de/d23/d2b/d2c/f3b zero size 2024-03-28T13:03:39.015 INFO:tasks.workunit.client.0.smithi076.stdout:4/245: dwrite d0/d20/f48 [0,4194304] 0 2024-03-28T13:03:39.015 INFO:tasks.workunit.client.0.smithi076.stdout:4/246: readlink d0/l7 0 2024-03-28T13:03:39.015 INFO:tasks.workunit.client.0.smithi076.stdout:8/186: dread de/d13/d27/f29 [0,4194304] 0 2024-03-28T13:03:39.017 INFO:tasks.workunit.client.0.smithi076.stdout:7/246: creat d1/f56 x:0 0 0 2024-03-28T13:03:39.038 INFO:tasks.workunit.client.0.smithi076.stdout:8/187: write de/d12/f21 [1250408,44984] 0 2024-03-28T13:03:39.378 INFO:tasks.workunit.client.0.smithi076.stdout:5/227: sync 2024-03-28T13:03:39.378 INFO:tasks.workunit.client.0.smithi076.stdout:1/242: sync 2024-03-28T13:03:39.379 INFO:tasks.workunit.client.0.smithi076.stdout:5/228: fdatasync d5/d9/d1c/d25/f2b 0 2024-03-28T13:03:39.558 INFO:tasks.workunit.client.0.smithi076.stdout:3/181: symlink d1/d7/d30/d38/l44 0 2024-03-28T13:03:39.559 INFO:tasks.workunit.client.0.smithi076.stdout:3/182: write d1/d7/d30/d38/f1a [2240483,123853] 0 2024-03-28T13:03:39.559 INFO:tasks.workunit.client.0.smithi076.stdout:3/183: chown d1/d7/d30/d38/d14/d27/c3c 413917830 1 2024-03-28T13:03:39.583 INFO:tasks.workunit.client.0.smithi076.stdout:9/227: creat d9/dd/df/d11/d18/f50 x:0 0 0 2024-03-28T13:03:39.819 INFO:tasks.workunit.client.0.smithi076.stdout:6/255: rename d6/da/d23/f37 to d6/f52 0 2024-03-28T13:03:39.827 INFO:tasks.workunit.client.0.smithi076.stdout:4/247: mknod d0/d3b/d40/d42/c4e 0 2024-03-28T13:03:39.855 INFO:tasks.workunit.client.0.smithi076.stdout:4/248: read d0/d3b/d40/d42/d28/f32 [2772930,91960] 0 2024-03-28T13:03:39.875 INFO:tasks.workunit.client.0.smithi076.stdout:4/249: write d0/d20/d21/f4b [3133672,34043] 0 2024-03-28T13:03:39.891 INFO:tasks.workunit.client.0.smithi076.stdout:8/188: getdents de 0 2024-03-28T13:03:39.891 INFO:tasks.workunit.client.0.smithi076.stdout:8/189: fsync de/f11 0 2024-03-28T13:03:40.133 INFO:tasks.workunit.client.0.smithi076.stdout:1/243: mkdir d14/d2a/d2e/d31/d51 0 2024-03-28T13:03:40.165 INFO:tasks.workunit.client.0.smithi076.stdout:5/229: rmdir d5/db/df 39 2024-03-28T13:03:40.165 INFO:tasks.workunit.client.0.smithi076.stdout:5/230: readlink d5/l30 0 2024-03-28T13:03:40.183 INFO:tasks.workunit.client.0.smithi076.stdout:5/231: write d5/f6 [4119550,33320] 0 2024-03-28T13:03:40.265 INFO:tasks.workunit.client.0.smithi076.stdout:3/184: symlink d1/d7/d30/d38/d14/d36/l45 0 2024-03-28T13:03:40.573 INFO:tasks.workunit.client.0.smithi076.stdout:2/227: mknod d2/d5/d7/c47 0 2024-03-28T13:03:40.573 INFO:tasks.workunit.client.0.smithi076.stdout:0/238: sync 2024-03-28T13:03:40.597 INFO:tasks.workunit.client.0.smithi076.stdout:2/228: read d2/d5/d7/d28/f43 [1549335,81809] 0 2024-03-28T13:03:40.615 INFO:tasks.workunit.client.0.smithi076.stdout:0/239: dwrite db/dc/df/d11/d40/f42 [0,4194304] 0 2024-03-28T13:03:40.615 INFO:tasks.workunit.client.0.smithi076.stdout:0/240: write db/dc/df/d11/f3b [1000304,97418] 0 2024-03-28T13:03:40.618 INFO:tasks.workunit.client.0.smithi076.stdout:9/228: rename f3 to d9/dd/df/d11/d14/f51 0 2024-03-28T13:03:40.618 INFO:tasks.workunit.client.0.smithi076.stdout:6/256: rename d6/f22 to d6/f53 0 2024-03-28T13:03:40.619 INFO:tasks.workunit.client.0.smithi076.stdout:6/257: write d6/f52 [5090858,5249] 0 2024-03-28T13:03:40.619 INFO:tasks.workunit.client.0.smithi076.stdout:4/250: unlink d0/db/f11 0 2024-03-28T13:03:40.619 INFO:tasks.workunit.client.0.smithi076.stdout:4/251: write d0/d20/d21/f4b [4650485,91780] 0 2024-03-28T13:03:40.668 INFO:tasks.workunit.client.0.smithi076.stdout:8/190: mkdir de/d12/d18/d3c 0 2024-03-28T13:03:40.693 INFO:tasks.workunit.client.0.smithi076.stdout:8/191: dwrite de/d12/d18/f1a [0,4194304] 0 2024-03-28T13:03:40.789 INFO:tasks.workunit.client.0.smithi076.stdout:3/185: link d1/d7/d30/d38/d14/d18/c2b d1/c46 0 2024-03-28T13:03:40.872 INFO:tasks.workunit.client.0.smithi076.stdout:2/229: creat d2/d5/d7/d8/d21/f48 x:0 0 0 2024-03-28T13:03:40.886 INFO:tasks.workunit.client.0.smithi076.stdout:2/230: write d2/d5/f12 [1821274,109221] 0 2024-03-28T13:03:41.018 INFO:tasks.workunit.client.0.smithi076.stdout:7/247: sync 2024-03-28T13:03:41.190 INFO:tasks.workunit.client.0.smithi076.stdout:1/244: rename d14/d2a/d2e/f3a to d14/f52 0 2024-03-28T13:03:41.229 INFO:tasks.workunit.client.0.smithi076.stdout:9/229: getdents d9 0 2024-03-28T13:03:41.329 INFO:tasks.workunit.client.0.smithi076.stdout:6/258: symlink d6/da/d40/l54 0 2024-03-28T13:03:41.473 INFO:tasks.workunit.client.0.smithi076.stdout:8/192: mknod de/d13/c3d 0 2024-03-28T13:03:41.611 INFO:tasks.workunit.client.0.smithi076.stdout:2/231: symlink d2/d5/db/l49 0 2024-03-28T13:03:41.612 INFO:tasks.workunit.client.0.smithi076.stdout:2/232: fsync d2/d5/d7/d3e/f45 0 2024-03-28T13:03:41.626 INFO:tasks.workunit.client.0.smithi076.stdout:2/233: dread d2/d5/d7/f19 [0,4194304] 0 2024-03-28T13:03:41.665 INFO:tasks.workunit.client.0.smithi076.stdout:2/234: dwrite d2/d5/d7/d8/d21/f27 [0,4194304] 0 2024-03-28T13:03:41.666 INFO:tasks.workunit.client.0.smithi076.stdout:2/235: dread - d2/d5/d7/d8/d21/f48 zero size 2024-03-28T13:03:41.666 INFO:tasks.workunit.client.0.smithi076.stdout:2/236: chown d2/d5/l2c 2 1 2024-03-28T13:03:41.666 INFO:tasks.workunit.client.0.smithi076.stdout:2/237: chown d2/d1d/d39 3277908 1 2024-03-28T13:03:41.666 INFO:tasks.workunit.client.0.smithi076.stdout:2/238: fsync d2/d5/d7/d3e/f45 0 2024-03-28T13:03:41.828 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:03:41.832 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:03:41.948 INFO:tasks.workunit.client.0.smithi076.stdout:0/241: write db/dc/d3d/d46/f58 [1195809,120603] 0 2024-03-28T13:03:42.128 INFO:tasks.workunit.client.0.smithi076.stdout:9/230: mknod d9/dd/c52 0 2024-03-28T13:03:42.128 INFO:tasks.workunit.client.0.smithi076.stdout:9/231: fdatasync d9/dd/df/d11/d14/f4e 0 2024-03-28T13:03:42.128 INFO:tasks.workunit.client.0.smithi076.stdout:6/259: mkdir d6/da/d40/d55 0 2024-03-28T13:03:42.128 INFO:tasks.workunit.client.0.smithi076.stdout:9/232: getdents d9/dd/df 0 2024-03-28T13:03:42.147 INFO:tasks.workunit.client.0.smithi076.stdout:9/233: dread d9/dd/df/d11/d14/f31 [0,4194304] 0 2024-03-28T13:03:42.147 INFO:tasks.workunit.client.0.smithi076.stdout:8/193: creat de/d12/f3e x:0 0 0 2024-03-28T13:03:42.148 INFO:tasks.workunit.client.0.smithi076.stdout:8/194: chown de/d12/f21 100 1 2024-03-28T13:03:42.148 INFO:tasks.workunit.client.0.smithi076.stdout:8/195: write f7 [2937128,40565] 0 2024-03-28T13:03:42.148 INFO:tasks.workunit.client.0.smithi076.stdout:8/196: readlink de/d12/l14 0 2024-03-28T13:03:42.158 INFO:tasks.workunit.client.0.smithi076.stdout:3/186: symlink d1/d7/d30/d38/l47 0 2024-03-28T13:03:42.165 INFO:tasks.workunit.client.0.smithi076.stdout:2/239: link d2/d1d/d39/l41 d2/d5/db/d3b/l4a 0 2024-03-28T13:03:42.218 INFO:tasks.workunit.client.0.smithi076.stdout:2/240: dwrite d2/d5/d7/f40 [0,4194304] 0 2024-03-28T13:03:42.218 INFO:tasks.workunit.client.0.smithi076.stdout:2/241: chown d2/d5/db 0 1 2024-03-28T13:03:42.440 INFO:tasks.workunit.client.0.smithi076.stdout:0/242: creat db/dc/f66 x:0 0 0 2024-03-28T13:03:42.440 INFO:tasks.workunit.client.0.smithi076.stdout:0/243: chown db/dc/df/d11/f1c 23223606 1 2024-03-28T13:03:42.440 INFO:tasks.workunit.client.0.smithi076.stdout:1/245: truncate f8 1508108 0 2024-03-28T13:03:42.454 INFO:tasks.workunit.client.0.smithi076.stdout:0/244: read db/dc/df/f1a [814058,73607] 0 2024-03-28T13:03:42.509 INFO:tasks.workunit.client.0.smithi076.stdout:6/260: rmdir d6 39 2024-03-28T13:03:42.620 INFO:tasks.workunit.client.0.smithi076.stdout:9/234: truncate d9/d3c/f32 936189 0 2024-03-28T13:03:42.620 INFO:tasks.workunit.client.0.smithi076.stdout:8/197: creat de/f3f x:0 0 0 2024-03-28T13:03:42.622 INFO:tasks.workunit.client.0.smithi076.stdout:2/242: unlink d2/f18 0 2024-03-28T13:03:42.622 INFO:tasks.workunit.client.0.smithi076.stdout:2/243: fsync d2/d5/d7/f19 0 2024-03-28T13:03:42.639 INFO:tasks.workunit.client.0.smithi076.stdout:8/198: dread de/d13/d27/f29 [0,4194304] 0 2024-03-28T13:03:42.658 INFO:tasks.workunit.client.0.smithi076.stdout:2/244: dread d2/d5/d7/d28/f43 [0,4194304] 0 2024-03-28T13:03:42.658 INFO:tasks.workunit.client.0.smithi076.stdout:7/248: dwrite d1/d8/f1e [0,4194304] 0 2024-03-28T13:03:42.910 INFO:tasks.workunit.client.0.smithi076.stdout:0/245: symlink db/dc/df/d11/d40/l67 0 2024-03-28T13:03:42.951 INFO:tasks.workunit.client.0.smithi076.stdout:0/246: dwrite db/dc/df/d18/f5f [0,4194304] 0 2024-03-28T13:03:43.152 INFO:tasks.workunit.client.0.smithi076.stdout:6/261: mkdir d6/da/d40/d56 0 2024-03-28T13:03:43.181 INFO:tasks.workunit.client.0.smithi076.stdout:8/199: mknod de/d23/d2b/d2c/c40 0 2024-03-28T13:03:43.222 INFO:tasks.workunit.client.0.smithi076.stdout:8/200: dwrite de/d12/d18/f32 [0,4194304] 0 2024-03-28T13:03:43.223 INFO:tasks.workunit.client.0.smithi076.stdout:8/201: fdatasync de/d13/d27/f29 0 2024-03-28T13:03:43.258 INFO:tasks.workunit.client.0.smithi076.stdout:8/202: dwrite f7 [8388608,4194304] 0 2024-03-28T13:03:43.280 INFO:tasks.workunit.client.0.smithi076.stdout:8/203: write de/f10 [306953,9228] 0 2024-03-28T13:03:43.280 INFO:tasks.workunit.client.0.smithi076.stdout:8/204: chown fa 7389823 1 2024-03-28T13:03:43.295 INFO:tasks.workunit.client.0.smithi076.stdout:8/205: write de/d13/d27/f29 [2858910,118149] 0 2024-03-28T13:03:43.295 INFO:tasks.workunit.client.0.smithi076.stdout:8/206: readlink de/d12/d18/l2f 0 2024-03-28T13:03:43.360 INFO:tasks.workunit.client.0.smithi076.stdout:7/249: link d1/dc/c2e d1/d18/d3c/c57 0 2024-03-28T13:03:43.360 INFO:tasks.workunit.client.0.smithi076.stdout:7/250: write d1/d18/d3c/f20 [435779,5493] 0 2024-03-28T13:03:43.503 INFO:tasks.workunit.client.0.smithi076.stdout:0/247: creat db/dc/df/d18/d1d/f68 x:0 0 0 2024-03-28T13:03:43.525 INFO:tasks.workunit.client.0.smithi076.stdout:0/248: write db/f4b [2746781,32858] 0 2024-03-28T13:03:43.525 INFO:tasks.workunit.client.0.smithi076.stdout:0/249: write db/f4b [4845007,6921] 0 2024-03-28T13:03:43.602 INFO:tasks.workunit.client.0.smithi076.stdout:7/251: creat d1/d8/d37/f58 x:0 0 0 2024-03-28T13:03:44.284 INFO:tasks.workunit.client.0.smithi076.stdout:3/187: creat d1/f48 x:0 0 0 2024-03-28T13:03:44.287 INFO:tasks.workunit.client.0.smithi076.stdout:9/235: creat d9/f53 x:0 0 0 2024-03-28T13:03:44.289 INFO:tasks.workunit.client.0.smithi076.stdout:9/236: dread d9/dd/df/d11/d14/f16 [0,4194304] 0 2024-03-28T13:03:44.289 INFO:tasks.workunit.client.0.smithi076.stdout:9/237: readlink d9/dd/df/d11/d14/l27 0 2024-03-28T13:03:44.289 INFO:tasks.workunit.client.0.smithi076.stdout:9/238: chown d9/dd/df/d11/f4b 2832 1 2024-03-28T13:03:44.306 INFO:tasks.workunit.client.0.smithi076.stdout:3/188: dwrite d1/d7/d30/d38/d14/d18/d3a/f40 [0,4194304] 0 2024-03-28T13:03:44.383 INFO:tasks.workunit.client.0.smithi076.stdout:9/239: link d9/dd/df/d11/d14/f4e d9/f54 0 2024-03-28T13:03:44.383 INFO:tasks.workunit.client.0.smithi076.stdout:9/240: chown d9/dd/df/d11/d18/d2a/f49 0 1 2024-03-28T13:03:44.384 INFO:tasks.workunit.client.0.smithi076.stdout:9/241: dread d9/dd/df/d11/d14/f16 [0,4194304] 0 2024-03-28T13:03:44.594 INFO:tasks.workunit.client.0.smithi076.stdout:9/242: unlink d9/d3c/l42 0 2024-03-28T13:03:44.594 INFO:tasks.workunit.client.0.smithi076.stdout:9/243: chown d9/l38 6002114 1 2024-03-28T13:03:44.641 INFO:tasks.workunit.client.0.smithi076.stdout:3/189: symlink d1/d7/d30/d38/l49 0 2024-03-28T13:03:44.648 INFO:tasks.workunit.client.0.smithi076.stdout:9/244: dwrite d9/dd/df/f25 [0,4194304] 0 2024-03-28T13:03:44.702 INFO:tasks.workunit.client.0.smithi076.stdout:9/245: dwrite d9/dd/df/f13 [0,4194304] 0 2024-03-28T13:03:45.033 INFO:tasks.workunit.client.0.smithi076.stdout:6/262: symlink d6/l57 0 2024-03-28T13:03:45.051 INFO:tasks.workunit.client.0.smithi076.stdout:5/232: rename d5/f7 to d5/db/d3f/d42/f58 0 2024-03-28T13:03:45.052 INFO:tasks.workunit.client.0.smithi076.stdout:3/190: mkdir d1/d7/d30/d38/d14/d4a 0 2024-03-28T13:03:45.068 INFO:tasks.workunit.client.0.smithi076.stdout:5/233: dread d5/db/f13 [0,4194304] 0 2024-03-28T13:03:45.263 INFO:tasks.workunit.client.0.smithi076.stdout:6/263: mkdir d6/da/d40/d56/d58 0 2024-03-28T13:03:45.264 INFO:tasks.workunit.client.0.smithi076.stdout:6/264: chown c2 20 1 2024-03-28T13:03:45.264 INFO:tasks.workunit.client.0.smithi076.stdout:4/252: rename d0/f2 to d0/db/d2d/f4f 0 2024-03-28T13:03:45.264 INFO:tasks.workunit.client.0.smithi076.stdout:4/253: fsync d0/d3b/d40/d42/f37 0 2024-03-28T13:03:45.264 INFO:tasks.workunit.client.0.smithi076.stdout:4/254: truncate d0/f1f 4790251 0 2024-03-28T13:03:45.264 INFO:tasks.workunit.client.0.smithi076.stdout:4/255: read - d0/f15 zero size 2024-03-28T13:03:45.264 INFO:tasks.workunit.client.0.smithi076.stdout:3/191: symlink d1/d7/d30/d38/d14/d18/l4b 0 2024-03-28T13:03:45.264 INFO:tasks.workunit.client.0.smithi076.stdout:3/192: readlink d1/d7/d30/d38/d14/d18/l4b 0 2024-03-28T13:03:45.274 INFO:tasks.workunit.client.0.smithi076.stdout:4/256: dread d0/db/d2d/f35 [0,4194304] 0 2024-03-28T13:03:45.276 INFO:tasks.workunit.client.0.smithi076.stdout:5/234: link d5/fa d5/d9/f59 0 2024-03-28T13:03:45.276 INFO:tasks.workunit.client.0.smithi076.stdout:5/235: stat d5/db/f13 0 2024-03-28T13:03:45.291 INFO:tasks.workunit.client.0.smithi076.stdout:5/236: dread d5/d9/d1c/d25/f2b [0,4194304] 0 2024-03-28T13:03:45.422 INFO:tasks.workunit.client.0.smithi076.stdout:6/265: rmdir d6/da/d40/d55 0 2024-03-28T13:03:45.536 INFO:tasks.workunit.client.0.smithi076.stdout:2/245: rename d2/d1d to d2/d5/d4b 0 2024-03-28T13:03:45.577 INFO:tasks.workunit.client.0.smithi076.stdout:0/250: sync 2024-03-28T13:03:45.577 INFO:tasks.workunit.client.0.smithi076.stdout:7/252: sync 2024-03-28T13:03:45.577 INFO:tasks.workunit.client.0.smithi076.stdout:1/246: sync 2024-03-28T13:03:45.577 INFO:tasks.workunit.client.0.smithi076.stdout:0/251: write f5 [239859,1666] 0 2024-03-28T13:03:45.577 INFO:tasks.workunit.client.0.smithi076.stdout:1/247: write d14/d2a/d2e/d31/d3b/f4e [1119304,4689] 0 2024-03-28T13:03:45.606 INFO:tasks.workunit.client.0.smithi076.stdout:3/193: chown d1/d2/l13 295256 1 2024-03-28T13:03:45.606 INFO:tasks.workunit.client.0.smithi076.stdout:3/194: fsync d1/d7/d30/d38/f35 0 2024-03-28T13:03:45.648 INFO:tasks.workunit.client.0.smithi076.stdout:3/195: dwrite d1/d7/d30/d38/f1a [0,4194304] 0 2024-03-28T13:03:45.664 INFO:tasks.workunit.client.0.smithi076.stdout:4/257: mkdir d0/d3b/d50 0 2024-03-28T13:03:45.664 INFO:tasks.workunit.client.0.smithi076.stdout:4/258: chown d0/f30 710280 1 2024-03-28T13:03:45.671 INFO:tasks.workunit.client.0.smithi076.stdout:3/196: read d1/d7/d30/f43 [1821237,8964] 0 2024-03-28T13:03:45.724 INFO:tasks.workunit.client.0.smithi076.stdout:9/246: sync 2024-03-28T13:03:45.724 INFO:tasks.workunit.client.0.smithi076.stdout:5/237: creat d5/db/df/f5a x:0 0 0 2024-03-28T13:03:45.740 INFO:tasks.workunit.client.0.smithi076.stdout:5/238: read d5/db/d3f/d42/f58 [2941193,101829] 0 2024-03-28T13:03:45.740 INFO:tasks.workunit.client.0.smithi076.stdout:5/239: chown d5/d9/f59 8646 1 2024-03-28T13:03:45.753 INFO:tasks.workunit.client.0.smithi076.stdout:6/266: creat d6/f59 x:0 0 0 2024-03-28T13:03:45.761 INFO:tasks.workunit.client.0.smithi076.stdout:5/240: dread d5/d9/f59 [0,4194304] 0 2024-03-28T13:03:45.761 INFO:tasks.workunit.client.0.smithi076.stdout:6/267: read d6/da/d1e/f1f [557914,15294] 0 2024-03-28T13:03:45.835 INFO:tasks.workunit.client.0.smithi076.stdout:8/207: rename de/d12/c31 to de/d13/c41 0 2024-03-28T13:03:45.881 INFO:tasks.workunit.client.0.smithi076.stdout:2/246: creat d2/d5/d7/d28/f4c x:0 0 0 2024-03-28T13:03:45.890 INFO:tasks.workunit.client.0.smithi076.stdout:2/247: dread d2/d5/d7/f19 [0,4194304] 0 2024-03-28T13:03:45.928 INFO:tasks.workunit.client.0.smithi076.stdout:2/248: dwrite d2/d5/d7/d8/d21/f48 [0,4194304] 0 2024-03-28T13:03:45.930 INFO:tasks.workunit.client.0.smithi076.stdout:2/249: dread d2/f16 [0,4194304] 0 2024-03-28T13:03:45.966 INFO:tasks.workunit.client.0.smithi076.stdout:7/253: symlink d1/dc/l59 0 2024-03-28T13:03:46.140 INFO:tasks.workunit.client.0.smithi076.stdout:1/248: unlink d14/d19/d20/l36 0 2024-03-28T13:03:46.140 INFO:tasks.workunit.client.0.smithi076.stdout:0/252: truncate db/f17 845255 0 2024-03-28T13:03:46.164 INFO:tasks.workunit.client.0.smithi076.stdout:0/253: read db/dc/df/f22 [1053206,109123] 0 2024-03-28T13:03:46.175 INFO:tasks.workunit.client.0.smithi076.stdout:4/259: mknod d0/d3b/d40/d42/d47/c51 0 2024-03-28T13:03:46.185 INFO:tasks.workunit.client.0.smithi076.stdout:0/254: read db/dc/fe [21050,111546] 0 2024-03-28T13:03:46.241 INFO:tasks.workunit.client.0.smithi076.stdout:3/197: creat d1/d7/d30/f4c x:0 0 0 2024-03-28T13:03:46.386 INFO:tasks.workunit.client.0.smithi076.stdout:5/241: symlink d5/d9/d1c/d1d/d31/l5b 0 2024-03-28T13:03:46.386 INFO:tasks.workunit.client.0.smithi076.stdout:5/242: write d5/d9/d1c/f32 [226965,127984] 0 2024-03-28T13:03:46.458 INFO:tasks.workunit.client.0.smithi076.stdout:6/268: truncate d6/da/d1e/f1f 534354 0 2024-03-28T13:03:46.459 INFO:tasks.workunit.client.0.smithi076.stdout:6/269: write d6/fb [3208267,90497] 0 2024-03-28T13:03:46.493 INFO:tasks.workunit.client.0.smithi076.stdout:6/270: dwrite d6/da/d39/f3b [0,4194304] 0 2024-03-28T13:03:46.493 INFO:tasks.workunit.client.0.smithi076.stdout:6/271: dread - d6/f3c zero size 2024-03-28T13:03:46.493 INFO:tasks.workunit.client.0.smithi076.stdout:6/272: fsync d6/da/f21 0 2024-03-28T13:03:46.524 INFO:tasks.workunit.client.0.smithi076.stdout:8/208: symlink de/d25/l42 0 2024-03-28T13:03:46.524 INFO:tasks.workunit.client.0.smithi076.stdout:8/209: read fa [1726,123090] 0 2024-03-28T13:03:46.680 INFO:tasks.workunit.client.0.smithi076.stdout:2/250: symlink d2/d5/d7/d8/d21/l4d 0 2024-03-28T13:03:46.750 INFO:tasks.workunit.client.0.smithi076.stdout:7/254: rename d1/c1f to d1/d8/c5a 0 2024-03-28T13:03:47.193 INFO:tasks.workunit.client.0.smithi076.stdout:1/249: creat d14/d2a/d2e/d31/f53 x:0 0 0 2024-03-28T13:03:47.193 INFO:tasks.workunit.client.0.smithi076.stdout:1/250: truncate d14/d19/f4b 122124 0 2024-03-28T13:03:47.338 INFO:tasks.workunit.client.0.smithi076.stdout:4/260: creat d0/d3b/d40/d42/d31/d4d/f52 x:0 0 0 2024-03-28T13:03:47.339 INFO:tasks.workunit.client.0.smithi076.stdout:0/255: mkdir db/dc/df/d11/d40/d69 0 2024-03-28T13:03:47.550 INFO:tasks.workunit.client.0.smithi076.stdout:5/243: creat d5/d9/d1c/d1d/d31/f5c x:0 0 0 2024-03-28T13:03:47.564 INFO:tasks.workunit.client.0.smithi076.stdout:6/273: truncate d6/da/d39/d41/f3e 2086711 0 2024-03-28T13:03:47.564 INFO:tasks.workunit.client.0.smithi076.stdout:8/210: mknod de/d13/c43 0 2024-03-28T13:03:47.564 INFO:tasks.workunit.client.0.smithi076.stdout:6/274: dread - d6/f4b zero size 2024-03-28T13:03:47.564 INFO:tasks.workunit.client.0.smithi076.stdout:2/251: write d2/d5/f12 [4104587,69704] 0 2024-03-28T13:03:47.564 INFO:tasks.workunit.client.0.smithi076.stdout:2/252: stat d2/d5/d7/d8/d21/l4d 0 2024-03-28T13:03:47.580 INFO:tasks.workunit.client.0.smithi076.stdout:2/253: write d2/d5/d7/fa [941520,79146] 0 2024-03-28T13:03:47.583 INFO:tasks.workunit.client.0.smithi076.stdout:7/255: mknod d1/d8/c5b 0 2024-03-28T13:03:47.587 INFO:tasks.workunit.client.0.smithi076.stdout:8/211: dread fd [0,4194304] 0 2024-03-28T13:03:47.593 INFO:tasks.workunit.client.0.smithi076.stdout:6/275: write d6/da/d39/f3b [4040895,18674] 0 2024-03-28T13:03:47.593 INFO:tasks.workunit.client.0.smithi076.stdout:6/276: stat d6/c26 0 2024-03-28T13:03:47.593 INFO:tasks.workunit.client.0.smithi076.stdout:6/277: chown d6/da/d40/d56 118371 1 2024-03-28T13:03:47.615 INFO:tasks.workunit.client.0.smithi076.stdout:2/254: dwrite d2/d5/d7/f19 [4194304,4194304] 0 2024-03-28T13:03:47.618 INFO:tasks.workunit.client.0.smithi076.stdout:7/256: dwrite d1/d8/d37/f43 [0,4194304] 0 2024-03-28T13:03:47.619 INFO:tasks.workunit.client.0.smithi076.stdout:7/257: read d1/f6 [3810476,54563] 0 2024-03-28T13:03:47.619 INFO:tasks.workunit.client.0.smithi076.stdout:7/258: truncate d1/f40 326031 0 2024-03-28T13:03:47.619 INFO:tasks.workunit.client.0.smithi076.stdout:7/259: readlink d1/d18/l39 0 2024-03-28T13:03:47.622 INFO:tasks.workunit.client.0.smithi076.stdout:7/260: dread d1/d18/d3c/f24 [0,4194304] 0 2024-03-28T13:03:47.627 INFO:tasks.workunit.client.0.smithi076.stdout:7/261: dread d1/f13 [4194304,4194304] 0 2024-03-28T13:03:47.627 INFO:tasks.workunit.client.0.smithi076.stdout:7/262: chown d1/d18/d3c/c57 424560 1 2024-03-28T13:03:47.634 INFO:tasks.workunit.client.0.smithi076.stdout:6/278: dwrite d6/da/d40/f48 [0,4194304] 0 2024-03-28T13:03:47.634 INFO:tasks.workunit.client.0.smithi076.stdout:6/279: chown d6/da/d39 1492 1 2024-03-28T13:03:47.634 INFO:tasks.workunit.client.0.smithi076.stdout:6/280: truncate d6/da/d23/f32 659951 0 2024-03-28T13:03:47.634 INFO:tasks.workunit.client.0.smithi076.stdout:6/281: chown d6/da/d39 300541767 1 2024-03-28T13:03:47.635 INFO:tasks.workunit.client.0.smithi076.stdout:6/282: truncate d6/f2f 479811 0 2024-03-28T13:03:47.635 INFO:tasks.workunit.client.0.smithi076.stdout:6/283: stat d6/c16 0 2024-03-28T13:03:47.635 INFO:tasks.workunit.client.0.smithi076.stdout:6/284: write d6/da/f21 [319358,127019] 0 2024-03-28T13:03:47.635 INFO:tasks.workunit.client.0.smithi076.stdout:6/285: write d6/f59 [659729,86322] 0 2024-03-28T13:03:47.635 INFO:tasks.workunit.client.0.smithi076.stdout:6/286: write d6/da/d1e/f3d [291879,14051] 0 2024-03-28T13:03:47.638 INFO:tasks.workunit.client.0.smithi076.stdout:6/287: fsync d6/da/d39/f3b 0 2024-03-28T13:03:47.799 INFO:tasks.workunit.client.0.smithi076.stdout:1/251: getdents d14/d2a 0 2024-03-28T13:03:47.803 INFO:tasks.workunit.client.0.smithi076.stdout:9/247: sync 2024-03-28T13:03:47.803 INFO:tasks.workunit.client.0.smithi076.stdout:9/248: chown d9/dd/df/d11/d37/l35 0 1 2024-03-28T13:03:47.803 INFO:tasks.workunit.client.0.smithi076.stdout:9/249: read - d9/dd/df/d11/d18/f50 zero size 2024-03-28T13:03:47.868 INFO:tasks.workunit.client.0.smithi076.stdout:4/261: mknod d0/d20/c53 0 2024-03-28T13:03:47.883 INFO:tasks.workunit.client.0.smithi076.stdout:0/256: creat db/dc/d3d/d46/f6a x:0 0 0 2024-03-28T13:03:47.891 INFO:tasks.workunit.client.0.smithi076.stdout:4/262: dwrite d0/db/d2d/f4f [0,4194304] 0 2024-03-28T13:03:47.891 INFO:tasks.workunit.client.0.smithi076.stdout:4/263: chown d0/c1a 4296129 1 2024-03-28T13:03:48.084 INFO:tasks.workunit.client.0.smithi076.stdout:8/212: truncate de/d12/f21 581927 0 2024-03-28T13:03:48.143 INFO:tasks.workunit.client.0.smithi076.stdout:2/255: creat d2/d5/db/d3b/f4e x:0 0 0 2024-03-28T13:03:48.361 INFO:tasks.workunit.client.0.smithi076.stdout:7/263: creat d1/d18/f5c x:0 0 0 2024-03-28T13:03:48.362 INFO:tasks.workunit.client.0.smithi076.stdout:7/264: write d1/d18/d2d/f34 [4739542,45221] 0 2024-03-28T13:03:48.486 INFO:tasks.workunit.client.0.smithi076.stdout:6/288: creat d6/da/d1e/f5a x:0 0 0 2024-03-28T13:03:48.486 INFO:tasks.workunit.client.0.smithi076.stdout:6/289: chown d6/da/f15 14594 1 2024-03-28T13:03:48.578 INFO:tasks.workunit.client.0.smithi076.stdout:1/252: dread f8 [0,4194304] 0 2024-03-28T13:03:48.623 INFO:tasks.workunit.client.0.smithi076.stdout:9/250: symlink d9/d3c/l55 0 2024-03-28T13:03:48.791 INFO:tasks.workunit.client.0.smithi076.stdout:4/264: rename d0/d3b/d40/d42/d31/d4d/f3e to d0/d3b/d40/d42/d31/d4d/f54 0 2024-03-28T13:03:48.791 INFO:tasks.workunit.client.0.smithi076.stdout:0/257: creat db/dc/df/d11/d40/d69/f6b x:0 0 0 2024-03-28T13:03:48.817 INFO:tasks.workunit.client.0.smithi076.stdout:4/265: dread d0/db/d2d/f3a [0,4194304] 0 2024-03-28T13:03:48.944 INFO:tasks.workunit.client.0.smithi076.stdout:8/213: creat de/d12/d18/d3c/f44 x:0 0 0 2024-03-28T13:03:48.945 INFO:tasks.workunit.client.0.smithi076.stdout:8/214: truncate de/d23/f1e 859415 0 2024-03-28T13:03:48.987 INFO:tasks.workunit.client.0.smithi076.stdout:2/256: creat d2/d5/db/d3b/d3f/f4f x:0 0 0 2024-03-28T13:03:48.987 INFO:tasks.workunit.client.0.smithi076.stdout:2/257: readlink d2/l25 0 2024-03-28T13:03:49.005 INFO:tasks.workunit.client.0.smithi076.stdout:3/198: sync 2024-03-28T13:03:49.006 INFO:tasks.workunit.client.0.smithi076.stdout:3/199: dread - d1/d7/d30/f4c zero size 2024-03-28T13:03:49.038 INFO:tasks.workunit.client.0.smithi076.stdout:7/265: symlink d1/dc/l5d 0 2024-03-28T13:03:49.077 INFO:tasks.workunit.client.0.smithi076.stdout:7/266: dwrite d1/f7 [4194304,4194304] 0 2024-03-28T13:03:49.077 INFO:tasks.workunit.client.0.smithi076.stdout:7/267: readlink d1/d18/l39 0 2024-03-28T13:03:49.106 INFO:tasks.workunit.client.0.smithi076.stdout:6/290: rename d6/da/d39/d41/f34 to d6/da/d39/d41/f5b 0 2024-03-28T13:03:49.106 INFO:tasks.workunit.client.0.smithi076.stdout:6/291: fsync d6/da/d40/f48 0 2024-03-28T13:03:49.259 INFO:tasks.workunit.client.0.smithi076.stdout:1/253: creat d14/d2a/d3f/f54 x:0 0 0 2024-03-28T13:03:49.623 INFO:tasks.workunit.client.0.smithi076.stdout:4/266: rename d0/d3b/d40/d42/d31/l33 to d0/d20/l55 0 2024-03-28T13:03:49.709 INFO:tasks.workunit.client.0.smithi076.stdout:5/244: write d5/d9/d1c/d1d/d22/f33 [876010,88408] 0 2024-03-28T13:03:49.709 INFO:tasks.workunit.client.0.smithi076.stdout:5/245: write d5/d9/d1c/d1d/d22/f33 [999883,105468] 0 2024-03-28T13:03:49.709 INFO:tasks.workunit.client.0.smithi076.stdout:5/246: chown d5/d9/d1c/d1d/d31/l5b 1 1 2024-03-28T13:03:49.709 INFO:tasks.workunit.client.0.smithi076.stdout:5/247: stat d5/d9/d1c/d25/f3a 0 2024-03-28T13:03:50.000 INFO:tasks.workunit.client.0.smithi076.stdout:8/215: symlink de/d12/d18/l45 0 2024-03-28T13:03:50.000 INFO:tasks.workunit.client.0.smithi076.stdout:8/216: fsync de/d13/f35 0 2024-03-28T13:03:50.236 INFO:tasks.workunit.client.0.smithi076.stdout:7/268: creat d1/d8/d37/f5e x:0 0 0 2024-03-28T13:03:50.236 INFO:tasks.workunit.client.0.smithi076.stdout:1/254: creat d14/d2a/d2e/d31/d3b/f55 x:0 0 0 2024-03-28T13:03:50.289 INFO:tasks.workunit.client.0.smithi076.stdout:3/200: rename d1/d7/d30/d38/f1d to d1/d7/d30/d38/d14/d18/f4d 0 2024-03-28T13:03:50.335 INFO:tasks.workunit.client.0.smithi076.stdout:5/248: getdents d5/db/d19 0 2024-03-28T13:03:50.335 INFO:tasks.workunit.client.0.smithi076.stdout:5/249: dread - d5/db/d19/f52 zero size 2024-03-28T13:03:50.370 INFO:tasks.workunit.client.0.smithi076.stdout:8/217: symlink de/d12/d18/d3c/l46 0 2024-03-28T13:03:50.714 INFO:tasks.workunit.client.0.smithi076.stdout:7/269: creat d1/d18/d3c/f5f x:0 0 0 2024-03-28T13:03:50.914 INFO:tasks.workunit.client.0.smithi076.stdout:3/201: creat d1/d7/d30/d38/d14/d27/f4e x:0 0 0 2024-03-28T13:03:50.914 INFO:tasks.workunit.client.0.smithi076.stdout:3/202: chown d1/d7/d30/d38/d14/d36/l45 1666161 1 2024-03-28T13:03:50.914 INFO:tasks.workunit.client.0.smithi076.stdout:3/203: fdatasync d1/f1b 0 2024-03-28T13:03:50.914 INFO:tasks.workunit.client.0.smithi076.stdout:5/250: getdents d5/d9 0 2024-03-28T13:03:50.915 INFO:tasks.workunit.client.0.smithi076.stdout:8/218: symlink de/d23/d2b/d2c/l47 0 2024-03-28T13:03:50.915 INFO:tasks.workunit.client.0.smithi076.stdout:5/251: chown d5/db/d3f/d42/f58 845 1 2024-03-28T13:03:50.915 INFO:tasks.workunit.client.0.smithi076.stdout:5/252: write d5/db/f46 [4468727,41367] 0 2024-03-28T13:03:50.918 INFO:tasks.workunit.client.0.smithi076.stdout:5/253: read d5/db/f12 [11477,20189] 0 2024-03-28T13:03:51.157 INFO:tasks.workunit.client.0.smithi076.stdout:7/270: getdents d1 0 2024-03-28T13:03:51.241 INFO:tasks.workunit.client.0.smithi076.stdout:9/251: dwrite d9/dd/df/d11/d18/f3d [4194304,4194304] 0 2024-03-28T13:03:51.241 INFO:tasks.workunit.client.0.smithi076.stdout:9/252: read d9/dd/df/d11/d14/f51 [406359,120861] 0 2024-03-28T13:03:51.241 INFO:tasks.workunit.client.0.smithi076.stdout:9/253: fdatasync d9/dd/df/d11/f4b 0 2024-03-28T13:03:51.389 INFO:tasks.workunit.client.0.smithi076.stdout:6/292: truncate d6/da/d23/f4d 931273 0 2024-03-28T13:03:51.389 INFO:tasks.workunit.client.0.smithi076.stdout:6/293: chown d6/da/d40/l51 77 1 2024-03-28T13:03:51.389 INFO:tasks.workunit.client.0.smithi076.stdout:6/294: dread - d6/da/d39/d41/f5b zero size 2024-03-28T13:03:51.389 INFO:tasks.workunit.client.0.smithi076.stdout:6/295: write d6/f12 [4865915,37587] 0 2024-03-28T13:03:51.400 INFO:tasks.workunit.client.0.smithi076.stdout:0/258: sync 2024-03-28T13:03:51.400 INFO:tasks.workunit.client.0.smithi076.stdout:2/258: sync 2024-03-28T13:03:51.427 INFO:tasks.workunit.client.0.smithi076.stdout:4/267: dwrite d0/f1e [0,4194304] 0 2024-03-28T13:03:51.431 INFO:tasks.workunit.client.0.smithi076.stdout:2/259: read d2/d5/d7/f17 [3986707,121126] 0 2024-03-28T13:03:51.431 INFO:tasks.workunit.client.0.smithi076.stdout:2/260: readlink d2/d5/d7/dd/l31 0 2024-03-28T13:03:51.437 INFO:tasks.workunit.client.0.smithi076.stdout:0/259: write db/dc/df/d18/f5f [2315072,119977] 0 2024-03-28T13:03:51.477 INFO:tasks.workunit.client.0.smithi076.stdout:0/260: dwrite db/dc/d3d/d46/f6a [0,4194304] 0 2024-03-28T13:03:51.478 INFO:tasks.workunit.client.0.smithi076.stdout:0/261: write db/dc/f66 [40946,126100] 0 2024-03-28T13:03:51.478 INFO:tasks.workunit.client.0.smithi076.stdout:0/262: dread - db/dc/df/d11/d40/f64 zero size 2024-03-28T13:03:51.492 INFO:tasks.workunit.client.0.smithi076.stdout:0/263: dread db/f3e [0,4194304] 0 2024-03-28T13:03:51.493 INFO:tasks.workunit.client.0.smithi076.stdout:0/264: chown db/dc/df/f1e 10383 1 2024-03-28T13:03:51.509 INFO:tasks.workunit.client.0.smithi076.stdout:0/265: dread db/dc/df/d11/f1c [0,4194304] 0 2024-03-28T13:03:51.509 INFO:tasks.workunit.client.0.smithi076.stdout:0/266: stat db/dc/df/d11/f63 0 2024-03-28T13:03:51.522 INFO:tasks.workunit.client.0.smithi076.stdout:0/267: dread db/dc/f24 [0,4194304] 0 2024-03-28T13:03:51.713 INFO:tasks.workunit.client.0.smithi076.stdout:3/204: creat d1/d2/f4f x:0 0 0 2024-03-28T13:03:51.719 INFO:tasks.workunit.client.0.smithi076.stdout:9/254: creat d9/dd/f56 x:0 0 0 2024-03-28T13:03:51.719 INFO:tasks.workunit.client.0.smithi076.stdout:5/254: creat d5/d9/d1c/d25/f5d x:0 0 0 2024-03-28T13:03:51.723 INFO:tasks.workunit.client.0.smithi076.stdout:6/296: symlink d6/da/d23/l5c 0 2024-03-28T13:03:51.727 INFO:tasks.workunit.client.0.smithi076.stdout:3/205: dread d1/d7/d30/d38/d14/f26 [0,4194304] 0 2024-03-28T13:03:51.749 INFO:tasks.workunit.client.0.smithi076.stdout:6/297: dread d6/da/f14 [0,4194304] 0 2024-03-28T13:03:51.751 INFO:tasks.workunit.client.0.smithi076.stdout:5/255: dwrite d5/db/f46 [0,4194304] 0 2024-03-28T13:03:51.751 INFO:tasks.workunit.client.0.smithi076.stdout:5/256: write d5/db/f12 [1395369,105433] 0 2024-03-28T13:03:51.763 INFO:tasks.workunit.client.0.smithi076.stdout:9/255: dwrite d9/d3c/f29 [0,4194304] 0 2024-03-28T13:03:51.763 INFO:tasks.workunit.client.0.smithi076.stdout:9/256: write d9/da/f39 [910497,15516] 0 2024-03-28T13:03:51.783 INFO:tasks.workunit.client.0.smithi076.stdout:9/257: dread d9/dd/df/f13 [0,4194304] 0 2024-03-28T13:03:51.783 INFO:tasks.workunit.client.0.smithi076.stdout:9/258: stat d9/da/l4d 0 2024-03-28T13:03:51.853 INFO:tasks.workunit.client.0.smithi076.stdout:4/268: link d0/d3b/d40/d42/d31/d4d/f52 d0/d3b/d40/d42/d31/f56 0 2024-03-28T13:03:52.163 INFO:tasks.workunit.client.0.smithi076.stdout:2/261: symlink d2/d5/l50 0 2024-03-28T13:03:52.217 INFO:tasks.workunit.client.0.smithi076.stdout:2/262: dwrite d2/d5/db/d3b/f4e [0,4194304] 0 2024-03-28T13:03:52.223 INFO:tasks.workunit.client.0.smithi076.stdout:3/206: symlink d1/d7/d30/d38/d14/d36/l50 0 2024-03-28T13:03:52.319 INFO:tasks.workunit.client.0.smithi076.stdout:6/298: rename d6/da/f21 to d6/da/d39/d41/d46/f5d 0 2024-03-28T13:03:52.360 INFO:tasks.workunit.client.0.smithi076.stdout:6/299: dwrite d6/da/d1e/f50 [4194304,4194304] 0 2024-03-28T13:03:52.442 INFO:tasks.workunit.client.0.smithi076.stdout:4/269: symlink d0/d3b/l57 0 2024-03-28T13:03:52.585 INFO:tasks.workunit.client.0.smithi076.stdout:2/263: symlink d2/d5/db/d3b/d42/l51 0 2024-03-28T13:03:52.586 INFO:tasks.workunit.client.0.smithi076.stdout:2/264: chown d2/d5/d7/d8/d21/l4d 853575396 1 2024-03-28T13:03:52.608 INFO:tasks.workunit.client.0.smithi076.stdout:1/255: dwrite d14/d2a/d2e/d31/d3b/f3d [0,4194304] 0 2024-03-28T13:03:52.729 INFO:tasks.workunit.client.0.smithi076.stdout:8/219: write de/d12/f15 [3827484,52561] 0 2024-03-28T13:03:52.729 INFO:tasks.workunit.client.0.smithi076.stdout:8/220: stat fa 0 2024-03-28T13:03:52.746 INFO:tasks.workunit.client.0.smithi076.stdout:8/221: dread de/d12/d18/f1a [0,4194304] 0 2024-03-28T13:03:52.746 INFO:tasks.workunit.client.0.smithi076.stdout:8/222: chown de/d12/f3e 37 1 2024-03-28T13:03:52.747 INFO:tasks.workunit.client.0.smithi076.stdout:8/223: truncate de/d12/d18/f33 98618 0 2024-03-28T13:03:52.795 INFO:tasks.workunit.client.0.smithi076.stdout:4/270: truncate d0/f1f 243781 0 2024-03-28T13:03:52.795 INFO:tasks.workunit.client.0.smithi076.stdout:4/271: read - d0/d3b/d40/d42/d31/f4a zero size 2024-03-28T13:03:52.917 INFO:tasks.workunit.client.0.smithi076.stdout:7/271: sync 2024-03-28T13:03:52.917 INFO:tasks.workunit.client.0.smithi076.stdout:7/272: fsync d1/f13 0 2024-03-28T13:03:52.964 INFO:tasks.workunit.client.0.smithi076.stdout:1/256: creat d14/d19/d20/f56 x:0 0 0 2024-03-28T13:03:53.004 INFO:tasks.workunit.client.0.smithi076.stdout:8/224: symlink de/d12/d18/l48 0 2024-03-28T13:03:53.004 INFO:tasks.workunit.client.0.smithi076.stdout:8/225: write de/f1d [7060044,105372] 0 2024-03-28T13:03:53.757 INFO:tasks.workunit.client.0.smithi076.stdout:4/272: creat d0/d3b/d50/f58 x:0 0 0 2024-03-28T13:03:53.757 INFO:tasks.workunit.client.0.smithi076.stdout:7/273: mknod d1/d18/d3c/c60 0 2024-03-28T13:03:53.771 INFO:tasks.workunit.client.0.smithi076.stdout:4/273: dread d0/d3b/d40/d42/d28/f32 [0,4194304] 0 2024-03-28T13:03:53.771 INFO:tasks.workunit.client.0.smithi076.stdout:4/274: read d0/d3b/d40/d42/d31/d4d/f4c [873877,23041] 0 2024-03-28T13:03:53.772 INFO:tasks.workunit.client.0.smithi076.stdout:1/257: unlink d14/d2a/d2e/l37 0 2024-03-28T13:03:53.871 INFO:tasks.workunit.client.0.smithi076.stdout:2/265: mknod d2/d5/d7/d8/c52 0 2024-03-28T13:03:53.871 INFO:tasks.workunit.client.0.smithi076.stdout:2/266: write d2/d5/d4b/f1f [609980,124052] 0 2024-03-28T13:03:53.891 INFO:tasks.workunit.client.0.smithi076.stdout:2/267: read d2/d5/d7/f40 [201333,8422] 0 2024-03-28T13:03:53.906 INFO:tasks.workunit.client.0.smithi076.stdout:0/268: truncate db/dc/d3d/d46/f6a 2072824 0 2024-03-28T13:03:53.909 INFO:tasks.workunit.client.0.smithi076.stdout:5/257: write d5/db/f2a [349355,78791] 0 2024-03-28T13:03:53.913 INFO:tasks.workunit.client.0.smithi076.stdout:9/259: creat d9/dd/f57 x:0 0 0 2024-03-28T13:03:54.282 INFO:tasks.workunit.client.0.smithi076.stdout:7/274: unlink d1/dc/f3e 0 2024-03-28T13:03:54.282 INFO:tasks.workunit.client.0.smithi076.stdout:1/258: creat d14/d2a/f57 x:0 0 0 2024-03-28T13:03:54.282 INFO:tasks.workunit.client.0.smithi076.stdout:7/275: read - d1/f4f zero size 2024-03-28T13:03:54.298 INFO:tasks.workunit.client.0.smithi076.stdout:0/269: mknod db/c6c 0 2024-03-28T13:03:54.298 INFO:tasks.workunit.client.0.smithi076.stdout:5/258: symlink d5/db/d19/l5e 0 2024-03-28T13:03:54.298 INFO:tasks.workunit.client.0.smithi076.stdout:0/270: stat db/dc/d3d/d46/c4f 0 2024-03-28T13:03:54.298 INFO:tasks.workunit.client.0.smithi076.stdout:0/271: chown db/dc/df/d11/d40/f65 382394 1 2024-03-28T13:03:54.298 INFO:tasks.workunit.client.0.smithi076.stdout:0/272: write db/dc/df/f1a [1951554,122346] 0 2024-03-28T13:03:54.329 INFO:tasks.workunit.client.0.smithi076.stdout:9/260: mkdir d9/dd/df/d11/d14/d58 0 2024-03-28T13:03:54.474 INFO:tasks.workunit.client.0.smithi076.stdout:8/226: write de/d23/f1e [1093508,40198] 0 2024-03-28T13:03:55.085 INFO:tasks.workunit.client.0.smithi076.stdout:0/273: dread db/dc/d3d/d46/f6a [0,4194304] 0 2024-03-28T13:03:55.085 INFO:tasks.workunit.client.0.smithi076.stdout:0/274: stat db/dc/df 0 2024-03-28T13:03:55.095 INFO:tasks.workunit.client.0.smithi076.stdout:7/276: mknod d1/dc/c61 0 2024-03-28T13:03:55.095 INFO:tasks.workunit.client.0.smithi076.stdout:6/300: symlink d6/l5e 0 2024-03-28T13:03:55.095 INFO:tasks.workunit.client.0.smithi076.stdout:3/207: mkdir d1/d7/d30/d38/d14/d51 0 2024-03-28T13:03:55.095 INFO:tasks.workunit.client.0.smithi076.stdout:7/277: readlink d1/d18/l39 0 2024-03-28T13:03:55.095 INFO:tasks.workunit.client.0.smithi076.stdout:1/259: creat d14/d2a/d2e/f58 x:0 0 0 2024-03-28T13:03:55.095 INFO:tasks.workunit.client.0.smithi076.stdout:1/260: write d14/d2a/f57 [197507,4232] 0 2024-03-28T13:03:55.095 INFO:tasks.workunit.client.0.smithi076.stdout:6/301: write d6/da/d39/f3b [5178436,101857] 0 2024-03-28T13:03:55.096 INFO:tasks.workunit.client.0.smithi076.stdout:2/268: mknod d2/d5/d7/c53 0 2024-03-28T13:03:55.096 INFO:tasks.workunit.client.0.smithi076.stdout:5/259: symlink d5/d9/d35/l5f 0 2024-03-28T13:03:55.096 INFO:tasks.workunit.client.0.smithi076.stdout:2/269: write d2/d5/d7/fe [2378476,35091] 0 2024-03-28T13:03:55.096 INFO:tasks.workunit.client.0.smithi076.stdout:2/270: readlink d2/d5/d7/d8/l2f 0 2024-03-28T13:03:55.096 INFO:tasks.workunit.client.0.smithi076.stdout:2/271: readlink d2/d5/l2c 0 2024-03-28T13:03:55.097 INFO:tasks.workunit.client.0.smithi076.stdout:9/261: getdents d9/dd 0 2024-03-28T13:03:55.097 INFO:tasks.workunit.client.0.smithi076.stdout:8/227: mkdir de/d12/d18/d49 0 2024-03-28T13:03:55.097 INFO:tasks.workunit.client.0.smithi076.stdout:8/228: getdents de/d12/d18/d49 0 2024-03-28T13:03:55.128 INFO:tasks.workunit.client.0.smithi076.stdout:8/229: dwrite de/d12/d18/d3c/f44 [0,4194304] 0 2024-03-28T13:03:55.138 INFO:tasks.workunit.client.0.smithi076.stdout:4/275: dwrite d0/f9 [0,4194304] 0 2024-03-28T13:03:55.138 INFO:tasks.workunit.client.0.smithi076.stdout:4/276: truncate d0/d3b/d40/d42/f19 101872 0 2024-03-28T13:03:55.151 INFO:tasks.workunit.client.0.smithi076.stdout:8/230: dread de/d12/f15 [4194304,4194304] 0 2024-03-28T13:03:55.151 INFO:tasks.workunit.client.0.smithi076.stdout:8/231: read de/d12/f15 [5787076,54376] 0 2024-03-28T13:03:55.317 INFO:tasks.workunit.client.0.smithi076.stdout:0/275: mkdir db/dc/df/d11/d40/d69/d6d 0 2024-03-28T13:03:55.318 INFO:tasks.workunit.client.0.smithi076.stdout:7/278: mknod d1/d18/d3c/c62 0 2024-03-28T13:03:55.319 INFO:tasks.workunit.client.0.smithi076.stdout:1/261: symlink d14/d2a/d2e/d31/d51/l59 0 2024-03-28T13:03:55.335 INFO:tasks.workunit.client.0.smithi076.stdout:0/276: dread db/dc/df/d11/d40/f42 [0,4194304] 0 2024-03-28T13:03:55.335 INFO:tasks.workunit.client.0.smithi076.stdout:0/277: stat db/dc/df/d18/d1d/d21/l5d 0 2024-03-28T13:03:55.346 INFO:tasks.workunit.client.0.smithi076.stdout:3/208: truncate d1/d7/d30/d38/fc 1905791 0 2024-03-28T13:03:55.347 INFO:tasks.workunit.client.0.smithi076.stdout:6/302: mkdir d6/da/d5f 0 2024-03-28T13:03:55.357 INFO:tasks.workunit.client.0.smithi076.stdout:7/279: dwrite d1/f5 [4194304,4194304] 0 2024-03-28T13:03:55.357 INFO:tasks.workunit.client.0.smithi076.stdout:7/280: chown d1/d18/c3f 599 1 2024-03-28T13:03:55.357 INFO:tasks.workunit.client.0.smithi076.stdout:7/281: chown d1/d18/c3b 369 1 2024-03-28T13:03:55.357 INFO:tasks.workunit.client.0.smithi076.stdout:7/282: stat d1/f40 0 2024-03-28T13:03:55.363 INFO:tasks.workunit.client.0.smithi076.stdout:3/209: dread d1/d7/d30/d38/d14/d18/f24 [0,4194304] 0 2024-03-28T13:03:55.363 INFO:tasks.workunit.client.0.smithi076.stdout:3/210: fdatasync d1/d2/f4f 0 2024-03-28T13:03:55.363 INFO:tasks.workunit.client.0.smithi076.stdout:3/211: truncate d1/d7/d30/d38/f29 4320342 0 2024-03-28T13:03:55.373 INFO:tasks.workunit.client.0.smithi076.stdout:5/260: mkdir d5/d9/d1c/d25/d60 0 2024-03-28T13:03:55.373 INFO:tasks.workunit.client.0.smithi076.stdout:5/261: write d5/d9/d1c/d25/f5d [399578,104190] 0 2024-03-28T13:03:55.424 INFO:tasks.workunit.client.0.smithi076.stdout:5/262: dwrite d5/d9/f4d [0,4194304] 0 2024-03-28T13:03:55.444 INFO:tasks.workunit.client.0.smithi076.stdout:2/272: mkdir d2/d54 0 2024-03-28T13:03:55.445 INFO:tasks.workunit.client.0.smithi076.stdout:9/262: rmdir d9/dd/df/d11/d37 39 2024-03-28T13:03:55.497 INFO:tasks.workunit.client.0.smithi076.stdout:2/273: dwrite d2/d5/d7/d8/d21/f48 [0,4194304] 0 2024-03-28T13:03:55.759 INFO:tasks.workunit.client.0.smithi076.stdout:4/277: rename d0/d3b/d40/d42/l1d to d0/l59 0 2024-03-28T13:03:55.759 INFO:tasks.workunit.client.0.smithi076.stdout:4/278: readlink d0/d3b/l57 0 2024-03-28T13:03:55.760 INFO:tasks.workunit.client.0.smithi076.stdout:8/232: creat de/d12/f4a x:0 0 0 2024-03-28T13:03:55.760 INFO:tasks.workunit.client.0.smithi076.stdout:8/233: fsync f2 0 2024-03-28T13:03:55.766 INFO:tasks.workunit.client.0.smithi076.stdout:8/234: fsync de/d23/f1e 0 2024-03-28T13:03:55.817 INFO:tasks.workunit.client.0.smithi076.stdout:1/262: getdents d14/d2a/d2e/d31 0 2024-03-28T13:03:55.817 INFO:tasks.workunit.client.0.smithi076.stdout:1/263: write d14/d2a/f38 [233841,72926] 0 2024-03-28T13:03:55.927 INFO:tasks.workunit.client.0.smithi076.stdout:0/278: link db/dc/df/d11/l2b db/dc/df/d18/d1d/d21/l6e 0 2024-03-28T13:03:55.928 INFO:tasks.workunit.client.0.smithi076.stdout:7/283: symlink d1/d18/d2d/l63 0 2024-03-28T13:03:55.957 INFO:tasks.workunit.client.0.smithi076.stdout:0/279: dwrite db/dc/df/d18/f4e [0,4194304] 0 2024-03-28T13:03:55.957 INFO:tasks.workunit.client.0.smithi076.stdout:0/280: write db/dc/d3d/d46/f58 [1661235,57828] 0 2024-03-28T13:03:55.967 INFO:tasks.workunit.client.0.smithi076.stdout:3/212: mknod d1/d7/d30/d38/d14/c52 0 2024-03-28T13:03:56.009 INFO:tasks.workunit.client.0.smithi076.stdout:3/213: dwrite d1/d7/d30/d38/f29 [0,4194304] 0 2024-03-28T13:03:56.009 INFO:tasks.workunit.client.0.smithi076.stdout:3/214: fsync d1/d7/d30/d38/d14/d18/f39 0 2024-03-28T13:03:56.009 INFO:tasks.workunit.client.0.smithi076.stdout:3/215: chown d1/f1b 1227863486 1 2024-03-28T13:03:56.009 INFO:tasks.workunit.client.0.smithi076.stdout:3/216: write d1/f48 [422448,62558] 0 2024-03-28T13:03:56.009 INFO:tasks.workunit.client.0.smithi076.stdout:3/217: chown d1/d7/d30/d38/d14/c52 5979777 1 2024-03-28T13:03:56.141 INFO:tasks.workunit.client.0.smithi076.stdout:5/263: mkdir d5/db/df/d61 0 2024-03-28T13:03:56.141 INFO:tasks.workunit.client.0.smithi076.stdout:5/264: fdatasync d5/db/d19/f52 0 2024-03-28T13:03:56.162 INFO:tasks.workunit.client.0.smithi076.stdout:5/265: write d5/d9/f40 [2496044,116378] 0 2024-03-28T13:03:56.251 INFO:tasks.workunit.client.0.smithi076.stdout:9/263: link d9/dd/df/d11/d14/f31 d9/dd/d48/f59 0 2024-03-28T13:03:56.439 INFO:tasks.workunit.client.0.smithi076.stdout:6/303: rename d6/da/d39/f4e to d6/da/d1e/f60 0 2024-03-28T13:03:56.440 INFO:tasks.workunit.client.0.smithi076.stdout:6/304: read - d6/da/d23/f45 zero size 2024-03-28T13:03:56.440 INFO:tasks.workunit.client.0.smithi076.stdout:6/305: fsync d6/da/d39/d41/f3e 0 2024-03-28T13:03:56.455 INFO:tasks.workunit.client.0.smithi076.stdout:4/279: symlink d0/d3b/d40/d42/d31/l5a 0 2024-03-28T13:03:56.645 INFO:tasks.workunit.client.0.smithi076.stdout:8/235: symlink de/l4b 0 2024-03-28T13:03:56.645 INFO:tasks.workunit.client.0.smithi076.stdout:8/236: stat de/d23/f1e 0 2024-03-28T13:03:56.676 INFO:tasks.workunit.client.0.smithi076.stdout:1/264: rmdir d14 39 2024-03-28T13:03:56.676 INFO:tasks.workunit.client.0.smithi076.stdout:7/284: unlink d1/d8/l4c 0 2024-03-28T13:03:56.676 INFO:tasks.workunit.client.0.smithi076.stdout:7/285: write d1/f36 [955043,71629] 0 2024-03-28T13:03:56.676 INFO:tasks.workunit.client.0.smithi076.stdout:7/286: write d1/f5 [3825210,100353] 0 2024-03-28T13:03:56.676 INFO:tasks.workunit.client.0.smithi076.stdout:7/287: dread - d1/d18/d3c/f30 zero size 2024-03-28T13:03:58.522 INFO:tasks.workunit.client.0.smithi076.stdout:5/266: symlink d5/db/df/l62 0 2024-03-28T13:03:58.677 INFO:tasks.workunit.client.0.smithi076.stdout:9/264: truncate d9/dd/df/d11/d37/f1c 2164172 0 2024-03-28T13:03:58.677 INFO:tasks.workunit.client.0.smithi076.stdout:2/274: truncate d2/d5/d7/d8/d21/f48 3029149 0 2024-03-28T13:03:58.677 INFO:tasks.workunit.client.0.smithi076.stdout:9/265: stat d9/dd/df/d11/d18/l46 0 2024-03-28T13:03:58.731 INFO:tasks.workunit.client.0.smithi076.stdout:2/275: dwrite d2/d5/d7/f40 [0,4194304] 0 2024-03-28T13:03:58.831 INFO:tasks.workunit.client.0.smithi076.stdout:4/280: creat d0/d3b/d40/d42/d28/f5b x:0 0 0 2024-03-28T13:03:58.897 INFO:tasks.workunit.client.0.smithi076.stdout:8/237: unlink de/d23/d2b/d2c/l47 0 2024-03-28T13:03:59.012 INFO:tasks.workunit.client.0.smithi076.stdout:7/288: creat d1/d8/d37/d53/f64 x:0 0 0 2024-03-28T13:03:59.053 INFO:tasks.workunit.client.0.smithi076.stdout:5/267: mkdir d5/d9/d4c/d63 0 2024-03-28T13:03:59.167 INFO:tasks.workunit.client.0.smithi076.stdout:9/266: creat d9/d3c/f5a x:0 0 0 2024-03-28T13:03:59.300 INFO:tasks.workunit.client.0.smithi076.stdout:0/281: rename db/dc/df/d18/d1d/f68 to db/d16/f6f 0 2024-03-28T13:03:59.300 INFO:tasks.workunit.client.0.smithi076.stdout:2/276: getdents d2/d5/db/d3b/d3f 0 2024-03-28T13:03:59.342 INFO:tasks.workunit.client.0.smithi076.stdout:0/282: dwrite db/dc/df/d18/f5f [0,4194304] 0 2024-03-28T13:03:59.342 INFO:tasks.workunit.client.0.smithi076.stdout:0/283: readlink db/dc/df/d18/d1d/l28 0 2024-03-28T13:03:59.354 INFO:tasks.workunit.client.0.smithi076.stdout:0/284: dread db/dc/df/d11/d40/f42 [0,4194304] 0 2024-03-28T13:03:59.354 INFO:tasks.workunit.client.0.smithi076.stdout:0/285: truncate db/dc/f62 324723 0 2024-03-28T13:03:59.354 INFO:tasks.workunit.client.0.smithi076.stdout:0/286: stat db/f14 0 2024-03-28T13:03:59.373 INFO:tasks.workunit.client.0.smithi076.stdout:4/281: creat d0/d20/f5c x:0 0 0 2024-03-28T13:03:59.373 INFO:tasks.workunit.client.0.smithi076.stdout:8/238: link de/d12/d18/d3c/f44 de/d23/d2b/d2c/f4c 0 2024-03-28T13:03:59.373 INFO:tasks.workunit.client.0.smithi076.stdout:8/239: truncate de/f11 4647744 0 2024-03-28T13:03:59.378 INFO:tasks.workunit.client.0.smithi076.stdout:1/265: creat d14/d2a/d2e/f5a x:0 0 0 2024-03-28T13:03:59.378 INFO:tasks.workunit.client.0.smithi076.stdout:1/266: readlink l11 0 2024-03-28T13:03:59.438 INFO:tasks.workunit.client.0.smithi076.stdout:7/289: creat d1/f65 x:0 0 0 2024-03-28T13:03:59.439 INFO:tasks.workunit.client.0.smithi076.stdout:7/290: fdatasync d1/f36 0 2024-03-28T13:03:59.597 INFO:tasks.workunit.client.0.smithi076.stdout:9/267: getdents d9/dd/df/d11/d18/d2a 0 2024-03-28T13:03:59.687 INFO:tasks.workunit.client.0.smithi076.stdout:6/306: rename d6/da/f1c to d6/da/d39/f61 0 2024-03-28T13:03:59.734 INFO:tasks.workunit.client.0.smithi076.stdout:2/277: mknod d2/d5/d7/d8/d21/c55 0 2024-03-28T13:03:59.735 INFO:tasks.workunit.client.0.smithi076.stdout:2/278: chown d2/d5/c10 1929428 1 2024-03-28T13:03:59.735 INFO:tasks.workunit.client.0.smithi076.stdout:2/279: dread - d2/d5/db/d3b/d3f/f4f zero size 2024-03-28T13:03:59.772 INFO:tasks.workunit.client.0.smithi076.stdout:2/280: dwrite d2/d5/d7/d8/d21/f27 [4194304,4194304] 0 2024-03-28T13:03:59.791 INFO:tasks.workunit.client.0.smithi076.stdout:2/281: write d2/d5/d7/f40 [6999640,78045] 0 2024-03-28T13:03:59.802 INFO:tasks.workunit.client.0.smithi076.stdout:2/282: dread d2/d5/d7/d28/f43 [0,4194304] 0 2024-03-28T13:03:59.802 INFO:tasks.workunit.client.0.smithi076.stdout:2/283: write d2/d5/d4b/f1f [2321241,58844] 0 2024-03-28T13:03:59.802 INFO:tasks.workunit.client.0.smithi076.stdout:2/284: stat d2/d5/d7/d8/c2d 0 2024-03-28T13:03:59.808 INFO:tasks.workunit.client.0.smithi076.stdout:0/287: creat db/dc/df/d18/d1d/d35/d51/d60/f70 x:0 0 0 2024-03-28T13:03:59.808 INFO:tasks.workunit.client.0.smithi076.stdout:0/288: write db/dc/df/d11/d40/f64 [456691,12453] 0 2024-03-28T13:03:59.808 INFO:tasks.workunit.client.0.smithi076.stdout:0/289: read - db/dc/df/d18/d1d/f29 zero size 2024-03-28T13:03:59.849 INFO:tasks.workunit.client.0.smithi076.stdout:4/282: symlink d0/d3b/d50/l5d 0 2024-03-28T13:03:59.909 INFO:tasks.workunit.client.0.smithi076.stdout:8/240: link de/d12/l24 de/d12/d18/d3c/l4d 0 2024-03-28T13:03:59.985 INFO:tasks.workunit.client.0.smithi076.stdout:1/267: mknod d14/d2a/d2e/d31/c5b 0 2024-03-28T13:03:59.985 INFO:tasks.workunit.client.0.smithi076.stdout:1/268: dread - d14/d2a/d3f/f54 zero size 2024-03-28T13:04:00.041 INFO:tasks.workunit.client.0.smithi076.stdout:7/291: getdents d1/d18/d3c/d48 0 2024-03-28T13:04:00.042 INFO:tasks.workunit.client.0.smithi076.stdout:9/268: creat d9/d3c/f5b x:0 0 0 2024-03-28T13:04:00.060 INFO:tasks.workunit.client.0.smithi076.stdout:9/269: dread d9/f36 [0,4194304] 0 2024-03-28T13:04:00.151 INFO:tasks.workunit.client.0.smithi076.stdout:3/218: sync 2024-03-28T13:04:00.152 INFO:tasks.workunit.client.0.smithi076.stdout:3/219: stat d1/d2/f2e 0 2024-03-28T13:04:00.179 INFO:tasks.workunit.client.0.smithi076.stdout:2/285: symlink d2/l56 0 2024-03-28T13:04:00.222 INFO:tasks.workunit.client.0.smithi076.stdout:0/290: truncate db/dc/df/f1a 1823025 0 2024-03-28T13:04:00.257 INFO:tasks.workunit.client.0.smithi076.stdout:0/291: dwrite db/dc/d3d/d57/f5b [0,4194304] 0 2024-03-28T13:04:00.257 INFO:tasks.workunit.client.0.smithi076.stdout:0/292: write db/dc/df/d18/d1d/d35/d51/d60/f70 [831774,1782] 0 2024-03-28T13:04:00.257 INFO:tasks.workunit.client.0.smithi076.stdout:0/293: fsync db/dc/df/d11/d40/f65 0 2024-03-28T13:04:00.307 INFO:tasks.workunit.client.0.smithi076.stdout:4/283: rename d0/d20/d21 to d0/d3b/d40/d42/d31/d5e 0 2024-03-28T13:04:00.416 INFO:tasks.workunit.client.0.smithi076.stdout:1/269: mkdir d14/d2a/d2e/d3c/d5c 0 2024-03-28T13:04:00.416 INFO:tasks.workunit.client.0.smithi076.stdout:1/270: write d14/f52 [888026,3208] 0 2024-03-28T13:04:00.417 INFO:tasks.workunit.client.0.smithi076.stdout:7/292: mkdir d1/dc/d66 0 2024-03-28T13:04:00.428 INFO:tasks.workunit.client.0.smithi076.stdout:6/307: dread d6/da/d1e/f28 [0,4194304] 0 2024-03-28T13:04:00.461 INFO:tasks.workunit.client.0.smithi076.stdout:9/270: truncate d9/da/f39 110152 0 2024-03-28T13:04:00.461 INFO:tasks.workunit.client.0.smithi076.stdout:9/271: chown d9/dd/df/d11/f4b 3 1 2024-03-28T13:04:00.461 INFO:tasks.workunit.client.0.smithi076.stdout:9/272: getdents d9/dd/df/d11/d18/d2a 0 2024-03-28T13:04:00.562 INFO:tasks.workunit.client.0.smithi076.stdout:2/286: truncate d2/d5/d7/fe 2167434 0 2024-03-28T13:04:00.762 INFO:tasks.workunit.client.0.smithi076.stdout:0/294: truncate f1 1107638 0 2024-03-28T13:04:00.869 INFO:tasks.workunit.client.0.smithi076.stdout:3/220: rename d1/d7/d30/d38/d14/d27/l37 to d1/d7/d30/l53 0 2024-03-28T13:04:00.869 INFO:tasks.workunit.client.0.smithi076.stdout:3/221: stat d1/f48 0 2024-03-28T13:04:00.886 INFO:tasks.workunit.client.0.smithi076.stdout:3/222: read d1/d7/d30/d38/f1a [790195,46961] 0 2024-03-28T13:04:00.887 INFO:tasks.workunit.client.0.smithi076.stdout:3/223: write d1/d7/d30/d38/d14/f1f [938029,48627] 0 2024-03-28T13:04:00.993 INFO:tasks.workunit.client.0.smithi076.stdout:8/241: mkdir de/d4e 0 2024-03-28T13:04:00.993 INFO:tasks.workunit.client.0.smithi076.stdout:8/242: readlink de/d13/l38 0 2024-03-28T13:04:00.994 INFO:tasks.workunit.client.0.smithi076.stdout:1/271: unlink d14/f21 0 2024-03-28T13:04:00.994 INFO:tasks.workunit.client.0.smithi076.stdout:1/272: dread - d14/d19/d20/f56 zero size 2024-03-28T13:04:01.515 INFO:tasks.workunit.client.0.smithi076.stdout:6/308: mkdir d6/da/d40/d62 0 2024-03-28T13:04:01.519 INFO:tasks.workunit.client.0.smithi076.stdout:5/268: sync 2024-03-28T13:04:01.904 INFO:tasks.workunit.client.0.smithi076.stdout:2/287: truncate d2/d5/d7/d28/f43 1290269 0 2024-03-28T13:04:01.904 INFO:tasks.workunit.client.0.smithi076.stdout:2/288: fsync d2/d5/d7/f19 0 2024-03-28T13:04:02.355 INFO:tasks.workunit.client.0.smithi076.stdout:4/284: link d0/f15 d0/db/f5f 0 2024-03-28T13:04:02.355 INFO:tasks.workunit.client.0.smithi076.stdout:8/243: creat de/d4e/f4f x:0 0 0 2024-03-28T13:04:02.355 INFO:tasks.workunit.client.0.smithi076.stdout:8/244: chown de/d4e/f4f 12647 1 2024-03-28T13:04:02.355 INFO:tasks.workunit.client.0.smithi076.stdout:8/245: chown de/d12/c1c 487432 1 2024-03-28T13:04:02.441 INFO:tasks.workunit.client.0.smithi076.stdout:1/273: symlink d14/d2a/l5d 0 2024-03-28T13:04:02.442 INFO:tasks.workunit.client.0.smithi076.stdout:1/274: dread - d14/d2a/d2e/f3e zero size 2024-03-28T13:04:02.494 INFO:tasks.workunit.client.0.smithi076.stdout:6/309: mkdir d6/da/d39/d63 0 2024-03-28T13:04:02.494 INFO:tasks.workunit.client.0.smithi076.stdout:6/310: readlink d6/da/d40/l54 0 2024-03-28T13:04:02.494 INFO:tasks.workunit.client.0.smithi076.stdout:6/311: dread - d6/da/d39/d41/f5b zero size 2024-03-28T13:04:02.499 INFO:tasks.workunit.client.0.smithi076.stdout:6/312: dread d6/f59 [0,4194304] 0 2024-03-28T13:04:02.558 INFO:tasks.workunit.client.0.smithi076.stdout:7/293: write d1/f40 [206200,114198] 0 2024-03-28T13:04:02.558 INFO:tasks.workunit.client.0.smithi076.stdout:7/294: write d1/f6 [4101841,29910] 0 2024-03-28T13:04:02.593 INFO:tasks.workunit.client.0.smithi076.stdout:7/295: dwrite d1/f13 [0,4194304] 0 2024-03-28T13:04:02.700 INFO:tasks.workunit.client.0.smithi076.stdout:2/289: mkdir d2/d5/d4b/d39/d57 0 2024-03-28T13:04:02.700 INFO:tasks.workunit.client.0.smithi076.stdout:3/224: mkdir d1/d7/d30/d38/d54 0 2024-03-28T13:04:02.700 INFO:tasks.workunit.client.0.smithi076.stdout:2/290: chown d2/d5/db/d3b/d42 341954 1 2024-03-28T13:04:02.707 INFO:tasks.workunit.client.0.smithi076.stdout:3/225: write d1/d7/d30/d38/d14/d18/f3b [621525,16626] 0 2024-03-28T13:04:02.918 INFO:tasks.workunit.client.0.smithi076.stdout:8/246: mkdir de/d12/d18/d3c/d50 0 2024-03-28T13:04:02.918 INFO:tasks.workunit.client.0.smithi076.stdout:8/247: fdatasync de/d23/d2b/d2c/f4c 0 2024-03-28T13:04:02.918 INFO:tasks.workunit.client.0.smithi076.stdout:8/248: write fa [844758,41468] 0 2024-03-28T13:04:02.919 INFO:tasks.workunit.client.0.smithi076.stdout:8/249: chown de/d13/c3d 605 1 2024-03-28T13:04:02.981 INFO:tasks.workunit.client.0.smithi076.stdout:1/275: truncate d14/f2b 1666470 0 2024-03-28T13:04:03.016 INFO:tasks.workunit.client.0.smithi076.stdout:2/291: rmdir d2/d5/db/d3b/d3f 39 2024-03-28T13:04:03.064 INFO:tasks.workunit.client.0.smithi076.stdout:3/226: link d1/d7/d30/d38/d14/d18/f4d d1/d7/d30/d38/d14/d18/d3a/f55 0 2024-03-28T13:04:03.113 INFO:tasks.workunit.client.0.smithi076.stdout:4/285: rename d0/db/c14 to d0/db/c60 0 2024-03-28T13:04:03.113 INFO:tasks.workunit.client.0.smithi076.stdout:4/286: truncate d0/d3b/d50/f58 392219 0 2024-03-28T13:04:03.150 INFO:tasks.workunit.client.0.smithi076.stdout:8/250: mkdir de/d23/d2b/d51 0 2024-03-28T13:04:03.296 INFO:tasks.workunit.client.0.smithi076.stdout:1/276: rmdir d14/d2a 39 2024-03-28T13:04:03.296 INFO:tasks.workunit.client.0.smithi076.stdout:2/292: symlink d2/d5/d4b/l58 0 2024-03-28T13:04:03.296 INFO:tasks.workunit.client.0.smithi076.stdout:2/293: stat d2/d5/d7/dd 0 2024-03-28T13:04:03.341 INFO:tasks.workunit.client.0.smithi076.stdout:2/294: dwrite d2/d5/db/d3b/d3f/f4f [0,4194304] 0 2024-03-28T13:04:03.446 INFO:tasks.workunit.client.0.smithi076.stdout:4/287: creat d0/db/f61 x:0 0 0 2024-03-28T13:04:03.457 INFO:tasks.workunit.client.0.smithi076.stdout:9/273: sync 2024-03-28T13:04:03.485 INFO:tasks.workunit.client.0.smithi076.stdout:9/274: dwrite d9/dd/df/d11/d18/d2a/f30 [0,4194304] 0 2024-03-28T13:04:03.485 INFO:tasks.workunit.client.0.smithi076.stdout:9/275: readlink d9/dd/df/d11/d14/l27 0 2024-03-28T13:04:03.649 INFO:tasks.workunit.client.0.smithi076.stdout:4/288: mknod d0/d3b/d40/c62 0 2024-03-28T13:04:03.717 INFO:tasks.workunit.client.0.smithi076.stdout:9/276: mknod d9/dd/df/d11/d18/d2a/c5c 0 2024-03-28T13:04:03.788 INFO:tasks.workunit.client.0.smithi076.stdout:4/289: mkdir d0/d3b/d40/d42/d31/d4d/d63 0 2024-03-28T13:04:03.788 INFO:tasks.workunit.client.0.smithi076.stdout:4/290: chown d0/d3b/d40/d42/d31/d5e/f4b 17117 1 2024-03-28T13:04:03.804 INFO:tasks.workunit.client.0.smithi076.stdout:4/291: dread d0/db/d2d/f3a [0,4194304] 0 2024-03-28T13:04:04.035 INFO:tasks.workunit.client.0.smithi076.stdout:9/277: link d9/dd/df/d11/d14/c40 d9/dd/df/c5d 0 2024-03-28T13:04:04.035 INFO:tasks.workunit.client.0.smithi076.stdout:9/278: read - d9/dd/df/d11/d14/f4e zero size 2024-03-28T13:04:04.036 INFO:tasks.workunit.client.0.smithi076.stdout:0/295: rename db/dc/d3d/d46 to db/dc/df/d71 0 2024-03-28T13:04:04.036 INFO:tasks.workunit.client.0.smithi076.stdout:0/296: chown db/dc/df/d71/l55 544945 1 2024-03-28T13:04:04.079 INFO:tasks.workunit.client.0.smithi076.stdout:0/297: dwrite db/dc/df/d71/d4a/f5c [0,4194304] 0 2024-03-28T13:04:04.079 INFO:tasks.workunit.client.0.smithi076.stdout:0/298: write db/dc/fe [1998816,102656] 0 2024-03-28T13:04:04.080 INFO:tasks.workunit.client.0.smithi076.stdout:0/299: write db/f12 [341329,100540] 0 2024-03-28T13:04:04.080 INFO:tasks.workunit.client.0.smithi076.stdout:0/300: read db/f4b [1128807,80186] 0 2024-03-28T13:04:04.646 INFO:tasks.workunit.client.0.smithi076.stdout:4/292: mkdir d0/d3b/d50/d64 0 2024-03-28T13:04:04.838 INFO:tasks.workunit.client.0.smithi076.stdout:5/269: rename d5/d9/d1c/d1d/d22/c2f to d5/db/d3f/c64 0 2024-03-28T13:04:05.261 INFO:tasks.workunit.client.0.smithi076.stdout:5/270: creat d5/d9/d1c/d1d/d22/f65 x:0 0 0 2024-03-28T13:04:05.290 INFO:tasks.workunit.client.0.smithi076.stdout:5/271: dwrite d5/d9/d1c/d1d/d31/f57 [0,4194304] 0 2024-03-28T13:04:05.340 INFO:tasks.workunit.client.0.smithi076.stdout:6/313: rename d6/f53 to d6/da/d39/d41/d46/f64 0 2024-03-28T13:04:05.370 INFO:tasks.workunit.client.0.smithi076.stdout:6/314: dwrite d6/da/d1e/f3d [0,4194304] 0 2024-03-28T13:04:05.405 INFO:tasks.workunit.client.0.smithi076.stdout:6/315: dwrite d6/da/d1e/f2b [0,4194304] 0 2024-03-28T13:04:05.405 INFO:tasks.workunit.client.0.smithi076.stdout:6/316: chown d6/da/d1e/f42 187328507 1 2024-03-28T13:04:05.476 INFO:tasks.workunit.client.0.smithi076.stdout:5/272: creat d5/d9/d4c/d63/f66 x:0 0 0 2024-03-28T13:04:05.536 INFO:tasks.workunit.client.0.smithi076.stdout:7/296: rename d1/c11 to d1/d18/d3c/c67 0 2024-03-28T13:04:05.695 INFO:tasks.workunit.client.0.smithi076.stdout:5/273: mknod d5/db/d3f/d42/c67 0 2024-03-28T13:04:05.696 INFO:tasks.workunit.client.0.smithi076.stdout:5/274: chown d5/l30 781 1 2024-03-28T13:04:05.748 INFO:tasks.workunit.client.0.smithi076.stdout:3/227: rename d1/d7/d30/d38/d3d to d1/d7/d30/d38/d14/d36/d56 0 2024-03-28T13:04:05.749 INFO:tasks.workunit.client.0.smithi076.stdout:3/228: chown d1/d7/d30/d38/d14/d27 45747 1 2024-03-28T13:04:05.831 INFO:tasks.workunit.client.0.smithi076.stdout:7/297: creat d1/d8/f68 x:0 0 0 2024-03-28T13:04:05.905 INFO:tasks.workunit.client.0.smithi076.stdout:5/275: unlink d5/d9/l29 0 2024-03-28T13:04:06.015 INFO:tasks.workunit.client.0.smithi076.stdout:8/251: rename de/c1f to de/d13/c52 0 2024-03-28T13:04:06.015 INFO:tasks.workunit.client.0.smithi076.stdout:8/252: fsync f2 0 2024-03-28T13:04:06.033 INFO:tasks.workunit.client.0.smithi076.stdout:8/253: write de/d23/d2b/d2c/f4c [332523,33032] 0 2024-03-28T13:04:06.192 INFO:tasks.workunit.client.0.smithi076.stdout:3/229: unlink d1/d7/d30/d38/d14/d18/f4d 0 2024-03-28T13:04:06.192 INFO:tasks.workunit.client.0.smithi076.stdout:0/301: write db/dc/df/f1a [2860101,15831] 0 2024-03-28T13:04:06.192 INFO:tasks.workunit.client.0.smithi076.stdout:0/302: readlink db/dc/df/d18/l61 0 2024-03-28T13:04:06.202 INFO:tasks.workunit.client.0.smithi076.stdout:7/298: mkdir d1/d18/d3c/d48/d69 0 2024-03-28T13:04:06.224 INFO:tasks.workunit.client.0.smithi076.stdout:0/303: dwrite db/d16/f54 [0,4194304] 0 2024-03-28T13:04:06.229 INFO:tasks.workunit.client.0.smithi076.stdout:7/299: dread d1/f26 [4194304,4194304] 0 2024-03-28T13:04:06.259 INFO:tasks.workunit.client.0.smithi076.stdout:5/276: creat d5/d9/d1c/d1d/d22/f68 x:0 0 0 2024-03-28T13:04:06.259 INFO:tasks.workunit.client.0.smithi076.stdout:5/277: fsync d5/d9/d1c/f54 0 2024-03-28T13:04:06.342 INFO:tasks.workunit.client.0.smithi076.stdout:1/277: rename d14/l1c to d14/d2a/d2e/l5e 0 2024-03-28T13:04:06.342 INFO:tasks.workunit.client.0.smithi076.stdout:2/295: rename d2/d5/d7/dd to d2/d5/d7/dd/d59 22 2024-03-28T13:04:06.444 INFO:tasks.workunit.client.0.smithi076.stdout:8/254: symlink de/d25/l53 0 2024-03-28T13:04:06.503 INFO:tasks.workunit.client.0.smithi076.stdout:3/230: creat d1/d7/d30/d38/d14/d36/f57 x:0 0 0 2024-03-28T13:04:06.684 INFO:tasks.workunit.client.0.smithi076.stdout:0/304: creat db/dc/df/d71/d4a/f72 x:0 0 0 2024-03-28T13:04:06.684 INFO:tasks.workunit.client.0.smithi076.stdout:0/305: write db/d16/f6f [642777,82258] 0 2024-03-28T13:04:06.684 INFO:tasks.workunit.client.0.smithi076.stdout:0/306: chown db/c31 3 1 2024-03-28T13:04:06.709 INFO:tasks.workunit.client.0.smithi076.stdout:7/300: truncate d1/f26 3850191 0 2024-03-28T13:04:06.709 INFO:tasks.workunit.client.0.smithi076.stdout:5/278: unlink d5/d9/c10 0 2024-03-28T13:04:06.709 INFO:tasks.workunit.client.0.smithi076.stdout:5/279: truncate d5/d9/d1c/d1d/d31/f37 1006450 0 2024-03-28T13:04:06.731 INFO:tasks.workunit.client.0.smithi076.stdout:4/293: sync 2024-03-28T13:04:06.731 INFO:tasks.workunit.client.0.smithi076.stdout:4/294: truncate d0/d3b/d40/d42/d31/d4d/f52 992784 0 2024-03-28T13:04:06.731 INFO:tasks.workunit.client.0.smithi076.stdout:4/295: chown d0/d3b/d40/d42/d28/l2c 1074345 1 2024-03-28T13:04:06.731 INFO:tasks.workunit.client.0.smithi076.stdout:5/280: write d5/d9/d1c/d1d/d31/f57 [651846,84312] 0 2024-03-28T13:04:06.773 INFO:tasks.workunit.client.0.smithi076.stdout:4/296: dwrite d0/d3b/d40/d42/f37 [0,4194304] 0 2024-03-28T13:04:06.815 INFO:tasks.workunit.client.0.smithi076.stdout:9/279: rename f7 to d9/dd/df/f5e 0 2024-03-28T13:04:06.856 INFO:tasks.workunit.client.0.smithi076.stdout:2/296: mkdir d2/d5/db/d3b/d5a 0 2024-03-28T13:04:06.943 INFO:tasks.workunit.client.0.smithi076.stdout:8/255: mkdir de/d4e/d54 0 2024-03-28T13:04:06.973 INFO:tasks.workunit.client.0.smithi076.stdout:3/231: mkdir d1/d7/d30/d38/d14/d18/d58 0 2024-03-28T13:04:07.626 INFO:tasks.workunit.client.0.smithi076.stdout:7/301: truncate d1/f1b 163219 0 2024-03-28T13:04:07.773 INFO:tasks.workunit.client.0.smithi076.stdout:5/281: mkdir d5/d9/d1c/d1d/d22/d69 0 2024-03-28T13:04:07.810 INFO:tasks.workunit.client.0.smithi076.stdout:5/282: dwrite d5/d9/d1c/f32 [0,4194304] 0 2024-03-28T13:04:07.810 INFO:tasks.workunit.client.0.smithi076.stdout:5/283: read - d5/d9/d1c/d1d/d31/f5c zero size 2024-03-28T13:04:07.810 INFO:tasks.workunit.client.0.smithi076.stdout:5/284: write d5/d9/d1c/d1d/d22/f68 [362749,69258] 0 2024-03-28T13:04:07.839 INFO:tasks.workunit.client.0.smithi076.stdout:5/285: dwrite d5/db/f2a [0,4194304] 0 2024-03-28T13:04:07.839 INFO:tasks.workunit.client.0.smithi076.stdout:5/286: write d5/d9/f40 [3112587,17255] 0 2024-03-28T13:04:07.879 INFO:tasks.workunit.client.0.smithi076.stdout:4/297: creat d0/d3b/d40/d42/f65 x:0 0 0 2024-03-28T13:04:08.070 INFO:tasks.workunit.client.0.smithi076.stdout:9/280: unlink d9/dd/df/d11/l24 0 2024-03-28T13:04:08.070 INFO:tasks.workunit.client.0.smithi076.stdout:6/317: rename d6/da/d23/f32 to d6/da/d39/f65 0 2024-03-28T13:04:08.110 INFO:tasks.workunit.client.0.smithi076.stdout:8/256: mkdir de/d23/d55 0 2024-03-28T13:04:08.110 INFO:tasks.workunit.client.0.smithi076.stdout:8/257: chown de/f11 228966 1 2024-03-28T13:04:08.131 INFO:tasks.workunit.client.0.smithi076.stdout:8/258: dread de/d12/d18/d3c/f44 [0,4194304] 0 2024-03-28T13:04:08.131 INFO:tasks.workunit.client.0.smithi076.stdout:8/259: dread - de/f3f zero size 2024-03-28T13:04:08.227 INFO:tasks.workunit.client.0.smithi076.stdout:3/232: rmdir d1/d7/d30/d38/d54 0 2024-03-28T13:04:08.294 INFO:tasks.workunit.client.0.smithi076.stdout:7/302: creat d1/d8/d37/d53/f6a x:0 0 0 2024-03-28T13:04:08.303 INFO:tasks.workunit.client.0.smithi076.stdout:1/278: write f8 [1056091,76757] 0 2024-03-28T13:04:08.336 INFO:tasks.workunit.client.0.smithi076.stdout:7/303: dwrite d1/d18/d3c/f44 [0,4194304] 0 2024-03-28T13:04:08.336 INFO:tasks.workunit.client.0.smithi076.stdout:7/304: dread - d1/d18/d3c/f5f zero size 2024-03-28T13:04:08.935 INFO:tasks.workunit.client.0.smithi076.stdout:4/298: creat d0/d3b/d40/d42/d28/f66 x:0 0 0 2024-03-28T13:04:08.935 INFO:tasks.workunit.client.0.smithi076.stdout:9/281: mknod d9/dd/df/d11/d37/c5f 0 2024-03-28T13:04:08.935 INFO:tasks.workunit.client.0.smithi076.stdout:9/282: fsync d9/f53 0 2024-03-28T13:04:08.938 INFO:tasks.workunit.client.0.smithi076.stdout:4/299: dread d0/d3b/d40/d42/d31/d4d/f54 [0,4194304] 0 2024-03-28T13:04:08.964 INFO:tasks.workunit.client.0.smithi076.stdout:9/283: read d9/d3c/f43 [1840843,98839] 0 2024-03-28T13:04:08.987 INFO:tasks.workunit.client.0.smithi076.stdout:9/284: write d9/dd/df/d11/d18/f3d [7959680,18799] 0 2024-03-28T13:04:08.993 INFO:tasks.workunit.client.0.smithi076.stdout:0/307: mkdir db/dc/df/d18/d1d/d73 0 2024-03-28T13:04:09.032 INFO:tasks.workunit.client.0.smithi076.stdout:9/285: dwrite d9/dd/df/d11/d18/d2a/f30 [0,4194304] 0 2024-03-28T13:04:09.055 INFO:tasks.workunit.client.0.smithi076.stdout:9/286: dread d9/d3c/f29 [0,4194304] 0 2024-03-28T13:04:09.055 INFO:tasks.workunit.client.0.smithi076.stdout:9/287: chown c0 660235 1 2024-03-28T13:04:09.055 INFO:tasks.workunit.client.0.smithi076.stdout:9/288: read - d9/d3c/f5b zero size 2024-03-28T13:04:09.077 INFO:tasks.workunit.client.0.smithi076.stdout:6/318: creat d6/da/d40/d56/d58/f66 x:0 0 0 2024-03-28T13:04:09.358 INFO:tasks.workunit.client.0.smithi076.stdout:5/287: mknod d5/d9/d1c/d1d/c6a 0 2024-03-28T13:04:09.389 INFO:tasks.workunit.client.0.smithi076.stdout:5/288: dwrite d5/db/f46 [0,4194304] 0 2024-03-28T13:04:09.405 INFO:tasks.workunit.client.0.smithi076.stdout:5/289: write d5/d9/f59 [579471,74564] 0 2024-03-28T13:04:09.405 INFO:tasks.workunit.client.0.smithi076.stdout:5/290: fdatasync d5/d9/d1c/d25/f3a 0 2024-03-28T13:04:09.428 INFO:tasks.workunit.client.0.smithi076.stdout:4/300: link d0/l59 d0/db/d2d/l67 0 2024-03-28T13:04:09.508 INFO:tasks.workunit.client.0.smithi076.stdout:0/308: mknod db/dc/d3d/d57/c74 0 2024-03-28T13:04:09.688 INFO:tasks.workunit.client.0.smithi076.stdout:9/289: creat d9/dd/df/d11/d18/f60 x:0 0 0 2024-03-28T13:04:10.160 INFO:tasks.workunit.client.0.smithi076.stdout:3/233: link d1/d2/f1e d1/d7/d30/d38/d14/d18/d3a/f59 0 2024-03-28T13:04:10.246 INFO:tasks.workunit.client.0.smithi076.stdout:2/297: rename d2/d5/d7/d8/c2d to d2/d5/c5b 0 2024-03-28T13:04:10.246 INFO:tasks.workunit.client.0.smithi076.stdout:2/298: stat d2/d54 0 2024-03-28T13:04:10.246 INFO:tasks.workunit.client.0.smithi076.stdout:2/299: fdatasync d2/d5/d7/d3e/f45 0 2024-03-28T13:04:10.317 INFO:tasks.workunit.client.0.smithi076.stdout:5/291: symlink d5/d9/d1c/d25/d60/l6b 0 2024-03-28T13:04:10.407 INFO:tasks.workunit.client.0.smithi076.stdout:0/309: rename db/dc/df/d18/d1d/d35 to db/dc/df/d18/d1d/d75 0 2024-03-28T13:04:10.407 INFO:tasks.workunit.client.0.smithi076.stdout:0/310: write db/dc/df/d71/d4a/f72 [853905,68076] 0 2024-03-28T13:04:10.411 INFO:tasks.workunit.client.0.smithi076.stdout:0/311: dread db/dc/df/f44 [0,4194304] 0 2024-03-28T13:04:10.411 INFO:tasks.workunit.client.0.smithi076.stdout:0/312: chown db/dc/df/d18/d1d/c3c 122 1 2024-03-28T13:04:10.451 INFO:tasks.workunit.client.0.smithi076.stdout:9/290: mknod d9/dd/c61 0 2024-03-28T13:04:10.481 INFO:tasks.workunit.client.0.smithi076.stdout:9/291: dwrite d9/d3c/f29 [0,4194304] 0 2024-03-28T13:04:10.534 INFO:tasks.workunit.client.0.smithi076.stdout:3/234: link d1/d7/f32 d1/d7/d30/d38/d14/d4a/f5a 0 2024-03-28T13:04:10.535 INFO:tasks.workunit.client.0.smithi076.stdout:3/235: stat d1/d7/d30/d38/d14/d18/d2f 0 2024-03-28T13:04:10.587 INFO:tasks.workunit.client.0.smithi076.stdout:7/305: rename d1/l10 to d1/d18/d2d/l6b 0 2024-03-28T13:04:10.587 INFO:tasks.workunit.client.0.smithi076.stdout:7/306: chown d1/d8/d37/l42 107 1 2024-03-28T13:04:10.633 INFO:tasks.workunit.client.0.smithi076.stdout:2/300: mknod d2/c5c 0 2024-03-28T13:04:10.652 INFO:tasks.workunit.client.0.smithi076.stdout:2/301: dread d2/d5/d7/f19 [4194304,4194304] 0 2024-03-28T13:04:10.711 INFO:tasks.workunit.client.0.smithi076.stdout:5/292: creat d5/f6c x:0 0 0 2024-03-28T13:04:10.758 INFO:tasks.workunit.client.0.smithi076.stdout:4/301: mkdir d0/db/d68 0 2024-03-28T13:04:10.883 INFO:tasks.workunit.client.0.smithi076.stdout:0/313: creat db/dc/df/d11/d40/d69/f76 x:0 0 0 2024-03-28T13:04:10.883 INFO:tasks.workunit.client.0.smithi076.stdout:0/314: fdatasync db/dc/f66 0 2024-03-28T13:04:11.006 INFO:tasks.workunit.client.0.smithi076.stdout:9/292: link d9/dd/df/d11/f22 d9/dd/df/d11/d18/d2a/f62 0 2024-03-28T13:04:11.006 INFO:tasks.workunit.client.0.smithi076.stdout:9/293: chown d9/dd/df/l2c 21948289 1 2024-03-28T13:04:11.006 INFO:tasks.workunit.client.0.smithi076.stdout:9/294: read - d9/d3c/f5a zero size 2024-03-28T13:04:11.090 INFO:tasks.workunit.client.0.smithi076.stdout:3/236: mkdir d1/d7/d30/d38/d14/d36/d56/d5b 0 2024-03-28T13:04:11.090 INFO:tasks.workunit.client.0.smithi076.stdout:3/237: fsync d1/d7/d30/d38/d14/d18/f41 0 2024-03-28T13:04:11.197 INFO:tasks.workunit.client.0.smithi076.stdout:2/302: symlink d2/d5/d4b/l5d 0 2024-03-28T13:04:11.292 INFO:tasks.workunit.client.0.smithi076.stdout:5/293: read d5/d9/d1c/d1d/d31/f57 [2258833,46268] 0 2024-03-28T13:04:11.293 INFO:tasks.workunit.client.0.smithi076.stdout:1/279: mkdir d14/d2a/d5f 0 2024-03-28T13:04:11.349 INFO:tasks.workunit.client.0.smithi076.stdout:4/302: unlink d0/d3b/d40/d42/c4e 0 2024-03-28T13:04:11.424 INFO:tasks.workunit.client.0.smithi076.stdout:0/315: mkdir db/dc/df/d11/d40/d77 0 2024-03-28T13:04:11.484 INFO:tasks.workunit.client.0.smithi076.stdout:9/295: rmdir d9/d3c 39 2024-03-28T13:04:11.484 INFO:tasks.workunit.client.0.smithi076.stdout:9/296: dread - d9/f53 zero size 2024-03-28T13:04:11.485 INFO:tasks.workunit.client.0.smithi076.stdout:9/297: dread - d9/dd/f56 zero size 2024-03-28T13:04:11.683 INFO:tasks.workunit.client.0.smithi076.stdout:2/303: creat d2/d5/d7/d8/d21/f5e x:0 0 0 2024-03-28T13:04:11.683 INFO:tasks.workunit.client.0.smithi076.stdout:2/304: truncate d2/d5/d7/fa 5040083 0 2024-03-28T13:04:11.683 INFO:tasks.workunit.client.0.smithi076.stdout:2/305: readlink d2/d5/d4b/l30 0 2024-03-28T13:04:11.683 INFO:tasks.workunit.client.0.smithi076.stdout:2/306: getdents d2/d5/d4b/d39/d57 0 2024-03-28T13:04:11.683 INFO:tasks.workunit.client.0.smithi076.stdout:5/294: truncate d5/d9/d1c/d1d/d22/f68 1269612 0 2024-03-28T13:04:11.711 INFO:tasks.workunit.client.0.smithi076.stdout:5/295: dwrite d5/db/f12 [0,4194304] 0 2024-03-28T13:04:11.720 INFO:tasks.workunit.client.0.smithi076.stdout:5/296: dread d5/f6 [0,4194304] 0 2024-03-28T13:04:11.754 INFO:tasks.workunit.client.0.smithi076.stdout:1/280: rmdir d14/d2a/d5f 0 2024-03-28T13:04:11.788 INFO:tasks.workunit.client.0.smithi076.stdout:4/303: mkdir d0/d3b/d40/d42/d47/d69 0 2024-03-28T13:04:11.898 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:04:11.902 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:04:12.013 INFO:tasks.workunit.client.0.smithi076.stdout:0/316: unlink db/dc/df/d11/d40/d69/f76 0 2024-03-28T13:04:12.013 INFO:tasks.workunit.client.0.smithi076.stdout:3/238: rename d1/d7/d30/d38/d14/d18/d3a/f55 to d1/d7/d30/d38/d14/d27/f5c 0 2024-03-28T13:04:12.013 INFO:tasks.workunit.client.0.smithi076.stdout:3/239: chown d1/d7/d30/d38/d14/d36/f57 17919 1 2024-03-28T13:04:12.033 INFO:tasks.workunit.client.0.smithi076.stdout:0/317: dread db/dc/df/d71/d4a/f5c [0,4194304] 0 2024-03-28T13:04:12.033 INFO:tasks.workunit.client.0.smithi076.stdout:0/318: chown db/dc/d3d/d57/f5b 65518 1 2024-03-28T13:04:12.037 INFO:tasks.workunit.client.0.smithi076.stdout:3/240: dwrite d1/d7/d30/d38/d14/d36/f19 [4194304,4194304] 0 2024-03-28T13:04:12.037 INFO:tasks.workunit.client.0.smithi076.stdout:2/307: creat d2/d5/f5f x:0 0 0 2024-03-28T13:04:12.267 INFO:tasks.workunit.client.0.smithi076.stdout:5/297: creat d5/d9/d1c/f6d x:0 0 0 2024-03-28T13:04:12.323 INFO:tasks.workunit.client.0.smithi076.stdout:4/304: rmdir d0/db/d2d 39 2024-03-28T13:04:12.424 INFO:tasks.workunit.client.0.smithi076.stdout:7/307: dread d1/f1b [0,4194304] 0 2024-03-28T13:04:12.444 INFO:tasks.workunit.client.0.smithi076.stdout:7/308: dread d1/d8/d37/f43 [0,4194304] 0 2024-03-28T13:04:12.487 INFO:tasks.workunit.client.0.smithi076.stdout:7/309: dwrite d1/d8/f68 [0,4194304] 0 2024-03-28T13:04:12.539 INFO:tasks.workunit.client.0.smithi076.stdout:5/298: creat d5/db/d19/d34/f6e x:0 0 0 2024-03-28T13:04:12.539 INFO:tasks.workunit.client.0.smithi076.stdout:5/299: write d5/d9/d1c/d1d/d31/f57 [512594,96687] 0 2024-03-28T13:04:12.583 INFO:tasks.workunit.client.0.smithi076.stdout:5/300: dwrite d5/d9/d1c/d25/f47 [0,4194304] 0 2024-03-28T13:04:12.585 INFO:tasks.workunit.client.0.smithi076.stdout:5/301: dread d5/db/d19/f2d [0,4194304] 0 2024-03-28T13:04:12.665 INFO:tasks.workunit.client.0.smithi076.stdout:5/302: dwrite d5/d9/d1c/d25/f47 [0,4194304] 0 2024-03-28T13:04:12.665 INFO:tasks.workunit.client.0.smithi076.stdout:5/303: write d5/d9/d1c/d1d/d22/f65 [2329,21132] 0 2024-03-28T13:04:13.044 INFO:tasks.workunit.client.0.smithi076.stdout:8/260: creat de/f56 x:0 0 0 2024-03-28T13:04:13.045 INFO:tasks.workunit.client.0.smithi076.stdout:8/261: dread - de/d12/f3e zero size 2024-03-28T13:04:13.385 INFO:tasks.workunit.client.0.smithi076.stdout:5/304: creat d5/db/df/d61/f6f x:0 0 0 2024-03-28T13:04:13.497 INFO:tasks.workunit.client.0.smithi076.stdout:8/262: dread de/d12/f21 [0,4194304] 0 2024-03-28T13:04:13.594 INFO:tasks.workunit.client.0.smithi076.stdout:5/305: rename d5/d9/d1c/f32 to d5/d9/d1c/f70 0 2024-03-28T13:04:13.923 INFO:tasks.workunit.client.0.smithi076.stdout:8/263: creat de/d23/d2b/d2c/f57 x:0 0 0 2024-03-28T13:04:13.924 INFO:tasks.workunit.client.0.smithi076.stdout:5/306: symlink d5/d9/d35/l71 0 2024-03-28T13:04:13.924 INFO:tasks.workunit.client.0.smithi076.stdout:8/264: truncate de/d23/d2b/d2c/f57 452884 0 2024-03-28T13:04:14.117 INFO:tasks.workunit.client.0.smithi076.stdout:2/308: mkdir d2/d5/db/d3b/d60 0 2024-03-28T13:04:14.318 INFO:tasks.workunit.client.0.smithi076.stdout:4/305: write d0/d3b/d40/d42/d31/f56 [1781589,5809] 0 2024-03-28T13:04:14.322 INFO:tasks.workunit.client.0.smithi076.stdout:6/319: sync 2024-03-28T13:04:14.736 INFO:tasks.workunit.client.0.smithi076.stdout:5/307: unlink d5/d9/d35/d3b/f44 0 2024-03-28T13:04:14.736 INFO:tasks.workunit.client.0.smithi076.stdout:8/265: mkdir de/d23/d2b/d58 0 2024-03-28T13:04:14.736 INFO:tasks.workunit.client.0.smithi076.stdout:5/308: fdatasync d5/d9/d1c/f6d 0 2024-03-28T13:04:14.736 INFO:tasks.workunit.client.0.smithi076.stdout:8/266: write de/d13/d27/f34 [240696,106354] 0 2024-03-28T13:04:14.737 INFO:tasks.workunit.client.0.smithi076.stdout:2/309: creat d2/d5/d7/d8/d21/f61 x:0 0 0 2024-03-28T13:04:14.737 INFO:tasks.workunit.client.0.smithi076.stdout:4/306: link d0/d3b/d40/d42/d28/f49 d0/d3b/d40/d42/d31/d4d/d63/f6a 0 2024-03-28T13:04:14.738 INFO:tasks.workunit.client.0.smithi076.stdout:2/310: dread - d2/d5/d7/d8/d21/f5e zero size 2024-03-28T13:04:14.774 INFO:tasks.workunit.client.0.smithi076.stdout:4/307: dread d0/f1e [0,4194304] 0 2024-03-28T13:04:14.774 INFO:tasks.workunit.client.0.smithi076.stdout:8/267: dwrite de/d23/d2b/d2c/f57 [0,4194304] 0 2024-03-28T13:04:14.804 INFO:tasks.workunit.client.0.smithi076.stdout:6/320: getdents d6/da/d1e 0 2024-03-28T13:04:14.804 INFO:tasks.workunit.client.0.smithi076.stdout:6/321: write d6/da/d39/d41/f5b [121962,61965] 0 2024-03-28T13:04:15.268 INFO:tasks.workunit.client.0.smithi076.stdout:8/268: symlink de/d12/d18/d49/l59 0 2024-03-28T13:04:15.468 INFO:tasks.workunit.client.0.smithi076.stdout:6/322: creat d6/da/d39/d41/f67 x:0 0 0 2024-03-28T13:04:15.468 INFO:tasks.workunit.client.0.smithi076.stdout:6/323: readlink d6/da/l2d 0 2024-03-28T13:04:15.469 INFO:tasks.workunit.client.0.smithi076.stdout:9/298: rename d9/dd/df/d11/d18 to d9/dd/df/d63 0 2024-03-28T13:04:15.469 INFO:tasks.workunit.client.0.smithi076.stdout:6/324: write d6/f59 [1122386,59559] 0 2024-03-28T13:04:15.469 INFO:tasks.workunit.client.0.smithi076.stdout:6/325: chown d6/da/d40/l54 105131 1 2024-03-28T13:04:15.488 INFO:tasks.workunit.client.0.smithi076.stdout:9/299: dread d9/dd/f2e [0,4194304] 0 2024-03-28T13:04:15.497 INFO:tasks.workunit.client.0.smithi076.stdout:4/308: creat d0/d3b/f6b x:0 0 0 2024-03-28T13:04:15.497 INFO:tasks.workunit.client.0.smithi076.stdout:8/269: creat de/d13/d27/f5a x:0 0 0 2024-03-28T13:04:15.497 INFO:tasks.workunit.client.0.smithi076.stdout:8/270: fsync de/d13/d27/f29 0 2024-03-28T13:04:15.536 INFO:tasks.workunit.client.0.smithi076.stdout:9/300: dwrite d9/f54 [0,4194304] 0 2024-03-28T13:04:15.536 INFO:tasks.workunit.client.0.smithi076.stdout:9/301: write d9/dd/df/d11/d14/f26 [219927,30057] 0 2024-03-28T13:04:15.536 INFO:tasks.workunit.client.0.smithi076.stdout:9/302: readlink d9/da/l23 0 2024-03-28T13:04:15.582 INFO:tasks.workunit.client.0.smithi076.stdout:9/303: dwrite d9/dd/df/f25 [0,4194304] 0 2024-03-28T13:04:15.582 INFO:tasks.workunit.client.0.smithi076.stdout:9/304: readlink d9/dd/df/d63/d2a/l47 0 2024-03-28T13:04:15.582 INFO:tasks.workunit.client.0.smithi076.stdout:9/305: chown d9/dd/df/d63/d2a/f30 2135309 1 2024-03-28T13:04:15.582 INFO:tasks.workunit.client.0.smithi076.stdout:9/306: dread - d9/dd/f57 zero size 2024-03-28T13:04:15.582 INFO:tasks.workunit.client.0.smithi076.stdout:9/307: chown d9/dd/df/d63/f21 5270867 1 2024-03-28T13:04:15.582 INFO:tasks.workunit.client.0.smithi076.stdout:9/308: chown d9/dd/c61 426628310 1 2024-03-28T13:04:15.877 INFO:tasks.workunit.client.0.smithi076.stdout:1/281: rename d14/d2a/d2e/d31/d3b/f44 to d14/d2a/d2e/d31/d51/f60 0 2024-03-28T13:04:16.183 INFO:tasks.workunit.client.0.smithi076.stdout:6/326: mknod d6/da/d1e/c68 0 2024-03-28T13:04:16.183 INFO:tasks.workunit.client.0.smithi076.stdout:4/309: mknod d0/d3b/d40/c6c 0 2024-03-28T13:04:16.183 INFO:tasks.workunit.client.0.smithi076.stdout:4/310: stat d0/d3b/d50/d64 0 2024-03-28T13:04:16.187 INFO:tasks.workunit.client.0.smithi076.stdout:9/309: link d9/dd/df/d11/l4a d9/dd/df/d11/d14/l64 0 2024-03-28T13:04:16.187 INFO:tasks.workunit.client.0.smithi076.stdout:8/271: creat de/d25/f5b x:0 0 0 2024-03-28T13:04:16.199 INFO:tasks.workunit.client.0.smithi076.stdout:8/272: dread de/d13/d27/f34 [0,4194304] 0 2024-03-28T13:04:16.212 INFO:tasks.workunit.client.0.smithi076.stdout:6/327: dwrite d6/f4b [0,4194304] 0 2024-03-28T13:04:16.212 INFO:tasks.workunit.client.0.smithi076.stdout:6/328: dread - d6/da/d1e/f60 zero size 2024-03-28T13:04:16.233 INFO:tasks.workunit.client.0.smithi076.stdout:6/329: dwrite d6/f24 [0,4194304] 0 2024-03-28T13:04:16.253 INFO:tasks.workunit.client.0.smithi076.stdout:0/319: rename db/dc/df/d18/d1d/c3c to db/dc/df/d18/d1d/d73/c78 0 2024-03-28T13:04:16.253 INFO:tasks.workunit.client.0.smithi076.stdout:1/282: creat d14/d2a/d2e/f61 x:0 0 0 2024-03-28T13:04:16.253 INFO:tasks.workunit.client.0.smithi076.stdout:1/283: write d14/d2a/d2e/f3e [596381,82057] 0 2024-03-28T13:04:16.253 INFO:tasks.workunit.client.0.smithi076.stdout:1/284: truncate d14/d2a/d2e/d31/d3b/f55 523639 0 2024-03-28T13:04:16.260 INFO:tasks.workunit.client.0.smithi076.stdout:0/320: dread db/dc/fd [0,4194304] 0 2024-03-28T13:04:16.261 INFO:tasks.workunit.client.0.smithi076.stdout:0/321: chown db/dc/df/d18/d1d/d73/c78 3382985 1 2024-03-28T13:04:16.261 INFO:tasks.workunit.client.0.smithi076.stdout:0/322: write db/dc/fe [1078900,22175] 0 2024-03-28T13:04:16.601 INFO:tasks.workunit.client.0.smithi076.stdout:9/310: creat d9/dd/df/d11/d14/f65 x:0 0 0 2024-03-28T13:04:16.614 INFO:tasks.workunit.client.0.smithi076.stdout:8/273: creat de/d12/d18/f5c x:0 0 0 2024-03-28T13:04:16.625 INFO:tasks.workunit.client.0.smithi076.stdout:8/274: dread de/f1d [4194304,4194304] 0 2024-03-28T13:04:16.633 INFO:tasks.workunit.client.0.smithi076.stdout:6/330: creat d6/da/d40/d56/d58/f69 x:0 0 0 2024-03-28T13:04:16.712 INFO:tasks.workunit.client.0.smithi076.stdout:3/241: rename d1/d7/d30/d38/l47 to d1/d7/d30/d38/d14/d36/d56/l5d 0 2024-03-28T13:04:16.712 INFO:tasks.workunit.client.0.smithi076.stdout:3/242: truncate d1/d7/d30/d38/d14/d18/f39 535301 0 2024-03-28T13:04:16.712 INFO:tasks.workunit.client.0.smithi076.stdout:3/243: getdents d1/d7/d30/d38/d14/d18/d58 0 2024-03-28T13:04:16.869 INFO:tasks.workunit.client.0.smithi076.stdout:1/285: rmdir d14/d2a 39 2024-03-28T13:04:16.870 INFO:tasks.workunit.client.0.smithi076.stdout:1/286: stat f12 0 2024-03-28T13:04:16.870 INFO:tasks.workunit.client.0.smithi076.stdout:0/323: symlink db/dc/df/d18/l79 0 2024-03-28T13:04:16.870 INFO:tasks.workunit.client.0.smithi076.stdout:0/324: readlink db/dc/df/d18/d1d/d21/l5d 0 2024-03-28T13:04:16.873 INFO:tasks.workunit.client.0.smithi076.stdout:4/311: unlink d0/d3b/f6b 0 2024-03-28T13:04:16.873 INFO:tasks.workunit.client.0.smithi076.stdout:8/275: mkdir de/d23/d2b/d5d 0 2024-03-28T13:04:16.873 INFO:tasks.workunit.client.0.smithi076.stdout:8/276: chown de/f11 34929276 1 2024-03-28T13:04:16.879 INFO:tasks.workunit.client.0.smithi076.stdout:4/312: write d0/db/d2d/f4f [4711966,32378] 0 2024-03-28T13:04:16.925 INFO:tasks.workunit.client.0.smithi076.stdout:8/277: dwrite de/f10 [0,4194304] 0 2024-03-28T13:04:16.950 INFO:tasks.workunit.client.0.smithi076.stdout:6/331: symlink d6/da/d5f/l6a 0 2024-03-28T13:04:16.976 INFO:tasks.workunit.client.0.smithi076.stdout:6/332: dwrite d6/f59 [0,4194304] 0 2024-03-28T13:04:17.022 INFO:tasks.workunit.client.0.smithi076.stdout:7/310: rename d1/f26 to d1/d8/d37/f6c 0 2024-03-28T13:04:17.100 INFO:tasks.workunit.client.0.smithi076.stdout:1/287: mkdir d14/d2a/d62 0 2024-03-28T13:04:17.100 INFO:tasks.workunit.client.0.smithi076.stdout:1/288: write d14/f32 [226716,33210] 0 2024-03-28T13:04:17.162 INFO:tasks.workunit.client.0.smithi076.stdout:0/325: mknod db/dc/df/d11/d40/c7a 0 2024-03-28T13:04:17.162 INFO:tasks.workunit.client.0.smithi076.stdout:0/326: readlink db/dc/df/d18/d1d/d21/l34 0 2024-03-28T13:04:17.661 INFO:tasks.workunit.client.0.smithi076.stdout:8/278: rmdir de/d23/d55 0 2024-03-28T13:04:17.662 INFO:tasks.workunit.client.0.smithi076.stdout:6/333: creat d6/da/d5f/f6b x:0 0 0 2024-03-28T13:04:17.662 INFO:tasks.workunit.client.0.smithi076.stdout:6/334: write d6/da/d1e/f35 [5024690,122864] 0 2024-03-28T13:04:17.662 INFO:tasks.workunit.client.0.smithi076.stdout:6/335: chown d6/l5e 5659 1 2024-03-28T13:04:17.662 INFO:tasks.workunit.client.0.smithi076.stdout:6/336: readlink d6/l5e 0 2024-03-28T13:04:17.693 INFO:tasks.workunit.client.0.smithi076.stdout:5/309: rename d5/d9/d1c/d1d/d31/f5c to d5/d9/d35/f72 0 2024-03-28T13:04:17.847 INFO:tasks.workunit.client.0.smithi076.stdout:7/311: creat d1/d18/d3c/d48/d69/f6d x:0 0 0 2024-03-28T13:04:17.847 INFO:tasks.workunit.client.0.smithi076.stdout:7/312: stat d1/f40 0 2024-03-28T13:04:17.926 INFO:tasks.workunit.client.0.smithi076.stdout:0/327: read db/dc/df/f1e [397978,25914] 0 2024-03-28T13:04:17.963 INFO:tasks.workunit.client.0.smithi076.stdout:0/328: dwrite db/dc/df/d11/f3b [0,4194304] 0 2024-03-28T13:04:17.975 INFO:tasks.workunit.client.0.smithi076.stdout:8/279: truncate de/f11 2809210 0 2024-03-28T13:04:18.131 INFO:tasks.workunit.client.0.smithi076.stdout:6/337: creat d6/da/d40/d56/f6c x:0 0 0 2024-03-28T13:04:18.181 INFO:tasks.workunit.client.0.smithi076.stdout:5/310: mkdir d5/d9/d1c/d25/d73 0 2024-03-28T13:04:18.181 INFO:tasks.workunit.client.0.smithi076.stdout:5/311: fdatasync d5/f6c 0 2024-03-28T13:04:18.253 INFO:tasks.workunit.client.0.smithi076.stdout:2/311: rename d2/d5/d7/d8/d21/f61 to d2/d5/db/d3b/f62 0 2024-03-28T13:04:18.258 INFO:tasks.workunit.client.0.smithi076.stdout:2/312: dread d2/d5/f12 [8388608,4194304] 0 2024-03-28T13:04:18.409 INFO:tasks.workunit.client.0.smithi076.stdout:8/280: creat de/d13/d27/f5e x:0 0 0 2024-03-28T13:04:18.530 INFO:tasks.workunit.client.0.smithi076.stdout:6/338: rmdir d6/da/d40/d56 39 2024-03-28T13:04:18.610 INFO:tasks.workunit.client.0.smithi076.stdout:5/312: mknod d5/db/d19/c74 0 2024-03-28T13:04:18.610 INFO:tasks.workunit.client.0.smithi076.stdout:5/313: chown d5/db/f2a 155 1 2024-03-28T13:04:18.775 INFO:tasks.workunit.client.0.smithi076.stdout:9/311: rename d9/d3c/f29 to d9/dd/d48/f66 0 2024-03-28T13:04:18.776 INFO:tasks.workunit.client.0.smithi076.stdout:9/312: write d9/dd/df/d63/f3d [6629656,66074] 0 2024-03-28T13:04:18.776 INFO:tasks.workunit.client.0.smithi076.stdout:2/313: truncate d2/d5/db/d3b/f4e 519558 0 2024-03-28T13:04:18.776 INFO:tasks.workunit.client.0.smithi076.stdout:2/314: write d2/d5/db/d3b/f62 [802246,55033] 0 2024-03-28T13:04:18.798 INFO:tasks.workunit.client.0.smithi076.stdout:9/313: dwrite d9/dd/f56 [0,4194304] 0 2024-03-28T13:04:18.843 INFO:tasks.workunit.client.0.smithi076.stdout:8/281: creat de/d12/d18/d3c/d50/f5f x:0 0 0 2024-03-28T13:04:19.042 INFO:tasks.workunit.client.0.smithi076.stdout:6/339: mkdir d6/da/d5f/d6d 0 2024-03-28T13:04:19.043 INFO:tasks.workunit.client.0.smithi076.stdout:6/340: chown d6/da/d1e/f31 749215809 1 2024-03-28T13:04:19.043 INFO:tasks.workunit.client.0.smithi076.stdout:5/314: truncate d5/d9/d1c/d1d/d22/f33 666715 0 2024-03-28T13:04:19.178 INFO:tasks.workunit.client.0.smithi076.stdout:2/315: unlink d2/l25 0 2024-03-28T13:04:19.178 INFO:tasks.workunit.client.0.smithi076.stdout:8/282: mkdir de/d23/d2b/d51/d60 0 2024-03-28T13:04:19.313 INFO:tasks.workunit.client.0.smithi076.stdout:4/313: write d0/f1f [1179878,25246] 0 2024-03-28T13:04:19.313 INFO:tasks.workunit.client.0.smithi076.stdout:6/341: mknod d6/da/d5f/d6d/c6e 0 2024-03-28T13:04:19.313 INFO:tasks.workunit.client.0.smithi076.stdout:4/314: write d0/d3b/d40/d42/d31/d4d/f4c [1299257,80823] 0 2024-03-28T13:04:19.333 INFO:tasks.workunit.client.0.smithi076.stdout:6/342: write d6/da/d39/d41/f30 [489244,24673] 0 2024-03-28T13:04:19.353 INFO:tasks.workunit.client.0.smithi076.stdout:5/315: mknod d5/c75 0 2024-03-28T13:04:19.532 INFO:tasks.workunit.client.0.smithi076.stdout:3/244: rename d1/d2/f1e to d1/d7/d30/d38/d14/d18/d3a/f5e 0 2024-03-28T13:04:19.591 INFO:tasks.workunit.client.0.smithi076.stdout:8/283: link de/d13/c41 de/d12/c61 0 2024-03-28T13:04:19.591 INFO:tasks.workunit.client.0.smithi076.stdout:4/315: mknod d0/d3b/d40/d42/d47/c6d 0 2024-03-28T13:04:19.591 INFO:tasks.workunit.client.0.smithi076.stdout:8/284: fsync de/d25/f36 0 2024-03-28T13:04:19.591 INFO:tasks.workunit.client.0.smithi076.stdout:4/316: chown d0/d20/f48 10753 1 2024-03-28T13:04:19.592 INFO:tasks.workunit.client.0.smithi076.stdout:4/317: read d0/db/f18 [1035465,89481] 0 2024-03-28T13:04:19.592 INFO:tasks.workunit.client.0.smithi076.stdout:4/318: chown d0/d3b/d40/d42/d31/c39 11 1 2024-03-28T13:04:19.807 INFO:tasks.workunit.client.0.smithi076.stdout:5/316: creat d5/f76 x:0 0 0 2024-03-28T13:04:19.807 INFO:tasks.workunit.client.0.smithi076.stdout:3/245: mkdir d1/d7/d30/d5f 0 2024-03-28T13:04:19.839 INFO:tasks.workunit.client.0.smithi076.stdout:3/246: dwrite d1/d7/d30/d38/f1a [4194304,4194304] 0 2024-03-28T13:04:19.882 INFO:tasks.workunit.client.0.smithi076.stdout:3/247: dwrite d1/f1b [0,4194304] 0 2024-03-28T13:04:19.917 INFO:tasks.workunit.client.0.smithi076.stdout:1/289: rename d14/f2b to d14/d2a/d2e/d31/d49/f63 0 2024-03-28T13:04:19.995 INFO:tasks.workunit.client.0.smithi076.stdout:8/285: mkdir de/d23/d2b/d51/d62 0 2024-03-28T13:04:19.995 INFO:tasks.workunit.client.0.smithi076.stdout:8/286: chown de/d12/d18/f32 36413734 1 2024-03-28T13:04:20.745 INFO:tasks.workunit.client.0.smithi076.stdout:5/317: link d5/d9/d1c/d25/f3a d5/db/d19/f77 0 2024-03-28T13:04:20.745 INFO:tasks.workunit.client.0.smithi076.stdout:5/318: write d5/db/df/d61/f6f [507826,83045] 0 2024-03-28T13:04:21.000 INFO:tasks.workunit.client.0.smithi076.stdout:7/313: rename d1/f6 to d1/dc/f6e 0 2024-03-28T13:04:21.034 INFO:tasks.workunit.client.0.smithi076.stdout:7/314: dwrite d1/dc/f6e [0,4194304] 0 2024-03-28T13:04:21.053 INFO:tasks.workunit.client.0.smithi076.stdout:1/290: link d14/d2a/d2e/d31/f53 d14/d2a/d2e/d31/d49/f64 0 2024-03-28T13:04:21.088 INFO:tasks.workunit.client.0.smithi076.stdout:8/287: mknod de/d12/c63 0 2024-03-28T13:04:21.200 INFO:tasks.workunit.client.0.smithi076.stdout:5/319: symlink d5/db/d19/l78 0 2024-03-28T13:04:21.230 INFO:tasks.workunit.client.0.smithi076.stdout:5/320: dwrite d5/d9/f40 [0,4194304] 0 2024-03-28T13:04:21.233 INFO:tasks.workunit.client.0.smithi076.stdout:9/314: dwrite d9/dd/df/d11/d37/f1c [0,4194304] 0 2024-03-28T13:04:21.325 INFO:tasks.workunit.client.0.smithi076.stdout:0/329: rename db/dc/df/d18/d1d/d73/c78 to db/dc/df/d18/d1d/c7b 0 2024-03-28T13:04:21.472 INFO:tasks.workunit.client.0.smithi076.stdout:7/315: unlink d1/d8/c5a 0 2024-03-28T13:04:21.606 INFO:tasks.workunit.client.0.smithi076.stdout:1/291: creat d14/d2a/d2e/d3c/d5c/f65 x:0 0 0 2024-03-28T13:04:21.682 INFO:tasks.workunit.client.0.smithi076.stdout:8/288: creat de/d4e/d54/f64 x:0 0 0 2024-03-28T13:04:21.682 INFO:tasks.workunit.client.0.smithi076.stdout:8/289: write de/d23/d2b/d2c/f4c [1190377,84547] 0 2024-03-28T13:04:21.947 INFO:tasks.workunit.client.0.smithi076.stdout:6/343: rmdir d6 39 2024-03-28T13:04:21.947 INFO:tasks.workunit.client.0.smithi076.stdout:6/344: fsync d6/da/d1e/f4a 0 2024-03-28T13:04:22.017 INFO:tasks.workunit.client.0.smithi076.stdout:2/316: rename d2/d5/d7/d28/f4c to d2/d5/db/d3b/d5a/f63 0 2024-03-28T13:04:22.141 INFO:tasks.workunit.client.0.smithi076.stdout:0/330: getdents db/dc/d3d 0 2024-03-28T13:04:22.142 INFO:tasks.workunit.client.0.smithi076.stdout:3/248: getdents d1/d7/d30 0 2024-03-28T13:04:22.143 INFO:tasks.workunit.client.0.smithi076.stdout:7/316: creat d1/d18/d2d/f6f x:0 0 0 2024-03-28T13:04:22.146 INFO:tasks.workunit.client.0.smithi076.stdout:3/249: read d1/f48 [32078,15185] 0 2024-03-28T13:04:22.798 INFO:tasks.workunit.client.0.smithi076.stdout:1/292: creat d14/d2a/d2e/d31/d3b/f66 x:0 0 0 2024-03-28T13:04:22.866 INFO:tasks.workunit.client.0.smithi076.stdout:8/290: mkdir de/d23/d2b/d58/d65 0 2024-03-28T13:04:22.867 INFO:tasks.workunit.client.0.smithi076.stdout:8/291: chown de/d12/d18/d3c/d50 2 1 2024-03-28T13:04:22.871 INFO:tasks.workunit.client.0.smithi076.stdout:8/292: dread de/d23/d2b/f30 [0,4194304] 0 2024-03-28T13:04:22.973 INFO:tasks.workunit.client.0.smithi076.stdout:4/319: creat d0/d3b/d40/f6e x:0 0 0 2024-03-28T13:04:23.005 INFO:tasks.workunit.client.0.smithi076.stdout:6/345: dread d6/f2f [0,4194304] 0 2024-03-28T13:04:23.005 INFO:tasks.workunit.client.0.smithi076.stdout:6/346: chown d6/da/d39/f3b 25102 1 2024-03-28T13:04:23.005 INFO:tasks.workunit.client.0.smithi076.stdout:6/347: chown d6/f4b 147211098 1 2024-03-28T13:04:23.103 INFO:tasks.workunit.client.0.smithi076.stdout:5/321: fsync d5/d9/d1c/d25/f3a 0 2024-03-28T13:04:23.124 INFO:tasks.workunit.client.0.smithi076.stdout:2/317: write d2/d5/f12 [8968304,115737] 0 2024-03-28T13:04:23.287 INFO:tasks.workunit.client.0.smithi076.stdout:0/331: link db/dc/d3d/d57/c74 db/dc/d3d/c7c 0 2024-03-28T13:04:23.287 INFO:tasks.workunit.client.0.smithi076.stdout:7/317: rmdir d1/dc/d66 0 2024-03-28T13:04:23.287 INFO:tasks.workunit.client.0.smithi076.stdout:0/332: fdatasync db/f12 0 2024-03-28T13:04:23.287 INFO:tasks.workunit.client.0.smithi076.stdout:7/318: fdatasync d1/f16 0 2024-03-28T13:04:23.287 INFO:tasks.workunit.client.0.smithi076.stdout:0/333: read - db/dc/df/d11/d40/d69/f6b zero size 2024-03-28T13:04:23.287 INFO:tasks.workunit.client.0.smithi076.stdout:7/319: chown d1/d8/d37/f58 18204 1 2024-03-28T13:04:23.287 INFO:tasks.workunit.client.0.smithi076.stdout:7/320: write d1/dc/f1c [1090324,127424] 0 2024-03-28T13:04:23.301 INFO:tasks.workunit.client.0.smithi076.stdout:0/334: write db/dc/df/d11/d40/f42 [1311813,48506] 0 2024-03-28T13:04:23.301 INFO:tasks.workunit.client.0.smithi076.stdout:0/335: readlink db/dc/df/d18/d1d/l25 0 2024-03-28T13:04:23.374 INFO:tasks.workunit.client.0.smithi076.stdout:7/321: dwrite d1/d18/d3c/f20 [0,4194304] 0 2024-03-28T13:04:23.374 INFO:tasks.workunit.client.0.smithi076.stdout:7/322: fsync d1/d18/f5c 0 2024-03-28T13:04:23.379 INFO:tasks.workunit.client.0.smithi076.stdout:0/336: dwrite db/dc/df/d11/d40/f64 [0,4194304] 0 2024-03-28T13:04:23.411 INFO:tasks.workunit.client.0.smithi076.stdout:7/323: dwrite d1/f16 [0,4194304] 0 2024-03-28T13:04:23.513 INFO:tasks.workunit.client.0.smithi076.stdout:6/348: mknod d6/da/d5f/d6d/c6f 0 2024-03-28T13:04:23.537 INFO:tasks.workunit.client.0.smithi076.stdout:6/349: dwrite d6/f3c [0,4194304] 0 2024-03-28T13:04:23.699 INFO:tasks.workunit.client.0.smithi076.stdout:2/318: chown d2/d5/db/d3b/d5a/f63 8332571 1 2024-03-28T13:04:24.078 INFO:tasks.workunit.client.0.smithi076.stdout:0/337: mkdir db/dc/df/d11/d40/d7d 0 2024-03-28T13:04:24.099 INFO:tasks.workunit.client.0.smithi076.stdout:0/338: dread db/dc/fe [0,4194304] 0 2024-03-28T13:04:24.106 INFO:tasks.workunit.client.0.smithi076.stdout:7/324: link d1/dc/f55 d1/d18/d3c/d48/d69/f70 0 2024-03-28T13:04:24.107 INFO:tasks.workunit.client.0.smithi076.stdout:0/339: write db/dc/df/d18/d1d/d75/f39 [969919,96384] 0 2024-03-28T13:04:24.564 INFO:tasks.workunit.client.0.smithi076.stdout:7/325: symlink d1/d18/l71 0 2024-03-28T13:04:24.658 INFO:tasks.workunit.client.0.smithi076.stdout:0/340: getdents db/dc/df/d18/d1d/d21 0 2024-03-28T13:04:24.798 INFO:tasks.workunit.client.0.smithi076.stdout:2/319: mkdir d2/d5/d7/d28/d64 0 2024-03-28T13:04:24.807 INFO:tasks.workunit.client.0.smithi076.stdout:7/326: link d1/d8/d37/l42 d1/d8/d37/l72 0 2024-03-28T13:04:24.818 INFO:tasks.workunit.client.0.smithi076.stdout:2/320: write d2/d5/d7/d8/d21/f48 [1808128,130467] 0 2024-03-28T13:04:24.844 INFO:tasks.workunit.client.0.smithi076.stdout:2/321: dwrite d2/f16 [0,4194304] 0 2024-03-28T13:04:24.879 INFO:tasks.workunit.client.0.smithi076.stdout:0/341: mkdir db/dc/df/d71/d4a/d7e 0 2024-03-28T13:04:24.880 INFO:tasks.workunit.client.0.smithi076.stdout:0/342: read - db/dc/df/f23 zero size 2024-03-28T13:04:24.880 INFO:tasks.workunit.client.0.smithi076.stdout:2/322: dwrite d2/d5/d7/f17 [0,4194304] 0 2024-03-28T13:04:24.886 INFO:tasks.workunit.client.0.smithi076.stdout:0/343: dread db/dc/df/f1e [0,4194304] 0 2024-03-28T13:04:24.887 INFO:tasks.workunit.client.0.smithi076.stdout:0/344: write db/dc/df/f1a [3315218,22177] 0 2024-03-28T13:04:25.413 INFO:tasks.workunit.client.0.smithi076.stdout:9/315: sync 2024-03-28T13:04:25.413 INFO:tasks.workunit.client.0.smithi076.stdout:9/316: dread - d9/d3c/f5a zero size 2024-03-28T13:04:25.603 INFO:tasks.workunit.client.0.smithi076.stdout:7/327: creat d1/d8/d37/d53/f73 x:0 0 0 2024-03-28T13:04:25.603 INFO:tasks.workunit.client.0.smithi076.stdout:7/328: readlink d1/l28 0 2024-03-28T13:04:25.644 INFO:tasks.workunit.client.0.smithi076.stdout:7/329: dwrite d1/d8/d37/f6c [0,4194304] 0 2024-03-28T13:04:25.816 INFO:tasks.workunit.client.0.smithi076.stdout:0/345: read db/dc/d3d/d57/f5b [3978242,95334] 0 2024-03-28T13:04:25.892 INFO:tasks.workunit.client.0.smithi076.stdout:9/317: getdents d9/dd/d48 0 2024-03-28T13:04:25.892 INFO:tasks.workunit.client.0.smithi076.stdout:9/318: fdatasync d9/dd/f57 0 2024-03-28T13:04:25.892 INFO:tasks.workunit.client.0.smithi076.stdout:9/319: dread - d9/dd/df/d63/f50 zero size 2024-03-28T13:04:25.925 INFO:tasks.workunit.client.0.smithi076.stdout:7/330: readlink d1/d18/d3c/l22 0 2024-03-28T13:04:25.925 INFO:tasks.workunit.client.0.smithi076.stdout:7/331: stat d1/dc/ff 0 2024-03-28T13:04:26.073 INFO:tasks.workunit.client.0.smithi076.stdout:0/346: link db/dc/df/d18/d1d/d21/l5d db/dc/df/d11/d40/d69/l7f 0 2024-03-28T13:04:26.082 INFO:tasks.workunit.client.0.smithi076.stdout:0/347: write db/dc/df/f1a [2209979,54756] 0 2024-03-28T13:04:26.361 INFO:tasks.workunit.client.0.smithi076.stdout:0/348: mknod db/dc/df/d11/c80 0 2024-03-28T13:04:26.361 INFO:tasks.workunit.client.0.smithi076.stdout:0/349: write db/f3e [415356,81728] 0 2024-03-28T13:04:26.373 INFO:tasks.workunit.client.0.smithi076.stdout:8/293: mknod de/d23/d2b/c66 0 2024-03-28T13:04:26.399 INFO:tasks.workunit.client.0.smithi076.stdout:4/320: unlink d0/ca 0 2024-03-28T13:04:26.399 INFO:tasks.workunit.client.0.smithi076.stdout:3/250: mkdir d1/d7/d30/d60 0 2024-03-28T13:04:26.412 INFO:tasks.workunit.client.0.smithi076.stdout:6/350: dwrite d6/da/d39/f65 [0,4194304] 0 2024-03-28T13:04:26.428 INFO:tasks.workunit.client.0.smithi076.stdout:8/294: dwrite de/f3f [0,4194304] 0 2024-03-28T13:04:26.460 INFO:tasks.workunit.client.0.smithi076.stdout:1/293: link d14/l50 d14/d2a/d2e/d31/l67 0 2024-03-28T13:04:26.603 INFO:tasks.workunit.client.0.smithi076.stdout:5/322: creat d5/db/f79 x:0 0 0 2024-03-28T13:04:26.603 INFO:tasks.workunit.client.0.smithi076.stdout:5/323: write d5/f6 [4836241,65107] 0 2024-03-28T13:04:26.609 INFO:tasks.workunit.client.0.smithi076.stdout:2/323: write d2/d5/d7/fa [1786572,41932] 0 2024-03-28T13:04:26.706 INFO:tasks.workunit.client.0.smithi076.stdout:7/332: symlink d1/d18/d3c/d48/d69/l74 0 2024-03-28T13:04:26.706 INFO:tasks.workunit.client.0.smithi076.stdout:9/320: creat d9/f67 x:0 0 0 2024-03-28T13:04:26.706 INFO:tasks.workunit.client.0.smithi076.stdout:7/333: write d1/d8/d37/f47 [586578,53905] 0 2024-03-28T13:04:26.769 INFO:tasks.workunit.client.0.smithi076.stdout:0/350: rmdir db/dc/df/d11/d40/d7d 0 2024-03-28T13:04:26.918 INFO:tasks.workunit.client.0.smithi076.stdout:4/321: symlink d0/d3b/d40/d42/d31/d5e/l6f 0 2024-03-28T13:04:26.918 INFO:tasks.workunit.client.0.smithi076.stdout:3/251: creat d1/f61 x:0 0 0 2024-03-28T13:04:26.918 INFO:tasks.workunit.client.0.smithi076.stdout:3/252: chown d1/d7/d30/d38/d14/d18/f24 675529 1 2024-03-28T13:04:26.948 INFO:tasks.workunit.client.0.smithi076.stdout:4/322: dwrite d0/d3b/d40/d42/f65 [0,4194304] 0 2024-03-28T13:04:26.948 INFO:tasks.workunit.client.0.smithi076.stdout:4/323: fdatasync d0/f9 0 2024-03-28T13:04:26.948 INFO:tasks.workunit.client.0.smithi076.stdout:4/324: stat d0/d3b/d40/d42/d31/d5e 0 2024-03-28T13:04:27.051 INFO:tasks.workunit.client.0.smithi076.stdout:6/351: creat d6/da/d1e/f70 x:0 0 0 2024-03-28T13:04:27.081 INFO:tasks.workunit.client.0.smithi076.stdout:6/352: dwrite d6/da/d1e/f60 [0,4194304] 0 2024-03-28T13:04:27.081 INFO:tasks.workunit.client.0.smithi076.stdout:6/353: fsync d6/da/d1e/f1f 0 2024-03-28T13:04:27.081 INFO:tasks.workunit.client.0.smithi076.stdout:6/354: truncate d6/da/d1e/f70 231551 0 2024-03-28T13:04:27.097 INFO:tasks.workunit.client.0.smithi076.stdout:6/355: dread d6/da/d39/d41/f5b [0,4194304] 0 2024-03-28T13:04:27.137 INFO:tasks.workunit.client.0.smithi076.stdout:6/356: dwrite d6/f12 [0,4194304] 0 2024-03-28T13:04:27.193 INFO:tasks.workunit.client.0.smithi076.stdout:8/295: unlink de/d23/d2b/c2d 0 2024-03-28T13:04:27.193 INFO:tasks.workunit.client.0.smithi076.stdout:1/294: getdents d14/d2a/d2e/d31/d46 0 2024-03-28T13:04:27.193 INFO:tasks.workunit.client.0.smithi076.stdout:1/295: chown l11 4 1 2024-03-28T13:04:27.233 INFO:tasks.workunit.client.0.smithi076.stdout:5/324: rmdir d5/db/d19/d34 39 2024-03-28T13:04:27.233 INFO:tasks.workunit.client.0.smithi076.stdout:5/325: stat d5/db/d3f/d42/f58 0 2024-03-28T13:04:27.277 INFO:tasks.workunit.client.0.smithi076.stdout:5/326: dwrite d5/d9/d1c/d25/f5d [0,4194304] 0 2024-03-28T13:04:27.330 INFO:tasks.workunit.client.0.smithi076.stdout:5/327: dwrite d5/db/d19/d34/f6e [0,4194304] 0 2024-03-28T13:04:27.333 INFO:tasks.workunit.client.0.smithi076.stdout:9/321: creat d9/da/f68 x:0 0 0 2024-03-28T13:04:27.342 INFO:tasks.workunit.client.0.smithi076.stdout:7/334: mknod d1/d18/d3c/d48/c75 0 2024-03-28T13:04:27.342 INFO:tasks.workunit.client.0.smithi076.stdout:7/335: write d1/d8/d37/f43 [4964051,14048] 0 2024-03-28T13:04:27.349 INFO:tasks.workunit.client.0.smithi076.stdout:2/324: dread d2/d5/d4b/f1f [0,4194304] 0 2024-03-28T13:04:28.389 INFO:tasks.workunit.client.0.smithi076.stdout:3/253: symlink d1/d7/d30/d38/d14/d36/d56/l62 0 2024-03-28T13:04:28.546 INFO:tasks.workunit.client.0.smithi076.stdout:4/325: link d0/c3d d0/d20/c70 0 2024-03-28T13:04:28.546 INFO:tasks.workunit.client.0.smithi076.stdout:4/326: write d0/d3b/d40/d42/d31/f56 [2461833,32802] 0 2024-03-28T13:04:28.546 INFO:tasks.workunit.client.0.smithi076.stdout:4/327: chown d0/db/d2d/f4f 253353 1 2024-03-28T13:04:28.546 INFO:tasks.workunit.client.0.smithi076.stdout:4/328: write d0/db/d2d/f35 [1178484,23364] 0 2024-03-28T13:04:28.778 INFO:tasks.workunit.client.0.smithi076.stdout:6/357: symlink d6/da/d40/d62/l71 0 2024-03-28T13:04:28.890 INFO:tasks.workunit.client.0.smithi076.stdout:8/296: rmdir de/d23/d2b/d58/d65 0 2024-03-28T13:04:28.896 INFO:tasks.workunit.client.0.smithi076.stdout:8/297: dread de/d23/f1e [0,4194304] 0 2024-03-28T13:04:29.259 INFO:tasks.workunit.client.0.smithi076.stdout:9/322: symlink d9/dd/df/d63/d2a/l69 0 2024-03-28T13:04:29.259 INFO:tasks.workunit.client.0.smithi076.stdout:9/323: readlink d9/dd/df/d63/d2a/l47 0 2024-03-28T13:04:29.259 INFO:tasks.workunit.client.0.smithi076.stdout:5/328: mkdir d5/db/d3f/d42/d43/d7a 0 2024-03-28T13:04:29.260 INFO:tasks.workunit.client.0.smithi076.stdout:9/324: stat d9/dd/d48/c4c 0 2024-03-28T13:04:29.309 INFO:tasks.workunit.client.0.smithi076.stdout:9/325: dwrite d9/d3c/f5a [0,4194304] 0 2024-03-28T13:04:29.310 INFO:tasks.workunit.client.0.smithi076.stdout:9/326: write d9/dd/df/d11/d14/f26 [2517179,19890] 0 2024-03-28T13:04:29.326 INFO:tasks.workunit.client.0.smithi076.stdout:9/327: dread d9/dd/df/d11/d14/f4e [0,4194304] 0 2024-03-28T13:04:29.360 INFO:tasks.workunit.client.0.smithi076.stdout:1/296: rmdir d14/d2a/d2e/d31 39 2024-03-28T13:04:29.399 INFO:tasks.workunit.client.0.smithi076.stdout:7/336: symlink d1/l76 0 2024-03-28T13:04:29.399 INFO:tasks.workunit.client.0.smithi076.stdout:7/337: read - d1/d8/d37/d53/f73 zero size 2024-03-28T13:04:29.437 INFO:tasks.workunit.client.0.smithi076.stdout:2/325: getdents d2/d5/d7 0 2024-03-28T13:04:29.448 INFO:tasks.workunit.client.0.smithi076.stdout:7/338: dwrite d1/d18/f5c [0,4194304] 0 2024-03-28T13:04:29.448 INFO:tasks.workunit.client.0.smithi076.stdout:7/339: write d1/f36 [1249824,82826] 0 2024-03-28T13:04:29.518 INFO:tasks.workunit.client.0.smithi076.stdout:3/254: creat d1/f63 x:0 0 0 2024-03-28T13:04:29.518 INFO:tasks.workunit.client.0.smithi076.stdout:3/255: read - d1/d7/f32 zero size 2024-03-28T13:04:29.712 INFO:tasks.workunit.client.0.smithi076.stdout:4/329: creat d0/db/d68/f71 x:0 0 0 2024-03-28T13:04:29.785 INFO:tasks.workunit.client.0.smithi076.stdout:8/298: creat de/d4e/f67 x:0 0 0 2024-03-28T13:04:29.871 INFO:tasks.workunit.client.0.smithi076.stdout:5/329: rmdir d5/d9/d4c/d63 39 2024-03-28T13:04:29.968 INFO:tasks.workunit.client.0.smithi076.stdout:9/328: creat d9/dd/df/d11/d14/f6a x:0 0 0 2024-03-28T13:04:30.030 INFO:tasks.workunit.client.0.smithi076.stdout:1/297: unlink d14/d2a/d2e/d31/f35 0 2024-03-28T13:04:30.092 INFO:tasks.workunit.client.0.smithi076.stdout:2/326: truncate d2/d5/f5f 178580 0 2024-03-28T13:04:30.183 INFO:tasks.workunit.client.0.smithi076.stdout:0/351: sync 2024-03-28T13:04:30.291 INFO:tasks.workunit.client.0.smithi076.stdout:7/340: rename d1/dc/f17 to d1/d18/d3c/d48/f77 0 2024-03-28T13:04:30.291 INFO:tasks.workunit.client.0.smithi076.stdout:7/341: readlink d1/d8/d37/l42 0 2024-03-28T13:04:30.370 INFO:tasks.workunit.client.0.smithi076.stdout:4/330: mkdir d0/d3b/d40/d42/d31/d5e/d72 0 2024-03-28T13:04:30.370 INFO:tasks.workunit.client.0.smithi076.stdout:8/299: unlink de/d13/c22 0 2024-03-28T13:04:30.474 INFO:tasks.workunit.client.0.smithi076.stdout:5/330: rmdir d5/d9/d1c/d1d/d31 39 2024-03-28T13:04:30.474 INFO:tasks.workunit.client.0.smithi076.stdout:5/331: readlink d5/db/l1a 0 2024-03-28T13:04:30.513 INFO:tasks.workunit.client.0.smithi076.stdout:9/329: creat d9/f6b x:0 0 0 2024-03-28T13:04:30.820 INFO:tasks.workunit.client.0.smithi076.stdout:3/256: rename d1/d7/d30/d38/d14/d18/f39 to d1/d7/d30/d38/d14/d4a/f64 0 2024-03-28T13:04:30.820 INFO:tasks.workunit.client.0.smithi076.stdout:2/327: rename d2 to d2/d5/d7/d3e/d65 22 2024-03-28T13:04:30.834 INFO:tasks.workunit.client.0.smithi076.stdout:3/257: dread d1/d7/d30/d38/d14/d18/f24 [0,4194304] 0 2024-03-28T13:04:30.864 INFO:tasks.workunit.client.0.smithi076.stdout:3/258: dwrite d1/d7/d30/d38/f1a [4194304,4194304] 0 2024-03-28T13:04:30.864 INFO:tasks.workunit.client.0.smithi076.stdout:3/259: fsync d1/d7/d30/d38/d14/f26 0 2024-03-28T13:04:30.864 INFO:tasks.workunit.client.0.smithi076.stdout:3/260: readlink d1/d7/d30/d38/d14/d36/l3e 0 2024-03-28T13:04:30.879 INFO:tasks.workunit.client.0.smithi076.stdout:7/342: truncate d1/d8/d37/f6c 3943641 0 2024-03-28T13:04:31.013 INFO:tasks.workunit.client.0.smithi076.stdout:8/300: mkdir de/d4e/d54/d68 0 2024-03-28T13:04:31.013 INFO:tasks.workunit.client.0.smithi076.stdout:8/301: dread - de/d13/d27/f5a zero size 2024-03-28T13:04:31.030 INFO:tasks.workunit.client.0.smithi076.stdout:8/302: dread de/f3f [0,4194304] 0 2024-03-28T13:04:31.030 INFO:tasks.workunit.client.0.smithi076.stdout:8/303: chown de/d23/d2b 113 1 2024-03-28T13:04:31.059 INFO:tasks.workunit.client.0.smithi076.stdout:4/331: creat d0/f73 x:0 0 0 2024-03-28T13:04:31.059 INFO:tasks.workunit.client.0.smithi076.stdout:4/332: write d0/d3b/d40/d42/d28/f66 [610466,36624] 0 2024-03-28T13:04:31.097 INFO:tasks.workunit.client.0.smithi076.stdout:5/332: symlink d5/d9/l7b 0 2024-03-28T13:04:31.115 INFO:tasks.workunit.client.0.smithi076.stdout:5/333: write d5/db/f2a [2742124,1210] 0 2024-03-28T13:04:31.117 INFO:tasks.workunit.client.0.smithi076.stdout:5/334: fsync d5/db/f13 0 2024-03-28T13:04:31.161 INFO:tasks.workunit.client.0.smithi076.stdout:9/330: creat d9/dd/df/d11/d14/d58/f6c x:0 0 0 2024-03-28T13:04:31.260 INFO:tasks.workunit.client.0.smithi076.stdout:2/328: rename d2/d5/db/d3b/d5a/f63 to d2/d5/d4b/d39/d57/f66 0 2024-03-28T13:04:31.280 INFO:tasks.workunit.client.0.smithi076.stdout:3/261: symlink d1/d7/d30/d5f/l65 0 2024-03-28T13:04:31.374 INFO:tasks.workunit.client.0.smithi076.stdout:7/343: mknod d1/d8/c78 0 2024-03-28T13:04:31.413 INFO:tasks.workunit.client.0.smithi076.stdout:8/304: truncate de/d23/d2b/d2c/f57 421260 0 2024-03-28T13:04:31.463 INFO:tasks.workunit.client.0.smithi076.stdout:8/305: dwrite de/f1d [4194304,4194304] 0 2024-03-28T13:04:31.502 INFO:tasks.workunit.client.0.smithi076.stdout:4/333: mknod d0/d3b/d40/c74 0 2024-03-28T13:04:31.527 INFO:tasks.workunit.client.0.smithi076.stdout:4/334: dwrite d0/d3b/d40/d42/f24 [0,4194304] 0 2024-03-28T13:04:31.566 INFO:tasks.workunit.client.0.smithi076.stdout:4/335: dwrite d0/db/d68/f71 [0,4194304] 0 2024-03-28T13:04:31.589 INFO:tasks.workunit.client.0.smithi076.stdout:5/335: mkdir d5/db/d3f/d42/d43/d7a/d7c 0 2024-03-28T13:04:31.703 INFO:tasks.workunit.client.0.smithi076.stdout:9/331: creat d9/dd/df/d63/d2a/f6d x:0 0 0 2024-03-28T13:04:31.755 INFO:tasks.workunit.client.0.smithi076.stdout:3/262: mkdir d1/d7/d30/d38/d14/d4a/d66 0 2024-03-28T13:04:31.756 INFO:tasks.workunit.client.0.smithi076.stdout:3/263: getdents d1/d7/d30/d38/d14/d18/d58 0 2024-03-28T13:04:31.756 INFO:tasks.workunit.client.0.smithi076.stdout:3/264: fsync d1/f61 0 2024-03-28T13:04:31.756 INFO:tasks.workunit.client.0.smithi076.stdout:3/265: write d1/d7/d30/d38/d14/d18/d3a/f5e [2227638,33955] 0 2024-03-28T13:04:31.801 INFO:tasks.workunit.client.0.smithi076.stdout:7/344: rmdir d1/dc 39 2024-03-28T13:04:31.801 INFO:tasks.workunit.client.0.smithi076.stdout:7/345: stat d1/dc/f55 0 2024-03-28T13:04:31.840 INFO:tasks.workunit.client.0.smithi076.stdout:7/346: dwrite d1/dc/f2b [0,4194304] 0 2024-03-28T13:04:31.861 INFO:tasks.workunit.client.0.smithi076.stdout:8/306: mknod de/d12/c69 0 2024-03-28T13:04:31.861 INFO:tasks.workunit.client.0.smithi076.stdout:8/307: chown de/d13/d27/f29 81 1 2024-03-28T13:04:31.861 INFO:tasks.workunit.client.0.smithi076.stdout:8/308: chown de/d12/d18/d3c/f44 63066 1 2024-03-28T13:04:31.978 INFO:tasks.workunit.client.0.smithi076.stdout:6/358: sync 2024-03-28T13:04:32.173 INFO:tasks.workunit.client.0.smithi076.stdout:4/336: mkdir d0/db/d2d/d75 0 2024-03-28T13:04:32.213 INFO:tasks.workunit.client.0.smithi076.stdout:5/336: rmdir d5/d9/d1c/d1d/d22/d69 0 2024-03-28T13:04:32.223 INFO:tasks.workunit.client.0.smithi076.stdout:4/337: dwrite d0/d3b/d40/d42/d31/d4d/f54 [0,4194304] 0 2024-03-28T13:04:32.349 INFO:tasks.workunit.client.0.smithi076.stdout:3/266: link d1/d7/d30/d38/l49 d1/d7/d30/d38/d14/l67 0 2024-03-28T13:04:32.349 INFO:tasks.workunit.client.0.smithi076.stdout:3/267: getdents d1/d7/d30/d60 0 2024-03-28T13:04:32.719 INFO:tasks.workunit.client.0.smithi076.stdout:6/359: symlink d6/da/d39/l72 0 2024-03-28T13:04:32.719 INFO:tasks.workunit.client.0.smithi076.stdout:6/360: read - d6/da/d1e/f5a zero size 2024-03-28T13:04:32.793 INFO:tasks.workunit.client.0.smithi076.stdout:5/337: write d5/d9/d1c/d1d/d31/f57 [4109684,10133] 0 2024-03-28T13:04:32.898 INFO:tasks.workunit.client.0.smithi076.stdout:1/298: write f7 [4163190,21134] 0 2024-03-28T13:04:32.937 INFO:tasks.workunit.client.0.smithi076.stdout:4/338: symlink d0/d3b/d50/l76 0 2024-03-28T13:04:32.953 INFO:tasks.workunit.client.0.smithi076.stdout:4/339: dread d0/d3b/d40/d42/f37 [0,4194304] 0 2024-03-28T13:04:32.984 INFO:tasks.workunit.client.0.smithi076.stdout:3/268: truncate d1/d7/f17 2681722 0 2024-03-28T13:04:33.068 INFO:tasks.workunit.client.0.smithi076.stdout:6/361: symlink d6/da/d5f/l73 0 2024-03-28T13:04:33.069 INFO:tasks.workunit.client.0.smithi076.stdout:2/329: mkdir d2/d67 0 2024-03-28T13:04:33.069 INFO:tasks.workunit.client.0.smithi076.stdout:2/330: stat d2/d5/d4b/l5d 0 2024-03-28T13:04:33.069 INFO:tasks.workunit.client.0.smithi076.stdout:2/331: fsync d2/d5/f12 0 2024-03-28T13:04:33.259 INFO:tasks.workunit.client.0.smithi076.stdout:5/338: creat d5/db/d3f/f7d x:0 0 0 2024-03-28T13:04:33.259 INFO:tasks.workunit.client.0.smithi076.stdout:4/340: mknod d0/db/d2d/c77 0 2024-03-28T13:04:33.290 INFO:tasks.workunit.client.0.smithi076.stdout:5/339: dwrite d5/d9/d1c/f6d [0,4194304] 0 2024-03-28T13:04:33.290 INFO:tasks.workunit.client.0.smithi076.stdout:5/340: truncate d5/d9/d1c/f54 842206 0 2024-03-28T13:04:33.308 INFO:tasks.workunit.client.0.smithi076.stdout:5/341: write d5/d9/f4d [1352613,106198] 0 2024-03-28T13:04:33.417 INFO:tasks.workunit.client.0.smithi076.stdout:3/269: link d1/d7/d30/d38/f1a d1/d7/d30/d38/d14/d27/d42/f68 0 2024-03-28T13:04:33.452 INFO:tasks.workunit.client.0.smithi076.stdout:0/352: sync 2024-03-28T13:04:33.650 INFO:tasks.workunit.client.0.smithi076.stdout:9/332: rename d9/dd/df/d63 to d9/dd/df/d11/d14/d58/d6e 0 2024-03-28T13:04:33.784 INFO:tasks.workunit.client.0.smithi076.stdout:6/362: creat d6/da/d39/d41/d46/f74 x:0 0 0 2024-03-28T13:04:33.784 INFO:tasks.workunit.client.0.smithi076.stdout:6/363: chown d6/l19 0 1 2024-03-28T13:04:33.908 INFO:tasks.workunit.client.0.smithi076.stdout:2/332: link d2/d5/d7/dd/c46 d2/d5/db/d3b/d60/c68 0 2024-03-28T13:04:34.261 INFO:tasks.workunit.client.0.smithi076.stdout:5/342: symlink d5/db/d19/d34/l7e 0 2024-03-28T13:04:34.388 INFO:tasks.workunit.client.0.smithi076.stdout:3/270: mkdir d1/d7/d30/d38/d14/d27/d69 0 2024-03-28T13:04:34.551 INFO:tasks.workunit.client.0.smithi076.stdout:0/353: link db/dc/df/d71/d4a/f5c db/dc/df/d18/d1d/d73/f81 0 2024-03-28T13:04:34.675 INFO:tasks.workunit.client.0.smithi076.stdout:9/333: creat d9/da/f6f x:0 0 0 2024-03-28T13:04:34.713 INFO:tasks.workunit.client.0.smithi076.stdout:9/334: dwrite d9/da/f6f [0,4194304] 0 2024-03-28T13:04:34.769 INFO:tasks.workunit.client.0.smithi076.stdout:2/333: getdents d2/d5/d7/d3e 0 2024-03-28T13:04:35.192 INFO:tasks.workunit.client.0.smithi076.stdout:6/364: getdents d6/da/d5f 0 2024-03-28T13:04:35.192 INFO:tasks.workunit.client.0.smithi076.stdout:6/365: chown d6/da/d5f/d6d 5313829 1 2024-03-28T13:04:35.229 INFO:tasks.workunit.client.0.smithi076.stdout:1/299: dwrite d14/d2a/d2e/d31/d3b/f55 [0,4194304] 0 2024-03-28T13:04:35.229 INFO:tasks.workunit.client.0.smithi076.stdout:1/300: chown d14/d2a/d2e/d31 24 1 2024-03-28T13:04:35.229 INFO:tasks.workunit.client.0.smithi076.stdout:1/301: write d14/d2a/d2e/d31/d49/f64 [670730,76566] 0 2024-03-28T13:04:35.244 INFO:tasks.workunit.client.0.smithi076.stdout:3/271: creat d1/d7/d30/d38/d14/d4a/d66/f6a x:0 0 0 2024-03-28T13:04:35.244 INFO:tasks.workunit.client.0.smithi076.stdout:3/272: write d1/d7/d30/d38/d14/d4a/f5a [601510,112022] 0 2024-03-28T13:04:35.254 INFO:tasks.workunit.client.0.smithi076.stdout:3/273: dread d1/d7/d30/f43 [0,4194304] 0 2024-03-28T13:04:35.377 INFO:tasks.workunit.client.0.smithi076.stdout:0/354: getdents db/d16 0 2024-03-28T13:04:35.560 INFO:tasks.workunit.client.0.smithi076.stdout:9/335: getdents d9/dd/df/d11/d14 0 2024-03-28T13:04:35.560 INFO:tasks.workunit.client.0.smithi076.stdout:9/336: chown d9/dd/df/l2c 176 1 2024-03-28T13:04:35.679 INFO:tasks.workunit.client.0.smithi076.stdout:2/334: rename d2/d5/d7/f17 to d2/d5/d7/d8/d21/f69 0 2024-03-28T13:04:35.776 INFO:tasks.workunit.client.0.smithi076.stdout:6/366: mknod d6/da/d23/c75 0 2024-03-28T13:04:35.907 INFO:tasks.workunit.client.0.smithi076.stdout:4/341: write d0/d3b/d50/f58 [83574,15931] 0 2024-03-28T13:04:36.245 INFO:tasks.workunit.client.0.smithi076.stdout:2/335: readlink d2/d5/l3c 0 2024-03-28T13:04:36.260 INFO:tasks.workunit.client.0.smithi076.stdout:2/336: dread d2/d5/d7/f19 [0,4194304] 0 2024-03-28T13:04:36.260 INFO:tasks.workunit.client.0.smithi076.stdout:2/337: read - d2/d5/d7/d8/d21/f5e zero size 2024-03-28T13:04:36.279 INFO:tasks.workunit.client.0.smithi076.stdout:9/337: rename d9/dd/df/f28 to d9/dd/df/d11/d14/d58/d6e/f70 0 2024-03-28T13:04:36.302 INFO:tasks.workunit.client.0.smithi076.stdout:2/338: dwrite d2/d5/d7/d8/d21/f27 [0,4194304] 0 2024-03-28T13:04:36.314 INFO:tasks.workunit.client.0.smithi076.stdout:9/338: dwrite d9/dd/df/d11/d14/f31 [4194304,4194304] 0 2024-03-28T13:04:36.330 INFO:tasks.workunit.client.0.smithi076.stdout:9/339: write d9/dd/d48/f59 [4075762,93914] 0 2024-03-28T13:04:36.357 INFO:tasks.workunit.client.0.smithi076.stdout:6/367: symlink d6/da/d1e/l76 0 2024-03-28T13:04:36.359 INFO:tasks.workunit.client.0.smithi076.stdout:6/368: dread d6/da/f15 [0,4194304] 0 2024-03-28T13:04:36.359 INFO:tasks.workunit.client.0.smithi076.stdout:6/369: write d6/da/d1e/f1f [1294508,59386] 0 2024-03-28T13:04:36.422 INFO:tasks.workunit.client.0.smithi076.stdout:4/342: truncate d0/d3b/d40/d42/d31/d4d/d63/f6a 1032168 0 2024-03-28T13:04:36.422 INFO:tasks.workunit.client.0.smithi076.stdout:4/343: chown d0/d3b/d40/d42/d31/d5e 16345 1 2024-03-28T13:04:36.499 INFO:tasks.workunit.client.0.smithi076.stdout:3/274: link d1/d7/d30/f43 d1/d2/f6b 0 2024-03-28T13:04:36.499 INFO:tasks.workunit.client.0.smithi076.stdout:3/275: write d1/d2/f6b [1499568,86641] 0 2024-03-28T13:04:36.528 INFO:tasks.workunit.client.0.smithi076.stdout:3/276: dwrite d1/d7/d30/d38/d14/d18/f41 [0,4194304] 0 2024-03-28T13:04:36.528 INFO:tasks.workunit.client.0.smithi076.stdout:3/277: read - d1/f63 zero size 2024-03-28T13:04:36.665 INFO:tasks.workunit.client.0.smithi076.stdout:2/339: creat d2/d5/d7/d8/f6a x:0 0 0 2024-03-28T13:04:36.666 INFO:tasks.workunit.client.0.smithi076.stdout:2/340: fdatasync d2/d5/d7/f40 0 2024-03-28T13:04:36.666 INFO:tasks.workunit.client.0.smithi076.stdout:2/341: chown d2/d5/db/d3b/l4a 0 1 2024-03-28T13:04:36.764 INFO:tasks.workunit.client.0.smithi076.stdout:9/340: rename d9/dd/df/d11/d14/d58/d6e/d2a/l47 to d9/da/l71 0 2024-03-28T13:04:36.837 INFO:tasks.workunit.client.0.smithi076.stdout:6/370: symlink d6/da/d40/d56/l77 0 2024-03-28T13:04:36.861 INFO:tasks.workunit.client.0.smithi076.stdout:6/371: dwrite d6/da/d39/f3b [4194304,4194304] 0 2024-03-28T13:04:36.890 INFO:tasks.workunit.client.0.smithi076.stdout:4/344: mkdir d0/d3b/d40/d42/d31/d5e/d72/d78 0 2024-03-28T13:04:36.890 INFO:tasks.workunit.client.0.smithi076.stdout:4/345: write d0/f73 [996276,88797] 0 2024-03-28T13:04:37.200 INFO:tasks.workunit.client.0.smithi076.stdout:2/342: rename d2/d5/d4b/l5d to d2/d5/db/d3b/d60/l6b 0 2024-03-28T13:04:37.241 INFO:tasks.workunit.client.0.smithi076.stdout:9/341: mknod d9/dd/df/d11/d14/d58/d6e/d2a/c72 0 2024-03-28T13:04:37.241 INFO:tasks.workunit.client.0.smithi076.stdout:9/342: chown d9/dd/df/f25 401190345 1 2024-03-28T13:04:37.290 INFO:tasks.workunit.client.0.smithi076.stdout:6/372: rmdir d6/da/d5f 39 2024-03-28T13:04:37.296 INFO:tasks.workunit.client.0.smithi076.stdout:9/343: dwrite d9/dd/f2e [0,4194304] 0 2024-03-28T13:04:37.296 INFO:tasks.workunit.client.0.smithi076.stdout:9/344: readlink d9/dd/df/d11/l4a 0 2024-03-28T13:04:37.296 INFO:tasks.workunit.client.0.smithi076.stdout:9/345: rename d9/dd/df/d11/d14/d58 to d9/dd/df/d11/d14/d58/d6e/d73 22 2024-03-28T13:04:37.330 INFO:tasks.workunit.client.0.smithi076.stdout:4/346: creat d0/d3b/f79 x:0 0 0 2024-03-28T13:04:37.368 INFO:tasks.workunit.client.0.smithi076.stdout:9/346: dwrite d9/dd/df/d11/d14/d58/d6e/d2a/f6d [0,4194304] 0 2024-03-28T13:04:37.381 INFO:tasks.workunit.client.0.smithi076.stdout:4/347: dwrite d0/db/f23 [0,4194304] 0 2024-03-28T13:04:37.426 INFO:tasks.workunit.client.0.smithi076.stdout:6/373: getdents d6/da/d5f/d6d 0 2024-03-28T13:04:37.442 INFO:tasks.workunit.client.0.smithi076.stdout:6/374: dread d6/f12 [0,4194304] 0 2024-03-28T13:04:37.783 INFO:tasks.workunit.client.0.smithi076.stdout:7/347: rmdir d1/d8 39 2024-03-28T13:04:37.783 INFO:tasks.workunit.client.0.smithi076.stdout:8/309: link de/d12/c39 de/c6a 0 2024-03-28T13:04:37.819 INFO:tasks.workunit.client.0.smithi076.stdout:8/310: dwrite de/d4e/f4f [0,4194304] 0 2024-03-28T13:04:37.935 INFO:tasks.workunit.client.0.smithi076.stdout:9/347: mkdir d9/d74 0 2024-03-28T13:04:38.057 INFO:tasks.workunit.client.0.smithi076.stdout:0/355: dwrite db/dc/df/f1e [0,4194304] 0 2024-03-28T13:04:38.057 INFO:tasks.workunit.client.0.smithi076.stdout:0/356: readlink db/dc/df/d18/d1d/l25 0 2024-03-28T13:04:38.108 INFO:tasks.workunit.client.0.smithi076.stdout:4/348: creat d0/d3b/d40/d42/d47/d69/f7a x:0 0 0 2024-03-28T13:04:38.252 INFO:tasks.workunit.client.0.smithi076.stdout:7/348: mkdir d1/d18/d3c/d48/d69/d79 0 2024-03-28T13:04:38.253 INFO:tasks.workunit.client.0.smithi076.stdout:7/349: stat d1/d8/c41 0 2024-03-28T13:04:38.253 INFO:tasks.workunit.client.0.smithi076.stdout:4/349: write d0/d3b/d40/d42/d31/d4d/f54 [1366992,106080] 0 2024-03-28T13:04:38.288 INFO:tasks.workunit.client.0.smithi076.stdout:7/350: dwrite d1/d8/d37/d53/f73 [0,4194304] 0 2024-03-28T13:04:38.304 INFO:tasks.workunit.client.0.smithi076.stdout:4/350: dwrite d0/f1f [0,4194304] 0 2024-03-28T13:04:38.304 INFO:tasks.workunit.client.0.smithi076.stdout:4/351: chown d0/c44 0 1 2024-03-28T13:04:38.320 INFO:tasks.workunit.client.0.smithi076.stdout:4/352: write d0/d3b/d40/d42/f37 [1657507,6935] 0 2024-03-28T13:04:38.549 INFO:tasks.workunit.client.0.smithi076.stdout:0/357: symlink db/dc/df/d71/l82 0 2024-03-28T13:04:38.572 INFO:tasks.workunit.client.0.smithi076.stdout:0/358: write db/dc/df/d11/f3b [2051356,68636] 0 2024-03-28T13:04:38.583 INFO:tasks.workunit.client.0.smithi076.stdout:0/359: dread db/dc/df/f33 [0,4194304] 0 2024-03-28T13:04:38.748 INFO:tasks.workunit.client.0.smithi076.stdout:7/351: unlink d1/d18/d3c/d48/d69/l74 0 2024-03-28T13:04:38.898 INFO:tasks.workunit.client.0.smithi076.stdout:4/353: mkdir d0/d20/d7b 0 2024-03-28T13:04:38.898 INFO:tasks.workunit.client.0.smithi076.stdout:4/354: read - d0/d3b/d40/d42/d31/f4a zero size 2024-03-28T13:04:38.898 INFO:tasks.workunit.client.0.smithi076.stdout:4/355: write d0/db/d68/f71 [4350823,13499] 0 2024-03-28T13:04:38.898 INFO:tasks.workunit.client.0.smithi076.stdout:4/356: write d0/db/d68/f71 [4662070,13194] 0 2024-03-28T13:04:38.939 INFO:tasks.workunit.client.0.smithi076.stdout:8/311: link de/d12/l14 de/d4e/l6b 0 2024-03-28T13:04:38.965 INFO:tasks.workunit.client.0.smithi076.stdout:8/312: dwrite fa [0,4194304] 0 2024-03-28T13:04:39.025 INFO:tasks.workunit.client.0.smithi076.stdout:0/360: mknod db/dc/df/d18/d1d/d75/d51/c83 0 2024-03-28T13:04:39.108 INFO:tasks.workunit.client.0.smithi076.stdout:7/352: mknod d1/d8/d37/d53/c7a 0 2024-03-28T13:04:39.176 INFO:tasks.workunit.client.0.smithi076.stdout:4/357: mkdir d0/d3b/d40/d42/d47/d7c 0 2024-03-28T13:04:39.218 INFO:tasks.workunit.client.0.smithi076.stdout:4/358: dwrite d0/d3b/d40/d42/d28/f49 [0,4194304] 0 2024-03-28T13:04:39.245 INFO:tasks.workunit.client.0.smithi076.stdout:8/313: stat de/d12/c61 0 2024-03-28T13:04:39.245 INFO:tasks.workunit.client.0.smithi076.stdout:8/314: truncate de/f56 26643 0 2024-03-28T13:04:39.245 INFO:tasks.workunit.client.0.smithi076.stdout:8/315: chown de/l4b 54532768 1 2024-03-28T13:04:39.479 INFO:tasks.workunit.client.0.smithi076.stdout:4/359: creat d0/d3b/d40/d42/d31/d4d/d63/f7d x:0 0 0 2024-03-28T13:04:39.555 INFO:tasks.workunit.client.0.smithi076.stdout:8/316: symlink de/l6c 0 2024-03-28T13:04:39.657 INFO:tasks.workunit.client.0.smithi076.stdout:7/353: mkdir d1/d18/d3c/d7b 0 2024-03-28T13:04:39.658 INFO:tasks.workunit.client.0.smithi076.stdout:4/360: link d0/db/d2d/f3a d0/d3b/d40/d42/d28/f7e 0 2024-03-28T13:04:39.676 INFO:tasks.workunit.client.0.smithi076.stdout:7/354: dread d1/d8/f19 [0,4194304] 0 2024-03-28T13:04:39.676 INFO:tasks.workunit.client.0.smithi076.stdout:7/355: readlink d1/d8/d37/l72 0 2024-03-28T13:04:39.696 INFO:tasks.workunit.client.0.smithi076.stdout:4/361: dwrite d0/d3b/d40/d42/d31/f56 [0,4194304] 0 2024-03-28T13:04:39.696 INFO:tasks.workunit.client.0.smithi076.stdout:4/362: readlink d0/db/l1c 0 2024-03-28T13:04:39.730 INFO:tasks.workunit.client.0.smithi076.stdout:8/317: creat de/d23/d2b/d2c/f6d x:0 0 0 2024-03-28T13:04:39.730 INFO:tasks.workunit.client.0.smithi076.stdout:8/318: chown de/d4e 228 1 2024-03-28T13:04:39.751 INFO:tasks.workunit.client.0.smithi076.stdout:8/319: write de/f3f [523968,53036] 0 2024-03-28T13:04:39.988 INFO:tasks.workunit.client.0.smithi076.stdout:5/343: sync 2024-03-28T13:04:39.988 INFO:tasks.workunit.client.0.smithi076.stdout:3/278: sync 2024-03-28T13:04:39.988 INFO:tasks.workunit.client.0.smithi076.stdout:1/302: sync 2024-03-28T13:04:40.015 INFO:tasks.workunit.client.0.smithi076.stdout:2/343: sync 2024-03-28T13:04:40.015 INFO:tasks.workunit.client.0.smithi076.stdout:6/375: sync 2024-03-28T13:04:40.016 INFO:tasks.workunit.client.0.smithi076.stdout:2/344: fdatasync d2/d5/f5f 0 2024-03-28T13:04:40.016 INFO:tasks.workunit.client.0.smithi076.stdout:6/376: chown d6/da/d40/l54 25 1 2024-03-28T13:04:40.016 INFO:tasks.workunit.client.0.smithi076.stdout:2/345: fdatasync d2/d5/d7/f40 0 2024-03-28T13:04:40.016 INFO:tasks.workunit.client.0.smithi076.stdout:2/346: truncate d2/d5/d7/d8/d21/f5e 896951 0 2024-03-28T13:04:40.016 INFO:tasks.workunit.client.0.smithi076.stdout:3/279: dwrite d1/d2/f6b [0,4194304] 0 2024-03-28T13:04:40.122 INFO:tasks.workunit.client.0.smithi076.stdout:4/363: stat d0/db/l1c 0 2024-03-28T13:04:40.260 INFO:tasks.workunit.client.0.smithi076.stdout:9/348: sync 2024-03-28T13:04:40.294 INFO:tasks.workunit.client.0.smithi076.stdout:9/349: dwrite d9/dd/df/f13 [0,4194304] 0 2024-03-28T13:04:40.294 INFO:tasks.workunit.client.0.smithi076.stdout:9/350: truncate d9/dd/df/d11/d14/d58/d6e/d2a/f49 542082 0 2024-03-28T13:04:40.318 INFO:tasks.workunit.client.0.smithi076.stdout:8/320: chown de/d12/c37 16101 1 2024-03-28T13:04:40.372 INFO:tasks.workunit.client.0.smithi076.stdout:1/303: symlink d14/d19/l68 0 2024-03-28T13:04:40.442 INFO:tasks.workunit.client.0.smithi076.stdout:5/344: getdents d5/db/d3f/d42 0 2024-03-28T13:04:40.529 INFO:tasks.workunit.client.0.smithi076.stdout:6/377: mknod d6/da/d40/d56/d58/c78 0 2024-03-28T13:04:40.613 INFO:tasks.workunit.client.0.smithi076.stdout:2/347: dread d2/d5/db/d3b/f4e [0,4194304] 0 2024-03-28T13:04:40.746 INFO:tasks.workunit.client.0.smithi076.stdout:4/364: mkdir d0/d20/d7f 0 2024-03-28T13:04:40.815 INFO:tasks.workunit.client.0.smithi076.stdout:9/351: mkdir d9/d75 0 2024-03-28T13:04:40.979 INFO:tasks.workunit.client.0.smithi076.stdout:1/304: symlink d14/d19/l69 0 2024-03-28T13:04:41.013 INFO:tasks.workunit.client.0.smithi076.stdout:5/345: rename d5/d9/d1c/d25/f47 to d5/d9/d35/f7f 0 2024-03-28T13:04:41.013 INFO:tasks.workunit.client.0.smithi076.stdout:6/378: symlink d6/da/d40/d56/l79 0 2024-03-28T13:04:41.035 INFO:tasks.workunit.client.0.smithi076.stdout:5/346: read d5/db/d19/f77 [3313724,116216] 0 2024-03-28T13:04:41.154 INFO:tasks.workunit.client.0.smithi076.stdout:2/348: mknod d2/d5/db/d3b/d60/c6c 0 2024-03-28T13:04:41.154 INFO:tasks.workunit.client.0.smithi076.stdout:0/361: rmdir db/dc/df/d18 39 2024-03-28T13:04:41.154 INFO:tasks.workunit.client.0.smithi076.stdout:0/362: write db/dc/df/f37 [2798560,100530] 0 2024-03-28T13:04:41.154 INFO:tasks.workunit.client.0.smithi076.stdout:0/363: getdents db/d16 0 2024-03-28T13:04:41.282 INFO:tasks.workunit.client.0.smithi076.stdout:1/305: creat d14/d2a/d2e/f6a x:0 0 0 2024-03-28T13:04:41.346 INFO:tasks.workunit.client.0.smithi076.stdout:6/379: rmdir d6/da/d23 39 2024-03-28T13:04:41.427 INFO:tasks.workunit.client.0.smithi076.stdout:2/349: creat d2/d5/db/d3b/d42/f6d x:0 0 0 2024-03-28T13:04:41.427 INFO:tasks.workunit.client.0.smithi076.stdout:2/350: stat d2 0 2024-03-28T13:04:41.475 INFO:tasks.workunit.client.0.smithi076.stdout:4/365: mknod d0/db/c80 0 2024-03-28T13:04:41.571 INFO:tasks.workunit.client.0.smithi076.stdout:0/364: creat db/dc/df/d11/f84 x:0 0 0 2024-03-28T13:04:41.571 INFO:tasks.workunit.client.0.smithi076.stdout:9/352: truncate d9/da/f39 541370 0 2024-03-28T13:04:41.571 INFO:tasks.workunit.client.0.smithi076.stdout:9/353: fsync d9/dd/df/f5e 0 2024-03-28T13:04:41.652 INFO:tasks.workunit.client.0.smithi076.stdout:1/306: creat d14/f6b x:0 0 0 2024-03-28T13:04:41.712 INFO:tasks.workunit.client.0.smithi076.stdout:6/380: truncate d6/f3c 2168167 0 2024-03-28T13:04:41.741 INFO:tasks.workunit.client.0.smithi076.stdout:2/351: mknod d2/d5/d7/d8/c6e 0 2024-03-28T13:04:41.761 INFO:tasks.workunit.client.0.smithi076.stdout:2/352: dread d2/d5/d4b/f1f [0,4194304] 0 2024-03-28T13:04:41.761 INFO:tasks.workunit.client.0.smithi076.stdout:2/353: readlink d2/d5/l3c 0 2024-03-28T13:04:41.794 INFO:tasks.workunit.client.0.smithi076.stdout:4/366: mkdir d0/d20/d7b/d81 0 2024-03-28T13:04:41.882 INFO:tasks.workunit.client.0.smithi076.stdout:0/365: rename db/dc/df/d18/f41 to db/dc/df/f85 0 2024-03-28T13:04:41.910 INFO:tasks.workunit.client.0.smithi076.stdout:0/366: dwrite db/dc/df/f19 [0,4194304] 0 2024-03-28T13:04:41.911 INFO:tasks.workunit.client.0.smithi076.stdout:0/367: chown db/dc/df/d11/f63 14 1 2024-03-28T13:04:41.922 INFO:tasks.workunit.client.0.smithi076.stdout:0/368: dread db/dc/df/d11/d40/f42 [0,4194304] 0 2024-03-28T13:04:41.947 INFO:tasks.workunit.client.0.smithi076.stdout:0/369: dwrite db/dc/df/f22 [0,4194304] 0 2024-03-28T13:04:41.947 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:04:41.953 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:04:42.106 INFO:tasks.workunit.client.0.smithi076.stdout:1/307: mkdir d14/d6c 0 2024-03-28T13:04:42.247 INFO:tasks.workunit.client.0.smithi076.stdout:6/381: truncate d6/da/d1e/f3d 3691189 0 2024-03-28T13:04:42.247 INFO:tasks.workunit.client.0.smithi076.stdout:4/367: symlink d0/d3b/d50/d64/l82 0 2024-03-28T13:04:42.247 INFO:tasks.workunit.client.0.smithi076.stdout:6/382: readlink d6/da/d5f/l73 0 2024-03-28T13:04:42.309 INFO:tasks.workunit.client.0.smithi076.stdout:4/368: dwrite d0/d3b/d40/d42/d31/d4d/d63/f7d [0,4194304] 0 2024-03-28T13:04:42.309 INFO:tasks.workunit.client.0.smithi076.stdout:4/369: stat d0/d3b/d40/f6e 0 2024-03-28T13:04:42.320 INFO:tasks.workunit.client.0.smithi076.stdout:0/370: creat db/dc/df/d11/d40/d77/f86 x:0 0 0 2024-03-28T13:04:42.320 INFO:tasks.workunit.client.0.smithi076.stdout:0/371: fsync db/dc/df/d18/d1d/d75/f53 0 2024-03-28T13:04:42.367 INFO:tasks.workunit.client.0.smithi076.stdout:1/308: dread fd [0,4194304] 0 2024-03-28T13:04:42.430 INFO:tasks.workunit.client.0.smithi076.stdout:8/321: truncate de/f3f 2481165 0 2024-03-28T13:04:42.430 INFO:tasks.workunit.client.0.smithi076.stdout:8/322: chown de/d25/l53 7970 1 2024-03-28T13:04:42.433 INFO:tasks.workunit.client.0.smithi076.stdout:7/356: sync 2024-03-28T13:04:42.477 INFO:tasks.workunit.client.0.smithi076.stdout:6/383: creat d6/f7a x:0 0 0 2024-03-28T13:04:42.477 INFO:tasks.workunit.client.0.smithi076.stdout:6/384: stat d6/da/d5f/f6b 0 2024-03-28T13:04:42.503 INFO:tasks.workunit.client.0.smithi076.stdout:6/385: write d6/f59 [187569,32086] 0 2024-03-28T13:04:42.679 INFO:tasks.workunit.client.0.smithi076.stdout:2/354: dwrite d2/d5/f5f [0,4194304] 0 2024-03-28T13:04:42.688 INFO:tasks.workunit.client.0.smithi076.stdout:2/355: dread d2/d5/f12 [0,4194304] 0 2024-03-28T13:04:42.732 INFO:tasks.workunit.client.0.smithi076.stdout:4/370: link d0/db/d2d/f3a d0/d3b/d40/d42/d31/d5e/f83 0 2024-03-28T13:04:42.756 INFO:tasks.workunit.client.0.smithi076.stdout:4/371: write d0/d3b/d40/d42/f3f [1204810,75935] 0 2024-03-28T13:04:42.769 INFO:tasks.workunit.client.0.smithi076.stdout:0/372: mkdir db/dc/df/d11/d40/d77/d87 0 2024-03-28T13:04:42.769 INFO:tasks.workunit.client.0.smithi076.stdout:0/373: readlink l4 0 2024-03-28T13:04:42.769 INFO:tasks.workunit.client.0.smithi076.stdout:0/374: write db/dc/df/d18/d1d/f29 [305422,83823] 0 2024-03-28T13:04:42.892 INFO:tasks.workunit.client.0.smithi076.stdout:7/357: symlink d1/d8/l7c 0 2024-03-28T13:04:42.895 INFO:tasks.workunit.client.0.smithi076.stdout:3/280: write d1/d7/f17 [2034102,89430] 0 2024-03-28T13:04:42.946 INFO:tasks.workunit.client.0.smithi076.stdout:3/281: dwrite d1/d7/f17 [0,4194304] 0 2024-03-28T13:04:42.997 INFO:tasks.workunit.client.0.smithi076.stdout:3/282: dwrite d1/d7/d30/d38/f29 [0,4194304] 0 2024-03-28T13:04:43.158 INFO:tasks.workunit.client.0.smithi076.stdout:2/356: mknod d2/d5/d7/d28/d64/c6f 0 2024-03-28T13:04:43.158 INFO:tasks.workunit.client.0.smithi076.stdout:4/372: creat d0/d20/d7f/f84 x:0 0 0 2024-03-28T13:04:43.158 INFO:tasks.workunit.client.0.smithi076.stdout:4/373: readlink d0/db/l1c 0 2024-03-28T13:04:43.181 INFO:tasks.workunit.client.0.smithi076.stdout:0/375: mkdir db/dc/df/d11/d40/d77/d87/d88 0 2024-03-28T13:04:43.181 INFO:tasks.workunit.client.0.smithi076.stdout:7/358: mkdir d1/d18/d3c/d7b/d7d 0 2024-03-28T13:04:43.181 INFO:tasks.workunit.client.0.smithi076.stdout:8/323: mkdir de/d12/d6e 0 2024-03-28T13:04:43.182 INFO:tasks.workunit.client.0.smithi076.stdout:7/359: readlink d1/d18/d2d/l63 0 2024-03-28T13:04:43.182 INFO:tasks.workunit.client.0.smithi076.stdout:7/360: stat d1/d18/d2d/f34 0 2024-03-28T13:04:43.182 INFO:tasks.workunit.client.0.smithi076.stdout:7/361: chown d1/dc/f1d 1581 1 2024-03-28T13:04:43.183 INFO:tasks.workunit.client.0.smithi076.stdout:2/357: dread d2/d5/db/d3b/d3f/f4f [0,4194304] 0 2024-03-28T13:04:43.183 INFO:tasks.workunit.client.0.smithi076.stdout:2/358: chown d2/d5/d7/d8 18079 1 2024-03-28T13:04:43.183 INFO:tasks.workunit.client.0.smithi076.stdout:2/359: read d2/d5/d7/d8/d21/f48 [2381584,113454] 0 2024-03-28T13:04:43.200 INFO:tasks.workunit.client.0.smithi076.stdout:7/362: write d1/dc/f6e [3248728,116486] 0 2024-03-28T13:04:43.221 INFO:tasks.workunit.client.0.smithi076.stdout:0/376: dwrite db/dc/d3d/d57/f5b [4194304,4194304] 0 2024-03-28T13:04:43.221 INFO:tasks.workunit.client.0.smithi076.stdout:0/377: chown db/dc/df/d18/d1d/c7b 10 1 2024-03-28T13:04:43.312 INFO:tasks.workunit.client.0.smithi076.stdout:4/374: mknod d0/d3b/d40/d42/d31/d4d/d63/c85 0 2024-03-28T13:04:43.365 INFO:tasks.workunit.client.0.smithi076.stdout:4/375: dwrite d0/d3b/d40/d42/d31/d4d/d63/f6a [0,4194304] 0 2024-03-28T13:04:43.376 INFO:tasks.workunit.client.0.smithi076.stdout:8/324: symlink de/d23/d2b/d51/d60/l6f 0 2024-03-28T13:04:43.387 INFO:tasks.workunit.client.0.smithi076.stdout:4/376: dread d0/f9 [0,4194304] 0 2024-03-28T13:04:43.387 INFO:tasks.workunit.client.0.smithi076.stdout:4/377: fsync d0/db/f61 0 2024-03-28T13:04:43.405 INFO:tasks.workunit.client.0.smithi076.stdout:5/347: creat d5/f80 x:0 0 0 2024-03-28T13:04:43.409 INFO:tasks.workunit.client.0.smithi076.stdout:4/378: write d0/d3b/d40/d42/d31/d4d/d63/f6a [4102866,86452] 0 2024-03-28T13:04:43.450 INFO:tasks.workunit.client.0.smithi076.stdout:5/348: dwrite d5/d9/f4d [0,4194304] 0 2024-03-28T13:04:43.612 INFO:tasks.workunit.client.0.smithi076.stdout:2/360: mknod d2/d5/d4b/d39/d57/c70 0 2024-03-28T13:04:43.612 INFO:tasks.workunit.client.0.smithi076.stdout:2/361: chown d2/d5/d7/d28 103 1 2024-03-28T13:04:43.612 INFO:tasks.workunit.client.0.smithi076.stdout:2/362: chown d2/d5/d7/d28/c37 1319 1 2024-03-28T13:04:43.612 INFO:tasks.workunit.client.0.smithi076.stdout:7/363: creat d1/f7e x:0 0 0 2024-03-28T13:04:43.646 INFO:tasks.workunit.client.0.smithi076.stdout:2/363: dwrite d2/d5/d4b/f1f [0,4194304] 0 2024-03-28T13:04:43.812 INFO:tasks.workunit.client.0.smithi076.stdout:0/378: mkdir db/dc/df/d18/d1d/d75/d51/d60/d89 0 2024-03-28T13:04:43.819 INFO:tasks.workunit.client.0.smithi076.stdout:0/379: dread db/dc/df/d18/d1d/d75/f39 [0,4194304] 0 2024-03-28T13:04:43.819 INFO:tasks.workunit.client.0.smithi076.stdout:3/283: rename d1/d7/d30/d38/d14/d18/c2b to d1/d7/d30/d38/d14/d18/d3a/c6c 0 2024-03-28T13:04:43.820 INFO:tasks.workunit.client.0.smithi076.stdout:3/284: write d1/d7/d30/d38/f35 [481153,20305] 0 2024-03-28T13:04:43.871 INFO:tasks.workunit.client.0.smithi076.stdout:8/325: mknod de/d4e/d54/c70 0 2024-03-28T13:04:43.935 INFO:tasks.workunit.client.0.smithi076.stdout:4/379: symlink d0/d20/d7b/d81/l86 0 2024-03-28T13:04:44.389 INFO:tasks.workunit.client.0.smithi076.stdout:7/364: rmdir d1/d18/d3c/d48/d69 39 2024-03-28T13:04:44.490 INFO:tasks.workunit.client.0.smithi076.stdout:2/364: unlink d2/d5/d7/d28/d64/c6f 0 2024-03-28T13:04:44.515 INFO:tasks.workunit.client.0.smithi076.stdout:2/365: write d2/d5/d4b/f1f [3732052,26847] 0 2024-03-28T13:04:44.515 INFO:tasks.workunit.client.0.smithi076.stdout:2/366: readlink d2/d5/d7/d8/l2f 0 2024-03-28T13:04:44.686 INFO:tasks.workunit.client.0.smithi076.stdout:0/380: symlink db/dc/df/d71/d4a/l8a 0 2024-03-28T13:04:44.707 INFO:tasks.workunit.client.0.smithi076.stdout:0/381: read db/d16/f54 [3986015,113829] 0 2024-03-28T13:04:44.805 INFO:tasks.workunit.client.0.smithi076.stdout:3/285: rename d1/d7/d30/d38/d14/d18/d2f to d1/d7/d30/d38/d14/d36/d56/d5b/d6d 0 2024-03-28T13:04:44.805 INFO:tasks.workunit.client.0.smithi076.stdout:3/286: chown d1/d7/l1c 84277683 1 2024-03-28T13:04:44.805 INFO:tasks.workunit.client.0.smithi076.stdout:8/326: write de/d12/d18/d3c/d50/f5f [799444,43501] 0 2024-03-28T13:04:44.805 INFO:tasks.workunit.client.0.smithi076.stdout:3/287: dread - d1/d2/f4f zero size 2024-03-28T13:04:44.806 INFO:tasks.workunit.client.0.smithi076.stdout:8/327: read - de/d23/d2b/d2c/f3b zero size 2024-03-28T13:04:44.823 INFO:tasks.workunit.client.0.smithi076.stdout:3/288: dread d1/d7/f17 [0,4194304] 0 2024-03-28T13:04:45.167 INFO:tasks.workunit.client.0.smithi076.stdout:6/386: write d6/f2f [1607761,123194] 0 2024-03-28T13:04:45.179 INFO:tasks.workunit.client.0.smithi076.stdout:6/387: dread d6/da/d39/d41/f30 [0,4194304] 0 2024-03-28T13:04:45.179 INFO:tasks.workunit.client.0.smithi076.stdout:6/388: chown d6/fb 1349055230 1 2024-03-28T13:04:45.179 INFO:tasks.workunit.client.0.smithi076.stdout:6/389: fdatasync d6/da/d39/f3b 0 2024-03-28T13:04:45.179 INFO:tasks.workunit.client.0.smithi076.stdout:6/390: chown d6/l57 209 1 2024-03-28T13:04:45.279 INFO:tasks.workunit.client.0.smithi076.stdout:7/365: dread d1/d18/d3c/f24 [0,4194304] 0 2024-03-28T13:04:45.344 INFO:tasks.workunit.client.0.smithi076.stdout:2/367: unlink d2/d5/d7/d8/d21/l24 0 2024-03-28T13:04:45.361 INFO:tasks.workunit.client.0.smithi076.stdout:2/368: dread d2/d5/db/d3b/d3f/f4f [0,4194304] 0 2024-03-28T13:04:45.437 INFO:tasks.workunit.client.0.smithi076.stdout:0/382: mknod db/dc/df/d18/c8b 0 2024-03-28T13:04:45.520 INFO:tasks.workunit.client.0.smithi076.stdout:4/380: rename d0/db/f61 to d0/d20/f87 0 2024-03-28T13:04:45.520 INFO:tasks.workunit.client.0.smithi076.stdout:4/381: fdatasync d0/f1f 0 2024-03-28T13:04:45.520 INFO:tasks.workunit.client.0.smithi076.stdout:4/382: readlink d0/d3b/d40/d42/d31/l41 0 2024-03-28T13:04:45.712 INFO:tasks.workunit.client.0.smithi076.stdout:8/328: mkdir de/d23/d2b/d51/d71 0 2024-03-28T13:04:45.712 INFO:tasks.workunit.client.0.smithi076.stdout:3/289: symlink d1/d7/d30/d38/d14/d27/d42/l6e 0 2024-03-28T13:04:45.712 INFO:tasks.workunit.client.0.smithi076.stdout:8/329: readlink de/d12/d18/d3c/l46 0 2024-03-28T13:04:45.712 INFO:tasks.workunit.client.0.smithi076.stdout:3/290: readlink d1/d7/d30/l53 0 2024-03-28T13:04:45.720 INFO:tasks.workunit.client.0.smithi076.stdout:6/391: creat d6/da/d40/d62/f7b x:0 0 0 2024-03-28T13:04:45.720 INFO:tasks.workunit.client.0.smithi076.stdout:7/366: mkdir d1/d8/d37/d7f 0 2024-03-28T13:04:45.731 INFO:tasks.workunit.client.0.smithi076.stdout:2/369: rmdir d2/d5/db/d3b/d42 39 2024-03-28T13:04:45.731 INFO:tasks.workunit.client.0.smithi076.stdout:2/370: readlink d2/d5/d4b/d39/l41 0 2024-03-28T13:04:45.765 INFO:tasks.workunit.client.0.smithi076.stdout:0/383: link db/dc/df/f1a db/dc/df/d11/d40/d69/d6d/f8c 0 2024-03-28T13:04:45.766 INFO:tasks.workunit.client.0.smithi076.stdout:0/384: stat db/dc/df/d11/f1c 0 2024-03-28T13:04:45.852 INFO:tasks.workunit.client.0.smithi076.stdout:4/383: unlink d0/d3b/d40/d42/d28/f66 0 2024-03-28T13:04:45.900 INFO:tasks.workunit.client.0.smithi076.stdout:4/384: dwrite d0/d3b/d40/d42/d28/f32 [0,4194304] 0 2024-03-28T13:04:45.930 INFO:tasks.workunit.client.0.smithi076.stdout:9/354: sync 2024-03-28T13:04:46.073 INFO:tasks.workunit.client.0.smithi076.stdout:6/392: symlink d6/da/d39/d41/l7c 0 2024-03-28T13:04:46.175 INFO:tasks.workunit.client.0.smithi076.stdout:7/367: symlink d1/d8/d37/d53/l80 0 2024-03-28T13:04:46.306 INFO:tasks.workunit.client.0.smithi076.stdout:2/371: creat d2/d5/d7/f71 x:0 0 0 2024-03-28T13:04:46.412 INFO:tasks.workunit.client.0.smithi076.stdout:0/385: truncate db/f14 2480704 0 2024-03-28T13:04:46.413 INFO:tasks.workunit.client.0.smithi076.stdout:0/386: fdatasync db/dc/df/f85 0 2024-03-28T13:04:46.438 INFO:tasks.workunit.client.0.smithi076.stdout:0/387: dwrite db/dc/df/d11/d40/d77/f86 [0,4194304] 0 2024-03-28T13:04:46.984 INFO:tasks.workunit.client.0.smithi076.stdout:4/385: symlink d0/d3b/d40/d42/l88 0 2024-03-28T13:04:46.984 INFO:tasks.workunit.client.0.smithi076.stdout:4/386: readlink d0/l59 0 2024-03-28T13:04:47.013 INFO:tasks.workunit.client.0.smithi076.stdout:8/330: rename de/d23/d2b/d2c/f6d to de/d12/f72 0 2024-03-28T13:04:47.013 INFO:tasks.workunit.client.0.smithi076.stdout:9/355: creat d9/dd/df/d11/d14/d58/d6e/d2a/f76 x:0 0 0 2024-03-28T13:04:47.013 INFO:tasks.workunit.client.0.smithi076.stdout:8/331: write de/d23/d2b/d2c/f3b [820500,48768] 0 2024-03-28T13:04:47.104 INFO:tasks.workunit.client.0.smithi076.stdout:7/368: mkdir d1/d81 0 2024-03-28T13:04:47.342 INFO:tasks.workunit.client.0.smithi076.stdout:0/388: creat db/dc/df/d18/d1d/d75/d51/f8d x:0 0 0 2024-03-28T13:04:47.342 INFO:tasks.workunit.client.0.smithi076.stdout:0/389: getdents db/dc/df/d18/d1d/d21 0 2024-03-28T13:04:47.473 INFO:tasks.workunit.client.0.smithi076.stdout:2/372: rename d2/d5/d7/d8/d21/l3a to d2/d5/d7/l72 0 2024-03-28T13:04:47.626 INFO:tasks.workunit.client.0.smithi076.stdout:8/332: write de/d12/f15 [6818544,39015] 0 2024-03-28T13:04:47.626 INFO:tasks.workunit.client.0.smithi076.stdout:8/333: chown de/d23/d2b/d5d 78431325 1 2024-03-28T13:04:47.626 INFO:tasks.workunit.client.0.smithi076.stdout:8/334: read - de/d13/f35 zero size 2024-03-28T13:04:47.731 INFO:tasks.workunit.client.0.smithi076.stdout:7/369: creat d1/d18/d3c/d7b/d7d/f82 x:0 0 0 2024-03-28T13:04:47.752 INFO:tasks.workunit.client.0.smithi076.stdout:7/370: write d1/f16 [1512717,68109] 0 2024-03-28T13:04:47.777 INFO:tasks.workunit.client.0.smithi076.stdout:0/390: mknod db/dc/df/d18/d1d/d75/d51/c8e 0 2024-03-28T13:04:47.777 INFO:tasks.workunit.client.0.smithi076.stdout:0/391: stat db/c6c 0 2024-03-28T13:04:48.097 INFO:tasks.workunit.client.0.smithi076.stdout:2/373: creat d2/d5/db/d3b/d42/f73 x:0 0 0 2024-03-28T13:04:48.097 INFO:tasks.workunit.client.0.smithi076.stdout:7/371: mknod d1/d18/d3c/d7b/c83 0 2024-03-28T13:04:48.129 INFO:tasks.workunit.client.0.smithi076.stdout:0/392: truncate db/dc/df/d71/f58 1596129 0 2024-03-28T13:04:48.150 INFO:tasks.workunit.client.0.smithi076.stdout:7/372: dwrite d1/d18/d3c/f24 [0,4194304] 0 2024-03-28T13:04:48.305 INFO:tasks.workunit.client.0.smithi076.stdout:0/393: symlink db/dc/df/d71/d4a/d7e/l8f 0 2024-03-28T13:04:48.318 INFO:tasks.workunit.client.0.smithi076.stdout:0/394: write db/dc/fd [2813814,89253] 0 2024-03-28T13:04:48.318 INFO:tasks.workunit.client.0.smithi076.stdout:0/395: chown db/dc/df/d11/l2b 512 1 2024-03-28T13:04:48.330 INFO:tasks.workunit.client.0.smithi076.stdout:0/396: dread db/dc/df/f1a [0,4194304] 0 2024-03-28T13:04:48.351 INFO:tasks.workunit.client.0.smithi076.stdout:7/373: dread - d1/d18/d3c/f33 zero size 2024-03-28T13:04:48.368 INFO:tasks.workunit.client.0.smithi076.stdout:7/374: write d1/d8/d37/f43 [679210,47469] 0 2024-03-28T13:04:48.528 INFO:tasks.workunit.client.0.smithi076.stdout:1/309: symlink d14/d2a/l6d 0 2024-03-28T13:04:48.682 INFO:tasks.workunit.client.0.smithi076.stdout:4/387: rename d0/db to d0/d3b/d50/d64/d89 0 2024-03-28T13:04:48.682 INFO:tasks.workunit.client.0.smithi076.stdout:4/388: stat d0/f30 0 2024-03-28T13:04:48.812 INFO:tasks.workunit.client.0.smithi076.stdout:1/310: mknod d14/d2a/d3f/c6e 0 2024-03-28T13:04:48.812 INFO:tasks.workunit.client.0.smithi076.stdout:9/356: symlink d9/l77 0 2024-03-28T13:04:48.892 INFO:tasks.workunit.client.0.smithi076.stdout:2/374: rename d2/d5/db/d3b/d60/l6b to d2/d5/db/d3b/d5a/l74 0 2024-03-28T13:04:48.927 INFO:tasks.workunit.client.0.smithi076.stdout:2/375: dwrite d2/d5/d7/d28/f43 [0,4194304] 0 2024-03-28T13:04:49.143 INFO:tasks.workunit.client.0.smithi076.stdout:1/311: truncate d14/f2f 3090549 0 2024-03-28T13:04:49.206 INFO:tasks.workunit.client.0.smithi076.stdout:9/357: creat d9/dd/df/d11/d37/f78 x:0 0 0 2024-03-28T13:04:49.251 INFO:tasks.workunit.client.0.smithi076.stdout:9/358: dwrite d9/dd/df/d11/d37/f78 [0,4194304] 0 2024-03-28T13:04:49.478 INFO:tasks.workunit.client.0.smithi076.stdout:2/376: mkdir d2/d75 0 2024-03-28T13:04:49.593 INFO:tasks.workunit.client.0.smithi076.stdout:1/312: mkdir d14/d2a/d2e/d31/d6f 0 2024-03-28T13:04:49.642 INFO:tasks.workunit.client.0.smithi076.stdout:1/313: dwrite f7 [0,4194304] 0 2024-03-28T13:04:49.764 INFO:tasks.workunit.client.0.smithi076.stdout:0/397: rename db/dc/df/d11/d40/d69/l7f to db/dc/d3d/l90 0 2024-03-28T13:04:49.798 INFO:tasks.workunit.client.0.smithi076.stdout:0/398: dwrite db/dc/fe [0,4194304] 0 2024-03-28T13:04:49.826 INFO:tasks.workunit.client.0.smithi076.stdout:2/377: mknod d2/d5/d4b/d39/d57/c76 0 2024-03-28T13:04:49.954 INFO:tasks.workunit.client.0.smithi076.stdout:9/359: rename d9/f53 to d9/da/f79 0 2024-03-28T13:04:49.999 INFO:tasks.workunit.client.0.smithi076.stdout:9/360: dwrite d9/d3c/f5a [0,4194304] 0 2024-03-28T13:04:49.999 INFO:tasks.workunit.client.0.smithi076.stdout:9/361: fdatasync d9/dd/df/d11/d14/f65 0 2024-03-28T13:04:49.999 INFO:tasks.workunit.client.0.smithi076.stdout:9/362: stat d9/l34 0 2024-03-28T13:04:50.036 INFO:tasks.workunit.client.0.smithi076.stdout:0/399: mkdir db/dc/df/d71/d4a/d7e/d91 0 2024-03-28T13:04:50.041 INFO:tasks.workunit.client.0.smithi076.stdout:9/363: dwrite d9/dd/df/d11/d14/d58/f6c [0,4194304] 0 2024-03-28T13:04:50.061 INFO:tasks.workunit.client.0.smithi076.stdout:9/364: dread d9/dd/df/f13 [0,4194304] 0 2024-03-28T13:04:50.061 INFO:tasks.workunit.client.0.smithi076.stdout:9/365: read - d9/da/f68 zero size 2024-03-28T13:04:50.178 INFO:tasks.workunit.client.0.smithi076.stdout:5/349: sync 2024-03-28T13:04:50.178 INFO:tasks.workunit.client.0.smithi076.stdout:3/291: sync 2024-03-28T13:04:50.178 INFO:tasks.workunit.client.0.smithi076.stdout:6/393: sync 2024-03-28T13:04:50.178 INFO:tasks.workunit.client.0.smithi076.stdout:6/394: fdatasync d6/da/d5f/f6b 0 2024-03-28T13:04:50.192 INFO:tasks.workunit.client.0.smithi076.stdout:6/395: dread d6/da/f14 [0,4194304] 0 2024-03-28T13:04:50.215 INFO:tasks.workunit.client.0.smithi076.stdout:3/292: dwrite d1/d2/f4f [0,4194304] 0 2024-03-28T13:04:50.215 INFO:tasks.workunit.client.0.smithi076.stdout:3/293: truncate d1/f61 112201 0 2024-03-28T13:04:50.219 INFO:tasks.workunit.client.0.smithi076.stdout:5/350: dwrite d5/d9/d1c/d25/f2b [0,4194304] 0 2024-03-28T13:04:50.326 INFO:tasks.workunit.client.0.smithi076.stdout:9/366: truncate d9/dd/df/d11/d14/f26 192596 0 2024-03-28T13:04:50.476 INFO:tasks.workunit.client.0.smithi076.stdout:6/396: creat d6/da/d40/d62/f7d x:0 0 0 2024-03-28T13:04:50.476 INFO:tasks.workunit.client.0.smithi076.stdout:6/397: read d6/f59 [2962133,41362] 0 2024-03-28T13:04:50.537 INFO:tasks.workunit.client.0.smithi076.stdout:8/335: sync 2024-03-28T13:04:50.563 INFO:tasks.workunit.client.0.smithi076.stdout:3/294: getdents d1/d7 0 2024-03-28T13:04:50.582 INFO:tasks.workunit.client.0.smithi076.stdout:3/295: read d1/d7/d30/d38/d14/d18/f41 [911571,88609] 0 2024-03-28T13:04:50.656 INFO:tasks.workunit.client.0.smithi076.stdout:5/351: rename d5/c3d to d5/db/d3f/d42/d43/d7a/d7c/c81 0 2024-03-28T13:04:50.656 INFO:tasks.workunit.client.0.smithi076.stdout:5/352: chown l0 2077216 1 2024-03-28T13:04:50.669 INFO:tasks.workunit.client.0.smithi076.stdout:5/353: dread d5/db/f12 [0,4194304] 0 2024-03-28T13:04:50.838 INFO:tasks.workunit.client.0.smithi076.stdout:9/367: symlink d9/dd/d48/l7a 0 2024-03-28T13:04:50.839 INFO:tasks.workunit.client.0.smithi076.stdout:9/368: fdatasync d9/d3c/f32 0 2024-03-28T13:04:50.839 INFO:tasks.workunit.client.0.smithi076.stdout:9/369: dread d9/dd/df/d11/d14/f16 [0,4194304] 0 2024-03-28T13:04:50.870 INFO:tasks.workunit.client.0.smithi076.stdout:6/398: mkdir d6/da/d5f/d7e 0 2024-03-28T13:04:50.914 INFO:tasks.workunit.client.0.smithi076.stdout:6/399: dwrite d6/da/d23/f4d [0,4194304] 0 2024-03-28T13:04:50.914 INFO:tasks.workunit.client.0.smithi076.stdout:6/400: rename d6/da/d39 to d6/da/d39/d63/d7f 22 2024-03-28T13:04:50.971 INFO:tasks.workunit.client.0.smithi076.stdout:8/336: creat de/d23/d2b/d51/d60/f73 x:0 0 0 2024-03-28T13:04:50.971 INFO:tasks.workunit.client.0.smithi076.stdout:8/337: readlink de/d12/d18/l2f 0 2024-03-28T13:04:50.988 INFO:tasks.workunit.client.0.smithi076.stdout:8/338: write fd [373587,52352] 0 2024-03-28T13:04:51.079 INFO:tasks.workunit.client.0.smithi076.stdout:3/296: creat d1/d7/d30/d38/d14/d18/d58/f6f x:0 0 0 2024-03-28T13:04:51.162 INFO:tasks.workunit.client.0.smithi076.stdout:5/354: mkdir d5/d9/d1c/d25/d60/d82 0 2024-03-28T13:04:51.270 INFO:tasks.workunit.client.0.smithi076.stdout:9/370: mknod d9/dd/df/d11/d37/c7b 0 2024-03-28T13:04:51.426 INFO:tasks.workunit.client.0.smithi076.stdout:6/401: getdents d6/da/d39/d41 0 2024-03-28T13:04:51.698 INFO:tasks.workunit.client.0.smithi076.stdout:3/297: dread d1/d7/d30/d38/d14/d36/f19 [4194304,4194304] 0 2024-03-28T13:04:51.816 INFO:tasks.workunit.client.0.smithi076.stdout:5/355: rename f3 to d5/db/d3f/d42/f83 0 2024-03-28T13:04:51.876 INFO:tasks.workunit.client.0.smithi076.stdout:9/371: creat d9/da/f7c x:0 0 0 2024-03-28T13:04:51.925 INFO:tasks.workunit.client.0.smithi076.stdout:6/402: creat d6/da/d23/f80 x:0 0 0 2024-03-28T13:04:51.925 INFO:tasks.workunit.client.0.smithi076.stdout:6/403: fdatasync d6/fb 0 2024-03-28T13:04:52.091 INFO:tasks.workunit.client.0.smithi076.stdout:3/298: truncate d1/d7/d30/d38/d14/d36/f19 4874651 0 2024-03-28T13:04:52.091 INFO:tasks.workunit.client.0.smithi076.stdout:5/356: link d5/db/d3f/d42/f58 d5/d9/d1c/d25/d60/d82/f84 0 2024-03-28T13:04:52.091 INFO:tasks.workunit.client.0.smithi076.stdout:5/357: write d5/f76 [200318,84337] 0 2024-03-28T13:04:52.136 INFO:tasks.workunit.client.0.smithi076.stdout:3/299: dwrite d1/d7/d30/f43 [0,4194304] 0 2024-03-28T13:04:52.149 INFO:tasks.workunit.client.0.smithi076.stdout:9/372: rename d9/d75 to d9/d74/d7d 0 2024-03-28T13:04:52.149 INFO:tasks.workunit.client.0.smithi076.stdout:9/373: chown d9/dd/df/d11/d37/l35 41 1 2024-03-28T13:04:52.149 INFO:tasks.workunit.client.0.smithi076.stdout:6/404: truncate d6/f52 3581515 0 2024-03-28T13:04:52.155 INFO:tasks.workunit.client.0.smithi076.stdout:2/378: write d2/d5/d7/d8/d21/f5e [1367585,81593] 0 2024-03-28T13:04:52.155 INFO:tasks.workunit.client.0.smithi076.stdout:2/379: chown d2/d75 233520 1 2024-03-28T13:04:52.371 INFO:tasks.workunit.client.0.smithi076.stdout:7/375: rmdir d1/d8/d37/d7f 0 2024-03-28T13:04:52.473 INFO:tasks.workunit.client.0.smithi076.stdout:5/358: creat d5/d9/d35/f85 x:0 0 0 2024-03-28T13:04:52.949 INFO:tasks.workunit.client.0.smithi076.stdout:6/405: mknod d6/da/d39/d41/d46/c81 0 2024-03-28T13:04:52.949 INFO:tasks.workunit.client.0.smithi076.stdout:6/406: chown d6/da/d39/d41/l7c 1376026 1 2024-03-28T13:04:52.949 INFO:tasks.workunit.client.0.smithi076.stdout:6/407: truncate d6/da/d40/d56/f6c 431878 0 2024-03-28T13:04:52.949 INFO:tasks.workunit.client.0.smithi076.stdout:6/408: write d6/da/d5f/f6b [815660,85776] 0 2024-03-28T13:04:52.975 INFO:tasks.workunit.client.0.smithi076.stdout:6/409: dwrite d6/da/d23/f43 [0,4194304] 0 2024-03-28T13:04:52.975 INFO:tasks.workunit.client.0.smithi076.stdout:6/410: stat d6/da/d39/d41 0 2024-03-28T13:04:52.996 INFO:tasks.workunit.client.0.smithi076.stdout:2/380: creat d2/d54/f77 x:0 0 0 2024-03-28T13:04:53.097 INFO:tasks.workunit.client.0.smithi076.stdout:7/376: mkdir d1/d18/d3c/d7b/d84 0 2024-03-28T13:04:53.207 INFO:tasks.workunit.client.0.smithi076.stdout:5/359: mknod d5/d9/c86 0 2024-03-28T13:04:53.207 INFO:tasks.workunit.client.0.smithi076.stdout:5/360: read d5/db/d19/f77 [2983134,103047] 0 2024-03-28T13:04:53.207 INFO:tasks.workunit.client.0.smithi076.stdout:5/361: truncate d5/f76 537567 0 2024-03-28T13:04:53.207 INFO:tasks.workunit.client.0.smithi076.stdout:5/362: fsync d5/d9/f4d 0 2024-03-28T13:04:53.231 INFO:tasks.workunit.client.0.smithi076.stdout:5/363: dwrite d5/db/d19/f52 [0,4194304] 0 2024-03-28T13:04:53.251 INFO:tasks.workunit.client.0.smithi076.stdout:9/374: unlink d9/dd/df/d11/d14/f26 0 2024-03-28T13:04:53.251 INFO:tasks.workunit.client.0.smithi076.stdout:9/375: stat d9/dd/df/d11/d14/d58/d6e/d2a/f62 0 2024-03-28T13:04:53.268 INFO:tasks.workunit.client.0.smithi076.stdout:9/376: read d9/dd/df/f13 [2219036,122636] 0 2024-03-28T13:04:53.268 INFO:tasks.workunit.client.0.smithi076.stdout:9/377: stat d9/dd/df/d11/d14/f31 0 2024-03-28T13:04:53.268 INFO:tasks.workunit.client.0.smithi076.stdout:9/378: chown d9/dd/d48/f59 144765145 1 2024-03-28T13:04:53.371 INFO:tasks.workunit.client.0.smithi076.stdout:6/411: rmdir d6/da/d40/d62 39 2024-03-28T13:04:53.425 INFO:tasks.workunit.client.0.smithi076.stdout:2/381: creat d2/d5/db/f78 x:0 0 0 2024-03-28T13:04:53.425 INFO:tasks.workunit.client.0.smithi076.stdout:2/382: write d2/d5/d4b/f1f [854716,3934] 0 2024-03-28T13:04:53.485 INFO:tasks.workunit.client.0.smithi076.stdout:7/377: rmdir d1/d18 39 2024-03-28T13:04:53.662 INFO:tasks.workunit.client.0.smithi076.stdout:9/379: link d9/d3c/f2f d9/dd/df/d11/f7e 0 2024-03-28T13:04:53.663 INFO:tasks.workunit.client.0.smithi076.stdout:6/412: creat d6/da/d40/f82 x:0 0 0 2024-03-28T13:04:53.687 INFO:tasks.workunit.client.0.smithi076.stdout:9/380: dread d9/d3c/f2f [0,4194304] 0 2024-03-28T13:04:53.687 INFO:tasks.workunit.client.0.smithi076.stdout:9/381: fdatasync d9/dd/df/d11/d14/d58/f6c 0 2024-03-28T13:04:53.711 INFO:tasks.workunit.client.0.smithi076.stdout:6/413: dwrite d6/da/d39/f61 [0,4194304] 0 2024-03-28T13:04:53.732 INFO:tasks.workunit.client.0.smithi076.stdout:9/382: dwrite d9/dd/df/d11/d14/f4e [0,4194304] 0 2024-03-28T13:04:53.989 INFO:tasks.workunit.client.0.smithi076.stdout:6/414: mknod d6/da/d23/c83 0 2024-03-28T13:04:53.992 INFO:tasks.workunit.client.0.smithi076.stdout:9/383: unlink d9/dd/df/d11/d14/d58/d6e/d2a/f62 0 2024-03-28T13:04:53.993 INFO:tasks.workunit.client.0.smithi076.stdout:9/384: chown d9/dd/df/d11/f22 166087 1 2024-03-28T13:04:54.150 INFO:tasks.workunit.client.0.smithi076.stdout:6/415: mkdir d6/da/d40/d56/d84 0 2024-03-28T13:04:54.168 INFO:tasks.workunit.client.0.smithi076.stdout:6/416: write d6/f24 [2771715,46184] 0 2024-03-28T13:04:54.193 INFO:tasks.workunit.client.0.smithi076.stdout:6/417: read d6/f2f [2992669,105165] 0 2024-03-28T13:04:54.211 INFO:tasks.workunit.client.0.smithi076.stdout:6/418: dread d6/da/d39/f3b [4194304,4194304] 0 2024-03-28T13:04:54.393 INFO:tasks.workunit.client.0.smithi076.stdout:4/389: sync 2024-03-28T13:04:54.393 INFO:tasks.workunit.client.0.smithi076.stdout:1/314: sync 2024-03-28T13:04:54.393 INFO:tasks.workunit.client.0.smithi076.stdout:0/400: sync 2024-03-28T13:04:54.393 INFO:tasks.workunit.client.0.smithi076.stdout:8/339: sync 2024-03-28T13:04:54.393 INFO:tasks.workunit.client.0.smithi076.stdout:8/340: fdatasync de/f56 0 2024-03-28T13:04:54.393 INFO:tasks.workunit.client.0.smithi076.stdout:8/341: chown de/l4b 291051354 1 2024-03-28T13:04:54.393 INFO:tasks.workunit.client.0.smithi076.stdout:8/342: write de/d4e/d54/f64 [147973,3609] 0 2024-03-28T13:04:54.420 INFO:tasks.workunit.client.0.smithi076.stdout:4/390: write d0/d3b/d50/d64/d89/d2d/f3a [2521366,100161] 0 2024-03-28T13:04:54.420 INFO:tasks.workunit.client.0.smithi076.stdout:1/315: dwrite d14/d2a/d2e/d3c/d5c/f65 [0,4194304] 0 2024-03-28T13:04:54.420 INFO:tasks.workunit.client.0.smithi076.stdout:4/391: fsync d0/f1f 0 2024-03-28T13:04:54.696 INFO:tasks.workunit.client.0.smithi076.stdout:3/300: sync 2024-03-28T13:04:54.697 INFO:tasks.workunit.client.0.smithi076.stdout:3/301: readlink d1/d7/d30/l53 0 2024-03-28T13:04:54.743 INFO:tasks.workunit.client.0.smithi076.stdout:3/302: dwrite d1/f1b [0,4194304] 0 2024-03-28T13:04:54.743 INFO:tasks.workunit.client.0.smithi076.stdout:3/303: chown d1 225339 1 2024-03-28T13:04:54.772 INFO:tasks.workunit.client.0.smithi076.stdout:3/304: dwrite d1/d7/d30/d38/d14/f26 [0,4194304] 0 2024-03-28T13:04:54.789 INFO:tasks.workunit.client.0.smithi076.stdout:6/419: link d6/da/d40/d62/l71 d6/da/d5f/d6d/l85 0 2024-03-28T13:04:55.146 INFO:tasks.workunit.client.0.smithi076.stdout:5/364: dwrite d5/db/f46 [0,4194304] 0 2024-03-28T13:04:55.209 INFO:tasks.workunit.client.0.smithi076.stdout:0/401: mkdir db/dc/df/d18/d1d/d75/d51/d60/d92 0 2024-03-28T13:04:55.209 INFO:tasks.workunit.client.0.smithi076.stdout:0/402: write db/dc/df/d18/d1d/d75/d51/d60/f70 [867231,2303] 0 2024-03-28T13:04:55.298 INFO:tasks.workunit.client.0.smithi076.stdout:8/343: mknod de/d13/c74 0 2024-03-28T13:04:55.298 INFO:tasks.workunit.client.0.smithi076.stdout:8/344: chown de/d23/d2b/d51/d60/f73 256423631 1 2024-03-28T13:04:55.298 INFO:tasks.workunit.client.0.smithi076.stdout:8/345: stat de/f1d 0 2024-03-28T13:04:55.299 INFO:tasks.workunit.client.0.smithi076.stdout:9/385: write d9/dd/df/d11/d14/d58/d6e/d2a/f49 [1190345,95301] 0 2024-03-28T13:04:55.299 INFO:tasks.workunit.client.0.smithi076.stdout:8/346: readlink de/l6c 0 2024-03-28T13:04:55.299 INFO:tasks.workunit.client.0.smithi076.stdout:8/347: fsync de/d23/f1e 0 2024-03-28T13:04:55.318 INFO:tasks.workunit.client.0.smithi076.stdout:8/348: read de/d12/d18/f32 [995947,116661] 0 2024-03-28T13:04:55.432 INFO:tasks.workunit.client.0.smithi076.stdout:1/316: getdents d14/d2a/d3f 0 2024-03-28T13:04:55.432 INFO:tasks.workunit.client.0.smithi076.stdout:1/317: write d14/d2a/d2e/d31/d3b/f3d [5140670,12504] 0 2024-03-28T13:04:56.000 INFO:tasks.workunit.client.0.smithi076.stdout:2/383: rename d2/d54 to d2/d5/db/d3b/d3f/d79 0 2024-03-28T13:04:56.000 INFO:tasks.workunit.client.0.smithi076.stdout:2/384: readlink d2/l36 0 2024-03-28T13:04:56.051 INFO:tasks.workunit.client.0.smithi076.stdout:6/420: unlink d6/da/d39/d41/d46/c4f 0 2024-03-28T13:04:56.051 INFO:tasks.workunit.client.0.smithi076.stdout:6/421: fsync d6/da/d23/f45 0 2024-03-28T13:04:56.084 INFO:tasks.workunit.client.0.smithi076.stdout:6/422: dwrite d6/da/d23/f45 [0,4194304] 0 2024-03-28T13:04:56.085 INFO:tasks.workunit.client.0.smithi076.stdout:6/423: chown d6/da/d23/f4d 36064 1 2024-03-28T13:04:56.085 INFO:tasks.workunit.client.0.smithi076.stdout:6/424: write d6/f24 [2560178,22447] 0 2024-03-28T13:04:56.173 INFO:tasks.workunit.client.0.smithi076.stdout:5/365: creat d5/d9/d1c/d1d/d31/f87 x:0 0 0 2024-03-28T13:04:56.562 INFO:tasks.workunit.client.0.smithi076.stdout:8/349: creat de/d13/f75 x:0 0 0 2024-03-28T13:04:56.641 INFO:tasks.workunit.client.0.smithi076.stdout:1/318: creat d14/d2a/d2e/d31/d51/f70 x:0 0 0 2024-03-28T13:04:56.710 INFO:tasks.workunit.client.0.smithi076.stdout:0/403: rmdir db 39 2024-03-28T13:04:56.784 INFO:tasks.workunit.client.0.smithi076.stdout:3/305: rename d1/d2/f6b to d1/d2/f70 0 2024-03-28T13:04:56.784 INFO:tasks.workunit.client.0.smithi076.stdout:3/306: read d1/d7/d30/d38/d14/d27/d42/f68 [1778599,124964] 0 2024-03-28T13:04:56.784 INFO:tasks.workunit.client.0.smithi076.stdout:3/307: stat d1/f1b 0 2024-03-28T13:04:56.784 INFO:tasks.workunit.client.0.smithi076.stdout:3/308: write d1/d7/d30/d38/d14/d36/f19 [749382,38909] 0 2024-03-28T13:04:56.861 INFO:tasks.workunit.client.0.smithi076.stdout:2/385: rmdir d2/d5/db/d3b/d5a 39 2024-03-28T13:04:56.883 INFO:tasks.workunit.client.0.smithi076.stdout:2/386: dwrite d2/d5/d7/f71 [0,4194304] 0 2024-03-28T13:04:56.883 INFO:tasks.workunit.client.0.smithi076.stdout:2/387: chown d2/d5/d7/l72 1279855090 1 2024-03-28T13:04:56.883 INFO:tasks.workunit.client.0.smithi076.stdout:2/388: chown d2/d5/d7/f23 11311 1 2024-03-28T13:04:56.963 INFO:tasks.workunit.client.0.smithi076.stdout:6/425: creat d6/da/d1e/f86 x:0 0 0 2024-03-28T13:04:57.011 INFO:tasks.workunit.client.0.smithi076.stdout:6/426: dwrite d6/da/d40/d62/f7b [0,4194304] 0 2024-03-28T13:04:57.016 INFO:tasks.workunit.client.0.smithi076.stdout:5/366: symlink d5/db/d3f/d42/l88 0 2024-03-28T13:04:57.188 INFO:tasks.workunit.client.0.smithi076.stdout:1/319: mknod d14/d2a/d2e/d31/d51/c71 0 2024-03-28T13:04:57.188 INFO:tasks.workunit.client.0.smithi076.stdout:7/378: rename d1/d8/c5b to d1/d18/d3c/c85 0 2024-03-28T13:04:57.188 INFO:tasks.workunit.client.0.smithi076.stdout:7/379: chown d1/d18/d2d/c4b 100796 1 2024-03-28T13:04:57.188 INFO:tasks.workunit.client.0.smithi076.stdout:7/380: stat d1/dc/c23 0 2024-03-28T13:04:57.189 INFO:tasks.workunit.client.0.smithi076.stdout:7/381: write d1/d8/d37/f43 [3564128,85331] 0 2024-03-28T13:04:57.267 INFO:tasks.workunit.client.0.smithi076.stdout:0/404: truncate db/f3e 2236570 0 2024-03-28T13:04:57.304 INFO:tasks.workunit.client.0.smithi076.stdout:0/405: dwrite db/dc/df/d18/f5f [0,4194304] 0 2024-03-28T13:04:57.304 INFO:tasks.workunit.client.0.smithi076.stdout:0/406: chown db/dc/df/d18/d1d/d21/l5d 6318297 1 2024-03-28T13:04:57.335 INFO:tasks.workunit.client.0.smithi076.stdout:4/392: sync 2024-03-28T13:04:57.373 INFO:tasks.workunit.client.0.smithi076.stdout:4/393: dwrite d0/d3b/d40/d42/d28/f32 [0,4194304] 0 2024-03-28T13:04:57.373 INFO:tasks.workunit.client.0.smithi076.stdout:4/394: chown d0/d20/f5c 760 1 2024-03-28T13:04:57.373 INFO:tasks.workunit.client.0.smithi076.stdout:4/395: truncate d0/d3b/d40/d42/d31/d4d/f4c 1736157 0 2024-03-28T13:04:57.395 INFO:tasks.workunit.client.0.smithi076.stdout:3/309: mkdir d1/d7/d30/d71 0 2024-03-28T13:04:57.395 INFO:tasks.workunit.client.0.smithi076.stdout:3/310: write d1/d7/d30/d38/d14/d36/f57 [308129,63669] 0 2024-03-28T13:04:57.407 INFO:tasks.workunit.client.0.smithi076.stdout:4/396: dwrite d0/f9 [4194304,4194304] 0 2024-03-28T13:04:57.626 INFO:tasks.workunit.client.0.smithi076.stdout:2/389: symlink d2/d5/d7/d8/d21/l7a 0 2024-03-28T13:04:57.907 INFO:tasks.workunit.client.0.smithi076.stdout:5/367: creat d5/d9/f89 x:0 0 0 2024-03-28T13:04:57.908 INFO:tasks.workunit.client.0.smithi076.stdout:5/368: fsync d5/d9/d1c/d1d/d31/f87 0 2024-03-28T13:04:57.908 INFO:tasks.workunit.client.0.smithi076.stdout:5/369: truncate d5/d9/d1c/d1d/d22/f65 289439 0 2024-03-28T13:04:58.008 INFO:tasks.workunit.client.0.smithi076.stdout:9/386: sync 2024-03-28T13:04:58.318 INFO:tasks.workunit.client.0.smithi076.stdout:7/382: symlink d1/d18/d3c/d7b/l86 0 2024-03-28T13:04:58.318 INFO:tasks.workunit.client.0.smithi076.stdout:7/383: stat d1/d8/d37/d53/l80 0 2024-03-28T13:04:58.359 INFO:tasks.workunit.client.0.smithi076.stdout:0/407: unlink f1 0 2024-03-28T13:04:58.359 INFO:tasks.workunit.client.0.smithi076.stdout:3/311: unlink d1/d7/d30/d38/f1a 0 2024-03-28T13:04:58.476 INFO:tasks.workunit.client.0.smithi076.stdout:4/397: mknod d0/d3b/d40/d42/d28/c8a 0 2024-03-28T13:04:58.476 INFO:tasks.workunit.client.0.smithi076.stdout:4/398: readlink d0/d3b/d50/l76 0 2024-03-28T13:04:58.477 INFO:tasks.workunit.client.0.smithi076.stdout:4/399: stat d0/d3b/d40/d42/f3f 0 2024-03-28T13:04:58.477 INFO:tasks.workunit.client.0.smithi076.stdout:4/400: readlink d0/d20/d7b/d81/l86 0 2024-03-28T13:04:58.477 INFO:tasks.workunit.client.0.smithi076.stdout:4/401: dread - d0/f43 zero size 2024-03-28T13:04:58.518 INFO:tasks.workunit.client.0.smithi076.stdout:4/402: dwrite d0/d3b/d50/d64/d89/d68/f71 [4194304,4194304] 0 2024-03-28T13:04:58.576 INFO:tasks.workunit.client.0.smithi076.stdout:5/370: getdents d5/db/d19/d34 0 2024-03-28T13:04:58.609 INFO:tasks.workunit.client.0.smithi076.stdout:8/350: write de/d13/d27/f34 [953028,123908] 0 2024-03-28T13:04:58.738 INFO:tasks.workunit.client.0.smithi076.stdout:7/384: stat d1/d18/d3c/l50 0 2024-03-28T13:04:58.802 INFO:tasks.workunit.client.0.smithi076.stdout:0/408: mknod db/dc/df/d71/c93 0 2024-03-28T13:04:58.863 INFO:tasks.workunit.client.0.smithi076.stdout:3/312: mknod d1/d7/d30/d38/d14/d36/d56/d5b/d6d/c72 0 2024-03-28T13:04:58.864 INFO:tasks.workunit.client.0.smithi076.stdout:3/313: chown d1/d7/d30 8677 1 2024-03-28T13:04:58.959 INFO:tasks.workunit.client.0.smithi076.stdout:4/403: mknod d0/d3b/d40/d42/d31/d5e/d72/d78/c8b 0 2024-03-28T13:04:59.107 INFO:tasks.workunit.client.0.smithi076.stdout:5/371: link d5/db/d3f/d42/d43/d7a/d7c/c81 d5/d9/d4c/c8a 0 2024-03-28T13:04:59.153 INFO:tasks.workunit.client.0.smithi076.stdout:8/351: unlink de/d12/d18/f32 0 2024-03-28T13:04:59.302 INFO:tasks.workunit.client.0.smithi076.stdout:9/387: write d9/dd/df/d11/f22 [3742545,93605] 0 2024-03-28T13:04:59.707 INFO:tasks.workunit.client.0.smithi076.stdout:9/388: creat d9/dd/df/d11/d14/f7f x:0 0 0 2024-03-28T13:04:59.786 INFO:tasks.workunit.client.0.smithi076.stdout:4/404: symlink d0/d3b/d50/d64/d89/l8c 0 2024-03-28T13:04:59.787 INFO:tasks.workunit.client.0.smithi076.stdout:4/405: chown d0/d3b/d40/d42/f3f 0 1 2024-03-28T13:04:59.832 INFO:tasks.workunit.client.0.smithi076.stdout:4/406: dwrite d0/d3b/d40/d42/d31/d4d/f4c [0,4194304] 0 2024-03-28T13:04:59.866 INFO:tasks.workunit.client.0.smithi076.stdout:5/372: truncate d5/d9/d1c/d1d/d22/f33 815714 0 2024-03-28T13:04:59.866 INFO:tasks.workunit.client.0.smithi076.stdout:5/373: write d5/db/d19/f2d [787668,62368] 0 2024-03-28T13:04:59.873 INFO:tasks.workunit.client.0.smithi076.stdout:4/407: dwrite d0/f43 [0,4194304] 0 2024-03-28T13:04:59.891 INFO:tasks.workunit.client.0.smithi076.stdout:4/408: dread d0/d3b/d40/d42/d31/d4d/d63/f7d [0,4194304] 0 2024-03-28T13:04:59.949 INFO:tasks.workunit.client.0.smithi076.stdout:9/389: rename d9/dd/df/d11/f4b to d9/dd/df/d11/f80 0 2024-03-28T13:05:00.518 INFO:tasks.workunit.client.0.smithi076.stdout:2/390: write d2/d5/db/d3b/f4e [633241,125006] 0 2024-03-28T13:05:01.209 INFO:tasks.workunit.client.0.smithi076.stdout:0/409: dwrite db/f4b [0,4194304] 0 2024-03-28T13:05:01.568 INFO:tasks.workunit.client.0.smithi076.stdout:3/314: truncate d1/d7/d30/d38/d14/d36/f19 4845503 0 2024-03-28T13:05:01.568 INFO:tasks.workunit.client.0.smithi076.stdout:1/320: rename l11 to d14/l72 0 2024-03-28T13:05:01.618 INFO:tasks.workunit.client.0.smithi076.stdout:5/374: mknod d5/db/d3f/c8b 0 2024-03-28T13:05:01.618 INFO:tasks.workunit.client.0.smithi076.stdout:5/375: dread - d5/db/df/f5a zero size 2024-03-28T13:05:01.641 INFO:tasks.workunit.client.0.smithi076.stdout:4/409: dwrite d0/d3b/d40/d42/f19 [0,4194304] 0 2024-03-28T13:05:01.641 INFO:tasks.workunit.client.0.smithi076.stdout:4/410: chown d0/d3b/d40/d42/d31/d5e/d72/d78/c8b 38835 1 2024-03-28T13:05:01.683 INFO:tasks.workunit.client.0.smithi076.stdout:0/410: unlink db/f17 0 2024-03-28T13:05:01.825 INFO:tasks.workunit.client.0.smithi076.stdout:6/427: rename d6/da/d39/d41/d46/f5d to d6/f87 0 2024-03-28T13:05:01.890 INFO:tasks.workunit.client.0.smithi076.stdout:1/321: creat d14/d2a/d3f/f73 x:0 0 0 2024-03-28T13:05:01.932 INFO:tasks.workunit.client.0.smithi076.stdout:7/385: creat d1/f87 x:0 0 0 2024-03-28T13:05:01.964 INFO:tasks.workunit.client.0.smithi076.stdout:5/376: rmdir d5/d9/d35/d3b 39 2024-03-28T13:05:02.016 INFO:tasks.workunit.client.0.smithi076.stdout:5/377: dwrite d5/db/f46 [4194304,4194304] 0 2024-03-28T13:05:02.016 INFO:tasks.workunit.client.0.smithi076.stdout:7/386: dwrite d1/d18/d3c/f33 [0,4194304] 0 2024-03-28T13:05:02.063 INFO:tasks.workunit.client.0.smithi076.stdout:4/411: mkdir d0/d3b/d40/d8d 0 2024-03-28T13:05:02.063 INFO:tasks.workunit.client.0.smithi076.stdout:4/412: chown d0/d3b/d40/d42/d47/d69 1613 1 2024-03-28T13:05:02.140 INFO:tasks.workunit.client.0.smithi076.stdout:0/411: creat db/f94 x:0 0 0 2024-03-28T13:05:02.236 INFO:tasks.workunit.client.0.smithi076.stdout:8/352: rename de/d12 to de/d23/d2b/d5d/d76 0 2024-03-28T13:05:02.331 INFO:tasks.workunit.client.0.smithi076.stdout:6/428: truncate d6/f4b 1267789 0 2024-03-28T13:05:02.464 INFO:tasks.workunit.client.0.smithi076.stdout:1/322: mkdir d14/d6c/d74 0 2024-03-28T13:05:02.464 INFO:tasks.workunit.client.0.smithi076.stdout:5/378: creat d5/db/d19/f8c x:0 0 0 2024-03-28T13:05:02.464 INFO:tasks.workunit.client.0.smithi076.stdout:1/323: truncate d14/d2a/d2e/d31/d51/f60 1956224 0 2024-03-28T13:05:02.482 INFO:tasks.workunit.client.0.smithi076.stdout:5/379: dread d5/d9/d1c/f6d [0,4194304] 0 2024-03-28T13:05:02.700 INFO:tasks.workunit.client.0.smithi076.stdout:7/387: creat d1/d18/d3c/d7b/d84/f88 x:0 0 0 2024-03-28T13:05:02.703 INFO:tasks.workunit.client.0.smithi076.stdout:2/391: sync 2024-03-28T13:05:02.704 INFO:tasks.workunit.client.0.smithi076.stdout:9/390: sync 2024-03-28T13:05:02.782 INFO:tasks.workunit.client.0.smithi076.stdout:4/413: mkdir d0/d3b/d50/d64/d89/d2d/d75/d8e 0 2024-03-28T13:05:02.783 INFO:tasks.workunit.client.0.smithi076.stdout:4/414: fsync d0/d3b/d50/d64/d89/f18 0 2024-03-28T13:05:03.189 INFO:tasks.workunit.client.0.smithi076.stdout:3/315: rename d1/d7/l34 to d1/d7/d30/d60/l73 0 2024-03-28T13:05:03.347 INFO:tasks.workunit.client.0.smithi076.stdout:6/429: creat d6/da/d40/d56/d58/f88 x:0 0 0 2024-03-28T13:05:03.347 INFO:tasks.workunit.client.0.smithi076.stdout:6/430: truncate d6/da/d1e/f47 623744 0 2024-03-28T13:05:03.371 INFO:tasks.workunit.client.0.smithi076.stdout:6/431: dwrite d6/da/d40/d56/d58/f66 [0,4194304] 0 2024-03-28T13:05:03.421 INFO:tasks.workunit.client.0.smithi076.stdout:1/324: mknod d14/d2a/d2e/d31/d49/c75 0 2024-03-28T13:05:03.459 INFO:tasks.workunit.client.0.smithi076.stdout:5/380: creat d5/db/d3f/f8d x:0 0 0 2024-03-28T13:05:03.518 INFO:tasks.workunit.client.0.smithi076.stdout:5/381: dwrite d5/db/d19/f77 [0,4194304] 0 2024-03-28T13:05:03.628 INFO:tasks.workunit.client.0.smithi076.stdout:7/388: creat d1/d18/d3c/d48/d69/d79/f89 x:0 0 0 2024-03-28T13:05:03.659 INFO:tasks.workunit.client.0.smithi076.stdout:9/391: write d9/d3c/f2f [2268399,102630] 0 2024-03-28T13:05:03.715 INFO:tasks.workunit.client.0.smithi076.stdout:2/392: symlink d2/d5/d7/d28/d64/l7b 0 2024-03-28T13:05:03.726 INFO:tasks.workunit.client.0.smithi076.stdout:2/393: dread d2/d5/d7/f40 [4194304,4194304] 0 2024-03-28T13:05:03.759 INFO:tasks.workunit.client.0.smithi076.stdout:4/415: creat d0/d3b/d40/d42/d31/f8f x:0 0 0 2024-03-28T13:05:03.781 INFO:tasks.workunit.client.0.smithi076.stdout:4/416: dwrite d0/d3b/f79 [0,4194304] 0 2024-03-28T13:05:03.879 INFO:tasks.workunit.client.0.smithi076.stdout:3/316: mkdir d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74 0 2024-03-28T13:05:03.918 INFO:tasks.workunit.client.0.smithi076.stdout:3/317: dwrite d1/d7/d30/d38/d14/d36/f19 [0,4194304] 0 2024-03-28T13:05:03.923 INFO:tasks.workunit.client.0.smithi076.stdout:8/353: truncate de/d23/d2b/d5d/d76/f4a 930594 0 2024-03-28T13:05:03.957 INFO:tasks.workunit.client.0.smithi076.stdout:3/318: dwrite d1/d2/f2e [0,4194304] 0 2024-03-28T13:05:03.960 INFO:tasks.workunit.client.0.smithi076.stdout:8/354: dwrite de/d25/f36 [0,4194304] 0 2024-03-28T13:05:03.960 INFO:tasks.workunit.client.0.smithi076.stdout:8/355: fdatasync de/d13/d27/f5a 0 2024-03-28T13:05:03.975 INFO:tasks.workunit.client.0.smithi076.stdout:8/356: write de/d23/d2b/d5d/d76/d18/f1a [3489303,61214] 0 2024-03-28T13:05:04.021 INFO:tasks.workunit.client.0.smithi076.stdout:8/357: dwrite de/d23/d2b/d2c/f3b [0,4194304] 0 2024-03-28T13:05:04.074 INFO:tasks.workunit.client.0.smithi076.stdout:8/358: dwrite de/f3f [0,4194304] 0 2024-03-28T13:05:04.110 INFO:tasks.workunit.client.0.smithi076.stdout:6/432: mkdir d6/da/d89 0 2024-03-28T13:05:04.110 INFO:tasks.workunit.client.0.smithi076.stdout:6/433: truncate d6/da/d23/f43 4853880 0 2024-03-28T13:05:04.110 INFO:tasks.workunit.client.0.smithi076.stdout:6/434: write d6/da/d1e/f60 [5043853,71190] 0 2024-03-28T13:05:04.364 INFO:tasks.workunit.client.0.smithi076.stdout:5/382: mkdir d5/d9/d35/d3b/d8e 0 2024-03-28T13:05:04.364 INFO:tasks.workunit.client.0.smithi076.stdout:5/383: chown d5/d9/d1c/d25/f5d 345240 1 2024-03-28T13:05:04.431 INFO:tasks.workunit.client.0.smithi076.stdout:7/389: mknod d1/d18/d3c/d48/c8a 0 2024-03-28T13:05:04.527 INFO:tasks.workunit.client.0.smithi076.stdout:9/392: fdatasync d9/da/f7c 0 2024-03-28T13:05:04.564 INFO:tasks.workunit.client.0.smithi076.stdout:2/394: stat d2/d5/db/d3b/d60/c68 0 2024-03-28T13:05:04.585 INFO:tasks.workunit.client.0.smithi076.stdout:2/395: write d2/d5/d7/dd/f32 [2328636,13257] 0 2024-03-28T13:05:04.585 INFO:tasks.workunit.client.0.smithi076.stdout:2/396: dread - d2/d5/db/d3b/d42/f6d zero size 2024-03-28T13:05:04.585 INFO:tasks.workunit.client.0.smithi076.stdout:2/397: stat d2/d5/db/d3b/d60/c68 0 2024-03-28T13:05:04.612 INFO:tasks.workunit.client.0.smithi076.stdout:2/398: write d2/d5/d7/d8/d21/f27 [2608492,121679] 0 2024-03-28T13:05:04.699 INFO:tasks.workunit.client.0.smithi076.stdout:4/417: getdents d0/d3b/d40/d42/d31/d4d 0 2024-03-28T13:05:04.699 INFO:tasks.workunit.client.0.smithi076.stdout:4/418: getdents d0/d3b/d40/d42/d31/d4d 0 2024-03-28T13:05:04.745 INFO:tasks.workunit.client.0.smithi076.stdout:0/412: creat db/dc/df/d11/d40/d69/f95 x:0 0 0 2024-03-28T13:05:05.225 INFO:tasks.workunit.client.0.smithi076.stdout:8/359: mkdir de/d25/d77 0 2024-03-28T13:05:05.226 INFO:tasks.workunit.client.0.smithi076.stdout:8/360: truncate de/d13/d27/f34 1935003 0 2024-03-28T13:05:05.226 INFO:tasks.workunit.client.0.smithi076.stdout:6/435: creat d6/da/d39/d63/f8a x:0 0 0 2024-03-28T13:05:05.280 INFO:tasks.workunit.client.0.smithi076.stdout:7/390: mkdir d1/dc/d8b 0 2024-03-28T13:05:05.292 INFO:tasks.workunit.client.0.smithi076.stdout:7/391: dread d1/d8/d37/d53/f73 [0,4194304] 0 2024-03-28T13:05:05.387 INFO:tasks.workunit.client.0.smithi076.stdout:9/393: truncate d9/dd/df/d11/d14/f16 330662 0 2024-03-28T13:05:05.556 INFO:tasks.workunit.client.0.smithi076.stdout:2/399: mknod d2/d5/d7/d28/d64/c7c 0 2024-03-28T13:05:05.556 INFO:tasks.workunit.client.0.smithi076.stdout:4/419: link d0/d20/c70 d0/d3b/d40/d42/d47/c90 0 2024-03-28T13:05:05.635 INFO:tasks.workunit.client.0.smithi076.stdout:3/319: mknod d1/d2/c75 0 2024-03-28T13:05:05.697 INFO:tasks.workunit.client.0.smithi076.stdout:8/361: mkdir de/d23/d2b/d58/d78 0 2024-03-28T13:05:05.890 INFO:tasks.workunit.client.0.smithi076.stdout:9/394: symlink d9/dd/df/d11/d37/l81 0 2024-03-28T13:05:05.890 INFO:tasks.workunit.client.0.smithi076.stdout:9/395: truncate d9/da/f7c 338952 0 2024-03-28T13:05:05.950 INFO:tasks.workunit.client.0.smithi076.stdout:2/400: rmdir d2/d5/d7 39 2024-03-28T13:05:06.038 INFO:tasks.workunit.client.0.smithi076.stdout:4/420: creat d0/d3b/d40/d42/d47/d7c/f91 x:0 0 0 2024-03-28T13:05:06.152 INFO:tasks.workunit.client.0.smithi076.stdout:0/413: rename db/dc/f62 to db/dc/df/d18/d1d/d75/f96 0 2024-03-28T13:05:06.213 INFO:tasks.workunit.client.0.smithi076.stdout:3/320: creat d1/d7/d30/d38/d14/d36/d56/d5b/f76 x:0 0 0 2024-03-28T13:05:06.313 INFO:tasks.workunit.client.0.smithi076.stdout:8/362: link de/d23/d2b/d5d/d76/d18/d3c/f44 de/d23/d2b/d5d/d76/d6e/f79 0 2024-03-28T13:05:06.416 INFO:tasks.workunit.client.0.smithi076.stdout:1/325: write d14/d2a/d2e/d31/d49/f63 [1516247,36715] 0 2024-03-28T13:05:06.575 INFO:tasks.workunit.client.0.smithi076.stdout:7/392: mkdir d1/d18/d3c/d8c 0 2024-03-28T13:05:06.598 INFO:tasks.workunit.client.0.smithi076.stdout:2/401: truncate d2/d5/d7/f23 1410078 0 2024-03-28T13:05:06.651 INFO:tasks.workunit.client.0.smithi076.stdout:4/421: creat d0/d3b/d40/d42/d28/f92 x:0 0 0 2024-03-28T13:05:06.651 INFO:tasks.workunit.client.0.smithi076.stdout:4/422: write d0/d3b/d40/d42/d31/f4a [24472,108741] 0 2024-03-28T13:05:06.651 INFO:tasks.workunit.client.0.smithi076.stdout:4/423: dread - d0/d20/f87 zero size 2024-03-28T13:05:06.651 INFO:tasks.workunit.client.0.smithi076.stdout:4/424: write d0/f15 [104638,20736] 0 2024-03-28T13:05:06.651 INFO:tasks.workunit.client.0.smithi076.stdout:4/425: chown d0/d20/f5c 514424149 1 2024-03-28T13:05:06.679 INFO:tasks.workunit.client.0.smithi076.stdout:2/402: dwrite d2/d5/d7/d3e/f45 [0,4194304] 0 2024-03-28T13:05:06.704 INFO:tasks.workunit.client.0.smithi076.stdout:0/414: mkdir db/dc/df/d18/d1d/d75/d51/d97 0 2024-03-28T13:05:06.704 INFO:tasks.workunit.client.0.smithi076.stdout:0/415: write db/dc/df/d18/d1d/f29 [1021142,119030] 0 2024-03-28T13:05:06.740 INFO:tasks.workunit.client.0.smithi076.stdout:0/416: dwrite db/dc/df/d18/f5f [0,4194304] 0 2024-03-28T13:05:06.872 INFO:tasks.workunit.client.0.smithi076.stdout:1/326: mknod d14/d2a/d3f/c76 0 2024-03-28T13:05:07.289 INFO:tasks.workunit.client.0.smithi076.stdout:7/393: creat d1/d18/d3c/d48/f8d x:0 0 0 2024-03-28T13:05:07.295 INFO:tasks.workunit.client.0.smithi076.stdout:7/394: dread d1/f36 [0,4194304] 0 2024-03-28T13:05:07.310 INFO:tasks.workunit.client.0.smithi076.stdout:7/395: dread d1/d8/d37/f45 [0,4194304] 0 2024-03-28T13:05:07.336 INFO:tasks.workunit.client.0.smithi076.stdout:9/396: rename d9/dd/d48/l7a to d9/d74/d7d/l82 0 2024-03-28T13:05:07.358 INFO:tasks.workunit.client.0.smithi076.stdout:9/397: write d9/dd/df/d11/d37/f1c [3884984,38905] 0 2024-03-28T13:05:07.437 INFO:tasks.workunit.client.0.smithi076.stdout:4/426: creat d0/d3b/d50/d64/f93 x:0 0 0 2024-03-28T13:05:07.612 INFO:tasks.workunit.client.0.smithi076.stdout:2/403: creat d2/d5/d4b/d39/d57/f7d x:0 0 0 2024-03-28T13:05:07.734 INFO:tasks.workunit.client.0.smithi076.stdout:3/321: symlink d1/d7/d30/d38/d14/d18/d3a/l77 0 2024-03-28T13:05:07.851 INFO:tasks.workunit.client.0.smithi076.stdout:1/327: rmdir d14/d2a/d2e/d31/d51 39 2024-03-28T13:05:07.851 INFO:tasks.workunit.client.0.smithi076.stdout:7/396: truncate d1/f4 1305871 0 2024-03-28T13:05:07.851 INFO:tasks.workunit.client.0.smithi076.stdout:7/397: truncate d1/f3d 782357 0 2024-03-28T13:05:07.994 INFO:tasks.workunit.client.0.smithi076.stdout:4/427: mkdir d0/d20/d7b/d94 0 2024-03-28T13:05:07.995 INFO:tasks.workunit.client.0.smithi076.stdout:4/428: dread - d0/d3b/d40/d42/d31/f8f zero size 2024-03-28T13:05:08.024 INFO:tasks.workunit.client.0.smithi076.stdout:4/429: dwrite d0/d3b/d40/d42/d31/d4d/d63/f7d [4194304,4194304] 0 2024-03-28T13:05:08.045 INFO:tasks.workunit.client.0.smithi076.stdout:2/404: symlink d2/d5/d7/d28/d64/l7e 0 2024-03-28T13:05:08.045 INFO:tasks.workunit.client.0.smithi076.stdout:2/405: readlink d2/l56 0 2024-03-28T13:05:08.077 INFO:tasks.workunit.client.0.smithi076.stdout:6/436: dwrite d6/da/d40/d56/f6c [0,4194304] 0 2024-03-28T13:05:08.098 INFO:tasks.workunit.client.0.smithi076.stdout:5/384: write d5/d9/d1c/d25/d60/d82/f84 [2386785,22747] 0 2024-03-28T13:05:08.098 INFO:tasks.workunit.client.0.smithi076.stdout:5/385: chown d5/l30 77 1 2024-03-28T13:05:08.127 INFO:tasks.workunit.client.0.smithi076.stdout:5/386: dwrite d5/db/df/d61/f6f [0,4194304] 0 2024-03-28T13:05:08.128 INFO:tasks.workunit.client.0.smithi076.stdout:5/387: chown d5/d9/c86 7134 1 2024-03-28T13:05:08.159 INFO:tasks.workunit.client.0.smithi076.stdout:0/417: unlink db/f3e 0 2024-03-28T13:05:08.270 INFO:tasks.workunit.client.0.smithi076.stdout:9/398: getdents d9/dd/df/d11/d37 0 2024-03-28T13:05:08.335 INFO:tasks.workunit.client.0.smithi076.stdout:3/322: creat d1/d7/f78 x:0 0 0 2024-03-28T13:05:08.422 INFO:tasks.workunit.client.0.smithi076.stdout:1/328: creat d14/d2a/d2e/d31/d51/f77 x:0 0 0 2024-03-28T13:05:08.483 INFO:tasks.workunit.client.0.smithi076.stdout:7/398: dread d1/d18/d3c/f44 [0,4194304] 0 2024-03-28T13:05:08.647 INFO:tasks.workunit.client.0.smithi076.stdout:4/430: symlink d0/d3b/d50/d64/l95 0 2024-03-28T13:05:08.647 INFO:tasks.workunit.client.0.smithi076.stdout:2/406: rmdir d2/d5/d4b/d39/d57 39 2024-03-28T13:05:08.662 INFO:tasks.workunit.client.0.smithi076.stdout:2/407: dread d2/f16 [0,4194304] 0 2024-03-28T13:05:08.767 INFO:tasks.workunit.client.0.smithi076.stdout:6/437: mknod d6/da/d40/d62/c8b 0 2024-03-28T13:05:08.815 INFO:tasks.workunit.client.0.smithi076.stdout:6/438: dwrite d6/da/d23/f4d [0,4194304] 0 2024-03-28T13:05:08.816 INFO:tasks.workunit.client.0.smithi076.stdout:6/439: fsync d6/da/d39/f3b 0 2024-03-28T13:05:09.015 INFO:tasks.workunit.client.0.smithi076.stdout:0/418: write db/dc/df/f22 [3474236,99521] 0 2024-03-28T13:05:09.066 INFO:tasks.workunit.client.0.smithi076.stdout:9/399: link d9/dd/df/d11/d14/f6a d9/d74/f83 0 2024-03-28T13:05:09.066 INFO:tasks.workunit.client.0.smithi076.stdout:9/400: fsync d9/dd/df/f5e 0 2024-03-28T13:05:09.131 INFO:tasks.workunit.client.0.smithi076.stdout:3/323: link d1/d7/d30/d38/l44 d1/d7/d30/d38/d14/d4a/d66/l79 0 2024-03-28T13:05:09.131 INFO:tasks.workunit.client.0.smithi076.stdout:3/324: chown d1/c4 615 1 2024-03-28T13:05:09.195 INFO:tasks.workunit.client.0.smithi076.stdout:1/329: creat d14/d6c/d74/f78 x:0 0 0 2024-03-28T13:05:09.313 INFO:tasks.workunit.client.0.smithi076.stdout:4/431: unlink d0/d3b/d50/f58 0 2024-03-28T13:05:09.368 INFO:tasks.workunit.client.0.smithi076.stdout:2/408: creat d2/d5/d4b/d39/f7f x:0 0 0 2024-03-28T13:05:09.411 INFO:tasks.workunit.client.0.smithi076.stdout:2/409: dwrite d2/d5/d4b/f1f [0,4194304] 0 2024-03-28T13:05:09.515 INFO:tasks.workunit.client.0.smithi076.stdout:6/440: creat d6/da/d89/f8c x:0 0 0 2024-03-28T13:05:09.515 INFO:tasks.workunit.client.0.smithi076.stdout:6/441: chown d6/da/d5f/d6d 8105 1 2024-03-28T13:05:09.515 INFO:tasks.workunit.client.0.smithi076.stdout:6/442: readlink d6/da/d40/d56/l79 0 2024-03-28T13:05:09.515 INFO:tasks.workunit.client.0.smithi076.stdout:6/443: write d6/f24 [1794730,98405] 0 2024-03-28T13:05:09.515 INFO:tasks.workunit.client.0.smithi076.stdout:6/444: dread - d6/da/d40/f82 zero size 2024-03-28T13:05:09.524 INFO:tasks.workunit.client.0.smithi076.stdout:0/419: write db/dc/df/d71/f6a [280377,114633] 0 2024-03-28T13:05:09.524 INFO:tasks.workunit.client.0.smithi076.stdout:0/420: read - db/dc/df/d11/d40/d69/f95 zero size 2024-03-28T13:05:09.524 INFO:tasks.workunit.client.0.smithi076.stdout:0/421: truncate db/dc/fd 5003193 0 2024-03-28T13:05:09.536 INFO:tasks.workunit.client.0.smithi076.stdout:6/445: dread d6/fb [0,4194304] 0 2024-03-28T13:05:09.544 INFO:tasks.workunit.client.0.smithi076.stdout:0/422: dread db/dc/df/d18/f4e [0,4194304] 0 2024-03-28T13:05:09.577 INFO:tasks.workunit.client.0.smithi076.stdout:9/401: readlink d9/l38 0 2024-03-28T13:05:09.623 INFO:tasks.workunit.client.0.smithi076.stdout:9/402: dwrite d9/dd/d48/f59 [0,4194304] 0 2024-03-28T13:05:09.710 INFO:tasks.workunit.client.0.smithi076.stdout:3/325: rmdir d1 39 2024-03-28T13:05:09.780 INFO:tasks.workunit.client.0.smithi076.stdout:1/330: rmdir d14/d2a/d2e/d31/d51 39 2024-03-28T13:05:09.881 INFO:tasks.workunit.client.0.smithi076.stdout:4/432: link d0/d3b/d40/c74 d0/d3b/d40/d8d/c96 0 2024-03-28T13:05:09.922 INFO:tasks.workunit.client.0.smithi076.stdout:2/410: mknod d2/d5/d7/d3e/c80 0 2024-03-28T13:05:09.922 INFO:tasks.workunit.client.0.smithi076.stdout:2/411: chown d2/d5/db/d3b/f62 92659 1 2024-03-28T13:05:09.964 INFO:tasks.workunit.client.0.smithi076.stdout:6/446: getdents d6/da/d5f/d6d 0 2024-03-28T13:05:10.003 INFO:tasks.workunit.client.0.smithi076.stdout:6/447: dwrite d6/da/d1e/f86 [0,4194304] 0 2024-03-28T13:05:10.003 INFO:tasks.workunit.client.0.smithi076.stdout:6/448: write d6/da/d40/d56/d58/f66 [4489128,91752] 0 2024-03-28T13:05:10.115 INFO:tasks.workunit.client.0.smithi076.stdout:9/403: link d9/da/l23 d9/dd/df/d11/d37/l84 0 2024-03-28T13:05:10.137 INFO:tasks.workunit.client.0.smithi076.stdout:9/404: dread d9/dd/df/d11/d37/f78 [0,4194304] 0 2024-03-28T13:05:10.279 INFO:tasks.workunit.client.0.smithi076.stdout:1/331: mknod d14/d6c/c79 0 2024-03-28T13:05:10.282 INFO:tasks.workunit.client.0.smithi076.stdout:1/332: read d14/d2a/f38 [127449,105437] 0 2024-03-28T13:05:10.282 INFO:tasks.workunit.client.0.smithi076.stdout:1/333: fsync fd 0 2024-03-28T13:05:10.352 INFO:tasks.workunit.client.0.smithi076.stdout:4/433: mkdir d0/d3b/d50/d64/d89/d68/d97 0 2024-03-28T13:05:10.352 INFO:tasks.workunit.client.0.smithi076.stdout:4/434: chown d0/d3b/f79 594917540 1 2024-03-28T13:05:10.352 INFO:tasks.workunit.client.0.smithi076.stdout:4/435: dread - d0/d3b/d40/d42/d31/f8f zero size 2024-03-28T13:05:10.360 INFO:tasks.workunit.client.0.smithi076.stdout:8/363: sync 2024-03-28T13:05:10.361 INFO:tasks.workunit.client.0.smithi076.stdout:8/364: readlink de/d4e/l6b 0 2024-03-28T13:05:10.361 INFO:tasks.workunit.client.0.smithi076.stdout:8/365: write de/d25/f5b [199974,83059] 0 2024-03-28T13:05:10.808 INFO:tasks.workunit.client.0.smithi076.stdout:3/326: unlink d1/d7/d30/d38/d14/d27/f5c 0 2024-03-28T13:05:10.948 INFO:tasks.workunit.client.0.smithi076.stdout:6/449: getdents d6/da/d39 0 2024-03-28T13:05:11.426 INFO:tasks.workunit.client.0.smithi076.stdout:9/405: truncate d9/dd/df/d11/f7e 1925567 0 2024-03-28T13:05:11.427 INFO:tasks.workunit.client.0.smithi076.stdout:9/406: dread - d9/dd/df/d11/d14/f65 zero size 2024-03-28T13:05:11.522 INFO:tasks.workunit.client.0.smithi076.stdout:1/334: creat d14/d2a/d2e/d31/d49/f7a x:0 0 0 2024-03-28T13:05:11.579 INFO:tasks.workunit.client.0.smithi076.stdout:4/436: getdents d0/d20/d7f 0 2024-03-28T13:05:11.579 INFO:tasks.workunit.client.0.smithi076.stdout:4/437: write d0/d3b/d50/d64/d89/f5f [294885,15719] 0 2024-03-28T13:05:11.579 INFO:tasks.workunit.client.0.smithi076.stdout:4/438: dread - d0/d3b/d40/d42/d28/f92 zero size 2024-03-28T13:05:11.694 INFO:tasks.workunit.client.0.smithi076.stdout:8/366: rename de/d23/d2b/d2c to de/d23/d2b/d5d/d76/d6e/d7a 0 2024-03-28T13:05:11.694 INFO:tasks.workunit.client.0.smithi076.stdout:8/367: truncate de/d23/d2b/d51/d60/f73 252867 0 2024-03-28T13:05:11.698 INFO:tasks.workunit.client.0.smithi076.stdout:5/388: write d5/d9/d1c/d1d/d22/f33 [291163,61851] 0 2024-03-28T13:05:11.803 INFO:tasks.workunit.client.0.smithi076.stdout:3/327: link d1/d2/f2e d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/f7a 0 2024-03-28T13:05:11.825 INFO:tasks.workunit.client.0.smithi076.stdout:6/450: mknod d6/da/d40/d56/d58/c8d 0 2024-03-28T13:05:11.929 INFO:tasks.workunit.client.0.smithi076.stdout:0/423: mknod db/c98 0 2024-03-28T13:05:12.018 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:05:12.021 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:05:12.118 INFO:tasks.workunit.client.0.smithi076.stdout:1/335: creat d14/d2a/d2e/f7b x:0 0 0 2024-03-28T13:05:12.323 INFO:tasks.workunit.client.0.smithi076.stdout:5/389: creat d5/db/d3f/f8f x:0 0 0 2024-03-28T13:05:12.690 INFO:tasks.workunit.client.0.smithi076.stdout:6/451: creat d6/da/d40/d56/d58/f8e x:0 0 0 2024-03-28T13:05:12.692 INFO:tasks.workunit.client.0.smithi076.stdout:1/336: creat d14/d2a/d2e/d31/d51/f7c x:0 0 0 2024-03-28T13:05:12.692 INFO:tasks.workunit.client.0.smithi076.stdout:1/337: stat d14/d2a/d2e/d31/d49/c75 0 2024-03-28T13:05:12.692 INFO:tasks.workunit.client.0.smithi076.stdout:1/338: dread - d14/d6c/d74/f78 zero size 2024-03-28T13:05:12.699 INFO:tasks.workunit.client.0.smithi076.stdout:1/339: dread d14/d19/f34 [0,4194304] 0 2024-03-28T13:05:12.699 INFO:tasks.workunit.client.0.smithi076.stdout:1/340: chown d14/d2a/d2e/f6a 1814 1 2024-03-28T13:05:12.699 INFO:tasks.workunit.client.0.smithi076.stdout:1/341: chown d14/c1d 7701154 1 2024-03-28T13:05:12.715 INFO:tasks.workunit.client.0.smithi076.stdout:6/452: dread d6/f2f [0,4194304] 0 2024-03-28T13:05:12.715 INFO:tasks.workunit.client.0.smithi076.stdout:6/453: chown d6/c4c 177143 1 2024-03-28T13:05:12.715 INFO:tasks.workunit.client.0.smithi076.stdout:6/454: dread - d6/da/d39/d41/d46/f74 zero size 2024-03-28T13:05:12.759 INFO:tasks.workunit.client.0.smithi076.stdout:6/455: dwrite d6/f24 [0,4194304] 0 2024-03-28T13:05:12.779 INFO:tasks.workunit.client.0.smithi076.stdout:8/368: mknod de/d23/d2b/d5d/d76/c7b 0 2024-03-28T13:05:12.878 INFO:tasks.workunit.client.0.smithi076.stdout:5/390: dread d5/d9/d1c/f70 [0,4194304] 0 2024-03-28T13:05:13.235 INFO:tasks.workunit.client.0.smithi076.stdout:0/424: creat db/dc/d3d/d57/f99 x:0 0 0 2024-03-28T13:05:13.309 INFO:tasks.workunit.client.0.smithi076.stdout:1/342: creat d14/d2a/d2e/d31/d3b/f7d x:0 0 0 2024-03-28T13:05:13.309 INFO:tasks.workunit.client.0.smithi076.stdout:1/343: write d14/d2a/d2e/f3e [1139558,81996] 0 2024-03-28T13:05:13.428 INFO:tasks.workunit.client.0.smithi076.stdout:8/369: dread de/d23/d2b/d5d/d76/d6e/f79 [0,4194304] 0 2024-03-28T13:05:13.487 INFO:tasks.workunit.client.0.smithi076.stdout:5/391: symlink d5/db/d3f/d42/l90 0 2024-03-28T13:05:13.577 INFO:tasks.workunit.client.0.smithi076.stdout:0/425: creat db/dc/f9a x:0 0 0 2024-03-28T13:05:13.577 INFO:tasks.workunit.client.0.smithi076.stdout:1/344: mkdir d14/d2a/d2e/d3c/d7e 0 2024-03-28T13:05:13.577 INFO:tasks.workunit.client.0.smithi076.stdout:0/426: chown db/dc/df/d18/d1d/d75/d51/f8d 802148 1 2024-03-28T13:05:13.577 INFO:tasks.workunit.client.0.smithi076.stdout:0/427: write db/dc/df/f22 [509409,45319] 0 2024-03-28T13:05:13.581 INFO:tasks.workunit.client.0.smithi076.stdout:1/345: dread d14/d2a/d2e/d31/f53 [0,4194304] 0 2024-03-28T13:05:13.603 INFO:tasks.workunit.client.0.smithi076.stdout:1/346: dwrite d14/d2a/d2e/d31/d3b/f7d [0,4194304] 0 2024-03-28T13:05:13.713 INFO:tasks.workunit.client.0.smithi076.stdout:5/392: getdents d5/d9/d4c/d63 0 2024-03-28T13:05:13.761 INFO:tasks.workunit.client.0.smithi076.stdout:0/428: link db/dc/df/d71/c4f db/dc/df/d71/c9b 0 2024-03-28T13:05:13.762 INFO:tasks.workunit.client.0.smithi076.stdout:5/393: dwrite d5/db/d3f/f7d [0,4194304] 0 2024-03-28T13:05:13.762 INFO:tasks.workunit.client.0.smithi076.stdout:5/394: dread - d5/f6c zero size 2024-03-28T13:05:13.962 INFO:tasks.workunit.client.0.smithi076.stdout:0/429: write db/d16/f6f [105560,22671] 0 2024-03-28T13:05:13.995 INFO:tasks.workunit.client.0.smithi076.stdout:9/407: dwrite d9/dd/df/d11/f7e [0,4194304] 0 2024-03-28T13:05:14.176 INFO:tasks.workunit.client.0.smithi076.stdout:5/395: unlink d5/db/d3f/f7d 0 2024-03-28T13:05:14.177 INFO:tasks.workunit.client.0.smithi076.stdout:0/430: mknod db/dc/df/d18/d1d/d75/d51/d60/d92/c9c 0 2024-03-28T13:05:14.177 INFO:tasks.workunit.client.0.smithi076.stdout:0/431: read - db/dc/df/d11/f84 zero size 2024-03-28T13:05:14.365 INFO:tasks.workunit.client.0.smithi076.stdout:9/408: creat d9/dd/f85 x:0 0 0 2024-03-28T13:05:14.906 INFO:tasks.workunit.client.0.smithi076.stdout:7/399: symlink d1/d18/d3c/l8e 0 2024-03-28T13:05:15.043 INFO:tasks.workunit.client.0.smithi076.stdout:1/347: fsync d14/d2a/d2e/d31/d51/f7c 0 2024-03-28T13:05:15.087 INFO:tasks.workunit.client.0.smithi076.stdout:1/348: dwrite d14/f6b [0,4194304] 0 2024-03-28T13:05:15.164 INFO:tasks.workunit.client.0.smithi076.stdout:4/439: rename d0/f15 to d0/d3b/d40/d42/f98 0 2024-03-28T13:05:15.218 INFO:tasks.workunit.client.0.smithi076.stdout:4/440: dwrite d0/d3b/d50/d64/f93 [0,4194304] 0 2024-03-28T13:05:15.218 INFO:tasks.workunit.client.0.smithi076.stdout:4/441: fdatasync d0/d3b/d40/d42/d31/f8f 0 2024-03-28T13:05:15.357 INFO:tasks.workunit.client.0.smithi076.stdout:1/349: unlink d14/c18 0 2024-03-28T13:05:15.532 INFO:tasks.workunit.client.0.smithi076.stdout:4/442: creat d0/d3b/d40/d42/d31/f99 x:0 0 0 2024-03-28T13:05:15.557 INFO:tasks.workunit.client.0.smithi076.stdout:4/443: dread d0/d3b/d50/d64/f93 [0,4194304] 0 2024-03-28T13:05:15.608 INFO:tasks.workunit.client.0.smithi076.stdout:1/350: creat d14/d2a/d2e/d3c/d7e/f7f x:0 0 0 2024-03-28T13:05:15.608 INFO:tasks.workunit.client.0.smithi076.stdout:6/456: write d6/da/d1e/f3d [3993159,113039] 0 2024-03-28T13:05:15.608 INFO:tasks.workunit.client.0.smithi076.stdout:6/457: readlink d6/da/d40/d56/l79 0 2024-03-28T13:05:15.633 INFO:tasks.workunit.client.0.smithi076.stdout:6/458: write d6/da/d40/d56/f6c [2742526,4956] 0 2024-03-28T13:05:15.694 INFO:tasks.workunit.client.0.smithi076.stdout:4/444: link d0/d3b/d50/d64/d89/f18 d0/d3b/f9a 0 2024-03-28T13:05:15.694 INFO:tasks.workunit.client.0.smithi076.stdout:4/445: stat d0/d3b/d50/d64/d89/d68/f71 0 2024-03-28T13:05:15.719 INFO:tasks.workunit.client.0.smithi076.stdout:4/446: write d0/d3b/d40/d42/f65 [376877,109665] 0 2024-03-28T13:05:15.756 INFO:tasks.workunit.client.0.smithi076.stdout:1/351: mknod d14/d2a/d2e/d31/d51/c80 0 2024-03-28T13:05:15.824 INFO:tasks.workunit.client.0.smithi076.stdout:8/370: write de/d23/d2b/d5d/d76/d6e/d7a/f57 [844846,31579] 0 2024-03-28T13:05:16.030 INFO:tasks.workunit.client.0.smithi076.stdout:4/447: creat d0/d3b/d40/d42/d31/d4d/f9b x:0 0 0 2024-03-28T13:05:16.030 INFO:tasks.workunit.client.0.smithi076.stdout:1/352: creat d14/d2a/d2e/d31/d6f/f81 x:0 0 0 2024-03-28T13:05:16.059 INFO:tasks.workunit.client.0.smithi076.stdout:4/448: dwrite d0/f73 [0,4194304] 0 2024-03-28T13:05:16.066 INFO:tasks.workunit.client.0.smithi076.stdout:1/353: dwrite d14/d2a/d2e/d31/d51/f70 [0,4194304] 0 2024-03-28T13:05:16.095 INFO:tasks.workunit.client.0.smithi076.stdout:1/354: dwrite d14/d2a/d2e/d31/d3b/f43 [0,4194304] 0 2024-03-28T13:05:16.220 INFO:tasks.workunit.client.0.smithi076.stdout:4/449: getdents d0/d3b/d40/d42/d47 0 2024-03-28T13:05:16.222 INFO:tasks.workunit.client.0.smithi076.stdout:4/450: write d0/d3b/d40/d42/f98 [266783,59639] 0 2024-03-28T13:05:16.407 INFO:tasks.workunit.client.0.smithi076.stdout:1/355: mknod d14/d19/d20/c82 0 2024-03-28T13:05:16.414 INFO:tasks.workunit.client.0.smithi076.stdout:1/356: dread d14/d2a/d2e/d31/d3b/f4e [0,4194304] 0 2024-03-28T13:05:16.419 INFO:tasks.workunit.client.0.smithi076.stdout:1/357: dread d14/f52 [0,4194304] 0 2024-03-28T13:05:16.419 INFO:tasks.workunit.client.0.smithi076.stdout:1/358: write d14/d2a/d2e/d31/d6f/f81 [778981,96933] 0 2024-03-28T13:05:16.419 INFO:tasks.workunit.client.0.smithi076.stdout:1/359: dread - d14/d19/d20/f56 zero size 2024-03-28T13:05:16.532 INFO:tasks.workunit.client.0.smithi076.stdout:4/451: mknod d0/d20/d7b/d94/c9c 0 2024-03-28T13:05:16.580 INFO:tasks.workunit.client.0.smithi076.stdout:1/360: creat d14/d6c/f83 x:0 0 0 2024-03-28T13:05:16.612 INFO:tasks.workunit.client.0.smithi076.stdout:1/361: dwrite d14/d2a/d2e/f61 [0,4194304] 0 2024-03-28T13:05:16.627 INFO:tasks.workunit.client.0.smithi076.stdout:1/362: dread d14/d2a/d2e/f61 [0,4194304] 0 2024-03-28T13:05:16.630 INFO:tasks.workunit.client.0.smithi076.stdout:1/363: dread d14/f32 [0,4194304] 0 2024-03-28T13:05:16.773 INFO:tasks.workunit.client.0.smithi076.stdout:1/364: dread f8 [0,4194304] 0 2024-03-28T13:05:17.089 INFO:tasks.workunit.client.0.smithi076.stdout:0/432: sync 2024-03-28T13:05:17.089 INFO:tasks.workunit.client.0.smithi076.stdout:2/412: sync 2024-03-28T13:05:17.089 INFO:tasks.workunit.client.0.smithi076.stdout:0/433: stat la 0 2024-03-28T13:05:17.117 INFO:tasks.workunit.client.0.smithi076.stdout:0/434: dwrite db/dc/df/d11/d40/d77/f86 [0,4194304] 0 2024-03-28T13:05:17.154 INFO:tasks.workunit.client.0.smithi076.stdout:1/365: mknod d14/d2a/d2e/d31/d6f/c84 0 2024-03-28T13:05:17.155 INFO:tasks.workunit.client.0.smithi076.stdout:1/366: stat d14/d2a/d3f 0 2024-03-28T13:05:17.703 INFO:tasks.workunit.client.0.smithi076.stdout:9/409: mknod d9/c86 0 2024-03-28T13:05:17.786 INFO:tasks.workunit.client.0.smithi076.stdout:6/459: mkdir d6/da/d40/d56/d8f 0 2024-03-28T13:05:17.880 INFO:tasks.workunit.client.0.smithi076.stdout:9/410: unlink d9/dd/df/d11/f7e 0 2024-03-28T13:05:17.905 INFO:tasks.workunit.client.0.smithi076.stdout:9/411: dread d9/dd/f2e [0,4194304] 0 2024-03-28T13:05:18.035 INFO:tasks.workunit.client.0.smithi076.stdout:3/328: rename d1/d7/d30/l53 to d1/d7/d30/d38/d14/d36/d56/d5b/l7b 0 2024-03-28T13:05:18.035 INFO:tasks.workunit.client.0.smithi076.stdout:6/460: creat d6/da/d40/d56/d84/f90 x:0 0 0 2024-03-28T13:05:18.035 INFO:tasks.workunit.client.0.smithi076.stdout:6/461: chown d6/da/d1e/f50 206152964 1 2024-03-28T13:05:18.049 INFO:tasks.workunit.client.0.smithi076.stdout:6/462: dread d6/f2f [0,4194304] 0 2024-03-28T13:05:18.093 INFO:tasks.workunit.client.0.smithi076.stdout:9/412: creat d9/f87 x:0 0 0 2024-03-28T13:05:18.093 INFO:tasks.workunit.client.0.smithi076.stdout:9/413: truncate d9/d74/f83 360774 0 2024-03-28T13:05:18.093 INFO:tasks.workunit.client.0.smithi076.stdout:9/414: write d9/dd/df/f5e [2778385,90868] 0 2024-03-28T13:05:18.117 INFO:tasks.workunit.client.0.smithi076.stdout:9/415: dwrite d9/da/f7c [0,4194304] 0 2024-03-28T13:05:18.501 INFO:tasks.workunit.client.0.smithi076.stdout:8/371: sync 2024-03-28T13:05:18.501 INFO:tasks.workunit.client.0.smithi076.stdout:8/372: stat de/d23/c20 0 2024-03-28T13:05:18.501 INFO:tasks.workunit.client.0.smithi076.stdout:8/373: readlink de/d4e/l6b 0 2024-03-28T13:05:18.592 INFO:tasks.workunit.client.0.smithi076.stdout:9/416: dread - d9/f67 zero size 2024-03-28T13:05:18.592 INFO:tasks.workunit.client.0.smithi076.stdout:9/417: fsync d9/dd/df/f13 0 2024-03-28T13:05:18.592 INFO:tasks.workunit.client.0.smithi076.stdout:9/418: fsync d9/dd/df/d11/d37/f1c 0 2024-03-28T13:05:18.662 INFO:tasks.workunit.client.0.smithi076.stdout:3/329: symlink d1/d2/l7c 0 2024-03-28T13:05:18.662 INFO:tasks.workunit.client.0.smithi076.stdout:3/330: chown d1/d7/d30/d38/d14/d18/d58/f6f 252017456 1 2024-03-28T13:05:18.662 INFO:tasks.workunit.client.0.smithi076.stdout:3/331: write d1/d7/d30/d38/f35 [536302,84057] 0 2024-03-28T13:05:18.784 INFO:tasks.workunit.client.0.smithi076.stdout:8/374: symlink de/d23/d2b/d5d/d76/d18/d49/l7c 0 2024-03-28T13:05:18.916 INFO:tasks.workunit.client.0.smithi076.stdout:5/396: rename d5/db/df/d61 to d5/d9/d4c/d63/d91 0 2024-03-28T13:05:18.916 INFO:tasks.workunit.client.0.smithi076.stdout:3/332: link d1/d7/d30/d38/d14/d18/f41 d1/d7/d30/d5f/f7d 0 2024-03-28T13:05:18.930 INFO:tasks.workunit.client.0.smithi076.stdout:3/333: dread d1/d7/d30/d38/d14/d18/f24 [0,4194304] 0 2024-03-28T13:05:18.930 INFO:tasks.workunit.client.0.smithi076.stdout:3/334: fsync d1/d7/d30/d38/d14/d36/d56/d5b/f76 0 2024-03-28T13:05:19.051 INFO:tasks.workunit.client.0.smithi076.stdout:8/375: mkdir de/d23/d2b/d58/d7d 0 2024-03-28T13:05:19.219 INFO:tasks.workunit.client.0.smithi076.stdout:7/400: rename d1/d8/d37/f5e to d1/d8/d37/d53/f8f 0 2024-03-28T13:05:19.219 INFO:tasks.workunit.client.0.smithi076.stdout:5/397: rmdir d5/d9/d1c/d1d/d31 39 2024-03-28T13:05:19.219 INFO:tasks.workunit.client.0.smithi076.stdout:5/398: write d5/db/d3f/d42/f58 [3315285,34928] 0 2024-03-28T13:05:19.538 INFO:tasks.workunit.client.0.smithi076.stdout:8/376: sync 2024-03-28T13:05:19.538 INFO:tasks.workunit.client.0.smithi076.stdout:9/419: sync 2024-03-28T13:05:19.728 INFO:tasks.workunit.client.0.smithi076.stdout:4/452: rename d0/d3b/d40/d42/d31/d4d/f4c to d0/d20/d7b/f9d 0 2024-03-28T13:05:19.728 INFO:tasks.workunit.client.0.smithi076.stdout:4/453: stat d0/d3b/d40/d42/d31/d4d/d63/f6a 0 2024-03-28T13:05:19.729 INFO:tasks.workunit.client.0.smithi076.stdout:7/401: symlink d1/d18/d3c/d7b/d7d/l90 0 2024-03-28T13:05:19.729 INFO:tasks.workunit.client.0.smithi076.stdout:7/402: readlink d1/dc/l5d 0 2024-03-28T13:05:19.742 INFO:tasks.workunit.client.0.smithi076.stdout:9/420: symlink d9/dd/df/l88 0 2024-03-28T13:05:19.749 INFO:tasks.workunit.client.0.smithi076.stdout:4/454: dread d0/d3b/d40/d42/d28/f32 [0,4194304] 0 2024-03-28T13:05:19.754 INFO:tasks.workunit.client.0.smithi076.stdout:8/377: dread de/f11 [0,4194304] 0 2024-03-28T13:05:19.768 INFO:tasks.workunit.client.0.smithi076.stdout:9/421: write d9/dd/df/f25 [925427,90222] 0 2024-03-28T13:05:19.768 INFO:tasks.workunit.client.0.smithi076.stdout:9/422: chown d9/da/f68 570 1 2024-03-28T13:05:19.804 INFO:tasks.workunit.client.0.smithi076.stdout:8/378: dwrite de/f1d [4194304,4194304] 0 2024-03-28T13:05:19.804 INFO:tasks.workunit.client.0.smithi076.stdout:9/423: dwrite d9/dd/df/d11/d14/f51 [0,4194304] 0 2024-03-28T13:05:19.944 INFO:tasks.workunit.client.0.smithi076.stdout:5/399: write d5/d9/d1c/f54 [878607,130103] 0 2024-03-28T13:05:19.944 INFO:tasks.workunit.client.0.smithi076.stdout:4/455: mknod d0/d3b/d40/d8d/c9e 0 2024-03-28T13:05:19.977 INFO:tasks.workunit.client.0.smithi076.stdout:8/379: rmdir de/d25/d77 0 2024-03-28T13:05:19.977 INFO:tasks.workunit.client.0.smithi076.stdout:8/380: stat de/f10 0 2024-03-28T13:05:19.977 INFO:tasks.workunit.client.0.smithi076.stdout:8/381: stat de/d23/c20 0 2024-03-28T13:05:19.980 INFO:tasks.workunit.client.0.smithi076.stdout:9/424: link d9/dd/f2e d9/dd/df/d11/d14/d58/f89 0 2024-03-28T13:05:19.981 INFO:tasks.workunit.client.0.smithi076.stdout:9/425: write d9/da/f7c [4812204,127816] 0 2024-03-28T13:05:20.257 INFO:tasks.workunit.client.0.smithi076.stdout:2/413: rename d2/d5/f3d to d2/d5/d7/d3e/f81 0 2024-03-28T13:05:20.257 INFO:tasks.workunit.client.0.smithi076.stdout:5/400: symlink d5/db/d3f/l92 0 2024-03-28T13:05:20.257 INFO:tasks.workunit.client.0.smithi076.stdout:5/401: chown d5/d9/d4c/d63/d91/f6f 84167 1 2024-03-28T13:05:20.279 INFO:tasks.workunit.client.0.smithi076.stdout:4/456: rmdir d0/d3b/d50/d64/d89/d2d/d75/d8e 0 2024-03-28T13:05:20.279 INFO:tasks.workunit.client.0.smithi076.stdout:4/457: write d0/d3b/d50/d64/d89/f5f [872409,94886] 0 2024-03-28T13:05:20.286 INFO:tasks.workunit.client.0.smithi076.stdout:9/426: truncate d9/dd/df/d11/d37/f1d 4717553 0 2024-03-28T13:05:20.286 INFO:tasks.workunit.client.0.smithi076.stdout:9/427: write d9/f67 [384387,53544] 0 2024-03-28T13:05:20.326 INFO:tasks.workunit.client.0.smithi076.stdout:4/458: dwrite d0/d3b/d40/d42/d31/f56 [4194304,4194304] 0 2024-03-28T13:05:20.689 INFO:tasks.workunit.client.0.smithi076.stdout:2/414: rmdir d2/d5/db 39 2024-03-28T13:05:20.689 INFO:tasks.workunit.client.0.smithi076.stdout:5/402: creat d5/d9/d1c/d25/d60/d82/f93 x:0 0 0 2024-03-28T13:05:20.690 INFO:tasks.workunit.client.0.smithi076.stdout:8/382: unlink de/d23/d2b/d5d/d76/c39 0 2024-03-28T13:05:20.690 INFO:tasks.workunit.client.0.smithi076.stdout:9/428: creat d9/dd/df/d11/d37/f8a x:0 0 0 2024-03-28T13:05:20.747 INFO:tasks.workunit.client.0.smithi076.stdout:5/403: dwrite d5/d9/f89 [0,4194304] 0 2024-03-28T13:05:20.756 INFO:tasks.workunit.client.0.smithi076.stdout:0/435: rename db/dc/df/f1a to db/dc/df/d71/d4a/f9d 0 2024-03-28T13:05:21.227 INFO:tasks.workunit.client.0.smithi076.stdout:8/383: truncate de/d23/f1e 1119224 0 2024-03-28T13:05:21.228 INFO:tasks.workunit.client.0.smithi076.stdout:9/429: truncate d9/dd/df/f5e 780547 0 2024-03-28T13:05:21.229 INFO:tasks.workunit.client.0.smithi076.stdout:5/404: unlink d5/d9/d1c/d25/d60/l6b 0 2024-03-28T13:05:21.229 INFO:tasks.workunit.client.0.smithi076.stdout:1/367: rename d14/d2a to d14/d19/d85 0 2024-03-28T13:05:21.255 INFO:tasks.workunit.client.0.smithi076.stdout:5/405: write d5/d9/f40 [2715407,82642] 0 2024-03-28T13:05:21.278 INFO:tasks.workunit.client.0.smithi076.stdout:5/406: read d5/d9/f4d [3838337,101973] 0 2024-03-28T13:05:21.295 INFO:tasks.workunit.client.0.smithi076.stdout:0/436: symlink db/dc/df/d71/l9e 0 2024-03-28T13:05:21.295 INFO:tasks.workunit.client.0.smithi076.stdout:5/407: dread d5/d9/f89 [0,4194304] 0 2024-03-28T13:05:21.406 INFO:tasks.workunit.client.0.smithi076.stdout:2/415: dwrite d2/d5/d7/f23 [0,4194304] 0 2024-03-28T13:05:21.436 INFO:tasks.workunit.client.0.smithi076.stdout:8/384: readlink de/d23/d2b/d5d/d76/l24 0 2024-03-28T13:05:21.436 INFO:tasks.workunit.client.0.smithi076.stdout:8/385: write de/d23/d2b/f30 [684368,20283] 0 2024-03-28T13:05:21.531 INFO:tasks.workunit.client.0.smithi076.stdout:9/430: creat d9/dd/df/d11/d14/d58/d6e/d2a/f8b x:0 0 0 2024-03-28T13:05:21.664 INFO:tasks.workunit.client.0.smithi076.stdout:6/463: rename d6/da/d1e/f31 to d6/da/d39/f91 0 2024-03-28T13:05:21.665 INFO:tasks.workunit.client.0.smithi076.stdout:1/368: mknod d14/d19/d85/d2e/d3c/c86 0 2024-03-28T13:05:21.761 INFO:tasks.workunit.client.0.smithi076.stdout:5/408: mknod d5/db/d3f/d42/d43/c94 0 2024-03-28T13:05:21.832 INFO:tasks.workunit.client.0.smithi076.stdout:2/416: mknod d2/d5/d7/d28/c82 0 2024-03-28T13:05:21.832 INFO:tasks.workunit.client.0.smithi076.stdout:2/417: write d2/d5/d7/f40 [2569604,65708] 0 2024-03-28T13:05:21.957 INFO:tasks.workunit.client.0.smithi076.stdout:8/386: symlink de/d23/d2b/d51/d62/l7e 0 2024-03-28T13:05:21.957 INFO:tasks.workunit.client.0.smithi076.stdout:8/387: write de/d13/d27/f29 [97587,42608] 0 2024-03-28T13:05:21.988 INFO:tasks.workunit.client.0.smithi076.stdout:9/431: creat d9/dd/df/d11/d14/f8c x:0 0 0 2024-03-28T13:05:22.008 INFO:tasks.workunit.client.0.smithi076.stdout:9/432: dread d9/dd/df/f25 [0,4194304] 0 2024-03-28T13:05:22.008 INFO:tasks.workunit.client.0.smithi076.stdout:9/433: chown d9/dd/df/d11/d14/d58/d6e/d2a/f30 44528 1 2024-03-28T13:05:22.008 INFO:tasks.workunit.client.0.smithi076.stdout:9/434: fdatasync d9/dd/df/d11/d14/d58/d6e/d2a/f76 0 2024-03-28T13:05:22.008 INFO:tasks.workunit.client.0.smithi076.stdout:9/435: fdatasync d9/d3c/f32 0 2024-03-28T13:05:22.118 INFO:tasks.workunit.client.0.smithi076.stdout:3/335: rename d1/d7/d30/d38/d14/d18/f41 to d1/d7/d30/d38/d14/d27/f7e 0 2024-03-28T13:05:22.170 INFO:tasks.workunit.client.0.smithi076.stdout:6/464: mknod d6/da/d40/d56/d8f/c92 0 2024-03-28T13:05:22.226 INFO:tasks.workunit.client.0.smithi076.stdout:1/369: mknod d14/d19/d85/d2e/d31/d6f/c87 0 2024-03-28T13:05:22.279 INFO:tasks.workunit.client.0.smithi076.stdout:5/409: creat d5/d9/f95 x:0 0 0 2024-03-28T13:05:22.439 INFO:tasks.workunit.client.0.smithi076.stdout:2/418: rmdir d2/d5/d7/d28 39 2024-03-28T13:05:22.786 INFO:tasks.workunit.client.0.smithi076.stdout:9/436: creat d9/dd/df/d11/d37/f8d x:0 0 0 2024-03-28T13:05:22.788 INFO:tasks.workunit.client.0.smithi076.stdout:7/403: rename d1/f87 to d1/d8/d37/d53/f91 0 2024-03-28T13:05:22.788 INFO:tasks.workunit.client.0.smithi076.stdout:3/336: creat d1/d7/d30/d38/d14/d36/d56/f7f x:0 0 0 2024-03-28T13:05:22.801 INFO:tasks.workunit.client.0.smithi076.stdout:5/410: symlink d5/d9/d4c/l96 0 2024-03-28T13:05:22.801 INFO:tasks.workunit.client.0.smithi076.stdout:6/465: rmdir d6/da/d1e 39 2024-03-28T13:05:22.801 INFO:tasks.workunit.client.0.smithi076.stdout:6/466: fdatasync d6/da/d1e/f60 0 2024-03-28T13:05:22.809 INFO:tasks.workunit.client.0.smithi076.stdout:0/437: dwrite db/f12 [0,4194304] 0 2024-03-28T13:05:22.837 INFO:tasks.workunit.client.0.smithi076.stdout:2/419: mknod d2/d75/c83 0 2024-03-28T13:05:22.998 INFO:tasks.workunit.client.0.smithi076.stdout:4/459: rename d0/d3b/d40/d42/d31/f4a to d0/d3b/d40/d42/d31/d4d/f9f 0 2024-03-28T13:05:22.998 INFO:tasks.workunit.client.0.smithi076.stdout:7/404: symlink d1/l92 0 2024-03-28T13:05:23.025 INFO:tasks.workunit.client.0.smithi076.stdout:3/337: unlink d1/d7/d30/d38/d14/d4a/f64 0 2024-03-28T13:05:23.025 INFO:tasks.workunit.client.0.smithi076.stdout:3/338: chown d1/d7/d30/d38/d14/d36/d56/d5b 2595270 1 2024-03-28T13:05:23.058 INFO:tasks.workunit.client.0.smithi076.stdout:6/467: symlink d6/da/d40/d56/d8f/l93 0 2024-03-28T13:05:23.084 INFO:tasks.workunit.client.0.smithi076.stdout:6/468: dwrite d6/da/d40/d62/f7d [0,4194304] 0 2024-03-28T13:05:23.085 INFO:tasks.workunit.client.0.smithi076.stdout:6/469: chown d6/da/d23/l5c 8 1 2024-03-28T13:05:23.378 INFO:tasks.workunit.client.0.smithi076.stdout:2/420: creat d2/d5/f84 x:0 0 0 2024-03-28T13:05:23.378 INFO:tasks.workunit.client.0.smithi076.stdout:2/421: fsync d2/d5/d4b/d39/d57/f7d 0 2024-03-28T13:05:23.390 INFO:tasks.workunit.client.0.smithi076.stdout:0/438: dread db/dc/df/f33 [0,4194304] 0 2024-03-28T13:05:23.592 INFO:tasks.workunit.client.0.smithi076.stdout:1/370: rename d14/d19/d85/d2e/d31/d51/f7c to d14/d19/d85/d2e/d31/d46/f88 0 2024-03-28T13:05:23.636 INFO:tasks.workunit.client.0.smithi076.stdout:1/371: dwrite f7 [0,4194304] 0 2024-03-28T13:05:23.636 INFO:tasks.workunit.client.0.smithi076.stdout:1/372: write d14/d19/d85/d2e/d3c/d7e/f7f [279689,106507] 0 2024-03-28T13:05:23.665 INFO:tasks.workunit.client.0.smithi076.stdout:7/405: truncate d1/d18/d3c/f20 4991236 0 2024-03-28T13:05:23.666 INFO:tasks.workunit.client.0.smithi076.stdout:7/406: fdatasync d1/d8/f68 0 2024-03-28T13:05:23.725 INFO:tasks.workunit.client.0.smithi076.stdout:5/411: truncate d5/d9/d35/f7f 698591 0 2024-03-28T13:05:23.778 INFO:tasks.workunit.client.0.smithi076.stdout:5/412: dwrite d5/f6 [0,4194304] 0 2024-03-28T13:05:23.778 INFO:tasks.workunit.client.0.smithi076.stdout:5/413: write d5/d9/d1c/d1d/d31/f57 [4318361,78540] 0 2024-03-28T13:05:23.795 INFO:tasks.workunit.client.0.smithi076.stdout:8/388: write de/d13/d27/f34 [669029,75310] 0 2024-03-28T13:05:23.800 INFO:tasks.workunit.client.0.smithi076.stdout:5/414: read d5/d9/f89 [3379180,30931] 0 2024-03-28T13:05:23.812 INFO:tasks.workunit.client.0.smithi076.stdout:5/415: dread d5/db/f12 [0,4194304] 0 2024-03-28T13:05:23.931 INFO:tasks.workunit.client.0.smithi076.stdout:6/470: mknod d6/da/d5f/d6d/c94 0 2024-03-28T13:05:23.931 INFO:tasks.workunit.client.0.smithi076.stdout:6/471: chown d6/f24 13689 1 2024-03-28T13:05:23.977 INFO:tasks.workunit.client.0.smithi076.stdout:2/422: creat d2/d5/d4b/d39/d57/f85 x:0 0 0 2024-03-28T13:05:23.977 INFO:tasks.workunit.client.0.smithi076.stdout:2/423: write d2/d5/d7/fa [1957014,89997] 0 2024-03-28T13:05:24.054 INFO:tasks.workunit.client.0.smithi076.stdout:0/439: rmdir db/dc/df/d18/d1d/d21 39 2024-03-28T13:05:24.211 INFO:tasks.workunit.client.0.smithi076.stdout:9/437: rename d9/dd/df/d11/d14/d58/f89 to d9/d74/f8e 0 2024-03-28T13:05:24.212 INFO:tasks.workunit.client.0.smithi076.stdout:9/438: write d9/da/f68 [607573,99347] 0 2024-03-28T13:05:24.386 INFO:tasks.workunit.client.0.smithi076.stdout:1/373: symlink d14/d19/d85/d2e/d31/d49/l89 0 2024-03-28T13:05:24.389 INFO:tasks.workunit.client.0.smithi076.stdout:1/374: read d14/d19/d85/d2e/d31/d3b/f4e [834921,2670] 0 2024-03-28T13:05:24.389 INFO:tasks.workunit.client.0.smithi076.stdout:1/375: write d14/d19/d85/d2e/d31/d51/f77 [371533,6368] 0 2024-03-28T13:05:24.394 INFO:tasks.workunit.client.0.smithi076.stdout:7/407: creat d1/d18/f93 x:0 0 0 2024-03-28T13:05:24.394 INFO:tasks.workunit.client.0.smithi076.stdout:7/408: fsync d1/d8/f68 0 2024-03-28T13:05:24.501 INFO:tasks.workunit.client.0.smithi076.stdout:3/339: link d1/d7/d30/d38/d14/d18/d3a/f40 d1/d7/d30/d38/d14/d27/f80 0 2024-03-28T13:05:24.682 INFO:tasks.workunit.client.0.smithi076.stdout:8/389: truncate de/d23/d2b/d5d/d76/f4a 874133 0 2024-03-28T13:05:24.682 INFO:tasks.workunit.client.0.smithi076.stdout:5/416: mkdir d5/db/d3f/d97 0 2024-03-28T13:05:24.896 INFO:tasks.workunit.client.0.smithi076.stdout:6/472: mkdir d6/da/d5f/d6d/d95 0 2024-03-28T13:05:24.915 INFO:tasks.workunit.client.0.smithi076.stdout:6/473: write d6/f12 [2337121,78905] 0 2024-03-28T13:05:24.952 INFO:tasks.workunit.client.0.smithi076.stdout:0/440: mkdir db/dc/df/d18/d9f 0 2024-03-28T13:05:25.007 INFO:tasks.workunit.client.0.smithi076.stdout:9/439: mknod d9/d3c/c8f 0 2024-03-28T13:05:25.026 INFO:tasks.workunit.client.0.smithi076.stdout:9/440: dread d9/d74/f8e [0,4194304] 0 2024-03-28T13:05:25.038 INFO:tasks.workunit.client.0.smithi076.stdout:1/376: symlink d14/d19/d85/d2e/d31/d3b/l8a 0 2024-03-28T13:05:25.039 INFO:tasks.workunit.client.0.smithi076.stdout:1/377: chown d14/d19/d85/d2e/d31/d6f/c84 1304024 1 2024-03-28T13:05:25.052 INFO:tasks.workunit.client.0.smithi076.stdout:1/378: dread d14/d19/d85/d2e/d31/d3b/f43 [0,4194304] 0 2024-03-28T13:05:25.225 INFO:tasks.workunit.client.0.smithi076.stdout:7/409: truncate d1/f3d 1123219 0 2024-03-28T13:05:25.254 INFO:tasks.workunit.client.0.smithi076.stdout:3/340: unlink d1/d2/c75 0 2024-03-28T13:05:25.268 INFO:tasks.workunit.client.0.smithi076.stdout:3/341: dread d1/d7/d30/d38/d14/d18/d3a/f59 [0,4194304] 0 2024-03-28T13:05:25.889 INFO:tasks.workunit.client.0.smithi076.stdout:0/441: fsync db/dc/df/f23 0 2024-03-28T13:05:26.006 INFO:tasks.workunit.client.0.smithi076.stdout:9/441: rmdir d9/dd/df/d11/d37 39 2024-03-28T13:05:26.149 INFO:tasks.workunit.client.0.smithi076.stdout:1/379: creat d14/d19/d85/d2e/d3c/d5c/f8b x:0 0 0 2024-03-28T13:05:26.229 INFO:tasks.workunit.client.0.smithi076.stdout:7/410: symlink d1/d18/d2d/l94 0 2024-03-28T13:05:26.229 INFO:tasks.workunit.client.0.smithi076.stdout:7/411: fdatasync d1/f13 0 2024-03-28T13:05:26.313 INFO:tasks.workunit.client.0.smithi076.stdout:7/412: dwrite d1/f56 [0,4194304] 0 2024-03-28T13:05:26.440 INFO:tasks.workunit.client.0.smithi076.stdout:0/442: rename db/dc/d3d/d57/f99 to db/dc/df/d11/fa0 0 2024-03-28T13:05:26.440 INFO:tasks.workunit.client.0.smithi076.stdout:0/443: chown db/dc/df/d18/f4e 496269 1 2024-03-28T13:05:26.525 INFO:tasks.workunit.client.0.smithi076.stdout:9/442: unlink d9/da/f39 0 2024-03-28T13:05:26.583 INFO:tasks.workunit.client.0.smithi076.stdout:1/380: unlink d14/d19/d85/d2e/d31/d3b/f66 0 2024-03-28T13:05:26.583 INFO:tasks.workunit.client.0.smithi076.stdout:1/381: write d14/d19/d85/d2e/d31/d49/f63 [1257570,15541] 0 2024-03-28T13:05:26.753 INFO:tasks.workunit.client.0.smithi076.stdout:6/474: creat d6/da/d40/d56/f96 x:0 0 0 2024-03-28T13:05:26.753 INFO:tasks.workunit.client.0.smithi076.stdout:7/413: creat d1/d18/f95 x:0 0 0 2024-03-28T13:05:26.773 INFO:tasks.workunit.client.0.smithi076.stdout:7/414: write d1/d18/f5c [3293312,93238] 0 2024-03-28T13:05:26.774 INFO:tasks.workunit.client.0.smithi076.stdout:7/415: write d1/d8/f68 [4205174,72545] 0 2024-03-28T13:05:26.918 INFO:tasks.workunit.client.0.smithi076.stdout:9/443: dread d9/d74/f83 [0,4194304] 0 2024-03-28T13:05:27.058 INFO:tasks.workunit.client.0.smithi076.stdout:6/475: creat d6/da/d23/f97 x:0 0 0 2024-03-28T13:05:27.072 INFO:tasks.workunit.client.0.smithi076.stdout:6/476: dread d6/da/d39/d41/f30 [0,4194304] 0 2024-03-28T13:05:27.242 INFO:tasks.workunit.client.0.smithi076.stdout:7/416: getdents d1 0 2024-03-28T13:05:27.261 INFO:tasks.workunit.client.0.smithi076.stdout:2/424: write d2/d5/f12 [2126190,114754] 0 2024-03-28T13:05:27.309 INFO:tasks.workunit.client.0.smithi076.stdout:9/444: dread d9/dd/df/d11/d14/d58/d6e/f70 [0,4194304] 0 2024-03-28T13:05:27.373 INFO:tasks.workunit.client.0.smithi076.stdout:6/477: creat d6/f98 x:0 0 0 2024-03-28T13:05:27.373 INFO:tasks.workunit.client.0.smithi076.stdout:6/478: readlink d6/da/d40/d56/l79 0 2024-03-28T13:05:27.396 INFO:tasks.workunit.client.0.smithi076.stdout:6/479: dwrite d6/da/d5f/f6b [0,4194304] 0 2024-03-28T13:05:27.398 INFO:tasks.workunit.client.0.smithi076.stdout:6/480: dread d6/da/f18 [0,4194304] 0 2024-03-28T13:05:27.539 INFO:tasks.workunit.client.0.smithi076.stdout:7/417: symlink d1/d18/d3c/d48/l96 0 2024-03-28T13:05:27.560 INFO:tasks.workunit.client.0.smithi076.stdout:9/445: getdents d9/dd/df/d11/d14/d58/d6e/d2a 0 2024-03-28T13:05:27.568 INFO:tasks.workunit.client.0.smithi076.stdout:8/390: write de/f11 [565106,44811] 0 2024-03-28T13:05:27.582 INFO:tasks.workunit.client.0.smithi076.stdout:9/446: write d9/da/f7c [3221594,49061] 0 2024-03-28T13:05:27.593 INFO:tasks.workunit.client.0.smithi076.stdout:7/418: dwrite d1/f40 [0,4194304] 0 2024-03-28T13:05:27.593 INFO:tasks.workunit.client.0.smithi076.stdout:7/419: chown d1/d18/d3c/d48/d69/d79 15907018 1 2024-03-28T13:05:27.614 INFO:tasks.workunit.client.0.smithi076.stdout:9/447: dwrite d9/dd/df/d11/d37/f1c [0,4194304] 0 2024-03-28T13:05:27.622 INFO:tasks.workunit.client.0.smithi076.stdout:3/342: mkdir d1/d7/d30/d81 0 2024-03-28T13:05:27.622 INFO:tasks.workunit.client.0.smithi076.stdout:3/343: chown d1/d7/d30/d38/d14/d18/d3a/f40 1715 1 2024-03-28T13:05:27.683 INFO:tasks.workunit.client.0.smithi076.stdout:6/481: dread d6/da/d1e/f47 [0,4194304] 0 2024-03-28T13:05:27.683 INFO:tasks.workunit.client.0.smithi076.stdout:6/482: truncate d6/da/d39/f91 990311 0 2024-03-28T13:05:27.740 INFO:tasks.workunit.client.0.smithi076.stdout:2/425: symlink d2/d5/db/d3b/d42/l86 0 2024-03-28T13:05:27.803 INFO:tasks.workunit.client.0.smithi076.stdout:8/391: dwrite de/f1d [0,4194304] 0 2024-03-28T13:05:27.845 INFO:tasks.workunit.client.0.smithi076.stdout:8/392: dwrite f7 [0,4194304] 0 2024-03-28T13:05:27.845 INFO:tasks.workunit.client.0.smithi076.stdout:8/393: write de/d13/d27/f29 [1432735,3810] 0 2024-03-28T13:05:27.845 INFO:tasks.workunit.client.0.smithi076.stdout:8/394: getdents de/d23/d2b/d58/d7d 0 2024-03-28T13:05:27.869 INFO:tasks.workunit.client.0.smithi076.stdout:8/395: dwrite de/d13/d27/f5e [0,4194304] 0 2024-03-28T13:05:27.964 INFO:tasks.workunit.client.0.smithi076.stdout:9/448: unlink d9/f67 0 2024-03-28T13:05:27.964 INFO:tasks.workunit.client.0.smithi076.stdout:9/449: write d9/dd/df/d11/d14/d58/d6e/d2a/f8b [369761,103132] 0 2024-03-28T13:05:28.138 INFO:tasks.workunit.client.0.smithi076.stdout:6/483: unlink d6/da/d40/d56/d8f/c92 0 2024-03-28T13:05:28.303 INFO:tasks.workunit.client.0.smithi076.stdout:2/426: truncate d2/d5/db/d3b/d3f/f4f 3825119 0 2024-03-28T13:05:28.346 INFO:tasks.workunit.client.0.smithi076.stdout:2/427: dwrite d2/d5/d4b/f1f [0,4194304] 0 2024-03-28T13:05:28.378 INFO:tasks.workunit.client.0.smithi076.stdout:2/428: dwrite d2/f16 [0,4194304] 0 2024-03-28T13:05:28.414 INFO:tasks.workunit.client.0.smithi076.stdout:2/429: dwrite d2/d5/d7/fa [0,4194304] 0 2024-03-28T13:05:28.414 INFO:tasks.workunit.client.0.smithi076.stdout:2/430: stat d2/d5/d7/c26 0 2024-03-28T13:05:28.594 INFO:tasks.workunit.client.0.smithi076.stdout:1/382: link d14/d19/d85/d2e/d31/d3b/f55 d14/d19/d85/d2e/d31/f8c 0 2024-03-28T13:05:28.624 INFO:tasks.workunit.client.0.smithi076.stdout:9/450: mknod d9/dd/df/d11/d37/c90 0 2024-03-28T13:05:28.630 INFO:tasks.workunit.client.0.smithi076.stdout:9/451: read d9/da/f68 [366727,109382] 0 2024-03-28T13:05:28.651 INFO:tasks.workunit.client.0.smithi076.stdout:6/484: rmdir d6/da/d23 39 2024-03-28T13:05:28.707 INFO:tasks.workunit.client.0.smithi076.stdout:2/431: link d2/d5/db/d3b/d42/f6d d2/d5/db/d3b/d60/f87 0 2024-03-28T13:05:28.708 INFO:tasks.workunit.client.0.smithi076.stdout:2/432: fsync d2/d5/d4b/d39/d57/f66 0 2024-03-28T13:05:28.726 INFO:tasks.workunit.client.0.smithi076.stdout:2/433: dread d2/d5/d7/f71 [0,4194304] 0 2024-03-28T13:05:28.838 INFO:tasks.workunit.client.0.smithi076.stdout:1/383: mknod d14/d19/d85/d2e/d31/d51/c8d 0 2024-03-28T13:05:28.890 INFO:tasks.workunit.client.0.smithi076.stdout:9/452: creat d9/f91 x:0 0 0 2024-03-28T13:05:29.054 INFO:tasks.workunit.client.0.smithi076.stdout:2/434: mknod d2/d5/db/c88 0 2024-03-28T13:05:29.233 INFO:tasks.workunit.client.0.smithi076.stdout:4/460: link d0/c3d d0/d3b/d40/d42/ca0 0 2024-03-28T13:05:29.233 INFO:tasks.workunit.client.0.smithi076.stdout:9/453: link d9/dd/df/l88 d9/dd/df/d11/d14/l92 0 2024-03-28T13:05:29.233 INFO:tasks.workunit.client.0.smithi076.stdout:4/461: fdatasync d0/d3b/d40/d42/d47/d69/f7a 0 2024-03-28T13:05:29.233 INFO:tasks.workunit.client.0.smithi076.stdout:9/454: write d9/f91 [579296,22931] 0 2024-03-28T13:05:29.233 INFO:tasks.workunit.client.0.smithi076.stdout:9/455: write d9/dd/df/d11/d14/d58/d6e/f60 [138407,121405] 0 2024-03-28T13:05:29.247 INFO:tasks.workunit.client.0.smithi076.stdout:4/462: dread d0/d3b/d40/d42/d28/f49 [0,4194304] 0 2024-03-28T13:05:29.247 INFO:tasks.workunit.client.0.smithi076.stdout:4/463: chown d0/d3b/l57 17919899 1 2024-03-28T13:05:29.247 INFO:tasks.workunit.client.0.smithi076.stdout:4/464: fdatasync d0/d3b/d40/d42/d31/d5e/f4b 0 2024-03-28T13:05:29.247 INFO:tasks.workunit.client.0.smithi076.stdout:4/465: chown d0/c44 35 1 2024-03-28T13:05:29.265 INFO:tasks.workunit.client.0.smithi076.stdout:7/420: unlink d1/f4 0 2024-03-28T13:05:29.671 INFO:tasks.workunit.client.0.smithi076.stdout:7/421: mknod d1/c97 0 2024-03-28T13:05:29.684 INFO:tasks.workunit.client.0.smithi076.stdout:3/344: rename d1/d7/d30/d38/d14/f26 to d1/d7/d30/d38/d14/d18/f82 0 2024-03-28T13:05:29.878 INFO:tasks.workunit.client.0.smithi076.stdout:0/444: dwrite db/f4b [4194304,4194304] 0 2024-03-28T13:05:29.914 INFO:tasks.workunit.client.0.smithi076.stdout:0/445: dwrite db/dc/df/d18/d1d/d75/d51/d60/f70 [0,4194304] 0 2024-03-28T13:05:30.068 INFO:tasks.workunit.client.0.smithi076.stdout:1/384: rename d14/c1d to d14/d19/d85/d2e/d31/c8e 0 2024-03-28T13:05:30.068 INFO:tasks.workunit.client.0.smithi076.stdout:1/385: chown d14/d19/d85/f38 29117833 1 2024-03-28T13:05:30.083 INFO:tasks.workunit.client.0.smithi076.stdout:1/386: read d14/d19/d85/d2e/f61 [3997014,5590] 0 2024-03-28T13:05:30.096 INFO:tasks.workunit.client.0.smithi076.stdout:1/387: dread d14/d19/d85/d2e/d31/d3b/f3d [0,4194304] 0 2024-03-28T13:05:30.097 INFO:tasks.workunit.client.0.smithi076.stdout:1/388: write d14/d6c/d74/f78 [767128,102262] 0 2024-03-28T13:05:30.102 INFO:tasks.workunit.client.0.smithi076.stdout:1/389: dread d14/d19/d85/d2e/f3e [0,4194304] 0 2024-03-28T13:05:30.128 INFO:tasks.workunit.client.0.smithi076.stdout:7/422: symlink d1/d8/d37/l98 0 2024-03-28T13:05:30.405 INFO:tasks.workunit.client.0.smithi076.stdout:0/446: truncate db/dc/df/d71/d4a/f9d 2272952 0 2024-03-28T13:05:30.503 INFO:tasks.workunit.client.0.smithi076.stdout:1/390: mkdir d14/d19/d85/d2e/d31/d8f 0 2024-03-28T13:05:30.704 INFO:tasks.workunit.client.0.smithi076.stdout:7/423: rmdir d1/d18/d3c/d7b/d7d 39 2024-03-28T13:05:30.704 INFO:tasks.workunit.client.0.smithi076.stdout:2/435: fsync d2/d5/db/d3b/d42/f6d 0 2024-03-28T13:05:30.704 INFO:tasks.workunit.client.0.smithi076.stdout:2/436: chown d2/d5/d7/d8/d21/f48 6972871 1 2024-03-28T13:05:30.846 INFO:tasks.workunit.client.0.smithi076.stdout:0/447: symlink db/dc/df/d71/d4a/d7e/la1 0 2024-03-28T13:05:30.846 INFO:tasks.workunit.client.0.smithi076.stdout:0/448: write db/dc/f66 [340045,30175] 0 2024-03-28T13:05:30.874 INFO:tasks.workunit.client.0.smithi076.stdout:8/396: dwrite de/d23/d2b/d5d/d76/d18/d3c/f44 [0,4194304] 0 2024-03-28T13:05:30.906 INFO:tasks.workunit.client.0.smithi076.stdout:7/424: rename d1/d8/d37/d53/f64 to d1/d8/d37/d53/f99 0 2024-03-28T13:05:30.953 INFO:tasks.workunit.client.0.smithi076.stdout:7/425: dwrite d1/d8/d37/f45 [0,4194304] 0 2024-03-28T13:05:30.953 INFO:tasks.workunit.client.0.smithi076.stdout:7/426: write d1/d8/d37/d53/f91 [351814,6887] 0 2024-03-28T13:05:30.973 INFO:tasks.workunit.client.0.smithi076.stdout:6/485: write d6/f3c [303481,7581] 0 2024-03-28T13:05:31.214 INFO:tasks.workunit.client.0.smithi076.stdout:8/397: mkdir de/d25/d7f 0 2024-03-28T13:05:31.251 INFO:tasks.workunit.client.0.smithi076.stdout:5/417: sync 2024-03-28T13:05:31.305 INFO:tasks.workunit.client.0.smithi076.stdout:5/418: dwrite d5/db/df/f5a [0,4194304] 0 2024-03-28T13:05:31.325 INFO:tasks.workunit.client.0.smithi076.stdout:5/419: write d5/d9/d1c/f6d [3255669,3769] 0 2024-03-28T13:05:31.540 INFO:tasks.workunit.client.0.smithi076.stdout:7/427: getdents d1 0 2024-03-28T13:05:31.746 INFO:tasks.workunit.client.0.smithi076.stdout:8/398: getdents de/d23/d2b/d5d/d76/d18/d3c/d50 0 2024-03-28T13:05:31.746 INFO:tasks.workunit.client.0.smithi076.stdout:8/399: fdatasync de/d23/d2b/d5d/d76/f4a 0 2024-03-28T13:05:31.828 INFO:tasks.workunit.client.0.smithi076.stdout:5/420: mkdir d5/d9/d4c/d98 0 2024-03-28T13:05:31.840 INFO:tasks.workunit.client.0.smithi076.stdout:5/421: dread d5/d9/d1c/d25/f2b [0,4194304] 0 2024-03-28T13:05:31.840 INFO:tasks.workunit.client.0.smithi076.stdout:5/422: fsync d5/d9/d1c/d25/d60/d82/f93 0 2024-03-28T13:05:31.923 INFO:tasks.workunit.client.0.smithi076.stdout:7/428: creat d1/d8/d37/f9a x:0 0 0 2024-03-28T13:05:31.997 INFO:tasks.workunit.client.0.smithi076.stdout:8/400: creat de/d13/f80 x:0 0 0 2024-03-28T13:05:32.386 INFO:tasks.workunit.client.0.smithi076.stdout:9/456: rename d9/dd/df/d11/d14/d58/d6e/d2a/f30 to d9/dd/df/d11/f93 0 2024-03-28T13:05:32.386 INFO:tasks.workunit.client.0.smithi076.stdout:1/391: rename d14 to d14/d19/d85/d3f/d90 22 2024-03-28T13:05:32.386 INFO:tasks.workunit.client.0.smithi076.stdout:1/392: chown d14/d19/d85/d2e/d31/d6f/f81 638181 1 2024-03-28T13:05:32.432 INFO:tasks.workunit.client.0.smithi076.stdout:3/345: dwrite d1/d7/d30/d38/d14/d18/d3a/f40 [0,4194304] 0 2024-03-28T13:05:32.432 INFO:tasks.workunit.client.0.smithi076.stdout:3/346: chown d1/d2 6 1 2024-03-28T13:05:32.653 INFO:tasks.workunit.client.0.smithi076.stdout:4/466: creat d0/d3b/d40/fa1 x:0 0 0 2024-03-28T13:05:32.663 INFO:tasks.workunit.client.0.smithi076.stdout:0/449: write db/f14 [1032062,4926] 0 2024-03-28T13:05:32.880 INFO:tasks.workunit.client.0.smithi076.stdout:7/429: unlink d1/d18/d2d/l63 0 2024-03-28T13:05:32.880 INFO:tasks.workunit.client.0.smithi076.stdout:8/401: link de/d23/d2b/d5d/d76/d6e/d7a/f3b de/d23/d2b/d58/d78/f81 0 2024-03-28T13:05:33.427 INFO:tasks.workunit.client.0.smithi076.stdout:9/457: link d9/dd/f85 d9/dd/df/d11/d14/d58/d6e/f94 0 2024-03-28T13:05:33.555 INFO:tasks.workunit.client.0.smithi076.stdout:1/393: getdents d14/d19/d85/d2e/d31/d6f 0 2024-03-28T13:05:33.577 INFO:tasks.workunit.client.0.smithi076.stdout:1/394: dwrite d14/d19/d85/d3f/f73 [0,4194304] 0 2024-03-28T13:05:33.617 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:24:50.805 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:05:33.623 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:24:50.810 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:05:33.660 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:24:50.774 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:05:33.661 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:24:50.777 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:05:33.664 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:24:50.780 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:05:33.703 INFO:tasks.workunit.client.0.smithi076.stdout:3/347: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/f83 x:0 0 0 2024-03-28T13:05:33.711 INFO:tasks.workunit.client.0.smithi076.stdout:4/467: link d0/d3b/d40/d42/c25 d0/d3b/d40/d42/d31/d4d/d63/ca2 0 2024-03-28T13:05:33.749 INFO:tasks.workunit.client.0.smithi076.stdout:3/348: dwrite d1/d7/d30/d38/d14/d36/f16 [0,4194304] 0 2024-03-28T13:05:33.749 INFO:tasks.workunit.client.0.smithi076.stdout:3/349: write d1/d7/d30/d5f/f7d [216833,52100] 0 2024-03-28T13:05:33.755 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:24:50.942 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:05:33.766 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:24:50.881 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:05:33.771 INFO:tasks.workunit.client.0.smithi076.stdout:3/350: write d1/f1b [1499049,26156] 0 2024-03-28T13:05:33.806 INFO:tasks.workunit.client.0.smithi076.stdout:7/430: dread d1/f7 [0,4194304] 0 2024-03-28T13:05:33.806 INFO:tasks.workunit.client.0.smithi076.stdout:7/431: dread - d1/d8/d37/d53/f99 zero size 2024-03-28T13:05:33.806 INFO:tasks.workunit.client.0.smithi076.stdout:7/432: read - d1/d8/d37/d53/f8f zero size 2024-03-28T13:05:33.806 INFO:tasks.workunit.client.0.smithi076.stdout:7/433: write d1/dc/f1d [1305538,44995] 0 2024-03-28T13:05:33.806 INFO:tasks.workunit.client.0.smithi076.stdout:7/434: dread - d1/f4f zero size 2024-03-28T13:05:33.807 INFO:tasks.workunit.client.0.smithi076.stdout:7/435: dread - d1/d18/d3c/d48/d69/f6d zero size 2024-03-28T13:05:33.807 INFO:tasks.workunit.client.0.smithi076.stdout:7/436: dread - d1/d18/f95 zero size 2024-03-28T13:05:33.848 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:24:50.963 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:05:33.948 INFO:tasks.workunit.client.0.smithi076.stdout:9/458: creat d9/d3c/f95 x:0 0 0 2024-03-28T13:05:33.948 INFO:tasks.workunit.client.0.smithi076.stdout:2/437: rename d2/d5/c10 to d2/d5/db/d3b/d60/c89 0 2024-03-28T13:05:33.948 INFO:tasks.workunit.client.0.smithi076.stdout:9/459: write d9/dd/df/d11/d37/f8a [517483,82636] 0 2024-03-28T13:05:33.971 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:24:51.086 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:05:34.001 INFO:tasks.workunit.client.0.smithi076.stdout:2/438: dwrite d2/d5/db/d3b/d60/f87 [0,4194304] 0 2024-03-28T13:05:34.118 INFO:tasks.workunit.client.0.smithi076.stdout:1/395: mkdir d14/d19/d85/d2e/d91 0 2024-03-28T13:05:34.118 INFO:tasks.workunit.client.0.smithi076.stdout:1/396: chown d14/d19/d20/c25 783 1 2024-03-28T13:05:34.281 INFO:tasks.workunit.client.0.smithi076.stdout:3/351: rmdir d1/d7/d30/d38/d14 39 2024-03-28T13:05:34.346 INFO:tasks.workunit.client.0.smithi076.stdout:9/460: getdents d9/dd/df/d11/d14/d58 0 2024-03-28T13:05:34.605 INFO:tasks.workunit.client.0.smithi076.stdout:1/397: getdents d14/d6c 0 2024-03-28T13:05:35.165 INFO:tasks.workunit.client.0.smithi076.stdout:5/423: sync 2024-03-28T13:05:35.482 INFO:tasks.workunit.client.0.smithi076.stdout:5/424: creat d5/d9/d4c/d98/f99 x:0 0 0 2024-03-28T13:05:35.505 INFO:tasks.workunit.client.0.smithi076.stdout:5/425: write d5/d9/d4c/d63/d91/f6f [4003763,10301] 0 2024-03-28T13:05:35.505 INFO:tasks.workunit.client.0.smithi076.stdout:5/426: write d5/d9/f89 [3249375,15936] 0 2024-03-28T13:05:35.726 INFO:tasks.workunit.client.0.smithi076.stdout:1/398: truncate d14/d19/d85/d3f/f73 2555429 0 2024-03-28T13:05:35.726 INFO:tasks.workunit.client.0.smithi076.stdout:2/439: write d2/d5/db/d3b/d60/f87 [4201456,22843] 0 2024-03-28T13:05:35.748 INFO:tasks.workunit.client.0.smithi076.stdout:2/440: dwrite d2/d5/d7/d8/d21/f69 [0,4194304] 0 2024-03-28T13:05:35.751 INFO:tasks.workunit.client.0.smithi076.stdout:4/468: unlink d0/d3b/d50/d64/f93 0 2024-03-28T13:05:35.754 INFO:tasks.workunit.client.0.smithi076.stdout:2/441: read d2/d5/db/d3b/f4e [223168,93770] 0 2024-03-28T13:05:35.773 INFO:tasks.workunit.client.0.smithi076.stdout:2/442: write d2/f16 [4173666,112272] 0 2024-03-28T13:05:35.814 INFO:tasks.workunit.client.0.smithi076.stdout:2/443: dwrite d2/d5/f12 [0,4194304] 0 2024-03-28T13:05:35.862 INFO:tasks.workunit.client.0.smithi076.stdout:2/444: dwrite d2/d5/d7/d8/d21/f69 [0,4194304] 0 2024-03-28T13:05:36.223 INFO:tasks.workunit.client.0.smithi076.stdout:1/399: readlink lf 0 2024-03-28T13:05:36.223 INFO:tasks.workunit.client.0.smithi076.stdout:1/400: readlink d14/d19/d85/l2d 0 2024-03-28T13:05:36.223 INFO:tasks.workunit.client.0.smithi076.stdout:4/469: unlink d0/d3b/d40/d42/d31/d4d/d63/f7d 0 2024-03-28T13:05:36.225 INFO:tasks.workunit.client.0.smithi076.stdout:5/427: read d5/d9/d1c/d1d/d22/f65 [223336,127897] 0 2024-03-28T13:05:36.226 INFO:tasks.workunit.client.0.smithi076.stdout:5/428: write d5/db/d3f/f8f [267839,13342] 0 2024-03-28T13:05:36.226 INFO:tasks.workunit.client.0.smithi076.stdout:5/429: fdatasync d5/d9/d1c/d1d/d22/f65 0 2024-03-28T13:05:36.354 INFO:tasks.workunit.client.0.smithi076.stdout:1/401: mkdir d14/d19/d85/d2e/d31/d51/d92 0 2024-03-28T13:05:36.398 INFO:tasks.workunit.client.0.smithi076.stdout:1/402: dwrite d14/d19/d85/d2e/d3c/d5c/f8b [0,4194304] 0 2024-03-28T13:05:36.416 INFO:tasks.workunit.client.0.smithi076.stdout:4/470: symlink d0/d3b/d40/d42/d47/d69/la3 0 2024-03-28T13:05:36.594 INFO:tasks.workunit.client.0.smithi076.stdout:1/403: stat d14/f2f 0 2024-03-28T13:05:36.601 INFO:tasks.workunit.client.0.smithi076.stdout:1/404: write d14/d19/d85/d2e/d31/d6f/f81 [234357,48330] 0 2024-03-28T13:05:36.630 INFO:tasks.workunit.client.0.smithi076.stdout:1/405: dwrite d14/d19/d85/d2e/d31/f53 [0,4194304] 0 2024-03-28T13:05:36.816 INFO:tasks.workunit.client.0.smithi076.stdout:6/486: rename d6/da/d39/d41 to d6/d99 0 2024-03-28T13:05:36.899 INFO:tasks.workunit.client.0.smithi076.stdout:1/406: mknod d14/d19/d85/d2e/d31/c93 0 2024-03-28T13:05:36.941 INFO:tasks.workunit.client.0.smithi076.stdout:1/407: dwrite d14/d19/d85/d2e/d31/d3b/f7d [0,4194304] 0 2024-03-28T13:05:36.985 INFO:tasks.workunit.client.0.smithi076.stdout:0/450: rename db/dc/df/d11/d40/d69 to db/dc/df/d11/d40/d77/da2 0 2024-03-28T13:05:37.098 INFO:tasks.workunit.client.0.smithi076.stdout:6/487: symlink d6/da/d5f/d7e/l9a 0 2024-03-28T13:05:37.171 INFO:tasks.workunit.client.0.smithi076.stdout:1/408: link d14/d19/d85/d2e/l5e d14/d19/d85/d2e/d31/d46/l94 0 2024-03-28T13:05:37.279 INFO:tasks.workunit.client.0.smithi076.stdout:8/402: rename de/d23/d2b/d5d/d76/c37 to de/d23/c82 0 2024-03-28T13:05:37.338 INFO:tasks.workunit.client.0.smithi076.stdout:0/451: truncate db/dc/df/f22 1299665 0 2024-03-28T13:05:37.446 INFO:tasks.workunit.client.0.smithi076.stdout:6/488: getdents d6/da/d40/d56/d58 0 2024-03-28T13:05:37.446 INFO:tasks.workunit.client.0.smithi076.stdout:6/489: write d6/da/d40/d56/f96 [997627,17985] 0 2024-03-28T13:05:37.449 INFO:tasks.workunit.client.0.smithi076.stdout:1/409: creat d14/d6c/d74/f95 x:0 0 0 2024-03-28T13:05:37.486 INFO:tasks.workunit.client.0.smithi076.stdout:1/410: dwrite d14/f32 [0,4194304] 0 2024-03-28T13:05:37.513 INFO:tasks.workunit.client.0.smithi076.stdout:7/437: rename d1/d18/l51 to d1/d8/d37/l9b 0 2024-03-28T13:05:37.761 INFO:tasks.workunit.client.0.smithi076.stdout:3/352: sync 2024-03-28T13:05:37.762 INFO:tasks.workunit.client.0.smithi076.stdout:2/445: sync 2024-03-28T13:05:37.766 INFO:tasks.workunit.client.0.smithi076.stdout:1/411: mknod d14/d6c/d74/c96 0 2024-03-28T13:05:37.766 INFO:tasks.workunit.client.0.smithi076.stdout:6/490: creat d6/da/d23/f9b x:0 0 0 2024-03-28T13:05:37.777 INFO:tasks.workunit.client.0.smithi076.stdout:5/430: write d5/d9/d1c/d1d/d22/f68 [169730,17096] 0 2024-03-28T13:05:37.798 INFO:tasks.workunit.client.0.smithi076.stdout:3/353: dwrite d1/d7/d30/d38/d14/d36/f57 [0,4194304] 0 2024-03-28T13:05:37.819 INFO:tasks.workunit.client.0.smithi076.stdout:2/446: dwrite d2/d5/d7/f19 [0,4194304] 0 2024-03-28T13:05:37.819 INFO:tasks.workunit.client.0.smithi076.stdout:2/447: fsync d2/d5/d7/d28/f43 0 2024-03-28T13:05:37.820 INFO:tasks.workunit.client.0.smithi076.stdout:3/354: write d1/d7/d30/d38/d14/d36/f16 [1661979,76012] 0 2024-03-28T13:05:37.835 INFO:tasks.workunit.client.0.smithi076.stdout:9/461: rename d9/c86 to d9/dd/df/d11/d14/d58/c96 0 2024-03-28T13:05:38.148 INFO:tasks.workunit.client.0.smithi076.stdout:7/438: creat d1/d18/d3c/f9c x:0 0 0 2024-03-28T13:05:38.148 INFO:tasks.workunit.client.0.smithi076.stdout:7/439: readlink d1/d8/d37/l9b 0 2024-03-28T13:05:38.148 INFO:tasks.workunit.client.0.smithi076.stdout:1/412: creat d14/f97 x:0 0 0 2024-03-28T13:05:38.158 INFO:tasks.workunit.client.0.smithi076.stdout:7/440: dread d1/d8/d37/f43 [0,4194304] 0 2024-03-28T13:05:38.158 INFO:tasks.workunit.client.0.smithi076.stdout:7/441: read - d1/d18/d2d/f6f zero size 2024-03-28T13:05:38.237 INFO:tasks.workunit.client.0.smithi076.stdout:6/491: truncate d6/da/fe 60688 0 2024-03-28T13:05:38.237 INFO:tasks.workunit.client.0.smithi076.stdout:2/448: symlink d2/d5/db/l8a 0 2024-03-28T13:05:38.237 INFO:tasks.workunit.client.0.smithi076.stdout:5/431: creat d5/f9a x:0 0 0 2024-03-28T13:05:38.253 INFO:tasks.workunit.client.0.smithi076.stdout:6/492: dread d6/da/d1e/f4a [4194304,4194304] 0 2024-03-28T13:05:38.266 INFO:tasks.workunit.client.0.smithi076.stdout:2/449: dwrite d2/d5/d7/fa [0,4194304] 0 2024-03-28T13:05:38.278 INFO:tasks.workunit.client.0.smithi076.stdout:4/471: rename d0/d3b/d40/d42/d31/l41 to d0/d3b/d50/d64/d89/d2d/d75/la4 0 2024-03-28T13:05:38.278 INFO:tasks.workunit.client.0.smithi076.stdout:4/472: readlink d0/d3b/d40/d42/d31/l5a 0 2024-03-28T13:05:38.279 INFO:tasks.workunit.client.0.smithi076.stdout:4/473: write d0/d3b/d40/d42/d31/d5e/f4b [1850692,97285] 0 2024-03-28T13:05:38.282 INFO:tasks.workunit.client.0.smithi076.stdout:9/462: creat d9/dd/df/d11/d14/d58/d6e/f97 x:0 0 0 2024-03-28T13:05:38.282 INFO:tasks.workunit.client.0.smithi076.stdout:9/463: fdatasync d9/d74/f8e 0 2024-03-28T13:05:38.817 INFO:tasks.workunit.client.0.smithi076.stdout:1/413: symlink d14/d19/d85/d2e/d31/d51/l98 0 2024-03-28T13:05:38.960 INFO:tasks.workunit.client.0.smithi076.stdout:5/432: mkdir d5/d9/d4c/d9b 0 2024-03-28T13:05:39.055 INFO:tasks.workunit.client.0.smithi076.stdout:6/493: getdents d6/da/d40/d56 0 2024-03-28T13:05:39.103 INFO:tasks.workunit.client.0.smithi076.stdout:6/494: dwrite d6/f87 [0,4194304] 0 2024-03-28T13:05:39.146 INFO:tasks.workunit.client.0.smithi076.stdout:2/450: creat d2/d5/d7/d28/f8b x:0 0 0 2024-03-28T13:05:39.146 INFO:tasks.workunit.client.0.smithi076.stdout:8/403: rename de/d23/d2b/d5d/d76/d18/l2f to de/d23/d2b/l83 0 2024-03-28T13:05:39.172 INFO:tasks.workunit.client.0.smithi076.stdout:4/474: mknod d0/d3b/d40/d8d/ca5 0 2024-03-28T13:05:39.172 INFO:tasks.workunit.client.0.smithi076.stdout:4/475: fsync d0/d3b/d40/d42/f37 0 2024-03-28T13:05:39.519 INFO:tasks.workunit.client.0.smithi076.stdout:0/452: sync 2024-03-28T13:05:39.601 INFO:tasks.workunit.client.0.smithi076.stdout:5/433: truncate d5/db/d19/f2d 428745 0 2024-03-28T13:05:39.836 INFO:tasks.workunit.client.0.smithi076.stdout:6/495: mknod d6/da/d89/c9c 0 2024-03-28T13:05:39.883 INFO:tasks.workunit.client.0.smithi076.stdout:3/355: rename d1/d7/d30/d5f/f7d to d1/d7/d30/d38/d14/d4a/f84 0 2024-03-28T13:05:39.883 INFO:tasks.workunit.client.0.smithi076.stdout:3/356: chown d1/d7/d30/d38/l49 1071132508 1 2024-03-28T13:05:39.908 INFO:tasks.workunit.client.0.smithi076.stdout:3/357: dwrite d1/d2/f2e [4194304,4194304] 0 2024-03-28T13:05:40.134 INFO:tasks.workunit.client.0.smithi076.stdout:4/476: creat d0/d20/d7b/fa6 x:0 0 0 2024-03-28T13:05:40.310 INFO:tasks.workunit.client.0.smithi076.stdout:5/434: creat d5/d9/d4c/d63/d91/f9c x:0 0 0 2024-03-28T13:05:40.508 INFO:tasks.workunit.client.0.smithi076.stdout:6/496: creat d6/da/d40/d56/d58/f9d x:0 0 0 2024-03-28T13:05:40.601 INFO:tasks.workunit.client.0.smithi076.stdout:7/442: rename d1/dc/ff to d1/d18/d3c/d7b/d7d/f9d 0 2024-03-28T13:05:40.825 INFO:tasks.workunit.client.0.smithi076.stdout:3/358: creat d1/d7/d30/d5f/f85 x:0 0 0 2024-03-28T13:05:40.826 INFO:tasks.workunit.client.0.smithi076.stdout:3/359: stat d1/d7/d30/d38/d14/d18/d58/f6f 0 2024-03-28T13:05:41.010 INFO:tasks.workunit.client.0.smithi076.stdout:5/435: mkdir d5/d9/d1c/d1d/d22/d9d 0 2024-03-28T13:05:41.011 INFO:tasks.workunit.client.0.smithi076.stdout:4/477: truncate d0/d3b/d50/d64/d89/d2d/f3a 2034616 0 2024-03-28T13:05:41.180 INFO:tasks.workunit.client.0.smithi076.stdout:6/497: truncate d6/da/d1e/f50 7450396 0 2024-03-28T13:05:41.181 INFO:tasks.workunit.client.0.smithi076.stdout:7/443: chown d1/d18/d3c/c60 13096 1 2024-03-28T13:05:41.181 INFO:tasks.workunit.client.0.smithi076.stdout:7/444: chown d1/d8/cb 410582 1 2024-03-28T13:05:41.181 INFO:tasks.workunit.client.0.smithi076.stdout:7/445: getdents d1/dc/d8b 0 2024-03-28T13:05:41.251 INFO:tasks.workunit.client.0.smithi076.stdout:0/453: rename db/dc/df/d18/f4e to db/dc/df/d11/fa3 0 2024-03-28T13:05:41.251 INFO:tasks.workunit.client.0.smithi076.stdout:0/454: write db/dc/df/d71/d4a/f72 [1963055,111434] 0 2024-03-28T13:05:41.311 INFO:tasks.workunit.client.0.smithi076.stdout:3/360: creat d1/d7/d30/d38/d14/d36/d56/d5b/f86 x:0 0 0 2024-03-28T13:05:41.311 INFO:tasks.workunit.client.0.smithi076.stdout:3/361: dread - d1/d7/d30/d38/d14/d36/d56/d5b/f86 zero size 2024-03-28T13:05:41.318 INFO:tasks.workunit.client.0.smithi076.stdout:3/362: dread d1/d7/d30/d38/d14/d4a/f5a [0,4194304] 0 2024-03-28T13:05:41.318 INFO:tasks.workunit.client.0.smithi076.stdout:3/363: dread - d1/d7/d30/d5f/f85 zero size 2024-03-28T13:05:41.318 INFO:tasks.workunit.client.0.smithi076.stdout:3/364: chown d1/d7/d30/d38/d14/d36/d56 1 1 2024-03-28T13:05:41.421 INFO:tasks.workunit.client.0.smithi076.stdout:5/436: mknod d5/db/d3f/c9e 0 2024-03-28T13:05:41.421 INFO:tasks.workunit.client.0.smithi076.stdout:5/437: truncate d5/db/f2a 4649645 0 2024-03-28T13:05:41.446 INFO:tasks.workunit.client.0.smithi076.stdout:5/438: dwrite d5/d9/d1c/d1d/d22/f68 [0,4194304] 0 2024-03-28T13:05:41.500 INFO:tasks.workunit.client.0.smithi076.stdout:9/464: write d9/dd/df/d11/d14/f16 [1340085,124890] 0 2024-03-28T13:05:41.515 INFO:tasks.workunit.client.0.smithi076.stdout:9/465: dread d9/dd/df/d11/d14/d58/d6e/d2a/f6d [0,4194304] 0 2024-03-28T13:05:41.554 INFO:tasks.workunit.client.0.smithi076.stdout:6/498: read d6/f52 [606771,117060] 0 2024-03-28T13:05:41.569 INFO:tasks.workunit.client.0.smithi076.stdout:6/499: dread d6/da/d39/f65 [0,4194304] 0 2024-03-28T13:05:41.605 INFO:tasks.workunit.client.0.smithi076.stdout:7/446: unlink d1/f4d 0 2024-03-28T13:05:41.633 INFO:tasks.workunit.client.0.smithi076.stdout:7/447: dwrite d1/d18/d3c/d48/d69/d79/f89 [0,4194304] 0 2024-03-28T13:05:41.685 INFO:tasks.workunit.client.0.smithi076.stdout:0/455: symlink db/dc/df/d18/d1d/d21/la4 0 2024-03-28T13:05:41.782 INFO:tasks.workunit.client.0.smithi076.stdout:3/365: creat d1/d7/d30/d38/d14/d51/f87 x:0 0 0 2024-03-28T13:05:41.845 INFO:tasks.workunit.client.0.smithi076.stdout:5/439: mknod d5/db/d3f/d42/d43/c9f 0 2024-03-28T13:05:41.845 INFO:tasks.workunit.client.0.smithi076.stdout:5/440: write d5/db/df/f26 [10444269,50677] 0 2024-03-28T13:05:41.845 INFO:tasks.workunit.client.0.smithi076.stdout:5/441: getdents d5/d9/d35/d3b/d8e 0 2024-03-28T13:05:41.941 INFO:tasks.workunit.client.0.smithi076.stdout:4/478: link d0/d3b/d40/d42/d31/d4d/f54 d0/d3b/d50/d64/d89/fa7 0 2024-03-28T13:05:41.957 INFO:tasks.workunit.client.0.smithi076.stdout:1/414: sync 2024-03-28T13:05:41.957 INFO:tasks.workunit.client.0.smithi076.stdout:1/415: chown d14/d19/d85/d2e/d31/d51/f60 25422238 1 2024-03-28T13:05:42.048 INFO:tasks.workunit.client.0.smithi076.stdout:6/500: creat d6/da/d40/d56/d8f/f9e x:0 0 0 2024-03-28T13:05:42.087 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:05:42.092 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:05:42.431 INFO:tasks.workunit.client.0.smithi076.stdout:7/448: symlink d1/l9e 0 2024-03-28T13:05:42.445 INFO:tasks.workunit.client.0.smithi076.stdout:7/449: dread d1/d18/d3c/d48/f77 [0,4194304] 0 2024-03-28T13:05:42.471 INFO:tasks.workunit.client.0.smithi076.stdout:8/404: dwrite de/d23/d2b/d5d/d76/d18/f33 [0,4194304] 0 2024-03-28T13:05:42.471 INFO:tasks.workunit.client.0.smithi076.stdout:8/405: fsync de/d23/d2b/d58/d78/f81 0 2024-03-28T13:05:42.471 INFO:tasks.workunit.client.0.smithi076.stdout:8/406: fsync de/d4e/f67 0 2024-03-28T13:05:42.485 INFO:tasks.workunit.client.0.smithi076.stdout:2/451: sync 2024-03-28T13:05:42.494 INFO:tasks.workunit.client.0.smithi076.stdout:0/456: link db/dc/df/d18/d1d/f29 db/dc/df/d18/d9f/fa5 0 2024-03-28T13:05:42.528 INFO:tasks.workunit.client.0.smithi076.stdout:8/407: dwrite fd [0,4194304] 0 2024-03-28T13:05:42.588 INFO:tasks.workunit.client.0.smithi076.stdout:3/366: dread d1/d7/d30/d38/fc [0,4194304] 0 2024-03-28T13:05:42.588 INFO:tasks.workunit.client.0.smithi076.stdout:3/367: dread - d1/d7/d30/d38/d14/d36/d56/d5b/f76 zero size 2024-03-28T13:05:42.710 INFO:tasks.workunit.client.0.smithi076.stdout:5/442: rename d5/d9/d1c/d1d/d31/f87 to d5/db/d3f/fa0 0 2024-03-28T13:05:42.720 INFO:tasks.workunit.client.0.smithi076.stdout:5/443: dread d5/d9/d1c/d25/f2b [0,4194304] 0 2024-03-28T13:05:42.808 INFO:tasks.workunit.client.0.smithi076.stdout:4/479: truncate d0/d3b/d40/d42/f65 2977773 0 2024-03-28T13:05:42.808 INFO:tasks.workunit.client.0.smithi076.stdout:4/480: fdatasync d0/d3b/d40/d42/d31/d4d/f9f 0 2024-03-28T13:05:42.808 INFO:tasks.workunit.client.0.smithi076.stdout:4/481: chown d0/d3b/d50 6427 1 2024-03-28T13:05:42.808 INFO:tasks.workunit.client.0.smithi076.stdout:4/482: write d0/d20/d7b/f9d [4575641,122252] 0 2024-03-28T13:05:42.808 INFO:tasks.workunit.client.0.smithi076.stdout:4/483: chown d0/d3b/d40/d8d 0 1 2024-03-28T13:05:42.831 INFO:tasks.workunit.client.0.smithi076.stdout:4/484: dread d0/d20/f48 [0,4194304] 0 2024-03-28T13:05:42.831 INFO:tasks.workunit.client.0.smithi076.stdout:4/485: chown d0/f1f 3222 1 2024-03-28T13:05:42.936 INFO:tasks.workunit.client.0.smithi076.stdout:6/501: mknod d6/da/d40/c9f 0 2024-03-28T13:05:42.953 INFO:tasks.workunit.client.0.smithi076.stdout:6/502: dread d6/da/d40/d62/f7d [0,4194304] 0 2024-03-28T13:05:43.054 INFO:tasks.workunit.client.0.smithi076.stdout:7/450: truncate d1/d8/d37/f45 77825 0 2024-03-28T13:05:43.077 INFO:tasks.workunit.client.0.smithi076.stdout:7/451: dwrite d1/d18/d3c/d48/f8d [0,4194304] 0 2024-03-28T13:05:43.078 INFO:tasks.workunit.client.0.smithi076.stdout:7/452: truncate d1/d18/d3c/d7b/d84/f88 330656 0 2024-03-28T13:05:43.201 INFO:tasks.workunit.client.0.smithi076.stdout:2/452: creat d2/d5/d7/f8c x:0 0 0 2024-03-28T13:05:43.201 INFO:tasks.workunit.client.0.smithi076.stdout:2/453: write d2/d5/d7/d3e/f81 [6005823,33272] 0 2024-03-28T13:05:43.201 INFO:tasks.workunit.client.0.smithi076.stdout:2/454: readlink d2/d5/d7/d8/l2f 0 2024-03-28T13:05:43.217 INFO:tasks.workunit.client.0.smithi076.stdout:2/455: dread d2/d5/d7/f71 [0,4194304] 0 2024-03-28T13:05:43.217 INFO:tasks.workunit.client.0.smithi076.stdout:2/456: chown d2/d5/db/d3b/d3f/f4f 3913 1 2024-03-28T13:05:43.281 INFO:tasks.workunit.client.0.smithi076.stdout:0/457: rmdir db/dc/df/d18/d1d/d75/d51 39 2024-03-28T13:05:43.392 INFO:tasks.workunit.client.0.smithi076.stdout:8/408: symlink de/d13/l84 0 2024-03-28T13:05:43.392 INFO:tasks.workunit.client.0.smithi076.stdout:8/409: fsync de/f11 0 2024-03-28T13:05:43.392 INFO:tasks.workunit.client.0.smithi076.stdout:8/410: chown de/f10 636 1 2024-03-28T13:05:43.392 INFO:tasks.workunit.client.0.smithi076.stdout:8/411: getdents de/d23/d2b/d5d/d76/d18/d3c/d50 0 2024-03-28T13:05:43.409 INFO:tasks.workunit.client.0.smithi076.stdout:8/412: dread de/f1d [0,4194304] 0 2024-03-28T13:05:43.409 INFO:tasks.workunit.client.0.smithi076.stdout:8/413: read - de/d4e/f67 zero size 2024-03-28T13:05:43.463 INFO:tasks.workunit.client.0.smithi076.stdout:8/414: dwrite de/d25/f36 [4194304,4194304] 0 2024-03-28T13:05:43.463 INFO:tasks.workunit.client.0.smithi076.stdout:8/415: chown de/d13/d27/f5e 48035 1 2024-03-28T13:05:43.463 INFO:tasks.workunit.client.0.smithi076.stdout:8/416: write de/d13/d27/f5a [976216,21997] 0 2024-03-28T13:05:43.463 INFO:tasks.workunit.client.0.smithi076.stdout:8/417: write de/d23/d2b/d5d/d76/f4a [898912,193] 0 2024-03-28T13:05:43.603 INFO:tasks.workunit.client.0.smithi076.stdout:3/368: creat d1/d7/d30/d60/f88 x:0 0 0 2024-03-28T13:05:43.603 INFO:tasks.workunit.client.0.smithi076.stdout:3/369: chown d1/d2/l13 114378259 1 2024-03-28T13:05:43.657 INFO:tasks.workunit.client.0.smithi076.stdout:5/444: mknod d5/d9/d4c/d9b/ca1 0 2024-03-28T13:05:43.856 INFO:tasks.workunit.client.0.smithi076.stdout:4/486: rename d0/d3b/d50/d64/d89/d68 to d0/d3b/d50/da8 0 2024-03-28T13:05:43.914 INFO:tasks.workunit.client.0.smithi076.stdout:9/466: dread - d9/f6b zero size 2024-03-28T13:05:44.061 INFO:tasks.workunit.client.0.smithi076.stdout:2/457: mkdir d2/d5/db/d3b/d5a/d8d 0 2024-03-28T13:05:44.062 INFO:tasks.workunit.client.0.smithi076.stdout:2/458: write d2/d5/d7/f23 [4557838,862] 0 2024-03-28T13:05:44.080 INFO:tasks.workunit.client.0.smithi076.stdout:0/458: truncate db/dc/df/f44 767347 0 2024-03-28T13:05:44.528 INFO:tasks.workunit.client.0.smithi076.stdout:8/418: truncate de/f3f 1951575 0 2024-03-28T13:05:44.528 INFO:tasks.workunit.client.0.smithi076.stdout:3/370: mkdir d1/d7/d30/d38/d14/d36/d56/d5b/d89 0 2024-03-28T13:05:44.528 INFO:tasks.workunit.client.0.smithi076.stdout:3/371: write d1/d7/d30/d38/d14/d36/d56/f7f [867936,7317] 0 2024-03-28T13:05:44.532 INFO:tasks.workunit.client.0.smithi076.stdout:3/372: dread d1/d7/d30/d38/fc [0,4194304] 0 2024-03-28T13:05:44.582 INFO:tasks.workunit.client.0.smithi076.stdout:5/445: rename d5/db/df/f26 to d5/db/df/fa2 0 2024-03-28T13:05:44.582 INFO:tasks.workunit.client.0.smithi076.stdout:6/503: rename d6/da/d1e/f2b to d6/da/d40/d56/d8f/fa0 0 2024-03-28T13:05:44.583 INFO:tasks.workunit.client.0.smithi076.stdout:6/504: chown d6/da/d23/c83 381868 1 2024-03-28T13:05:44.606 INFO:tasks.workunit.client.0.smithi076.stdout:4/487: mkdir d0/d3b/d40/d42/d47/d69/da9 0 2024-03-28T13:05:44.952 INFO:tasks.workunit.client.0.smithi076.stdout:2/459: creat d2/d5/db/d3b/d3f/d79/f8e x:0 0 0 2024-03-28T13:05:45.016 INFO:tasks.workunit.client.0.smithi076.stdout:0/459: dread db/dc/df/d18/d1d/d75/f96 [0,4194304] 0 2024-03-28T13:05:45.016 INFO:tasks.workunit.client.0.smithi076.stdout:0/460: fdatasync db/dc/df/d11/fa3 0 2024-03-28T13:05:45.027 INFO:tasks.workunit.client.0.smithi076.stdout:0/461: dread db/f14 [0,4194304] 0 2024-03-28T13:05:45.049 INFO:tasks.workunit.client.0.smithi076.stdout:0/462: read db/dc/fe [1069249,63237] 0 2024-03-28T13:05:45.049 INFO:tasks.workunit.client.0.smithi076.stdout:0/463: getdents db/dc/df/d11/d40/d77/d87/d88 0 2024-03-28T13:05:45.268 INFO:tasks.workunit.client.0.smithi076.stdout:8/419: rmdir de/d23/d2b/d5d/d76/d18/d49 39 2024-03-28T13:05:45.268 INFO:tasks.workunit.client.0.smithi076.stdout:3/373: creat d1/d7/d30/d38/d14/d51/f8a x:0 0 0 2024-03-28T13:05:45.268 INFO:tasks.workunit.client.0.smithi076.stdout:3/374: getdents d1/d7/d30/d38/d14/d27/d69 0 2024-03-28T13:05:45.343 INFO:tasks.workunit.client.0.smithi076.stdout:5/446: mknod d5/db/df/ca3 0 2024-03-28T13:05:45.398 INFO:tasks.workunit.client.0.smithi076.stdout:5/447: dwrite d5/d9/d4c/d98/f99 [0,4194304] 0 2024-03-28T13:05:45.488 INFO:tasks.workunit.client.0.smithi076.stdout:6/505: creat d6/da/d89/fa1 x:0 0 0 2024-03-28T13:05:45.787 INFO:tasks.workunit.client.0.smithi076.stdout:4/488: unlink d0/d3b/d40/d42/d47/d69/f7a 0 2024-03-28T13:05:45.787 INFO:tasks.workunit.client.0.smithi076.stdout:2/460: symlink d2/d5/d7/dd/l8f 0 2024-03-28T13:05:45.787 INFO:tasks.workunit.client.0.smithi076.stdout:4/489: write d0/d20/d7b/fa6 [955762,98061] 0 2024-03-28T13:05:45.804 INFO:tasks.workunit.client.0.smithi076.stdout:8/420: creat de/d25/f85 x:0 0 0 2024-03-28T13:05:45.828 INFO:tasks.workunit.client.0.smithi076.stdout:3/375: truncate d1/f61 1107460 0 2024-03-28T13:05:45.828 INFO:tasks.workunit.client.0.smithi076.stdout:1/416: write f8 [2937199,124245] 0 2024-03-28T13:05:45.841 INFO:tasks.workunit.client.0.smithi076.stdout:1/417: write d14/d19/d85/d2e/d31/d3b/f43 [2537828,94319] 0 2024-03-28T13:05:45.863 INFO:tasks.workunit.client.0.smithi076.stdout:1/418: write f5 [6898055,8082] 0 2024-03-28T13:05:45.892 INFO:tasks.workunit.client.0.smithi076.stdout:3/376: dwrite d1/d7/d30/d38/d14/d18/d58/f6f [0,4194304] 0 2024-03-28T13:05:45.908 INFO:tasks.workunit.client.0.smithi076.stdout:3/377: dread d1/d7/d30/d38/d14/d18/d3a/f59 [0,4194304] 0 2024-03-28T13:05:45.908 INFO:tasks.workunit.client.0.smithi076.stdout:3/378: fdatasync d1/d7/d30/d38/f35 0 2024-03-28T13:05:46.162 INFO:tasks.workunit.client.0.smithi076.stdout:6/506: mknod d6/da/d40/d62/ca2 0 2024-03-28T13:05:46.196 INFO:tasks.workunit.client.0.smithi076.stdout:6/507: dwrite d6/f87 [0,4194304] 0 2024-03-28T13:05:46.206 INFO:tasks.workunit.client.0.smithi076.stdout:4/490: mknod d0/d3b/d40/d42/d47/d69/da9/caa 0 2024-03-28T13:05:46.213 INFO:tasks.workunit.client.0.smithi076.stdout:4/491: dread d0/d3b/d40/d42/d31/d4d/f9f [0,4194304] 0 2024-03-28T13:05:46.213 INFO:tasks.workunit.client.0.smithi076.stdout:4/492: stat d0/d3b/d50/l76 0 2024-03-28T13:05:46.214 INFO:tasks.workunit.client.0.smithi076.stdout:4/493: read d0/d3b/d40/d42/d31/d4d/f54 [856738,121842] 0 2024-03-28T13:05:46.250 INFO:tasks.workunit.client.0.smithi076.stdout:0/464: mkdir db/da6 0 2024-03-28T13:05:46.301 INFO:tasks.workunit.client.0.smithi076.stdout:8/421: mknod de/d4e/c86 0 2024-03-28T13:05:46.418 INFO:tasks.workunit.client.0.smithi076.stdout:1/419: rmdir d14/d19/d85/d2e/d31/d49 39 2024-03-28T13:05:46.604 INFO:tasks.workunit.client.0.smithi076.stdout:3/379: creat d1/d7/d30/d38/d14/d36/d56/f8b x:0 0 0 2024-03-28T13:05:46.647 INFO:tasks.workunit.client.0.smithi076.stdout:4/494: symlink d0/d20/lab 0 2024-03-28T13:05:46.647 INFO:tasks.workunit.client.0.smithi076.stdout:4/495: chown d0/d20/f87 265768806 1 2024-03-28T13:05:46.664 INFO:tasks.workunit.client.0.smithi076.stdout:4/496: dread d0/d3b/d50/da8/f71 [4194304,4194304] 0 2024-03-28T13:05:46.664 INFO:tasks.workunit.client.0.smithi076.stdout:4/497: stat d0/d3b/d40/d42/d31/d4d 0 2024-03-28T13:05:46.819 INFO:tasks.workunit.client.0.smithi076.stdout:0/465: mknod db/dc/df/d18/d1d/d75/ca7 0 2024-03-28T13:05:46.819 INFO:tasks.workunit.client.0.smithi076.stdout:8/422: mkdir de/d23/d2b/d5d/d76/d6e/d87 0 2024-03-28T13:05:46.879 INFO:tasks.workunit.client.0.smithi076.stdout:1/420: link d14/d19/d85/d2e/f61 d14/d19/d85/d2e/d3c/d7e/f99 0 2024-03-28T13:05:46.932 INFO:tasks.workunit.client.0.smithi076.stdout:3/380: creat d1/d7/d30/d38/d14/f8c x:0 0 0 2024-03-28T13:05:47.077 INFO:tasks.workunit.client.0.smithi076.stdout:0/466: mkdir db/dc/df/d18/d1d/d75/d51/d60/d89/da8 0 2024-03-28T13:05:47.077 INFO:tasks.workunit.client.0.smithi076.stdout:0/467: fdatasync db/dc/df/f22 0 2024-03-28T13:05:47.121 INFO:tasks.workunit.client.0.smithi076.stdout:8/423: creat de/d4e/f88 x:0 0 0 2024-03-28T13:05:47.417 INFO:tasks.workunit.client.0.smithi076.stdout:8/424: mkdir de/d23/d2b/d51/d60/d89 0 2024-03-28T13:05:48.179 INFO:tasks.workunit.client.0.smithi076.stdout:9/467: sync 2024-03-28T13:05:48.180 INFO:tasks.workunit.client.0.smithi076.stdout:9/468: write d9/da/f7c [882539,34509] 0 2024-03-28T13:05:48.201 INFO:tasks.workunit.client.0.smithi076.stdout:9/469: dwrite d9/da/f68 [0,4194304] 0 2024-03-28T13:05:48.201 INFO:tasks.workunit.client.0.smithi076.stdout:9/470: chown d9/f91 3302 1 2024-03-28T13:05:48.201 INFO:tasks.workunit.client.0.smithi076.stdout:3/381: truncate d1/d7/d30/d38/d14/d36/f57 453745 0 2024-03-28T13:05:48.215 INFO:tasks.workunit.client.0.smithi076.stdout:8/425: mkdir de/d23/d2b/d5d/d76/d6e/d8a 0 2024-03-28T13:05:48.234 INFO:tasks.workunit.client.0.smithi076.stdout:3/382: dwrite d1/d7/f17 [0,4194304] 0 2024-03-28T13:05:48.240 INFO:tasks.workunit.client.0.smithi076.stdout:8/426: read de/f10 [189545,92275] 0 2024-03-28T13:05:48.241 INFO:tasks.workunit.client.0.smithi076.stdout:3/383: fdatasync d1/d7/d30/d38/d14/d36/d56/f7f 0 2024-03-28T13:05:48.265 INFO:tasks.workunit.client.0.smithi076.stdout:3/384: write d1/d7/f17 [4090827,84473] 0 2024-03-28T13:05:48.401 INFO:tasks.workunit.client.0.smithi076.stdout:5/448: mkdir d5/d9/d4c/da4 0 2024-03-28T13:05:48.663 INFO:tasks.workunit.client.0.smithi076.stdout:8/427: mkdir de/d23/d2b/d51/d62/d8b 0 2024-03-28T13:05:48.663 INFO:tasks.workunit.client.0.smithi076.stdout:8/428: truncate de/d23/d2b/d5d/d76/d18/f5c 592048 0 2024-03-28T13:05:48.860 INFO:tasks.workunit.client.0.smithi076.stdout:5/449: getdents d5/d9/d1c/d25 0 2024-03-28T13:05:48.860 INFO:tasks.workunit.client.0.smithi076.stdout:5/450: readlink d5/db/d19/d34/l7e 0 2024-03-28T13:05:48.910 INFO:tasks.workunit.client.0.smithi076.stdout:8/429: mkdir de/d13/d27/d8c 0 2024-03-28T13:05:48.933 INFO:tasks.workunit.client.0.smithi076.stdout:8/430: write de/d4e/f4f [357481,27854] 0 2024-03-28T13:05:49.153 INFO:tasks.workunit.client.0.smithi076.stdout:9/471: symlink d9/l98 0 2024-03-28T13:05:49.322 INFO:tasks.workunit.client.0.smithi076.stdout:4/498: rmdir d0/d3b/d50 39 2024-03-28T13:05:49.322 INFO:tasks.workunit.client.0.smithi076.stdout:0/468: write db/dc/df/f19 [5028269,125005] 0 2024-03-28T13:05:49.323 INFO:tasks.workunit.client.0.smithi076.stdout:7/453: rename d1/d18/c29 to d1/dc/d8b/c9f 0 2024-03-28T13:05:49.397 INFO:tasks.workunit.client.0.smithi076.stdout:1/421: dwrite f12 [4194304,4194304] 0 2024-03-28T13:05:49.418 INFO:tasks.workunit.client.0.smithi076.stdout:1/422: dread d14/d19/d85/d2e/d31/f39 [0,4194304] 0 2024-03-28T13:05:49.457 INFO:tasks.workunit.client.0.smithi076.stdout:1/423: dwrite d14/d19/d85/f38 [0,4194304] 0 2024-03-28T13:05:49.508 INFO:tasks.workunit.client.0.smithi076.stdout:8/431: truncate de/d23/d2b/d51/d60/f73 1286111 0 2024-03-28T13:05:49.514 INFO:tasks.workunit.client.0.smithi076.stdout:8/432: write de/d13/d27/f34 [193982,4436] 0 2024-03-28T13:05:49.514 INFO:tasks.workunit.client.0.smithi076.stdout:8/433: chown de/d13/d27/f29 109 1 2024-03-28T13:05:49.787 INFO:tasks.workunit.client.0.smithi076.stdout:9/472: symlink d9/dd/df/d11/d14/l99 0 2024-03-28T13:05:49.787 INFO:tasks.workunit.client.0.smithi076.stdout:9/473: fdatasync d9/dd/df/d11/d14/d58/d6e/f94 0 2024-03-28T13:05:49.787 INFO:tasks.workunit.client.0.smithi076.stdout:9/474: fsync d9/dd/df/d11/d14/f7f 0 2024-03-28T13:05:50.125 INFO:tasks.workunit.client.0.smithi076.stdout:3/385: dwrite d1/d7/d30/f43 [4194304,4194304] 0 2024-03-28T13:05:50.179 INFO:tasks.workunit.client.0.smithi076.stdout:4/499: mknod d0/d3b/d50/d64/d89/d2d/cac 0 2024-03-28T13:05:50.179 INFO:tasks.workunit.client.0.smithi076.stdout:4/500: chown d0/d3b/d50/d64/d89 88920479 1 2024-03-28T13:05:50.328 INFO:tasks.workunit.client.0.smithi076.stdout:0/469: mknod db/dc/df/d11/d40/d77/da2/ca9 0 2024-03-28T13:05:50.328 INFO:tasks.workunit.client.0.smithi076.stdout:2/461: rename d2/d5/db/c88 to d2/d5/db/d3b/d3f/c90 0 2024-03-28T13:05:50.332 INFO:tasks.workunit.client.0.smithi076.stdout:0/470: dread db/dc/f66 [0,4194304] 0 2024-03-28T13:05:50.333 INFO:tasks.workunit.client.0.smithi076.stdout:0/471: read db/dc/df/d71/f6a [1158316,48263] 0 2024-03-28T13:05:50.333 INFO:tasks.workunit.client.0.smithi076.stdout:0/472: write db/dc/df/d11/f3b [1347804,38223] 0 2024-03-28T13:05:50.384 INFO:tasks.workunit.client.0.smithi076.stdout:2/462: dwrite d2/d5/d7/d8/f6a [0,4194304] 0 2024-03-28T13:05:50.558 INFO:tasks.workunit.client.0.smithi076.stdout:1/424: mknod d14/d6c/d74/c9a 0 2024-03-28T13:05:50.638 INFO:tasks.workunit.client.0.smithi076.stdout:8/434: unlink de/d4e/f88 0 2024-03-28T13:05:50.805 INFO:tasks.workunit.client.0.smithi076.stdout:4/501: getdents d0/d3b/d50/d64 0 2024-03-28T13:05:50.912 INFO:tasks.workunit.client.0.smithi076.stdout:6/508: rename d6/l19 to d6/da/d40/d62/la3 0 2024-03-28T13:05:51.042 INFO:tasks.workunit.client.0.smithi076.stdout:0/473: creat db/dc/faa x:0 0 0 2024-03-28T13:05:51.042 INFO:tasks.workunit.client.0.smithi076.stdout:0/474: dread - db/dc/df/d11/d40/d77/da2/f95 zero size 2024-03-28T13:05:51.084 INFO:tasks.workunit.client.0.smithi076.stdout:7/454: mkdir d1/d18/d3c/da0 0 2024-03-28T13:05:51.084 INFO:tasks.workunit.client.0.smithi076.stdout:7/455: write d1/d18/d2d/f6f [400052,89470] 0 2024-03-28T13:05:51.197 INFO:tasks.workunit.client.0.smithi076.stdout:2/463: creat d2/d75/f91 x:0 0 0 2024-03-28T13:05:51.258 INFO:tasks.workunit.client.0.smithi076.stdout:8/435: unlink de/d23/d2b/d5d/d76/d6e/d7a/f57 0 2024-03-28T13:05:51.375 INFO:tasks.workunit.client.0.smithi076.stdout:4/502: creat d0/d20/d7f/fad x:0 0 0 2024-03-28T13:05:51.451 INFO:tasks.workunit.client.0.smithi076.stdout:5/451: rename d5/db/d19/l5e to d5/d9/d35/d3b/la5 0 2024-03-28T13:05:51.517 INFO:tasks.workunit.client.0.smithi076.stdout:6/509: getdents d6/da/d40 0 2024-03-28T13:05:51.606 INFO:tasks.workunit.client.0.smithi076.stdout:7/456: creat d1/fa1 x:0 0 0 2024-03-28T13:05:51.649 INFO:tasks.workunit.client.0.smithi076.stdout:2/464: mkdir d2/d92 0 2024-03-28T13:05:51.691 INFO:tasks.workunit.client.0.smithi076.stdout:2/465: dwrite d2/d5/d7/d8/f6a [0,4194304] 0 2024-03-28T13:05:51.691 INFO:tasks.workunit.client.0.smithi076.stdout:2/466: chown d2/d5/d7/f71 542488 1 2024-03-28T13:05:51.703 INFO:tasks.workunit.client.0.smithi076.stdout:2/467: dread d2/d5/d7/f19 [0,4194304] 0 2024-03-28T13:05:51.712 INFO:tasks.workunit.client.0.smithi076.stdout:9/475: mknod d9/dd/df/c9a 0 2024-03-28T13:05:51.737 INFO:tasks.workunit.client.0.smithi076.stdout:8/436: truncate fd 166908 0 2024-03-28T13:05:51.737 INFO:tasks.workunit.client.0.smithi076.stdout:8/437: write de/d4e/d54/f64 [1187135,129598] 0 2024-03-28T13:05:52.018 INFO:tasks.workunit.client.0.smithi076.stdout:4/503: getdents d0/d3b/d40/d42/d31 0 2024-03-28T13:05:52.062 INFO:tasks.workunit.client.0.smithi076.stdout:5/452: truncate d5/d9/d4c/d63/d91/f6f 491293 0 2024-03-28T13:05:52.128 INFO:tasks.workunit.client.0.smithi076.stdout:6/510: mkdir d6/da/d40/d56/da4 0 2024-03-28T13:05:52.129 INFO:tasks.workunit.client.0.smithi076.stdout:6/511: read d6/da/d39/f3b [670624,76337] 0 2024-03-28T13:05:52.248 INFO:tasks.workunit.client.0.smithi076.stdout:7/457: creat d1/d18/d3c/d8c/fa2 x:0 0 0 2024-03-28T13:05:52.249 INFO:tasks.workunit.client.0.smithi076.stdout:7/458: fsync d1/dc/f32 0 2024-03-28T13:05:52.249 INFO:tasks.workunit.client.0.smithi076.stdout:7/459: fsync d1/d8/d37/d53/f91 0 2024-03-28T13:05:52.271 INFO:tasks.workunit.client.0.smithi076.stdout:2/468: truncate d2/d5/f5f 562483 0 2024-03-28T13:05:52.273 INFO:tasks.workunit.client.0.smithi076.stdout:7/460: read d1/dc/f2b [3063478,100175] 0 2024-03-28T13:05:52.273 INFO:tasks.workunit.client.0.smithi076.stdout:7/461: readlink d1/d8/l15 0 2024-03-28T13:05:52.286 INFO:tasks.workunit.client.0.smithi076.stdout:2/469: write d2/d5/d7/f19 [666073,118940] 0 2024-03-28T13:05:52.300 INFO:tasks.workunit.client.0.smithi076.stdout:7/462: dwrite d1/d18/d3c/d8c/fa2 [0,4194304] 0 2024-03-28T13:05:52.340 INFO:tasks.workunit.client.0.smithi076.stdout:9/476: truncate d9/dd/d48/f59 7989213 0 2024-03-28T13:05:52.340 INFO:tasks.workunit.client.0.smithi076.stdout:9/477: chown d9/dd/df/d11/d37/l81 341239440 1 2024-03-28T13:05:52.382 INFO:tasks.workunit.client.0.smithi076.stdout:8/438: dread de/d23/d2b/d5d/d76/f21 [0,4194304] 0 2024-03-28T13:05:52.469 INFO:tasks.workunit.client.0.smithi076.stdout:4/504: symlink d0/d3b/d50/d64/lae 0 2024-03-28T13:05:52.495 INFO:tasks.workunit.client.0.smithi076.stdout:4/505: dread d0/d3b/d40/d42/f3f [0,4194304] 0 2024-03-28T13:05:52.610 INFO:tasks.workunit.client.0.smithi076.stdout:3/386: rename d1/d7/d30/d38/d14/d18 to d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d 0 2024-03-28T13:05:52.757 INFO:tasks.workunit.client.0.smithi076.stdout:5/453: creat d5/d9/d1c/d1d/fa6 x:0 0 0 2024-03-28T13:05:52.812 INFO:tasks.workunit.client.0.smithi076.stdout:6/512: getdents d6/da/d39 0 2024-03-28T13:05:52.840 INFO:tasks.workunit.client.0.smithi076.stdout:6/513: dwrite d6/da/d1e/f1f [0,4194304] 0 2024-03-28T13:05:52.855 INFO:tasks.workunit.client.0.smithi076.stdout:0/475: dwrite db/dc/df/f44 [0,4194304] 0 2024-03-28T13:05:52.895 INFO:tasks.workunit.client.0.smithi076.stdout:0/476: dwrite db/dc/df/d18/d9f/fa5 [0,4194304] 0 2024-03-28T13:05:52.908 INFO:tasks.workunit.client.0.smithi076.stdout:0/477: read db/dc/df/f19 [630003,24533] 0 2024-03-28T13:05:52.914 INFO:tasks.workunit.client.0.smithi076.stdout:0/478: dread db/dc/df/d18/d1d/d75/f39 [0,4194304] 0 2024-03-28T13:05:52.944 INFO:tasks.workunit.client.0.smithi076.stdout:0/479: dwrite db/dc/df/d18/f5f [4194304,4194304] 0 2024-03-28T13:05:53.353 INFO:tasks.workunit.client.0.smithi076.stdout:8/439: symlink de/d23/d2b/d51/d71/l8d 0 2024-03-28T13:05:53.353 INFO:tasks.workunit.client.0.smithi076.stdout:7/463: creat d1/d18/d2d/fa3 x:0 0 0 2024-03-28T13:05:53.353 INFO:tasks.workunit.client.0.smithi076.stdout:4/506: mknod d0/d3b/d40/d42/caf 0 2024-03-28T13:05:53.365 INFO:tasks.workunit.client.0.smithi076.stdout:1/425: rename d14/d19/d85/d2e/d31/d49/c75 to d14/d19/d85/d62/c9b 0 2024-03-28T13:05:53.365 INFO:tasks.workunit.client.0.smithi076.stdout:3/387: creat d1/d7/d30/d38/d14/f8e x:0 0 0 2024-03-28T13:05:53.365 INFO:tasks.workunit.client.0.smithi076.stdout:3/388: write d1/d7/d30/d38/d14/f8e [832710,101115] 0 2024-03-28T13:05:53.372 INFO:tasks.workunit.client.0.smithi076.stdout:5/454: symlink d5/d9/d1c/d1d/d22/la7 0 2024-03-28T13:05:53.389 INFO:tasks.workunit.client.0.smithi076.stdout:5/455: dread d5/f6 [0,4194304] 0 2024-03-28T13:05:53.389 INFO:tasks.workunit.client.0.smithi076.stdout:5/456: dread - d5/d9/d4c/d63/d91/f9c zero size 2024-03-28T13:05:53.389 INFO:tasks.workunit.client.0.smithi076.stdout:5/457: chown d5/db/d19/c4b 1 1 2024-03-28T13:05:53.420 INFO:tasks.workunit.client.0.smithi076.stdout:4/507: dread d0/d3b/d40/d42/d31/f56 [4194304,4194304] 0 2024-03-28T13:05:53.420 INFO:tasks.workunit.client.0.smithi076.stdout:4/508: fdatasync d0/d3b/d40/d42/f65 0 2024-03-28T13:05:53.427 INFO:tasks.workunit.client.0.smithi076.stdout:5/458: dwrite d5/db/f46 [4194304,4194304] 0 2024-03-28T13:05:53.427 INFO:tasks.workunit.client.0.smithi076.stdout:5/459: fdatasync d5/db/d19/f52 0 2024-03-28T13:05:53.432 INFO:tasks.workunit.client.0.smithi076.stdout:7/464: dwrite d1/d18/d2d/fa3 [0,4194304] 0 2024-03-28T13:05:53.591 INFO:tasks.workunit.client.0.smithi076.stdout:6/514: link d6/f24 d6/da/d5f/d6d/d95/fa5 0 2024-03-28T13:05:53.661 INFO:tasks.workunit.client.0.smithi076.stdout:6/515: dwrite d6/da/d23/f80 [0,4194304] 0 2024-03-28T13:05:53.922 INFO:tasks.workunit.client.0.smithi076.stdout:8/440: unlink de/d23/d2b/d5d/d76/d6e/d7a/f3b 0 2024-03-28T13:05:53.922 INFO:tasks.workunit.client.0.smithi076.stdout:8/441: chown c4 144490281 1 2024-03-28T13:05:54.033 INFO:tasks.workunit.client.0.smithi076.stdout:9/478: rename d9/dd/df/d11/f80 to d9/dd/df/d11/d14/d58/d6e/f9b 0 2024-03-28T13:05:54.033 INFO:tasks.workunit.client.0.smithi076.stdout:9/479: dread - d9/dd/f85 zero size 2024-03-28T13:05:54.077 INFO:tasks.workunit.client.0.smithi076.stdout:1/426: rmdir d14/d19/d85/d2e/d3c/d5c 39 2024-03-28T13:05:54.111 INFO:tasks.workunit.client.0.smithi076.stdout:1/427: dwrite d14/d19/d20/f56 [0,4194304] 0 2024-03-28T13:05:54.319 INFO:tasks.workunit.client.0.smithi076.stdout:4/509: symlink d0/d3b/d50/da8/lb0 0 2024-03-28T13:05:54.319 INFO:tasks.workunit.client.0.smithi076.stdout:4/510: stat d0/d3b/d50/l76 0 2024-03-28T13:05:54.357 INFO:tasks.workunit.client.0.smithi076.stdout:5/460: link d5/db/df/f5a d5/db/d3f/d97/fa8 0 2024-03-28T13:05:54.357 INFO:tasks.workunit.client.0.smithi076.stdout:5/461: dread - d5/f9a zero size 2024-03-28T13:05:54.775 INFO:tasks.workunit.client.0.smithi076.stdout:8/442: mkdir de/d23/d2b/d58/d8e 0 2024-03-28T13:05:54.831 INFO:tasks.workunit.client.0.smithi076.stdout:6/516: rename d6/da/f18 to d6/da/d1e/fa6 0 2024-03-28T13:05:54.917 INFO:tasks.workunit.client.0.smithi076.stdout:9/480: rename d9/dd/df/d11/d37/f8d to d9/dd/df/d11/d37/f9c 0 2024-03-28T13:05:55.238 INFO:tasks.workunit.client.0.smithi076.stdout:4/511: rename d0/d3b/d40/d42/d47/d69/da9/caa to d0/d3b/d40/d42/d47/d69/da9/cb1 0 2024-03-28T13:05:55.240 INFO:tasks.workunit.client.0.smithi076.stdout:1/428: dread fc [0,4194304] 0 2024-03-28T13:05:55.240 INFO:tasks.workunit.client.0.smithi076.stdout:1/429: chown d14/d19/d85/d3f/c6e 3 1 2024-03-28T13:05:55.240 INFO:tasks.workunit.client.0.smithi076.stdout:1/430: truncate d14/d19/d85/d2e/d31/d51/f77 1334244 0 2024-03-28T13:05:55.337 INFO:tasks.workunit.client.0.smithi076.stdout:5/462: symlink d5/db/d3f/d42/d43/la9 0 2024-03-28T13:05:55.454 INFO:tasks.workunit.client.0.smithi076.stdout:8/443: creat de/d4e/f8f x:0 0 0 2024-03-28T13:05:55.474 INFO:tasks.workunit.client.0.smithi076.stdout:8/444: dread de/d23/d2b/d5d/d76/d6e/d7a/f4c [0,4194304] 0 2024-03-28T13:05:55.482 INFO:tasks.workunit.client.0.smithi076.stdout:8/445: dread de/d13/d27/f5a [0,4194304] 0 2024-03-28T13:05:55.482 INFO:tasks.workunit.client.0.smithi076.stdout:8/446: truncate de/d13/f35 417497 0 2024-03-28T13:05:55.526 INFO:tasks.workunit.client.0.smithi076.stdout:6/517: creat d6/da/d23/fa7 x:0 0 0 2024-03-28T13:05:55.526 INFO:tasks.workunit.client.0.smithi076.stdout:6/518: write d6/da/d40/d62/f7d [4378321,118468] 0 2024-03-28T13:05:55.526 INFO:tasks.workunit.client.0.smithi076.stdout:6/519: getdents d6/da/d40/d56/da4 0 2024-03-28T13:05:55.526 INFO:tasks.workunit.client.0.smithi076.stdout:6/520: chown d6/da/d40/d56/d58/f88 3 1 2024-03-28T13:05:55.527 INFO:tasks.workunit.client.0.smithi076.stdout:6/521: chown d6/da/d40/d56/f6c 511833 1 2024-03-28T13:05:55.527 INFO:tasks.workunit.client.0.smithi076.stdout:6/522: chown d6/f3c 6087 1 2024-03-28T13:05:55.571 INFO:tasks.workunit.client.0.smithi076.stdout:2/470: sync 2024-03-28T13:05:55.581 INFO:tasks.workunit.client.0.smithi076.stdout:2/471: dread d2/d5/d7/dd/f32 [0,4194304] 0 2024-03-28T13:05:55.611 INFO:tasks.workunit.client.0.smithi076.stdout:2/472: dwrite d2/d5/db/d3b/d3f/d79/f8e [0,4194304] 0 2024-03-28T13:05:55.632 INFO:tasks.workunit.client.0.smithi076.stdout:2/473: dread d2/d5/d7/f71 [0,4194304] 0 2024-03-28T13:05:55.632 INFO:tasks.workunit.client.0.smithi076.stdout:9/481: rmdir d9/dd/df/d11/d14/d58/d6e 39 2024-03-28T13:05:55.946 INFO:tasks.workunit.client.0.smithi076.stdout:4/512: truncate d0/d3b/f9a 2280067 0 2024-03-28T13:05:55.947 INFO:tasks.workunit.client.0.smithi076.stdout:4/513: write d0/d3b/d40/d42/d28/f92 [186118,128633] 0 2024-03-28T13:05:55.949 INFO:tasks.workunit.client.0.smithi076.stdout:1/431: rename d14/d19/d85/d2e/d31/d3b/f7d to d14/d19/d85/d2e/d31/d8f/f9c 0 2024-03-28T13:05:55.967 INFO:tasks.workunit.client.0.smithi076.stdout:1/432: write d14/d19/d85/d2e/d31/d49/f64 [1152333,31214] 0 2024-03-28T13:05:56.056 INFO:tasks.workunit.client.0.smithi076.stdout:5/463: mknod d5/d9/d1c/d25/d73/caa 0 2024-03-28T13:05:56.065 INFO:tasks.workunit.client.0.smithi076.stdout:6/523: unlink d6/da/d1e/f60 0 2024-03-28T13:05:56.144 INFO:tasks.workunit.client.0.smithi076.stdout:0/480: truncate db/dc/df/f44 1267282 0 2024-03-28T13:05:56.211 INFO:tasks.workunit.client.0.smithi076.stdout:2/474: symlink d2/d5/db/d3b/d42/l93 0 2024-03-28T13:05:56.248 INFO:tasks.workunit.client.0.smithi076.stdout:9/482: creat d9/da/f9d x:0 0 0 2024-03-28T13:05:56.248 INFO:tasks.workunit.client.0.smithi076.stdout:9/483: stat d9/dd/df/d11/d14/d58/d6e/d2a/l69 0 2024-03-28T13:05:56.248 INFO:tasks.workunit.client.0.smithi076.stdout:9/484: write d9/dd/f85 [757852,61454] 0 2024-03-28T13:05:56.745 INFO:tasks.workunit.client.0.smithi076.stdout:8/447: rename de/d25/l42 to de/d23/d2b/d51/d60/d89/l90 0 2024-03-28T13:05:56.746 INFO:tasks.workunit.client.0.smithi076.stdout:8/448: fsync de/f1d 0 2024-03-28T13:05:56.781 INFO:tasks.workunit.client.0.smithi076.stdout:1/433: truncate d14/d19/d85/d2e/d31/d8f/f9c 2906180 0 2024-03-28T13:05:56.781 INFO:tasks.workunit.client.0.smithi076.stdout:1/434: chown d14/d19/d85/d2e/d3c/d5c/f8b 174 1 2024-03-28T13:05:56.781 INFO:tasks.workunit.client.0.smithi076.stdout:1/435: chown d14/d19/d85/d2e/d31/d6f 263568603 1 2024-03-28T13:05:56.832 INFO:tasks.workunit.client.0.smithi076.stdout:5/464: creat d5/d9/d1c/fab x:0 0 0 2024-03-28T13:05:56.832 INFO:tasks.workunit.client.0.smithi076.stdout:5/465: dread - d5/f6c zero size 2024-03-28T13:05:56.871 INFO:tasks.workunit.client.0.smithi076.stdout:6/524: mknod d6/ca8 0 2024-03-28T13:05:57.012 INFO:tasks.workunit.client.0.smithi076.stdout:0/481: creat db/dc/df/d11/d40/d77/d87/d88/fab x:0 0 0 2024-03-28T13:05:57.107 INFO:tasks.workunit.client.0.smithi076.stdout:9/485: creat d9/d74/d7d/f9e x:0 0 0 2024-03-28T13:05:57.160 INFO:tasks.workunit.client.0.smithi076.stdout:9/486: dwrite d9/dd/f85 [0,4194304] 0 2024-03-28T13:05:57.161 INFO:tasks.workunit.client.0.smithi076.stdout:9/487: write d9/dd/df/d11/d14/d58/d6e/d2a/f76 [215908,93116] 0 2024-03-28T13:05:57.161 INFO:tasks.workunit.client.0.smithi076.stdout:9/488: dread - d9/dd/df/d11/d14/f65 zero size 2024-03-28T13:05:57.161 INFO:tasks.workunit.client.0.smithi076.stdout:9/489: chown d9/dd/df/d11/d14/d58/d6e/f94 947 1 2024-03-28T13:05:57.187 INFO:tasks.workunit.client.0.smithi076.stdout:8/449: creat de/d23/d2b/d51/d62/d8b/f91 x:0 0 0 2024-03-28T13:05:57.454 INFO:tasks.workunit.client.0.smithi076.stdout:5/466: getdents d5/d9/d1c/d1d 0 2024-03-28T13:05:57.454 INFO:tasks.workunit.client.0.smithi076.stdout:5/467: readlink d5/d9/l2e 0 2024-03-28T13:05:57.454 INFO:tasks.workunit.client.0.smithi076.stdout:6/525: link d6/da/d5f/d6d/l85 d6/da/d5f/d7e/la9 0 2024-03-28T13:05:57.454 INFO:tasks.workunit.client.0.smithi076.stdout:5/468: write d5/d9/d1c/f6d [4153856,99491] 0 2024-03-28T13:05:57.492 INFO:tasks.workunit.client.0.smithi076.stdout:5/469: dwrite d5/f6 [0,4194304] 0 2024-03-28T13:05:57.492 INFO:tasks.workunit.client.0.smithi076.stdout:5/470: chown d5/db/d3f/d42/c67 576499534 1 2024-03-28T13:05:57.492 INFO:tasks.workunit.client.0.smithi076.stdout:5/471: chown d5/db/d3f/f8f 6 1 2024-03-28T13:05:57.492 INFO:tasks.workunit.client.0.smithi076.stdout:5/472: chown d5/d9/d35/d3b/la5 929256 1 2024-03-28T13:05:57.531 INFO:tasks.workunit.client.0.smithi076.stdout:0/482: unlink db/dc/df/d11/d40/l67 0 2024-03-28T13:05:57.625 INFO:tasks.workunit.client.0.smithi076.stdout:7/465: rmdir d1/d18/d3c/d8c 39 2024-03-28T13:05:57.752 INFO:tasks.workunit.client.0.smithi076.stdout:8/450: creat de/d23/d2b/d5d/d76/d6e/d7a/f92 x:0 0 0 2024-03-28T13:05:57.777 INFO:tasks.workunit.client.0.smithi076.stdout:8/451: dwrite de/d13/f35 [0,4194304] 0 2024-03-28T13:05:57.778 INFO:tasks.workunit.client.0.smithi076.stdout:8/452: dread de/f56 [0,4194304] 0 2024-03-28T13:05:57.804 INFO:tasks.workunit.client.0.smithi076.stdout:8/453: dwrite f2 [4194304,4194304] 0 2024-03-28T13:05:57.838 INFO:tasks.workunit.client.0.smithi076.stdout:6/526: truncate d6/da/d5f/f6b 1955143 0 2024-03-28T13:05:57.838 INFO:tasks.workunit.client.0.smithi076.stdout:6/527: fdatasync d6/da/d40/d56/d58/f66 0 2024-03-28T13:05:57.853 INFO:tasks.workunit.client.0.smithi076.stdout:6/528: write d6/da/d23/f45 [828122,41418] 0 2024-03-28T13:05:57.872 INFO:tasks.workunit.client.0.smithi076.stdout:6/529: dread d6/da/d40/d56/d58/f66 [0,4194304] 0 2024-03-28T13:05:57.898 INFO:tasks.workunit.client.0.smithi076.stdout:5/473: creat d5/d9/d35/fac x:0 0 0 2024-03-28T13:05:57.900 INFO:tasks.workunit.client.0.smithi076.stdout:6/530: dwrite d6/da/d39/f61 [0,4194304] 0 2024-03-28T13:05:57.900 INFO:tasks.workunit.client.0.smithi076.stdout:6/531: read d6/da/d40/d56/f6c [369361,93287] 0 2024-03-28T13:05:57.980 INFO:tasks.workunit.client.0.smithi076.stdout:0/483: creat db/dc/df/d18/d1d/d21/fac x:0 0 0 2024-03-28T13:05:57.980 INFO:tasks.workunit.client.0.smithi076.stdout:0/484: write db/dc/fe [1457382,75697] 0 2024-03-28T13:05:58.073 INFO:tasks.workunit.client.0.smithi076.stdout:7/466: symlink d1/d18/d3c/d7b/d7d/la4 0 2024-03-28T13:05:58.208 INFO:tasks.workunit.client.0.smithi076.stdout:3/389: mkdir d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d8f 0 2024-03-28T13:05:58.246 INFO:tasks.workunit.client.0.smithi076.stdout:8/454: mkdir de/d23/d2b/d5d/d76/d6e/d8a/d93 0 2024-03-28T13:05:58.251 INFO:tasks.workunit.client.0.smithi076.stdout:3/390: dwrite d1/d7/d30/d60/f88 [0,4194304] 0 2024-03-28T13:05:58.251 INFO:tasks.workunit.client.0.smithi076.stdout:3/391: write d1/f1b [3621141,104319] 0 2024-03-28T13:05:58.339 INFO:tasks.workunit.client.0.smithi076.stdout:6/532: creat d6/da/d39/faa x:0 0 0 2024-03-28T13:05:58.591 INFO:tasks.workunit.client.0.smithi076.stdout:7/467: mknod d1/d18/d3c/d48/d69/d79/ca5 0 2024-03-28T13:05:59.232 INFO:tasks.workunit.client.0.smithi076.stdout:8/455: creat de/d13/f94 x:0 0 0 2024-03-28T13:05:59.232 INFO:tasks.workunit.client.0.smithi076.stdout:8/456: readlink de/d25/l53 0 2024-03-28T13:05:59.232 INFO:tasks.workunit.client.0.smithi076.stdout:8/457: write de/d23/d2b/f30 [848055,88511] 0 2024-03-28T13:05:59.232 INFO:tasks.workunit.client.0.smithi076.stdout:8/458: chown de/d23/d2b/d5d/d76/d6e/f79 2 1 2024-03-28T13:05:59.262 INFO:tasks.workunit.client.0.smithi076.stdout:4/514: dread d0/d3b/f9a [0,4194304] 0 2024-03-28T13:05:59.284 INFO:tasks.workunit.client.0.smithi076.stdout:4/515: dread d0/f1e [0,4194304] 0 2024-03-28T13:05:59.566 INFO:tasks.workunit.client.0.smithi076.stdout:2/475: mkdir d2/d5/db/d3b/d94 0 2024-03-28T13:05:59.566 INFO:tasks.workunit.client.0.smithi076.stdout:2/476: dread - d2/d5/d4b/d39/f7f zero size 2024-03-28T13:05:59.842 INFO:tasks.workunit.client.0.smithi076.stdout:4/516: symlink d0/d3b/d50/d64/lb2 0 2024-03-28T13:06:00.303 INFO:tasks.workunit.client.0.smithi076.stdout:8/459: truncate de/f3f 1071333 0 2024-03-28T13:06:00.321 INFO:tasks.workunit.client.0.smithi076.stdout:2/477: unlink d2/d5/d7/dd/l31 0 2024-03-28T13:06:00.321 INFO:tasks.workunit.client.0.smithi076.stdout:1/436: write fc [1259072,10961] 0 2024-03-28T13:06:00.321 INFO:tasks.workunit.client.0.smithi076.stdout:2/478: write d2/d5/d4b/d39/d57/f85 [112846,28159] 0 2024-03-28T13:06:00.339 INFO:tasks.workunit.client.0.smithi076.stdout:1/437: dread d14/d19/d85/d2e/d31/d51/f70 [0,4194304] 0 2024-03-28T13:06:00.352 INFO:tasks.workunit.client.0.smithi076.stdout:2/479: dwrite d2/d5/d7/d8/d21/f5e [0,4194304] 0 2024-03-28T13:06:01.535 INFO:tasks.workunit.client.0.smithi076.stdout:8/460: symlink de/d23/d2b/d5d/d76/d6e/l95 0 2024-03-28T13:06:01.535 INFO:tasks.workunit.client.0.smithi076.stdout:4/517: creat d0/d3b/d40/d42/d31/d4d/d63/fb3 x:0 0 0 2024-03-28T13:06:01.535 INFO:tasks.workunit.client.0.smithi076.stdout:8/461: dread - de/d13/f75 zero size 2024-03-28T13:06:01.535 INFO:tasks.workunit.client.0.smithi076.stdout:4/518: chown d0/d3b/d40/d42/d31/c39 265468627 1 2024-03-28T13:06:01.558 INFO:tasks.workunit.client.0.smithi076.stdout:1/438: link d14/d19/d85/d2e/d31/d49/f7a d14/d19/d85/d2e/d3c/d7e/f9d 0 2024-03-28T13:06:01.567 INFO:tasks.workunit.client.0.smithi076.stdout:4/519: dwrite d0/f1f [0,4194304] 0 2024-03-28T13:06:01.567 INFO:tasks.workunit.client.0.smithi076.stdout:4/520: stat d0/d3b/d40/d42/d47/d7c/f91 0 2024-03-28T13:06:01.567 INFO:tasks.workunit.client.0.smithi076.stdout:4/521: fsync d0/d20/f48 0 2024-03-28T13:06:01.754 INFO:tasks.workunit.client.0.smithi076.stdout:9/490: rename d9/f87 to d9/dd/df/f9f 0 2024-03-28T13:06:02.163 INFO:tasks.workunit.client.0.smithi076.stdout:8/462: symlink de/d23/d2b/d5d/d76/d6e/l96 0 2024-03-28T13:06:02.170 INFO:tasks.workunit.client.0.smithi076.stdout:8/463: dread de/d13/d27/f5a [0,4194304] 0 2024-03-28T13:06:02.207 INFO:tasks.workunit.client.0.smithi076.stdout:1/439: mkdir d14/d6c/d74/d9e 0 2024-03-28T13:06:02.207 INFO:tasks.workunit.client.0.smithi076.stdout:5/474: rename d5/l51 to d5/d9/d4c/d63/lad 0 2024-03-28T13:06:02.207 INFO:tasks.workunit.client.0.smithi076.stdout:4/522: unlink d0/d3b/d40/d42/f19 0 2024-03-28T13:06:02.207 INFO:tasks.workunit.client.0.smithi076.stdout:1/440: write d14/d19/d85/d2e/d31/d49/f7a [187220,32733] 0 2024-03-28T13:06:02.576 INFO:tasks.workunit.client.0.smithi076.stdout:8/464: creat de/d13/d27/d8c/f97 x:0 0 0 2024-03-28T13:06:02.576 INFO:tasks.workunit.client.0.smithi076.stdout:6/533: rename d6/da/d5f/d6d/c6e to d6/da/d40/d62/cab 0 2024-03-28T13:06:02.595 INFO:tasks.workunit.client.0.smithi076.stdout:5/475: creat d5/d9/d1c/d1d/d22/fae x:0 0 0 2024-03-28T13:06:02.595 INFO:tasks.workunit.client.0.smithi076.stdout:4/523: mknod d0/d20/d7b/d94/cb4 0 2024-03-28T13:06:02.598 INFO:tasks.workunit.client.0.smithi076.stdout:1/441: link d14/d19/d85/d2e/d31/d49/f64 d14/d19/d85/d2e/d91/f9f 0 2024-03-28T13:06:02.598 INFO:tasks.workunit.client.0.smithi076.stdout:1/442: dread - d14/d6c/d74/f95 zero size 2024-03-28T13:06:02.621 INFO:tasks.workunit.client.0.smithi076.stdout:5/476: dwrite d5/d9/d1c/d25/d60/d82/f93 [0,4194304] 0 2024-03-28T13:06:02.897 INFO:tasks.workunit.client.0.smithi076.stdout:8/465: mkdir de/d4e/d54/d98 0 2024-03-28T13:06:02.898 INFO:tasks.workunit.client.0.smithi076.stdout:0/485: sync 2024-03-28T13:06:02.898 INFO:tasks.workunit.client.0.smithi076.stdout:7/468: sync 2024-03-28T13:06:02.898 INFO:tasks.workunit.client.0.smithi076.stdout:0/486: chown db/dc/faa 13429 1 2024-03-28T13:06:02.923 INFO:tasks.workunit.client.0.smithi076.stdout:6/534: mkdir d6/da/d5f/d6d/d95/dac 0 2024-03-28T13:06:02.923 INFO:tasks.workunit.client.0.smithi076.stdout:4/524: mknod d0/d3b/d40/cb5 0 2024-03-28T13:06:02.923 INFO:tasks.workunit.client.0.smithi076.stdout:4/525: chown d0/d20/f5c 176 1 2024-03-28T13:06:02.929 INFO:tasks.workunit.client.0.smithi076.stdout:1/443: dread d14/d19/d85/d2e/d31/d51/f77 [0,4194304] 0 2024-03-28T13:06:02.931 INFO:tasks.workunit.client.0.smithi076.stdout:8/466: dwrite de/f56 [0,4194304] 0 2024-03-28T13:06:02.956 INFO:tasks.workunit.client.0.smithi076.stdout:7/469: dwrite d1/f40 [0,4194304] 0 2024-03-28T13:06:02.958 INFO:tasks.workunit.client.0.smithi076.stdout:8/467: dwrite de/d25/f5b [0,4194304] 0 2024-03-28T13:06:02.987 INFO:tasks.workunit.client.0.smithi076.stdout:5/477: symlink d5/d9/d35/d3b/laf 0 2024-03-28T13:06:03.226 INFO:tasks.workunit.client.0.smithi076.stdout:0/487: mknod db/dc/df/d71/d4a/d7e/d91/cad 0 2024-03-28T13:06:03.226 INFO:tasks.workunit.client.0.smithi076.stdout:0/488: stat db/dc/d3d/d57/f5b 0 2024-03-28T13:06:03.298 INFO:tasks.workunit.client.0.smithi076.stdout:3/392: rename d1/d7/d30/d38/d14/d27/c3c to d1/d7/d30/d38/d14/c90 0 2024-03-28T13:06:03.355 INFO:tasks.workunit.client.0.smithi076.stdout:6/535: symlink d6/da/d5f/d7e/lad 0 2024-03-28T13:06:03.381 INFO:tasks.workunit.client.0.smithi076.stdout:6/536: dwrite d6/da/d5f/d6d/d95/fa5 [0,4194304] 0 2024-03-28T13:06:03.657 INFO:tasks.workunit.client.0.smithi076.stdout:1/444: creat d14/d19/d85/d2e/d91/fa0 x:0 0 0 2024-03-28T13:06:03.665 INFO:tasks.workunit.client.0.smithi076.stdout:4/526: dread d0/d3b/d40/d42/d28/f7e [0,4194304] 0 2024-03-28T13:06:03.686 INFO:tasks.workunit.client.0.smithi076.stdout:7/470: mknod d1/d81/ca6 0 2024-03-28T13:06:03.687 INFO:tasks.workunit.client.0.smithi076.stdout:8/468: creat de/d13/d27/d8c/f99 x:0 0 0 2024-03-28T13:06:03.690 INFO:tasks.workunit.client.0.smithi076.stdout:5/478: creat d5/d9/d35/fb0 x:0 0 0 2024-03-28T13:06:03.690 INFO:tasks.workunit.client.0.smithi076.stdout:0/489: getdents db/dc/d3d/d57 0 2024-03-28T13:06:03.729 INFO:tasks.workunit.client.0.smithi076.stdout:7/471: dwrite d1/dc/f2b [0,4194304] 0 2024-03-28T13:06:03.736 INFO:tasks.workunit.client.0.smithi076.stdout:4/527: dwrite d0/d3b/d40/d42/d31/d4d/f9b [0,4194304] 0 2024-03-28T13:06:03.774 INFO:tasks.workunit.client.0.smithi076.stdout:2/480: rename d2/d5/d7/d3e/c80 to d2/d5/d4b/d39/d57/c95 0 2024-03-28T13:06:04.112 INFO:tasks.workunit.client.0.smithi076.stdout:3/393: creat d1/d7/d30/d60/f91 x:0 0 0 2024-03-28T13:06:04.130 INFO:tasks.workunit.client.0.smithi076.stdout:3/394: dread d1/d7/d30/d38/f29 [0,4194304] 0 2024-03-28T13:06:04.131 INFO:tasks.workunit.client.0.smithi076.stdout:3/395: dread - d1/d7/d30/f4c zero size 2024-03-28T13:06:04.131 INFO:tasks.workunit.client.0.smithi076.stdout:3/396: truncate d1/d7/d30/d38/d14/d36/d56/f8b 547037 0 2024-03-28T13:06:04.245 INFO:tasks.workunit.client.0.smithi076.stdout:6/537: dread d6/f4b [0,4194304] 0 2024-03-28T13:06:04.336 INFO:tasks.workunit.client.0.smithi076.stdout:1/445: symlink d14/la1 0 2024-03-28T13:06:04.343 INFO:tasks.workunit.client.0.smithi076.stdout:8/469: creat de/d23/d2b/d5d/d76/d18/d3c/f9a x:0 0 0 2024-03-28T13:06:04.346 INFO:tasks.workunit.client.0.smithi076.stdout:1/446: dread d14/d19/d85/d2e/f61 [0,4194304] 0 2024-03-28T13:06:04.422 INFO:tasks.workunit.client.0.smithi076.stdout:5/479: mkdir d5/db/d3f/d42/d43/d7a/db1 0 2024-03-28T13:06:04.446 INFO:tasks.workunit.client.0.smithi076.stdout:0/490: mknod db/dc/df/d18/cae 0 2024-03-28T13:06:04.526 INFO:tasks.workunit.client.0.smithi076.stdout:7/472: rmdir d1 39 2024-03-28T13:06:04.527 INFO:tasks.workunit.client.0.smithi076.stdout:0/491: dwrite db/dc/d3d/d57/f5b [4194304,4194304] 0 2024-03-28T13:06:04.528 INFO:tasks.workunit.client.0.smithi076.stdout:0/492: write db/dc/f9a [415672,127346] 0 2024-03-28T13:06:04.529 INFO:tasks.workunit.client.0.smithi076.stdout:0/493: write db/dc/f9a [43595,108278] 0 2024-03-28T13:06:04.659 INFO:tasks.workunit.client.0.smithi076.stdout:4/528: symlink d0/d3b/d40/d42/d47/d69/lb6 0 2024-03-28T13:06:04.709 INFO:tasks.workunit.client.0.smithi076.stdout:4/529: dwrite d0/d3b/d40/d42/d28/f49 [0,4194304] 0 2024-03-28T13:06:04.735 INFO:tasks.workunit.client.0.smithi076.stdout:4/530: dwrite d0/f1e [0,4194304] 0 2024-03-28T13:06:04.759 INFO:tasks.workunit.client.0.smithi076.stdout:3/397: creat d1/f92 x:0 0 0 2024-03-28T13:06:04.780 INFO:tasks.workunit.client.0.smithi076.stdout:2/481: dread d2/d5/d7/f23 [0,4194304] 0 2024-03-28T13:06:04.800 INFO:tasks.workunit.client.0.smithi076.stdout:2/482: dread d2/d5/d7/f71 [0,4194304] 0 2024-03-28T13:06:04.834 INFO:tasks.workunit.client.0.smithi076.stdout:6/538: mknod d6/da/d39/cae 0 2024-03-28T13:06:04.834 INFO:tasks.workunit.client.0.smithi076.stdout:6/539: fsync d6/d99/f67 0 2024-03-28T13:06:04.946 INFO:tasks.workunit.client.0.smithi076.stdout:8/470: rename de/d23/d2b/l83 to de/d23/d2b/l9b 0 2024-03-28T13:06:05.212 INFO:tasks.workunit.client.0.smithi076.stdout:5/480: symlink d5/db/lb2 0 2024-03-28T13:06:05.613 INFO:tasks.workunit.client.0.smithi076.stdout:7/473: link d1/d18/d3c/f33 d1/d18/d2d/fa7 0 2024-03-28T13:06:05.614 INFO:tasks.workunit.client.0.smithi076.stdout:0/494: creat db/dc/df/d18/d1d/d75/d51/d60/d89/faf x:0 0 0 2024-03-28T13:06:05.614 INFO:tasks.workunit.client.0.smithi076.stdout:0/495: write db/dc/df/d18/d1d/d75/f39 [1900876,122927] 0 2024-03-28T13:06:05.614 INFO:tasks.workunit.client.0.smithi076.stdout:0/496: dread - db/dc/df/d18/d1d/d21/fac zero size 2024-03-28T13:06:05.718 INFO:tasks.workunit.client.0.smithi076.stdout:3/398: mkdir d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d93 0 2024-03-28T13:06:05.718 INFO:tasks.workunit.client.0.smithi076.stdout:3/399: chown d1/f63 0 1 2024-03-28T13:06:05.718 INFO:tasks.workunit.client.0.smithi076.stdout:3/400: fsync d1/d2/f4f 0 2024-03-28T13:06:05.742 INFO:tasks.workunit.client.0.smithi076.stdout:2/483: getdents d2/d5/d7/d8 0 2024-03-28T13:06:05.780 INFO:tasks.workunit.client.0.smithi076.stdout:2/484: dwrite d2/d5/d7/d8/d21/f5e [4194304,4194304] 0 2024-03-28T13:06:05.823 INFO:tasks.workunit.client.0.smithi076.stdout:6/540: mkdir d6/da/d5f/d6d/daf 0 2024-03-28T13:06:05.844 INFO:tasks.workunit.client.0.smithi076.stdout:6/541: dread d6/da/d40/d56/d8f/fa0 [0,4194304] 0 2024-03-28T13:06:06.001 INFO:tasks.workunit.client.0.smithi076.stdout:7/474: link d1/dc/c61 d1/d8/ca8 0 2024-03-28T13:06:06.001 INFO:tasks.workunit.client.0.smithi076.stdout:7/475: truncate d1/d8/d37/f47 938756 0 2024-03-28T13:06:06.005 INFO:tasks.workunit.client.0.smithi076.stdout:7/476: dread d1/f36 [0,4194304] 0 2024-03-28T13:06:06.070 INFO:tasks.workunit.client.0.smithi076.stdout:0/497: mknod db/dc/df/d71/d4a/d7e/cb0 0 2024-03-28T13:06:06.308 INFO:tasks.workunit.client.0.smithi076.stdout:9/491: rename d9/d74/d7d/f9e to d9/dd/fa0 0 2024-03-28T13:06:06.308 INFO:tasks.workunit.client.0.smithi076.stdout:9/492: fdatasync d9/dd/df/d11/d14/d58/d6e/f50 0 2024-03-28T13:06:06.368 INFO:tasks.workunit.client.0.smithi076.stdout:4/531: mkdir d0/d3b/d50/d64/d89/db7 0 2024-03-28T13:06:06.399 INFO:tasks.workunit.client.0.smithi076.stdout:4/532: dwrite d0/d3b/d40/d42/f37 [4194304,4194304] 0 2024-03-28T13:06:06.433 INFO:tasks.workunit.client.0.smithi076.stdout:3/401: getdents d1/d7/d30/d38/d14/d27 0 2024-03-28T13:06:06.446 INFO:tasks.workunit.client.0.smithi076.stdout:4/533: dwrite d0/d3b/d40/d42/f65 [0,4194304] 0 2024-03-28T13:06:06.446 INFO:tasks.workunit.client.0.smithi076.stdout:4/534: dread - d0/d3b/d40/d42/d28/f5b zero size 2024-03-28T13:06:06.554 INFO:tasks.workunit.client.0.smithi076.stdout:2/485: rmdir d2/d5/db/d3b 39 2024-03-28T13:06:06.629 INFO:tasks.workunit.client.0.smithi076.stdout:6/542: rmdir d6/da/d5f/d6d/d95/dac 0 2024-03-28T13:06:06.629 INFO:tasks.workunit.client.0.smithi076.stdout:6/543: fsync d6/da/d40/d56/f96 0 2024-03-28T13:06:06.629 INFO:tasks.workunit.client.0.smithi076.stdout:6/544: fdatasync d6/da/d39/f61 0 2024-03-28T13:06:06.733 INFO:tasks.workunit.client.0.smithi076.stdout:8/471: truncate de/d23/d2b/d5d/d76/f3e 501747 0 2024-03-28T13:06:06.733 INFO:tasks.workunit.client.0.smithi076.stdout:7/477: creat d1/d18/d3c/d8c/fa9 x:0 0 0 2024-03-28T13:06:06.781 INFO:tasks.workunit.client.0.smithi076.stdout:7/478: dwrite d1/d18/f95 [0,4194304] 0 2024-03-28T13:06:07.164 INFO:tasks.workunit.client.0.smithi076.stdout:5/481: rename d5/d9/d1c/f54 to d5/d9/d1c/d25/d60/d82/fb3 0 2024-03-28T13:06:07.164 INFO:tasks.workunit.client.0.smithi076.stdout:9/493: mkdir d9/dd/df/d11/d14/d58/da1 0 2024-03-28T13:06:07.209 INFO:tasks.workunit.client.0.smithi076.stdout:4/535: symlink d0/d3b/d50/da8/lb8 0 2024-03-28T13:06:07.226 INFO:tasks.workunit.client.0.smithi076.stdout:4/536: dread d0/d3b/d40/d42/d28/f32 [0,4194304] 0 2024-03-28T13:06:07.278 INFO:tasks.workunit.client.0.smithi076.stdout:2/486: getdents d2/d5/d7/d8/d21 0 2024-03-28T13:06:07.385 INFO:tasks.workunit.client.0.smithi076.stdout:6/545: mkdir d6/da/d40/d62/db0 0 2024-03-28T13:06:07.385 INFO:tasks.workunit.client.0.smithi076.stdout:6/546: chown d6/d99/d46/f64 7775499 1 2024-03-28T13:06:07.385 INFO:tasks.workunit.client.0.smithi076.stdout:8/472: rmdir de/d4e/d54 39 2024-03-28T13:06:07.385 INFO:tasks.workunit.client.0.smithi076.stdout:8/473: write de/d4e/f8f [713525,103027] 0 2024-03-28T13:06:07.585 INFO:tasks.workunit.client.0.smithi076.stdout:7/479: mknod d1/d18/d2d/caa 0 2024-03-28T13:06:07.623 INFO:tasks.workunit.client.0.smithi076.stdout:5/482: creat d5/d9/d1c/d1d/d22/fb4 x:0 0 0 2024-03-28T13:06:07.623 INFO:tasks.workunit.client.0.smithi076.stdout:5/483: dread - d5/d9/d1c/d1d/d22/fb4 zero size 2024-03-28T13:06:07.674 INFO:tasks.workunit.client.0.smithi076.stdout:9/494: unlink d9/dd/df/d11/d14/d58/d6e/f94 0 2024-03-28T13:06:07.766 INFO:tasks.workunit.client.0.smithi076.stdout:3/402: mknod d1/d7/d30/d38/d14/d27/d42/c94 0 2024-03-28T13:06:07.837 INFO:tasks.workunit.client.0.smithi076.stdout:4/537: unlink d0/f9 0 2024-03-28T13:06:07.916 INFO:tasks.workunit.client.0.smithi076.stdout:2/487: truncate d2/d5/db/d3b/f4e 472082 0 2024-03-28T13:06:07.916 INFO:tasks.workunit.client.0.smithi076.stdout:2/488: fdatasync d2/d5/d7/f23 0 2024-03-28T13:06:07.917 INFO:tasks.workunit.client.0.smithi076.stdout:2/489: dread - d2/d5/f84 zero size 2024-03-28T13:06:08.039 INFO:tasks.workunit.client.0.smithi076.stdout:6/547: symlink d6/da/d40/d56/lb1 0 2024-03-28T13:06:08.042 INFO:tasks.workunit.client.0.smithi076.stdout:8/474: creat de/d23/d2b/d5d/d76/d6e/f9c x:0 0 0 2024-03-28T13:06:08.210 INFO:tasks.workunit.client.0.smithi076.stdout:5/484: unlink d5/d9/d1c/d25/d60/d82/f93 0 2024-03-28T13:06:08.212 INFO:tasks.workunit.client.0.smithi076.stdout:1/447: sync 2024-03-28T13:06:08.294 INFO:tasks.workunit.client.0.smithi076.stdout:4/538: getdents d0/d3b/d50 0 2024-03-28T13:06:08.294 INFO:tasks.workunit.client.0.smithi076.stdout:4/539: fdatasync d0/d3b/f9a 0 2024-03-28T13:06:08.307 INFO:tasks.workunit.client.0.smithi076.stdout:4/540: dread d0/d3b/d50/d64/d89/d2d/f35 [0,4194304] 0 2024-03-28T13:06:08.307 INFO:tasks.workunit.client.0.smithi076.stdout:4/541: write d0/d3b/d40/d42/f3f [5077195,77727] 0 2024-03-28T13:06:08.331 INFO:tasks.workunit.client.0.smithi076.stdout:4/542: dread d0/d3b/f9a [0,4194304] 0 2024-03-28T13:06:08.331 INFO:tasks.workunit.client.0.smithi076.stdout:4/543: write d0/d20/d7f/fad [241550,89118] 0 2024-03-28T13:06:08.537 INFO:tasks.workunit.client.0.smithi076.stdout:2/490: mkdir d2/d5/db/d3b/d60/d96 0 2024-03-28T13:06:08.537 INFO:tasks.workunit.client.0.smithi076.stdout:2/491: write d2/d5/d7/f40 [3720152,5013] 0 2024-03-28T13:06:08.550 INFO:tasks.workunit.client.0.smithi076.stdout:6/548: rename d6/da/d40/d56/d58/f69 to d6/da/d5f/d6d/d95/fb2 0 2024-03-28T13:06:08.583 INFO:tasks.workunit.client.0.smithi076.stdout:6/549: dread - d6/da/d23/fa7 zero size 2024-03-28T13:06:08.584 INFO:tasks.workunit.client.0.smithi076.stdout:8/475: creat de/d4e/d54/d98/f9d x:0 0 0 2024-03-28T13:06:08.777 INFO:tasks.workunit.client.0.smithi076.stdout:5/485: truncate d5/db/d19/d34/f6e 3550681 0 2024-03-28T13:06:08.779 INFO:tasks.workunit.client.0.smithi076.stdout:1/448: creat d14/d6c/d74/d9e/fa2 x:0 0 0 2024-03-28T13:06:08.779 INFO:tasks.workunit.client.0.smithi076.stdout:9/495: mknod d9/ca2 0 2024-03-28T13:06:08.821 INFO:tasks.workunit.client.0.smithi076.stdout:9/496: dwrite d9/dd/df/d11/d37/f1c [0,4194304] 0 2024-03-28T13:06:08.821 INFO:tasks.workunit.client.0.smithi076.stdout:9/497: write d9/dd/f57 [1032100,15450] 0 2024-03-28T13:06:08.831 INFO:tasks.workunit.client.0.smithi076.stdout:3/403: symlink d1/d7/d30/d38/d14/d4a/l95 0 2024-03-28T13:06:09.201 INFO:tasks.workunit.client.0.smithi076.stdout:4/544: link d0/d3b/d50/l5d d0/d3b/d40/d42/d31/d5e/lb9 0 2024-03-28T13:06:09.201 INFO:tasks.workunit.client.0.smithi076.stdout:4/545: chown d0/d20/d7f 3 1 2024-03-28T13:06:09.201 INFO:tasks.workunit.client.0.smithi076.stdout:4/546: read d0/d3b/d40/d42/f3f [1617084,41557] 0 2024-03-28T13:06:09.251 INFO:tasks.workunit.client.0.smithi076.stdout:2/492: rmdir d2/d5/db/d3b/d42 39 2024-03-28T13:06:09.252 INFO:tasks.workunit.client.0.smithi076.stdout:0/498: sync 2024-03-28T13:06:09.252 INFO:tasks.workunit.client.0.smithi076.stdout:2/493: dread - d2/d5/d7/d28/f8b zero size 2024-03-28T13:06:09.252 INFO:tasks.workunit.client.0.smithi076.stdout:2/494: fsync d2/d5/d7/d8/f44 0 2024-03-28T13:06:09.635 INFO:tasks.workunit.client.0.smithi076.stdout:6/550: symlink d6/da/d89/lb3 0 2024-03-28T13:06:09.776 INFO:tasks.workunit.client.0.smithi076.stdout:8/476: symlink de/d13/d27/d8c/l9e 0 2024-03-28T13:06:09.817 INFO:tasks.workunit.client.0.smithi076.stdout:7/480: dwrite d1/f1b [0,4194304] 0 2024-03-28T13:06:09.820 INFO:tasks.workunit.client.0.smithi076.stdout:7/481: read d1/d18/d3c/d7b/d7d/f9d [1420071,83400] 0 2024-03-28T13:06:09.883 INFO:tasks.workunit.client.0.smithi076.stdout:5/486: link d5/db/df/l62 d5/d9/d4c/d63/lb5 0 2024-03-28T13:06:10.014 INFO:tasks.workunit.client.0.smithi076.stdout:1/449: mknod d14/d19/d85/d3f/ca3 0 2024-03-28T13:06:10.209 INFO:tasks.workunit.client.0.smithi076.stdout:9/498: creat d9/dd/df/d11/d14/fa3 x:0 0 0 2024-03-28T13:06:10.209 INFO:tasks.workunit.client.0.smithi076.stdout:3/404: mknod d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/c96 0 2024-03-28T13:06:10.821 INFO:tasks.workunit.client.0.smithi076.stdout:2/495: creat d2/d5/d4b/d39/f97 x:0 0 0 2024-03-28T13:06:11.320 INFO:tasks.workunit.client.0.smithi076.stdout:8/477: mknod de/d13/d27/c9f 0 2024-03-28T13:06:11.320 INFO:tasks.workunit.client.0.smithi076.stdout:8/478: chown de/d13 8 1 2024-03-28T13:06:11.320 INFO:tasks.workunit.client.0.smithi076.stdout:5/487: mkdir d5/d9/d35/d3b/db6 0 2024-03-28T13:06:11.328 INFO:tasks.workunit.client.0.smithi076.stdout:8/479: dread de/d23/d2b/d5d/d76/f4a [0,4194304] 0 2024-03-28T13:06:11.328 INFO:tasks.workunit.client.0.smithi076.stdout:8/480: stat de/f10 0 2024-03-28T13:06:11.412 INFO:tasks.workunit.client.0.smithi076.stdout:1/450: mkdir d14/d19/d85/d2e/d31/d51/d92/da4 0 2024-03-28T13:06:11.594 INFO:tasks.workunit.client.0.smithi076.stdout:3/405: rmdir d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d 39 2024-03-28T13:06:11.594 INFO:tasks.workunit.client.0.smithi076.stdout:3/406: chown d1/d7/d30/d38/d14/d4a/d66/f6a 23096 1 2024-03-28T13:06:11.594 INFO:tasks.workunit.client.0.smithi076.stdout:3/407: fdatasync d1/f61 0 2024-03-28T13:06:11.633 INFO:tasks.workunit.client.0.smithi076.stdout:0/499: symlink db/dc/df/lb1 0 2024-03-28T13:06:11.706 INFO:tasks.workunit.client.0.smithi076.stdout:2/496: stat d2/d5/d7/d8/l1e 0 2024-03-28T13:06:11.731 INFO:tasks.workunit.client.0.smithi076.stdout:2/497: dwrite d2/d5/db/d3b/d3f/d79/f77 [0,4194304] 0 2024-03-28T13:06:11.754 INFO:tasks.workunit.client.0.smithi076.stdout:8/481: dread de/f3f [0,4194304] 0 2024-03-28T13:06:11.811 INFO:tasks.workunit.client.0.smithi076.stdout:1/451: mknod d14/d6c/d74/ca5 0 2024-03-28T13:06:11.956 INFO:tasks.workunit.client.0.smithi076.stdout:0/500: creat db/dc/df/d18/d9f/fb2 x:0 0 0 2024-03-28T13:06:12.127 INFO:tasks.workunit.client.0.smithi076.stdout:2/498: getdents d2/d5/db/d3b/d5a 0 2024-03-28T13:06:12.127 INFO:tasks.workunit.client.0.smithi076.stdout:2/499: getdents d2/d92 0 2024-03-28T13:06:12.127 INFO:tasks.workunit.client.0.smithi076.stdout:2/500: write d2/d5/d7/dd/f32 [4007431,51068] 0 2024-03-28T13:06:12.131 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:06:12.135 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:06:12.164 INFO:tasks.workunit.client.0.smithi076.stdout:8/482: creat de/d23/d2b/d58/d78/fa0 x:0 0 0 2024-03-28T13:06:12.499 INFO:tasks.workunit.client.0.smithi076.stdout:1/452: link d14/l72 d14/d19/d85/d2e/d31/d49/la6 0 2024-03-28T13:06:12.499 INFO:tasks.workunit.client.0.smithi076.stdout:1/453: write d14/d19/d85/d2e/f61 [2735269,54800] 0 2024-03-28T13:06:12.554 INFO:tasks.workunit.client.0.smithi076.stdout:1/454: dwrite f12 [0,4194304] 0 2024-03-28T13:06:12.663 INFO:tasks.workunit.client.0.smithi076.stdout:6/551: creat d6/da/d5f/d6d/fb4 x:0 0 0 2024-03-28T13:06:12.663 INFO:tasks.workunit.client.0.smithi076.stdout:0/501: symlink db/dc/df/d71/d4a/lb3 0 2024-03-28T13:06:12.679 INFO:tasks.workunit.client.0.smithi076.stdout:6/552: dread d6/f2f [0,4194304] 0 2024-03-28T13:06:12.749 INFO:tasks.workunit.client.0.smithi076.stdout:9/499: rename d9/dd/df/c9a to d9/da/ca4 0 2024-03-28T13:06:12.751 INFO:tasks.workunit.client.0.smithi076.stdout:4/547: sync 2024-03-28T13:06:12.864 INFO:tasks.workunit.client.0.smithi076.stdout:2/501: unlink d2/f16 0 2024-03-28T13:06:12.872 INFO:tasks.workunit.client.0.smithi076.stdout:8/483: dread de/d23/d2b/f30 [0,4194304] 0 2024-03-28T13:06:12.923 INFO:tasks.workunit.client.0.smithi076.stdout:8/484: dwrite de/d4e/d54/f64 [0,4194304] 0 2024-03-28T13:06:12.923 INFO:tasks.workunit.client.0.smithi076.stdout:8/485: readlink de/d13/l84 0 2024-03-28T13:06:12.923 INFO:tasks.workunit.client.0.smithi076.stdout:8/486: fsync de/d23/d2b/d5d/d76/d18/f1a 0 2024-03-28T13:06:12.923 INFO:tasks.workunit.client.0.smithi076.stdout:8/487: dread - de/d23/d2b/d58/d78/fa0 zero size 2024-03-28T13:06:12.923 INFO:tasks.workunit.client.0.smithi076.stdout:8/488: dread - de/d25/f85 zero size 2024-03-28T13:06:12.936 INFO:tasks.workunit.client.0.smithi076.stdout:8/489: dread de/d23/d2b/d5d/d76/d18/d3c/f44 [0,4194304] 0 2024-03-28T13:06:13.210 INFO:tasks.workunit.client.0.smithi076.stdout:0/502: symlink db/da6/lb4 0 2024-03-28T13:06:13.243 INFO:tasks.workunit.client.0.smithi076.stdout:0/503: dwrite db/dc/f24 [0,4194304] 0 2024-03-28T13:06:13.346 INFO:tasks.workunit.client.0.smithi076.stdout:6/553: mknod d6/da/d40/d56/da4/cb5 0 2024-03-28T13:06:13.346 INFO:tasks.workunit.client.0.smithi076.stdout:5/488: rename d5/db/d3f/d42/c67 to d5/d9/d4c/d63/cb7 0 2024-03-28T13:06:13.479 INFO:tasks.workunit.client.0.smithi076.stdout:4/548: unlink d0/c3d 0 2024-03-28T13:06:13.479 INFO:tasks.workunit.client.0.smithi076.stdout:4/549: write d0/d3b/d40/d42/d47/d7c/f91 [952063,108613] 0 2024-03-28T13:06:13.516 INFO:tasks.workunit.client.0.smithi076.stdout:2/502: dread d2/d5/db/d3b/d3f/f4f [0,4194304] 0 2024-03-28T13:06:13.624 INFO:tasks.workunit.client.0.smithi076.stdout:8/490: mknod de/d13/d27/d8c/ca1 0 2024-03-28T13:06:13.642 INFO:tasks.workunit.client.0.smithi076.stdout:7/482: sync 2024-03-28T13:06:13.642 INFO:tasks.workunit.client.0.smithi076.stdout:7/483: write d1/d8/d37/d53/f6a [828950,122687] 0 2024-03-28T13:06:13.650 INFO:tasks.workunit.client.0.smithi076.stdout:8/491: write de/d13/f35 [38197,112684] 0 2024-03-28T13:06:13.655 INFO:tasks.workunit.client.0.smithi076.stdout:7/484: dread d1/d8/d37/d53/f6a [0,4194304] 0 2024-03-28T13:06:13.655 INFO:tasks.workunit.client.0.smithi076.stdout:7/485: write d1/d18/d3c/f33 [4679544,32951] 0 2024-03-28T13:06:13.655 INFO:tasks.workunit.client.0.smithi076.stdout:7/486: chown d1/d18/d3c/d48/c8a 0 1 2024-03-28T13:06:13.655 INFO:tasks.workunit.client.0.smithi076.stdout:7/487: write d1/f16 [2926121,112680] 0 2024-03-28T13:06:13.655 INFO:tasks.workunit.client.0.smithi076.stdout:7/488: chown d1/d18/d3c/d8c/fa2 53656257 1 2024-03-28T13:06:13.656 INFO:tasks.workunit.client.0.smithi076.stdout:7/489: readlink d1/d8/d37/l98 0 2024-03-28T13:06:13.702 INFO:tasks.workunit.client.0.smithi076.stdout:0/504: symlink db/dc/df/d18/d9f/lb5 0 2024-03-28T13:06:13.723 INFO:tasks.workunit.client.0.smithi076.stdout:0/505: write db/dc/df/d11/d40/f64 [3237302,93807] 0 2024-03-28T13:06:13.723 INFO:tasks.workunit.client.0.smithi076.stdout:0/506: truncate db/dc/df/f23 195780 0 2024-03-28T13:06:13.796 INFO:tasks.workunit.client.0.smithi076.stdout:6/554: link d6/f4b d6/da/d40/d56/d84/fb6 0 2024-03-28T13:06:13.857 INFO:tasks.workunit.client.0.smithi076.stdout:5/489: creat d5/d9/d4c/d9b/fb8 x:0 0 0 2024-03-28T13:06:13.893 INFO:tasks.workunit.client.0.smithi076.stdout:5/490: dwrite d5/f6 [0,4194304] 0 2024-03-28T13:06:13.909 INFO:tasks.workunit.client.0.smithi076.stdout:5/491: dread d5/d9/d1c/d25/f3a [0,4194304] 0 2024-03-28T13:06:13.959 INFO:tasks.workunit.client.0.smithi076.stdout:5/492: dwrite d5/d9/d1c/d25/f2b [0,4194304] 0 2024-03-28T13:06:14.329 INFO:tasks.workunit.client.0.smithi076.stdout:4/550: link d0/d3b/d40/d42/d31/d5e/f83 d0/d3b/d50/d64/d89/d2d/fba 0 2024-03-28T13:06:14.329 INFO:tasks.workunit.client.0.smithi076.stdout:3/408: mkdir d1/d7/d30/d38/d14/d97 0 2024-03-28T13:06:14.329 INFO:tasks.workunit.client.0.smithi076.stdout:2/503: mknod d2/d5/db/d3b/d60/d96/c98 0 2024-03-28T13:06:14.349 INFO:tasks.workunit.client.0.smithi076.stdout:4/551: dread d0/d3b/d40/d42/d28/f49 [0,4194304] 0 2024-03-28T13:06:14.401 INFO:tasks.workunit.client.0.smithi076.stdout:1/455: rename d14/d19/f1f to d14/d6c/fa7 0 2024-03-28T13:06:14.401 INFO:tasks.workunit.client.0.smithi076.stdout:1/456: readlink d14/d19/d85/d2e/d31/l67 0 2024-03-28T13:06:14.775 INFO:tasks.workunit.client.0.smithi076.stdout:6/555: mknod d6/da/d89/cb7 0 2024-03-28T13:06:14.775 INFO:tasks.workunit.client.0.smithi076.stdout:5/493: mknod d5/d9/d35/d3b/db6/cb9 0 2024-03-28T13:06:14.812 INFO:tasks.workunit.client.0.smithi076.stdout:3/409: mknod d1/d7/d30/d38/d14/d4a/d66/c98 0 2024-03-28T13:06:14.856 INFO:tasks.workunit.client.0.smithi076.stdout:2/504: mkdir d2/d5/db/d3b/d3f/d99 0 2024-03-28T13:06:15.076 INFO:tasks.workunit.client.0.smithi076.stdout:9/500: write d9/dd/df/d11/d14/f31 [8593803,80483] 0 2024-03-28T13:06:15.152 INFO:tasks.workunit.client.0.smithi076.stdout:1/457: mkdir d14/d19/d85/d2e/d91/da8 0 2024-03-28T13:06:15.348 INFO:tasks.workunit.client.0.smithi076.stdout:8/492: truncate de/d23/d2b/d51/d60/f73 646079 0 2024-03-28T13:06:15.370 INFO:tasks.workunit.client.0.smithi076.stdout:8/493: write fa [2105939,8646] 0 2024-03-28T13:06:15.370 INFO:tasks.workunit.client.0.smithi076.stdout:0/507: creat db/d16/fb6 x:0 0 0 2024-03-28T13:06:15.370 INFO:tasks.workunit.client.0.smithi076.stdout:0/508: write db/dc/df/d18/d1d/d75/f39 [2681291,52497] 0 2024-03-28T13:06:15.370 INFO:tasks.workunit.client.0.smithi076.stdout:0/509: write db/dc/df/d11/d40/d77/da2/f6b [931218,115812] 0 2024-03-28T13:06:15.370 INFO:tasks.workunit.client.0.smithi076.stdout:0/510: readlink db/dc/df/d18/d1d/l25 0 2024-03-28T13:06:15.375 INFO:tasks.workunit.client.0.smithi076.stdout:6/556: creat d6/da/d40/d56/da4/fb8 x:0 0 0 2024-03-28T13:06:15.426 INFO:tasks.workunit.client.0.smithi076.stdout:6/557: dwrite d6/da/d23/f4d [0,4194304] 0 2024-03-28T13:06:15.512 INFO:tasks.workunit.client.0.smithi076.stdout:5/494: rename d5/d9/d1c/d1d/d22/f68 to d5/d9/d1c/d25/d73/fba 0 2024-03-28T13:06:15.535 INFO:tasks.workunit.client.0.smithi076.stdout:5/495: dwrite d5/d9/d1c/d25/f5d [0,4194304] 0 2024-03-28T13:06:15.565 INFO:tasks.workunit.client.0.smithi076.stdout:3/410: symlink d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d58/l99 0 2024-03-28T13:06:15.629 INFO:tasks.workunit.client.0.smithi076.stdout:9/501: dread d9/f36 [0,4194304] 0 2024-03-28T13:06:15.836 INFO:tasks.workunit.client.0.smithi076.stdout:1/458: dread d14/d19/d85/d2e/d31/d8f/f9c [0,4194304] 0 2024-03-28T13:06:15.850 INFO:tasks.workunit.client.0.smithi076.stdout:1/459: dread d14/d19/d85/d2e/d31/f53 [0,4194304] 0 2024-03-28T13:06:16.307 INFO:tasks.workunit.client.0.smithi076.stdout:8/494: mkdir de/d13/da2 0 2024-03-28T13:06:16.307 INFO:tasks.workunit.client.0.smithi076.stdout:0/511: truncate db/dc/d3d/d57/f5b 6566443 0 2024-03-28T13:06:16.308 INFO:tasks.workunit.client.0.smithi076.stdout:8/495: write de/d13/d27/f34 [1726557,112631] 0 2024-03-28T13:06:16.310 INFO:tasks.workunit.client.0.smithi076.stdout:6/558: creat d6/da/d5f/d6d/fb9 x:0 0 0 2024-03-28T13:06:16.322 INFO:tasks.workunit.client.0.smithi076.stdout:6/559: dread d6/da/d23/f45 [0,4194304] 0 2024-03-28T13:06:16.322 INFO:tasks.workunit.client.0.smithi076.stdout:6/560: fsync d6/f2f 0 2024-03-28T13:06:16.476 INFO:tasks.workunit.client.0.smithi076.stdout:5/496: creat d5/db/d3f/d42/d43/d7a/fbb x:0 0 0 2024-03-28T13:06:16.586 INFO:tasks.workunit.client.0.smithi076.stdout:9/502: getdents d9 0 2024-03-28T13:06:16.586 INFO:tasks.workunit.client.0.smithi076.stdout:9/503: write d9/dd/df/d11/d14/d58/d6e/f97 [844055,73429] 0 2024-03-28T13:06:16.587 INFO:tasks.workunit.client.0.smithi076.stdout:9/504: chown d9/dd/df/d11/d14/f4e 20 1 2024-03-28T13:06:16.683 INFO:tasks.workunit.client.0.smithi076.stdout:1/460: link d14/d19/f47 d14/d19/d85/d62/fa9 0 2024-03-28T13:06:16.859 INFO:tasks.workunit.client.0.smithi076.stdout:0/512: creat db/dc/df/d18/d1d/d75/fb7 x:0 0 0 2024-03-28T13:06:16.869 INFO:tasks.workunit.client.0.smithi076.stdout:8/496: rename de/d13/l84 to de/d23/d2b/d58/d8e/la3 0 2024-03-28T13:06:16.871 INFO:tasks.workunit.client.0.smithi076.stdout:6/561: link d6/l5e d6/da/d5f/d6d/daf/lba 0 2024-03-28T13:06:16.968 INFO:tasks.workunit.client.0.smithi076.stdout:5/497: creat d5/d9/d1c/d1d/d22/fbc x:0 0 0 2024-03-28T13:06:17.084 INFO:tasks.workunit.client.0.smithi076.stdout:9/505: rmdir d9/dd/df/d11/d37 39 2024-03-28T13:06:17.158 INFO:tasks.workunit.client.0.smithi076.stdout:8/497: mknod de/d23/d2b/d58/d8e/ca4 0 2024-03-28T13:06:17.235 INFO:tasks.workunit.client.0.smithi076.stdout:1/461: rename d14/d19/d85/d2e/d31/d51/c71 to d14/d19/d85/d62/caa 0 2024-03-28T13:06:17.596 INFO:tasks.workunit.client.0.smithi076.stdout:9/506: creat d9/d74/d7d/fa5 x:0 0 0 2024-03-28T13:06:17.619 INFO:tasks.workunit.client.0.smithi076.stdout:9/507: read d9/da/f68 [2215259,78367] 0 2024-03-28T13:06:17.619 INFO:tasks.workunit.client.0.smithi076.stdout:9/508: read - d9/dd/df/d11/d14/d58/d6e/f9b zero size 2024-03-28T13:06:17.619 INFO:tasks.workunit.client.0.smithi076.stdout:9/509: readlink d9/d74/d7d/l82 0 2024-03-28T13:06:17.619 INFO:tasks.workunit.client.0.smithi076.stdout:9/510: chown d9/dd/df/c5d 328526 1 2024-03-28T13:06:17.654 INFO:tasks.workunit.client.0.smithi076.stdout:8/498: creat de/d23/d2b/d5d/d76/d6e/d8a/fa5 x:0 0 0 2024-03-28T13:06:17.654 INFO:tasks.workunit.client.0.smithi076.stdout:8/499: write de/d25/f85 [952505,45828] 0 2024-03-28T13:06:17.750 INFO:tasks.workunit.client.0.smithi076.stdout:6/562: rename d6/da/d5f/d6d/d95/fa5 to d6/da/d5f/d6d/fbb 0 2024-03-28T13:06:17.750 INFO:tasks.workunit.client.0.smithi076.stdout:6/563: dread - d6/da/d5f/d6d/d95/fb2 zero size 2024-03-28T13:06:17.750 INFO:tasks.workunit.client.0.smithi076.stdout:6/564: chown d6/da/d40/d62/cab 1657 1 2024-03-28T13:06:17.751 INFO:tasks.workunit.client.0.smithi076.stdout:6/565: write d6/d99/f67 [1008020,34698] 0 2024-03-28T13:06:17.793 INFO:tasks.workunit.client.0.smithi076.stdout:1/462: rmdir d14/d6c/d74/d9e 39 2024-03-28T13:06:17.794 INFO:tasks.workunit.client.0.smithi076.stdout:1/463: fdatasync d14/d19/d85/d2e/d31/f8c 0 2024-03-28T13:06:17.823 INFO:tasks.workunit.client.0.smithi076.stdout:1/464: dwrite d14/d19/d85/d2e/d31/d3b/f4e [0,4194304] 0 2024-03-28T13:06:17.841 INFO:tasks.workunit.client.0.smithi076.stdout:9/511: mkdir d9/d74/da6 0 2024-03-28T13:06:17.871 INFO:tasks.workunit.client.0.smithi076.stdout:8/500: rmdir de/d4e/d54/d98 39 2024-03-28T13:06:18.203 INFO:tasks.workunit.client.0.smithi076.stdout:9/512: unlink d9/d3c/f95 0 2024-03-28T13:06:18.258 INFO:tasks.workunit.client.0.smithi076.stdout:9/513: dwrite d9/dd/f2e [0,4194304] 0 2024-03-28T13:06:18.258 INFO:tasks.workunit.client.0.smithi076.stdout:9/514: write d9/dd/df/d11/d14/f65 [886310,24615] 0 2024-03-28T13:06:18.423 INFO:tasks.workunit.client.0.smithi076.stdout:9/515: mknod d9/d74/da6/ca7 0 2024-03-28T13:06:18.450 INFO:tasks.workunit.client.0.smithi076.stdout:8/501: truncate de/d23/f1e 2073751 0 2024-03-28T13:06:18.548 INFO:tasks.workunit.client.0.smithi076.stdout:9/516: creat d9/d3c/fa8 x:0 0 0 2024-03-28T13:06:18.615 INFO:tasks.workunit.client.0.smithi076.stdout:8/502: mknod de/d23/ca6 0 2024-03-28T13:06:18.615 INFO:tasks.workunit.client.0.smithi076.stdout:8/503: write de/d13/f94 [916367,28747] 0 2024-03-28T13:06:18.616 INFO:tasks.workunit.client.0.smithi076.stdout:8/504: chown de/d23/d2b/d5d/d76/l24 1285129 1 2024-03-28T13:06:18.677 INFO:tasks.workunit.client.0.smithi076.stdout:9/517: creat d9/dd/df/d11/fa9 x:0 0 0 2024-03-28T13:06:18.677 INFO:tasks.workunit.client.0.smithi076.stdout:9/518: readlink d9/dd/df/d11/l4a 0 2024-03-28T13:06:18.844 INFO:tasks.workunit.client.0.smithi076.stdout:8/505: creat de/fa7 x:0 0 0 2024-03-28T13:06:18.844 INFO:tasks.workunit.client.0.smithi076.stdout:9/519: creat d9/d3c/faa x:0 0 0 2024-03-28T13:06:18.844 INFO:tasks.workunit.client.0.smithi076.stdout:3/411: creat d1/d7/d30/d38/d14/d36/d56/f9a x:0 0 0 2024-03-28T13:06:18.844 INFO:tasks.workunit.client.0.smithi076.stdout:9/520: write d9/dd/df/d11/d14/d58/d6e/f97 [1824321,35789] 0 2024-03-28T13:06:18.889 INFO:tasks.workunit.client.0.smithi076.stdout:3/412: dwrite d1/d7/d30/d38/d14/f8c [0,4194304] 0 2024-03-28T13:06:18.895 INFO:tasks.workunit.client.0.smithi076.stdout:3/413: read d1/d7/d30/d38/d14/d36/d56/f7f [195997,108869] 0 2024-03-28T13:06:19.250 INFO:tasks.workunit.client.0.smithi076.stdout:5/498: rename d5/db/d3f/d42/d43 to d5/d9/d1c/d25/dbd 0 2024-03-28T13:06:19.250 INFO:tasks.workunit.client.0.smithi076.stdout:2/505: creat d2/d5/db/d3b/f9a x:0 0 0 2024-03-28T13:06:19.264 INFO:tasks.workunit.client.0.smithi076.stdout:5/499: dread d5/d9/d1c/d25/f5d [0,4194304] 0 2024-03-28T13:06:19.264 INFO:tasks.workunit.client.0.smithi076.stdout:5/500: write d5/d9/d1c/d1d/d22/fb4 [421882,2200] 0 2024-03-28T13:06:19.822 INFO:tasks.workunit.client.0.smithi076.stdout:9/521: rename d9/dd/df/d11/d14/c3f to d9/dd/df/d11/d14/d58/d6e/d2a/cab 0 2024-03-28T13:06:19.934 INFO:tasks.workunit.client.0.smithi076.stdout:5/501: link d5/f80 d5/d9/d1c/d25/dbd/fbe 0 2024-03-28T13:06:19.957 INFO:tasks.workunit.client.0.smithi076.stdout:8/506: truncate de/d23/d2b/d58/d78/f81 1889067 0 2024-03-28T13:06:20.181 INFO:tasks.workunit.client.0.smithi076.stdout:5/502: mknod d5/d9/d1c/d1d/d31/cbf 0 2024-03-28T13:06:20.197 INFO:tasks.workunit.client.0.smithi076.stdout:5/503: dread d5/db/d3f/d42/f83 [4194304,4194304] 0 2024-03-28T13:06:20.270 INFO:tasks.workunit.client.0.smithi076.stdout:8/507: rename de/d13/c3d to de/d23/d2b/d58/ca8 0 2024-03-28T13:06:20.270 INFO:tasks.workunit.client.0.smithi076.stdout:8/508: readlink de/d23/d2b/d5d/d76/d18/l48 0 2024-03-28T13:06:20.482 INFO:tasks.workunit.client.0.smithi076.stdout:8/509: symlink de/d13/d27/d8c/la9 0 2024-03-28T13:06:20.838 INFO:tasks.workunit.client.0.smithi076.stdout:1/465: dwrite d14/f2f [0,4194304] 0 2024-03-28T13:06:20.988 INFO:tasks.workunit.client.0.smithi076.stdout:8/510: link de/d4e/d54/c70 de/d23/d2b/d5d/d76/d6e/d8a/caa 0 2024-03-28T13:06:20.988 INFO:tasks.workunit.client.0.smithi076.stdout:8/511: stat de/d23/d2b/d5d/d76/d18/d49/l59 0 2024-03-28T13:06:20.988 INFO:tasks.workunit.client.0.smithi076.stdout:7/490: symlink d1/lab 0 2024-03-28T13:06:20.988 INFO:tasks.workunit.client.0.smithi076.stdout:7/491: chown d1/d18/f95 2 1 2024-03-28T13:06:20.988 INFO:tasks.workunit.client.0.smithi076.stdout:7/492: write d1/f5 [3421626,13483] 0 2024-03-28T13:06:21.044 INFO:tasks.workunit.client.0.smithi076.stdout:1/466: link d14/d19/l69 d14/d19/d85/d2e/d91/lab 0 2024-03-28T13:06:21.441 INFO:tasks.workunit.client.0.smithi076.stdout:2/506: creat d2/d5/db/d3b/d3f/f9b x:0 0 0 2024-03-28T13:06:21.482 INFO:tasks.workunit.client.0.smithi076.stdout:8/512: mknod de/d25/d7f/cab 0 2024-03-28T13:06:21.483 INFO:tasks.workunit.client.0.smithi076.stdout:7/493: mkdir d1/d8/d37/d53/dac 0 2024-03-28T13:06:21.487 INFO:tasks.workunit.client.0.smithi076.stdout:1/467: creat d14/d19/d85/d2e/d31/d46/fac x:0 0 0 2024-03-28T13:06:21.493 INFO:tasks.workunit.client.0.smithi076.stdout:2/507: dwrite d2/d5/db/d3b/d3f/d79/f8e [0,4194304] 0 2024-03-28T13:06:21.509 INFO:tasks.workunit.client.0.smithi076.stdout:8/513: dwrite de/d23/d2b/d5d/d76/f72 [0,4194304] 0 2024-03-28T13:06:21.713 INFO:tasks.workunit.client.0.smithi076.stdout:9/522: write d9/dd/df/d11/d14/f6a [160891,92781] 0 2024-03-28T13:06:21.825 INFO:tasks.workunit.client.0.smithi076.stdout:7/494: creat d1/d18/fad x:0 0 0 2024-03-28T13:06:21.833 INFO:tasks.workunit.client.0.smithi076.stdout:1/468: unlink d14/d19/c24 0 2024-03-28T13:06:21.850 INFO:tasks.workunit.client.0.smithi076.stdout:7/495: dwrite d1/d8/d37/f9a [0,4194304] 0 2024-03-28T13:06:21.926 INFO:tasks.workunit.client.0.smithi076.stdout:2/508: unlink d2/d5/db/d3b/d3f/f9b 0 2024-03-28T13:06:22.058 INFO:tasks.workunit.client.0.smithi076.stdout:8/514: mknod de/d23/d2b/d58/cac 0 2024-03-28T13:06:22.528 INFO:tasks.workunit.client.0.smithi076.stdout:1/469: rename d14/d19/l68 to d14/d6c/lad 0 2024-03-28T13:06:22.531 INFO:tasks.workunit.client.0.smithi076.stdout:6/566: sync 2024-03-28T13:06:22.531 INFO:tasks.workunit.client.0.smithi076.stdout:0/513: sync 2024-03-28T13:06:22.531 INFO:tasks.workunit.client.0.smithi076.stdout:4/552: sync 2024-03-28T13:06:22.531 INFO:tasks.workunit.client.0.smithi076.stdout:6/567: dread - d6/f7a zero size 2024-03-28T13:06:22.531 INFO:tasks.workunit.client.0.smithi076.stdout:6/568: fdatasync d6/da/d40/d56/f6c 0 2024-03-28T13:06:22.548 INFO:tasks.workunit.client.0.smithi076.stdout:6/569: dread d6/da/d1e/f3d [0,4194304] 0 2024-03-28T13:06:22.556 INFO:tasks.workunit.client.0.smithi076.stdout:7/496: mkdir d1/d8/d37/d53/dae 0 2024-03-28T13:06:22.561 INFO:tasks.workunit.client.0.smithi076.stdout:4/553: dwrite d0/d3b/d50/da8/f71 [4194304,4194304] 0 2024-03-28T13:06:22.562 INFO:tasks.workunit.client.0.smithi076.stdout:4/554: readlink d0/d20/l2f 0 2024-03-28T13:06:22.875 INFO:tasks.workunit.client.0.smithi076.stdout:2/509: mkdir d2/d5/d4b/d39/d57/d9c 0 2024-03-28T13:06:22.939 INFO:tasks.workunit.client.0.smithi076.stdout:1/470: creat d14/d19/d85/d2e/d91/fae x:0 0 0 2024-03-28T13:06:22.939 INFO:tasks.workunit.client.0.smithi076.stdout:1/471: readlink d14/l72 0 2024-03-28T13:06:23.043 INFO:tasks.workunit.client.0.smithi076.stdout:0/514: rename db/dc/f24 to db/dc/df/d18/d1d/fb8 0 2024-03-28T13:06:23.134 INFO:tasks.workunit.client.0.smithi076.stdout:6/570: creat d6/da/d40/d62/db0/fbc x:0 0 0 2024-03-28T13:06:23.180 INFO:tasks.workunit.client.0.smithi076.stdout:7/497: mknod d1/d8/caf 0 2024-03-28T13:06:23.180 INFO:tasks.workunit.client.0.smithi076.stdout:7/498: write d1/d18/d3c/d48/d69/d79/f89 [4593589,50595] 0 2024-03-28T13:06:23.180 INFO:tasks.workunit.client.0.smithi076.stdout:7/499: write d1/f36 [2109789,70437] 0 2024-03-28T13:06:23.209 INFO:tasks.workunit.client.0.smithi076.stdout:7/500: dwrite d1/f65 [0,4194304] 0 2024-03-28T13:06:23.255 INFO:tasks.workunit.client.0.smithi076.stdout:7/501: dwrite d1/d18/d3c/f33 [4194304,4194304] 0 2024-03-28T13:06:23.256 INFO:tasks.workunit.client.0.smithi076.stdout:7/502: dread - d1/fa1 zero size 2024-03-28T13:06:23.261 INFO:tasks.workunit.client.0.smithi076.stdout:4/555: mknod d0/d3b/d50/d64/d89/d2d/cbb 0 2024-03-28T13:06:23.336 INFO:tasks.workunit.client.0.smithi076.stdout:1/472: creat d14/d19/d85/faf x:0 0 0 2024-03-28T13:06:23.556 INFO:tasks.workunit.client.0.smithi076.stdout:2/510: rename d2/d5/d7/c53 to d2/c9d 0 2024-03-28T13:06:23.557 INFO:tasks.workunit.client.0.smithi076.stdout:0/515: mkdir db/dc/df/d11/d40/d77/da2/d6d/db9 0 2024-03-28T13:06:23.570 INFO:tasks.workunit.client.0.smithi076.stdout:6/571: creat d6/da/d40/d56/d58/fbd x:0 0 0 2024-03-28T13:06:23.589 INFO:tasks.workunit.client.0.smithi076.stdout:6/572: write d6/f2f [2630416,55774] 0 2024-03-28T13:06:23.589 INFO:tasks.workunit.client.0.smithi076.stdout:6/573: truncate d6/da/d5f/d6d/d95/fb2 879074 0 2024-03-28T13:06:23.589 INFO:tasks.workunit.client.0.smithi076.stdout:6/574: dread - d6/d99/d46/f74 zero size 2024-03-28T13:06:23.589 INFO:tasks.workunit.client.0.smithi076.stdout:6/575: dread - d6/da/d23/fa7 zero size 2024-03-28T13:06:23.812 INFO:tasks.workunit.client.0.smithi076.stdout:7/503: link d1/d18/d3c/d8c/fa9 d1/d18/d3c/d48/d69/fb0 0 2024-03-28T13:06:23.813 INFO:tasks.workunit.client.0.smithi076.stdout:9/523: creat d9/dd/df/d11/fac x:0 0 0 2024-03-28T13:06:23.832 INFO:tasks.workunit.client.0.smithi076.stdout:4/556: dread d0/d3b/d40/d42/d31/f56 [4194304,4194304] 0 2024-03-28T13:06:23.970 INFO:tasks.workunit.client.0.smithi076.stdout:1/473: symlink d14/d19/d85/d2e/d31/d51/d92/lb0 0 2024-03-28T13:06:23.971 INFO:tasks.workunit.client.0.smithi076.stdout:2/511: mkdir d2/d5/db/d3b/d3f/d79/d9e 0 2024-03-28T13:06:23.989 INFO:tasks.workunit.client.0.smithi076.stdout:2/512: dread d2/d5/d7/f23 [0,4194304] 0 2024-03-28T13:06:24.035 INFO:tasks.workunit.client.0.smithi076.stdout:0/516: read db/dc/df/d18/f5f [2651740,55048] 0 2024-03-28T13:06:24.082 INFO:tasks.workunit.client.0.smithi076.stdout:3/414: mkdir d1/d7/d30/d38/d9b 0 2024-03-28T13:06:24.082 INFO:tasks.workunit.client.0.smithi076.stdout:3/415: readlink d1/d7/d30/d38/d14/d36/l45 0 2024-03-28T13:06:24.247 INFO:tasks.workunit.client.0.smithi076.stdout:6/576: symlink d6/da/d39/d63/lbe 0 2024-03-28T13:06:24.327 INFO:tasks.workunit.client.0.smithi076.stdout:7/504: rename d1/dc/c61 to d1/dc/d8b/cb1 0 2024-03-28T13:06:24.343 INFO:tasks.workunit.client.0.smithi076.stdout:7/505: dread d1/d8/f19 [0,4194304] 0 2024-03-28T13:06:24.343 INFO:tasks.workunit.client.0.smithi076.stdout:7/506: write d1/dc/f2b [4925275,66643] 0 2024-03-28T13:06:24.386 INFO:tasks.workunit.client.0.smithi076.stdout:7/507: dwrite d1/d18/d3c/d8c/fa2 [0,4194304] 0 2024-03-28T13:06:24.386 INFO:tasks.workunit.client.0.smithi076.stdout:7/508: read - d1/d18/d3c/d48/d69/fb0 zero size 2024-03-28T13:06:24.386 INFO:tasks.workunit.client.0.smithi076.stdout:7/509: write d1/f7e [12211,130409] 0 2024-03-28T13:06:24.422 INFO:tasks.workunit.client.0.smithi076.stdout:7/510: dwrite d1/d8/d37/d53/f8f [0,4194304] 0 2024-03-28T13:06:24.433 INFO:tasks.workunit.client.0.smithi076.stdout:7/511: dread d1/dc/f1c [0,4194304] 0 2024-03-28T13:06:24.480 INFO:tasks.workunit.client.0.smithi076.stdout:7/512: dwrite d1/d18/d3c/d8c/fa9 [0,4194304] 0 2024-03-28T13:06:24.541 INFO:tasks.workunit.client.0.smithi076.stdout:9/524: dwrite d9/d3c/f2f [0,4194304] 0 2024-03-28T13:06:24.541 INFO:tasks.workunit.client.0.smithi076.stdout:9/525: write d9/dd/df/d11/fac [569571,75215] 0 2024-03-28T13:06:24.773 INFO:tasks.workunit.client.0.smithi076.stdout:4/557: read d0/d3b/d40/d42/f65 [1375320,11181] 0 2024-03-28T13:06:24.970 INFO:tasks.workunit.client.0.smithi076.stdout:0/517: unlink db/da6/lb4 0 2024-03-28T13:06:24.979 INFO:tasks.workunit.client.0.smithi076.stdout:8/515: write de/d23/d2b/d58/d78/f81 [1335999,36273] 0 2024-03-28T13:06:25.085 INFO:tasks.workunit.client.0.smithi076.stdout:3/416: write d1/d7/d30/d38/d14/d51/f8a [741268,31602] 0 2024-03-28T13:06:25.649 INFO:tasks.workunit.client.0.smithi076.stdout:7/513: truncate d1/f40 3931759 0 2024-03-28T13:06:25.649 INFO:tasks.workunit.client.0.smithi076.stdout:7/514: chown d1/d8/d37/l9b 5605 1 2024-03-28T13:06:25.698 INFO:tasks.workunit.client.0.smithi076.stdout:2/513: rename d2/d5/db/d3b/d3f/d79 to d2/d5/db/d3b/d9f 0 2024-03-28T13:06:25.698 INFO:tasks.workunit.client.0.smithi076.stdout:8/516: symlink de/d23/d2b/d5d/d76/d18/d3c/d50/lad 0 2024-03-28T13:06:25.698 INFO:tasks.workunit.client.0.smithi076.stdout:2/514: readlink d2/d5/d4b/l58 0 2024-03-28T13:06:25.843 INFO:tasks.workunit.client.0.smithi076.stdout:3/417: creat d1/d7/d30/d38/d14/d36/d56/d5b/d89/f9c x:0 0 0 2024-03-28T13:06:25.844 INFO:tasks.workunit.client.0.smithi076.stdout:5/504: sync 2024-03-28T13:06:25.844 INFO:tasks.workunit.client.0.smithi076.stdout:5/505: fdatasync d5/d9/d1c/d1d/fa6 0 2024-03-28T13:06:25.844 INFO:tasks.workunit.client.0.smithi076.stdout:5/506: chown d5/d9/d1c/d25/dbd/l4e 12473590 1 2024-03-28T13:06:25.878 INFO:tasks.workunit.client.0.smithi076.stdout:7/515: symlink d1/d8/lb2 0 2024-03-28T13:06:25.910 INFO:tasks.workunit.client.0.smithi076.stdout:5/507: dwrite d5/db/d3f/d42/f83 [0,4194304] 0 2024-03-28T13:06:25.931 INFO:tasks.workunit.client.0.smithi076.stdout:7/516: dwrite d1/d18/d3c/d48/d69/f6d [0,4194304] 0 2024-03-28T13:06:26.102 INFO:tasks.workunit.client.0.smithi076.stdout:4/558: mknod d0/d3b/d40/d42/d47/cbc 0 2024-03-28T13:06:26.124 INFO:tasks.workunit.client.0.smithi076.stdout:4/559: write d0/d3b/d40/d42/d31/d4d/f52 [5182601,46406] 0 2024-03-28T13:06:26.224 INFO:tasks.workunit.client.0.smithi076.stdout:8/517: unlink f7 0 2024-03-28T13:06:26.227 INFO:tasks.workunit.client.0.smithi076.stdout:8/518: dread de/d23/d2b/d5d/d76/f21 [0,4194304] 0 2024-03-28T13:06:26.268 INFO:tasks.workunit.client.0.smithi076.stdout:2/515: mkdir d2/d5/d7/d8/d21/da0 0 2024-03-28T13:06:26.354 INFO:tasks.workunit.client.0.smithi076.stdout:3/418: creat d1/d7/d30/d5f/f9d x:0 0 0 2024-03-28T13:06:26.354 INFO:tasks.workunit.client.0.smithi076.stdout:3/419: chown d1/f1b 535070350 1 2024-03-28T13:06:26.391 INFO:tasks.workunit.client.0.smithi076.stdout:5/508: rmdir d5/d9/d1c/d1d/d31 39 2024-03-28T13:06:26.533 INFO:tasks.workunit.client.0.smithi076.stdout:9/526: rename d9/d74/da6 to d9/dd/d48/dad 0 2024-03-28T13:06:26.540 INFO:tasks.workunit.client.0.smithi076.stdout:7/517: dread d1/d8/d37/f47 [0,4194304] 0 2024-03-28T13:06:26.541 INFO:tasks.workunit.client.0.smithi076.stdout:7/518: dread d1/f3d [0,4194304] 0 2024-03-28T13:06:26.595 INFO:tasks.workunit.client.0.smithi076.stdout:7/519: dwrite d1/d18/d3c/d7b/d7d/f82 [0,4194304] 0 2024-03-28T13:06:26.837 INFO:tasks.workunit.client.0.smithi076.stdout:0/518: rmdir db/dc/df/d18/d1d/d73 39 2024-03-28T13:06:27.014 INFO:tasks.workunit.client.0.smithi076.stdout:4/560: creat d0/d20/d7b/fbd x:0 0 0 2024-03-28T13:06:27.060 INFO:tasks.workunit.client.0.smithi076.stdout:6/577: mknod d6/da/d40/cbf 0 2024-03-28T13:06:27.107 INFO:tasks.workunit.client.0.smithi076.stdout:6/578: dwrite d6/da/d40/d56/f96 [0,4194304] 0 2024-03-28T13:06:27.126 INFO:tasks.workunit.client.0.smithi076.stdout:2/516: getdents d2/d5/d4b/d39 0 2024-03-28T13:06:27.442 INFO:tasks.workunit.client.0.smithi076.stdout:9/527: symlink d9/dd/df/d11/d14/d58/d6e/lae 0 2024-03-28T13:06:27.442 INFO:tasks.workunit.client.0.smithi076.stdout:9/528: fdatasync d9/dd/df/d11/d37/f9c 0 2024-03-28T13:06:27.646 INFO:tasks.workunit.client.0.smithi076.stdout:0/519: unlink db/dc/df/d11/d40/f42 0 2024-03-28T13:06:27.781 INFO:tasks.workunit.client.0.smithi076.stdout:8/519: rename de/d23/d2b/d5d/d76/d18/d3c/d50 to de/d23/d2b/d58/d7d/dae 0 2024-03-28T13:06:27.809 INFO:tasks.workunit.client.0.smithi076.stdout:4/561: dwrite d0/d3b/d40/d42/f24 [0,4194304] 0 2024-03-28T13:06:27.809 INFO:tasks.workunit.client.0.smithi076.stdout:4/562: dread - d0/d20/d7b/fbd zero size 2024-03-28T13:06:27.961 INFO:tasks.workunit.client.0.smithi076.stdout:6/579: mknod d6/d99/cc0 0 2024-03-28T13:06:27.962 INFO:tasks.workunit.client.0.smithi076.stdout:2/517: symlink d2/d92/la1 0 2024-03-28T13:06:28.210 INFO:tasks.workunit.client.0.smithi076.stdout:7/520: rename d1/d18/d3c/d48/d69/d79/ca5 to d1/d18/d3c/d7b/d84/cb3 0 2024-03-28T13:06:28.210 INFO:tasks.workunit.client.0.smithi076.stdout:7/521: chown d1/d18/d3c/d48/l96 10483 1 2024-03-28T13:06:28.294 INFO:tasks.workunit.client.0.smithi076.stdout:8/520: unlink de/d23/d2b/d5d/d76/d6e/d7a/c40 0 2024-03-28T13:06:28.447 INFO:tasks.workunit.client.0.smithi076.stdout:2/518: truncate d2/d5/d7/f19 4163394 0 2024-03-28T13:06:28.448 INFO:tasks.workunit.client.0.smithi076.stdout:0/520: write db/dc/df/d18/d1d/d73/f81 [4944993,80031] 0 2024-03-28T13:06:28.478 INFO:tasks.workunit.client.0.smithi076.stdout:2/519: write d2/d5/db/d3b/d9f/f77 [1119068,95051] 0 2024-03-28T13:06:28.478 INFO:tasks.workunit.client.0.smithi076.stdout:2/520: getdents d2/d5/db/d3b/d94 0 2024-03-28T13:06:28.478 INFO:tasks.workunit.client.0.smithi076.stdout:2/521: chown d2/d5/d7/d8/d21 90137704 1 2024-03-28T13:06:28.484 INFO:tasks.workunit.client.0.smithi076.stdout:0/521: dwrite db/dc/df/d11/fa3 [0,4194304] 0 2024-03-28T13:06:28.499 INFO:tasks.workunit.client.0.smithi076.stdout:2/522: dread d2/d5/f12 [0,4194304] 0 2024-03-28T13:06:28.503 INFO:tasks.workunit.client.0.smithi076.stdout:0/522: write db/dc/df/d18/d1d/fb8 [2061844,33635] 0 2024-03-28T13:06:28.524 INFO:tasks.workunit.client.0.smithi076.stdout:0/523: dread db/f4b [0,4194304] 0 2024-03-28T13:06:28.536 INFO:tasks.workunit.client.0.smithi076.stdout:9/529: rename d9/dd/df/d11/d37/f9c to d9/dd/df/d11/d14/d58/faf 0 2024-03-28T13:06:28.563 INFO:tasks.workunit.client.0.smithi076.stdout:9/530: dwrite d9/dd/df/d11/d14/d58/f6c [0,4194304] 0 2024-03-28T13:06:28.642 INFO:tasks.workunit.client.0.smithi076.stdout:7/522: creat d1/d18/d3c/d7b/fb4 x:0 0 0 2024-03-28T13:06:28.719 INFO:tasks.workunit.client.0.smithi076.stdout:8/521: symlink de/d4e/laf 0 2024-03-28T13:06:28.834 INFO:tasks.workunit.client.0.smithi076.stdout:2/523: mknod d2/d5/db/d3b/d3f/d99/ca2 0 2024-03-28T13:06:28.834 INFO:tasks.workunit.client.0.smithi076.stdout:2/524: stat d2/d5/d7/d28/d64/l7e 0 2024-03-28T13:06:28.834 INFO:tasks.workunit.client.0.smithi076.stdout:2/525: stat d2/d5/d7/f19 0 2024-03-28T13:06:28.904 INFO:tasks.workunit.client.0.smithi076.stdout:0/524: mknod db/dc/df/d18/d1d/d75/d51/cba 0 2024-03-28T13:06:29.018 INFO:tasks.workunit.client.0.smithi076.stdout:4/563: rename d0/d3b/d40/c74 to d0/d3b/d40/d42/d31/d5e/d72/cbe 0 2024-03-28T13:06:29.164 INFO:tasks.workunit.client.0.smithi076.stdout:8/522: symlink de/d4e/d54/d68/lb0 0 2024-03-28T13:06:29.165 INFO:tasks.workunit.client.0.smithi076.stdout:8/523: write de/d13/d27/f34 [185138,93052] 0 2024-03-28T13:06:29.290 INFO:tasks.workunit.client.0.smithi076.stdout:2/526: mkdir d2/d5/db/d3b/d94/da3 0 2024-03-28T13:06:29.290 INFO:tasks.workunit.client.0.smithi076.stdout:0/525: creat db/fbb x:0 0 0 2024-03-28T13:06:29.386 INFO:tasks.workunit.client.0.smithi076.stdout:3/420: dwrite d1/d7/d30/d38/d14/d27/d42/f68 [4194304,4194304] 0 2024-03-28T13:06:29.405 INFO:tasks.workunit.client.0.smithi076.stdout:3/421: write d1/d7/d30/d60/f88 [1311992,96494] 0 2024-03-28T13:06:29.596 INFO:tasks.workunit.client.0.smithi076.stdout:8/524: unlink de/d13/d27/d8c/ca1 0 2024-03-28T13:06:29.631 INFO:tasks.workunit.client.0.smithi076.stdout:8/525: dwrite de/d23/d2b/d5d/d76/f4a [0,4194304] 0 2024-03-28T13:06:29.662 INFO:tasks.workunit.client.0.smithi076.stdout:5/509: write d5/db/d19/f2d [1179753,69603] 0 2024-03-28T13:06:29.703 INFO:tasks.workunit.client.0.smithi076.stdout:2/527: creat d2/d5/d7/d28/fa4 x:0 0 0 2024-03-28T13:06:30.056 INFO:tasks.workunit.client.0.smithi076.stdout:0/526: unlink db/dc/df/d18/d1d/d75/f96 0 2024-03-28T13:06:30.056 INFO:tasks.workunit.client.0.smithi076.stdout:0/527: fdatasync db/dc/df/d18/d1d/d75/f39 0 2024-03-28T13:06:30.209 INFO:tasks.workunit.client.0.smithi076.stdout:1/474: creat d14/fb1 x:0 0 0 2024-03-28T13:06:30.209 INFO:tasks.workunit.client.0.smithi076.stdout:3/422: symlink d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d93/l9e 0 2024-03-28T13:06:30.296 INFO:tasks.workunit.client.0.smithi076.stdout:6/580: mkdir d6/dc1 0 2024-03-28T13:06:30.296 INFO:tasks.workunit.client.0.smithi076.stdout:8/526: symlink de/d23/d2b/d5d/d76/d6e/d87/lb1 0 2024-03-28T13:06:30.296 INFO:tasks.workunit.client.0.smithi076.stdout:6/581: fsync d6/da/d40/d62/f7d 0 2024-03-28T13:06:30.297 INFO:tasks.workunit.client.0.smithi076.stdout:8/527: write de/d23/d2b/d5d/d76/d6e/d7a/f92 [470369,94798] 0 2024-03-28T13:06:30.482 INFO:tasks.workunit.client.0.smithi076.stdout:2/528: creat d2/d5/db/d3b/d5a/fa5 x:0 0 0 2024-03-28T13:06:30.482 INFO:tasks.workunit.client.0.smithi076.stdout:2/529: chown d2/d5/d7/d8/d21 19502 1 2024-03-28T13:06:30.780 INFO:tasks.workunit.client.0.smithi076.stdout:1/475: read d14/d19/d85/d2e/d31/f39 [3406455,95721] 0 2024-03-28T13:06:30.824 INFO:tasks.workunit.client.0.smithi076.stdout:6/582: creat d6/fc2 x:0 0 0 2024-03-28T13:06:30.836 INFO:tasks.workunit.client.0.smithi076.stdout:6/583: dread d6/da/d23/f4d [0,4194304] 0 2024-03-28T13:06:30.836 INFO:tasks.workunit.client.0.smithi076.stdout:6/584: read d6/f59 [1236088,110307] 0 2024-03-28T13:06:31.579 INFO:tasks.workunit.client.0.smithi076.stdout:7/523: write d1/d8/f68 [3721240,91580] 0 2024-03-28T13:06:31.596 INFO:tasks.workunit.client.0.smithi076.stdout:9/531: dwrite d9/dd/df/d11/d14/f51 [0,4194304] 0 2024-03-28T13:06:31.596 INFO:tasks.workunit.client.0.smithi076.stdout:9/532: write d9/dd/df/d11/d14/fa3 [230290,45141] 0 2024-03-28T13:06:31.597 INFO:tasks.workunit.client.0.smithi076.stdout:9/533: truncate d9/d3c/f5b 101761 0 2024-03-28T13:06:32.008 INFO:tasks.workunit.client.0.smithi076.stdout:4/564: write d0/d3b/d40/d42/d31/d5e/f83 [788594,121952] 0 2024-03-28T13:06:32.009 INFO:tasks.workunit.client.0.smithi076.stdout:4/565: fsync d0/d3b/d40/d42/d31/d4d/d63/f6a 0 2024-03-28T13:06:32.030 INFO:tasks.workunit.client.0.smithi076.stdout:3/423: mknod d1/d7/d30/d38/d14/d27/d42/c9f 0 2024-03-28T13:06:32.030 INFO:tasks.workunit.client.0.smithi076.stdout:3/424: write d1/d7/f78 [966970,73108] 0 2024-03-28T13:06:32.030 INFO:tasks.workunit.client.0.smithi076.stdout:3/425: truncate d1/d7/d30/d38/d14/d27/f4e 522904 0 2024-03-28T13:06:32.030 INFO:tasks.workunit.client.0.smithi076.stdout:3/426: dread - d1/d7/d30/d38/d14/d4a/d66/f6a zero size 2024-03-28T13:06:32.034 INFO:tasks.workunit.client.0.smithi076.stdout:3/427: dread d1/f48 [0,4194304] 0 2024-03-28T13:06:32.034 INFO:tasks.workunit.client.0.smithi076.stdout:3/428: chown d1/d7/d30/d38/d14/d51 0 1 2024-03-28T13:06:32.088 INFO:tasks.workunit.client.0.smithi076.stdout:1/476: mknod d14/d19/d85/d2e/d31/d51/d92/cb2 0 2024-03-28T13:06:32.155 INFO:tasks.workunit.client.0.smithi076.stdout:6/585: mknod d6/da/d40/d56/d84/cc3 0 2024-03-28T13:06:32.155 INFO:tasks.workunit.client.0.smithi076.stdout:6/586: truncate d6/da/d1e/f5a 37787 0 2024-03-28T13:06:32.309 INFO:tasks.workunit.client.0.smithi076.stdout:4/566: rmdir d0/d3b/d40 39 2024-03-28T13:06:32.309 INFO:tasks.workunit.client.0.smithi076.stdout:4/567: dread - d0/d3b/d40/d42/d31/f99 zero size 2024-03-28T13:06:32.333 INFO:tasks.workunit.client.0.smithi076.stdout:6/587: mknod d6/da/d39/cc4 0 2024-03-28T13:06:33.053 INFO:tasks.workunit.client.0.smithi076.stdout:4/568: dread d0/d3b/d50/da8/f71 [4194304,4194304] 0 2024-03-28T13:06:33.155 INFO:tasks.workunit.client.0.smithi076.stdout:4/569: symlink d0/d3b/d40/d42/d47/d69/lbf 0 2024-03-28T13:06:33.623 INFO:tasks.workunit.client.0.smithi076.stdout:9/534: creat d9/dd/df/fb0 x:0 0 0 2024-03-28T13:06:33.623 INFO:tasks.workunit.client.0.smithi076.stdout:7/524: write d1/d18/d3c/f30 [712452,84750] 0 2024-03-28T13:06:33.623 INFO:tasks.workunit.client.0.smithi076.stdout:8/528: rmdir de/d23 39 2024-03-28T13:06:33.624 INFO:tasks.workunit.client.0.smithi076.stdout:5/510: rename d5/d9/f95 to d5/d9/d1c/d25/d60/d82/fc0 0 2024-03-28T13:06:33.627 INFO:tasks.workunit.client.0.smithi076.stdout:7/525: write d1/d8/d37/d53/f91 [634,25703] 0 2024-03-28T13:06:33.680 INFO:tasks.workunit.client.0.smithi076.stdout:6/588: dwrite d6/da/d1e/f50 [0,4194304] 0 2024-03-28T13:06:33.822 INFO:tasks.workunit.client.0.smithi076.stdout:9/535: creat d9/fb1 x:0 0 0 2024-03-28T13:06:33.822 INFO:tasks.workunit.client.0.smithi076.stdout:8/529: symlink de/d23/d2b/d51/d62/lb2 0 2024-03-28T13:06:33.875 INFO:tasks.workunit.client.0.smithi076.stdout:0/528: rename db/dc/df/d11/f3b to db/dc/df/d18/d1d/d75/d51/fbc 0 2024-03-28T13:06:33.875 INFO:tasks.workunit.client.0.smithi076.stdout:5/511: link d5/d9/d4c/d63/lad d5/d9/lc1 0 2024-03-28T13:06:33.875 INFO:tasks.workunit.client.0.smithi076.stdout:5/512: fdatasync d5/d9/d1c/d25/d73/fba 0 2024-03-28T13:06:34.022 INFO:tasks.workunit.client.0.smithi076.stdout:7/526: rmdir d1/d18/d3c/da0 0 2024-03-28T13:06:34.023 INFO:tasks.workunit.client.0.smithi076.stdout:9/536: mkdir d9/dd/df/d11/db2 0 2024-03-28T13:06:34.023 INFO:tasks.workunit.client.0.smithi076.stdout:6/589: truncate d6/f59 245202 0 2024-03-28T13:06:34.033 INFO:tasks.workunit.client.0.smithi076.stdout:8/530: mkdir de/d23/db3 0 2024-03-28T13:06:34.176 INFO:tasks.workunit.client.0.smithi076.stdout:3/429: rename d1/d7/d30/d38/l3f to d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d58/la0 0 2024-03-28T13:06:34.249 INFO:tasks.workunit.client.0.smithi076.stdout:0/529: mknod db/dc/df/d71/d4a/cbd 0 2024-03-28T13:06:34.320 INFO:tasks.workunit.client.0.smithi076.stdout:5/513: link d5/d9/d4c/d63/d91/f6f d5/db/d3f/fc2 0 2024-03-28T13:06:34.320 INFO:tasks.workunit.client.0.smithi076.stdout:5/514: write d5/d9/d35/fb0 [96751,35033] 0 2024-03-28T13:06:34.330 INFO:tasks.workunit.client.0.smithi076.stdout:5/515: dread d5/d9/d1c/d1d/d22/f33 [0,4194304] 0 2024-03-28T13:06:34.580 INFO:tasks.workunit.client.0.smithi076.stdout:7/527: rmdir d1/d18/d3c/d48 39 2024-03-28T13:06:34.580 INFO:tasks.workunit.client.0.smithi076.stdout:7/528: fsync d1/d8/f19 0 2024-03-28T13:06:34.583 INFO:tasks.workunit.client.0.smithi076.stdout:2/530: sync 2024-03-28T13:06:34.602 INFO:tasks.workunit.client.0.smithi076.stdout:2/531: dread d2/d5/db/d3b/d60/f87 [0,4194304] 0 2024-03-28T13:06:34.926 INFO:tasks.workunit.client.0.smithi076.stdout:9/537: unlink d9/dd/df/d11/d14/d58/d6e/f97 0 2024-03-28T13:06:34.927 INFO:tasks.workunit.client.0.smithi076.stdout:6/590: mknod d6/da/d89/cc5 0 2024-03-28T13:06:34.927 INFO:tasks.workunit.client.0.smithi076.stdout:6/591: fdatasync d6/d99/f30 0 2024-03-28T13:06:34.927 INFO:tasks.workunit.client.0.smithi076.stdout:6/592: write d6/f7a [191442,22792] 0 2024-03-28T13:06:34.927 INFO:tasks.workunit.client.0.smithi076.stdout:6/593: readlink d6/l5e 0 2024-03-28T13:06:34.956 INFO:tasks.workunit.client.0.smithi076.stdout:6/594: dwrite d6/d99/f30 [0,4194304] 0 2024-03-28T13:06:34.993 INFO:tasks.workunit.client.0.smithi076.stdout:8/531: creat de/d23/d2b/d5d/d76/d6e/d7a/fb4 x:0 0 0 2024-03-28T13:06:35.204 INFO:tasks.workunit.client.0.smithi076.stdout:3/430: unlink d1/f61 0 2024-03-28T13:06:35.206 INFO:tasks.workunit.client.0.smithi076.stdout:1/477: rename d14/d6c/f83 to d14/d19/d85/d2e/d31/d51/d92/fb3 0 2024-03-28T13:06:35.208 INFO:tasks.workunit.client.0.smithi076.stdout:3/431: dread d1/f48 [0,4194304] 0 2024-03-28T13:06:35.208 INFO:tasks.workunit.client.0.smithi076.stdout:3/432: stat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/l4b 0 2024-03-28T13:06:35.267 INFO:tasks.workunit.client.0.smithi076.stdout:0/530: creat db/dc/d3d/d57/fbe x:0 0 0 2024-03-28T13:06:35.267 INFO:tasks.workunit.client.0.smithi076.stdout:0/531: fdatasync db/dc/df/d11/f1c 0 2024-03-28T13:06:35.308 INFO:tasks.workunit.client.0.smithi076.stdout:5/516: mknod d5/db/d3f/d97/cc3 0 2024-03-28T13:06:35.309 INFO:tasks.workunit.client.0.smithi076.stdout:5/517: chown d5/d9/d1c/d1d/d31 1388067 1 2024-03-28T13:06:35.367 INFO:tasks.workunit.client.0.smithi076.stdout:7/529: unlink d1/dc/f1d 0 2024-03-28T13:06:35.442 INFO:tasks.workunit.client.0.smithi076.stdout:2/532: mknod d2/d5/db/d3b/d94/ca6 0 2024-03-28T13:06:35.575 INFO:tasks.workunit.client.0.smithi076.stdout:9/538: mkdir d9/d74/db3 0 2024-03-28T13:06:35.597 INFO:tasks.workunit.client.0.smithi076.stdout:9/539: write d9/dd/d48/f59 [7839237,89970] 0 2024-03-28T13:06:35.731 INFO:tasks.workunit.client.0.smithi076.stdout:6/595: creat d6/da/d23/fc6 x:0 0 0 2024-03-28T13:06:35.754 INFO:tasks.workunit.client.0.smithi076.stdout:6/596: dwrite d6/da/d1e/f35 [0,4194304] 0 2024-03-28T13:06:35.754 INFO:tasks.workunit.client.0.smithi076.stdout:6/597: write d6/da/d1e/f50 [8391573,55768] 0 2024-03-28T13:06:35.754 INFO:tasks.workunit.client.0.smithi076.stdout:6/598: fsync d6/fb 0 2024-03-28T13:06:35.770 INFO:tasks.workunit.client.0.smithi076.stdout:8/532: mknod de/d25/d7f/cb5 0 2024-03-28T13:06:35.946 INFO:tasks.workunit.client.0.smithi076.stdout:4/570: rename d0/c44 to d0/d3b/d40/d42/d31/d5e/d72/cc0 0 2024-03-28T13:06:35.963 INFO:tasks.workunit.client.0.smithi076.stdout:1/478: truncate f7 1991499 0 2024-03-28T13:06:35.972 INFO:tasks.workunit.client.0.smithi076.stdout:4/571: dwrite d0/d3b/f79 [0,4194304] 0 2024-03-28T13:06:36.096 INFO:tasks.workunit.client.0.smithi076.stdout:3/433: symlink d1/d7/d30/d38/d14/d36/d56/d5b/la1 0 2024-03-28T13:06:36.101 INFO:tasks.workunit.client.0.smithi076.stdout:0/532: read db/dc/df/f22 [591048,90943] 0 2024-03-28T13:06:36.144 INFO:tasks.workunit.client.0.smithi076.stdout:3/434: dwrite d1/d7/d30/d38/f29 [0,4194304] 0 2024-03-28T13:06:36.171 INFO:tasks.workunit.client.0.smithi076.stdout:5/518: creat d5/d9/d1c/d25/dbd/d7a/db1/fc4 x:0 0 0 2024-03-28T13:06:36.230 INFO:tasks.workunit.client.0.smithi076.stdout:7/530: mkdir d1/d18/d3c/d8c/db5 0 2024-03-28T13:06:36.295 INFO:tasks.workunit.client.0.smithi076.stdout:2/533: mknod d2/d5/db/d3b/d42/ca7 0 2024-03-28T13:06:36.388 INFO:tasks.workunit.client.0.smithi076.stdout:9/540: dread d9/dd/df/d11/d14/d58/d6e/d2a/f44 [0,4194304] 0 2024-03-28T13:06:36.389 INFO:tasks.workunit.client.0.smithi076.stdout:9/541: chown d9/dd/df/d11/d14/d58 36755069 1 2024-03-28T13:06:36.410 INFO:tasks.workunit.client.0.smithi076.stdout:9/542: read d9/dd/d48/f66 [3063658,44663] 0 2024-03-28T13:06:36.434 INFO:tasks.workunit.client.0.smithi076.stdout:6/599: mkdir d6/da/d40/d56/dc7 0 2024-03-28T13:06:36.434 INFO:tasks.workunit.client.0.smithi076.stdout:6/600: dread - d6/d99/d46/f74 zero size 2024-03-28T13:06:36.434 INFO:tasks.workunit.client.0.smithi076.stdout:6/601: write d6/da/d23/fc6 [575928,117188] 0 2024-03-28T13:06:36.434 INFO:tasks.workunit.client.0.smithi076.stdout:6/602: dread - d6/f98 zero size 2024-03-28T13:06:36.434 INFO:tasks.workunit.client.0.smithi076.stdout:6/603: fdatasync d6/da/d39/faa 0 2024-03-28T13:06:36.539 INFO:tasks.workunit.client.0.smithi076.stdout:8/533: rename de/d23/d2b/d58/d7d to de/d4e/db6 0 2024-03-28T13:06:36.707 INFO:tasks.workunit.client.0.smithi076.stdout:4/572: creat d0/d3b/d40/d42/fc1 x:0 0 0 2024-03-28T13:06:36.707 INFO:tasks.workunit.client.0.smithi076.stdout:4/573: chown d0/d3b/d40/d42/d47/c90 0 1 2024-03-28T13:06:36.804 INFO:tasks.workunit.client.0.smithi076.stdout:0/533: symlink db/dc/df/d11/d40/d77/da2/d6d/db9/lbf 0 2024-03-28T13:06:37.062 INFO:tasks.workunit.client.0.smithi076.stdout:7/531: truncate d1/d18/d3c/d48/d69/fb0 1603515 0 2024-03-28T13:06:37.062 INFO:tasks.workunit.client.0.smithi076.stdout:7/532: fdatasync d1/d18/fad 0 2024-03-28T13:06:37.062 INFO:tasks.workunit.client.0.smithi076.stdout:7/533: read - d1/d18/d3c/f9c zero size 2024-03-28T13:06:37.062 INFO:tasks.workunit.client.0.smithi076.stdout:7/534: write d1/d18/f93 [673887,48759] 0 2024-03-28T13:06:37.094 INFO:tasks.workunit.client.0.smithi076.stdout:9/543: mknod d9/d74/d7d/cb4 0 2024-03-28T13:06:37.110 INFO:tasks.workunit.client.0.smithi076.stdout:9/544: dread d9/da/f7c [0,4194304] 0 2024-03-28T13:06:37.148 INFO:tasks.workunit.client.0.smithi076.stdout:6/604: mkdir d6/da/d5f/d7e/dc8 0 2024-03-28T13:06:37.149 INFO:tasks.workunit.client.0.smithi076.stdout:6/605: chown d6/da/d89/f8c 50926782 1 2024-03-28T13:06:37.159 INFO:tasks.workunit.client.0.smithi076.stdout:6/606: dread d6/da/d1e/f28 [0,4194304] 0 2024-03-28T13:06:37.163 INFO:tasks.workunit.client.0.smithi076.stdout:6/607: dread d6/da/d39/f91 [0,4194304] 0 2024-03-28T13:06:37.301 INFO:tasks.workunit.client.0.smithi076.stdout:5/519: rename d5/d9/d1c/d1d/d22/fbc to d5/d9/d1c/d25/d60/fc5 0 2024-03-28T13:06:37.372 INFO:tasks.workunit.client.0.smithi076.stdout:8/534: truncate de/d23/d2b/d5d/d76/f4a 3455433 0 2024-03-28T13:06:37.373 INFO:tasks.workunit.client.0.smithi076.stdout:1/479: unlink d14/d19/d20/c82 0 2024-03-28T13:06:37.427 INFO:tasks.workunit.client.0.smithi076.stdout:4/574: rmdir d0/d20/d7b 39 2024-03-28T13:06:38.042 INFO:tasks.workunit.client.0.smithi076.stdout:0/534: rmdir db/dc/df/d11/d40/d77/da2/d6d/db9 39 2024-03-28T13:06:38.086 INFO:tasks.workunit.client.0.smithi076.stdout:0/535: dwrite db/dc/df/d18/d9f/fb2 [0,4194304] 0 2024-03-28T13:06:38.121 INFO:tasks.workunit.client.0.smithi076.stdout:0/536: dwrite db/f12 [0,4194304] 0 2024-03-28T13:06:38.161 INFO:tasks.workunit.client.0.smithi076.stdout:7/535: creat d1/dc/d8b/fb6 x:0 0 0 2024-03-28T13:06:38.162 INFO:tasks.workunit.client.0.smithi076.stdout:7/536: chown d1/d18/l71 7774 1 2024-03-28T13:06:38.176 INFO:tasks.workunit.client.0.smithi076.stdout:7/537: dread d1/d18/f93 [0,4194304] 0 2024-03-28T13:06:38.176 INFO:tasks.workunit.client.0.smithi076.stdout:7/538: fsync d1/d18/d3c/d48/d69/f6d 0 2024-03-28T13:06:38.215 INFO:tasks.workunit.client.0.smithi076.stdout:9/545: mkdir d9/d74/db3/db5 0 2024-03-28T13:06:38.215 INFO:tasks.workunit.client.0.smithi076.stdout:9/546: fdatasync d9/d3c/fa8 0 2024-03-28T13:06:38.258 INFO:tasks.workunit.client.0.smithi076.stdout:9/547: dwrite d9/dd/df/d11/d14/f65 [0,4194304] 0 2024-03-28T13:06:38.273 INFO:tasks.workunit.client.0.smithi076.stdout:9/548: dread d9/dd/df/d11/d37/f1c [0,4194304] 0 2024-03-28T13:06:38.297 INFO:tasks.workunit.client.0.smithi076.stdout:6/608: creat d6/fc9 x:0 0 0 2024-03-28T13:06:38.474 INFO:tasks.workunit.client.0.smithi076.stdout:2/534: rename d2/d5/d7/d8/c6e to d2/d5/db/d3b/d60/ca8 0 2024-03-28T13:06:38.481 INFO:tasks.workunit.client.0.smithi076.stdout:5/520: unlink d5/d9/d35/f72 0 2024-03-28T13:06:38.482 INFO:tasks.workunit.client.0.smithi076.stdout:5/521: stat d5/d9/d1c/d1d/d31/cbf 0 2024-03-28T13:06:38.636 INFO:tasks.workunit.client.0.smithi076.stdout:1/480: creat d14/d6c/d74/fb4 x:0 0 0 2024-03-28T13:06:38.636 INFO:tasks.workunit.client.0.smithi076.stdout:4/575: chown d0/d3b/d40/d42/d28/f32 119062 1 2024-03-28T13:06:38.819 INFO:tasks.workunit.client.0.smithi076.stdout:0/537: creat db/dc/df/fc0 x:0 0 0 2024-03-28T13:06:38.868 INFO:tasks.workunit.client.0.smithi076.stdout:7/539: creat d1/d18/d3c/fb7 x:0 0 0 2024-03-28T13:06:38.896 INFO:tasks.workunit.client.0.smithi076.stdout:7/540: dwrite d1/d18/d2d/fa3 [0,4194304] 0 2024-03-28T13:06:38.896 INFO:tasks.workunit.client.0.smithi076.stdout:7/541: chown d1/d8/d37/l98 207 1 2024-03-28T13:06:38.896 INFO:tasks.workunit.client.0.smithi076.stdout:7/542: fdatasync d1/d18/d3c/f44 0 2024-03-28T13:06:38.896 INFO:tasks.workunit.client.0.smithi076.stdout:7/543: write d1/dc/f55 [203239,87738] 0 2024-03-28T13:06:38.944 INFO:tasks.workunit.client.0.smithi076.stdout:9/549: stat d9/dd/df/d11/d37/f1d 0 2024-03-28T13:06:38.993 INFO:tasks.workunit.client.0.smithi076.stdout:6/609: mkdir d6/da/d40/d62/dca 0 2024-03-28T13:06:39.004 INFO:tasks.workunit.client.0.smithi076.stdout:6/610: dread d6/da/d1e/f50 [4194304,4194304] 0 2024-03-28T13:06:39.033 INFO:tasks.workunit.client.0.smithi076.stdout:2/535: symlink d2/d5/d7/la9 0 2024-03-28T13:06:39.055 INFO:tasks.workunit.client.0.smithi076.stdout:2/536: dread d2/d5/db/d3b/d42/f6d [0,4194304] 0 2024-03-28T13:06:39.195 INFO:tasks.workunit.client.0.smithi076.stdout:4/576: mknod d0/d3b/d40/d42/d31/d5e/d72/d78/cc2 0 2024-03-28T13:06:39.195 INFO:tasks.workunit.client.0.smithi076.stdout:4/577: write d0/d3b/d50/d64/d89/d2d/fba [36325,129278] 0 2024-03-28T13:06:39.195 INFO:tasks.workunit.client.0.smithi076.stdout:4/578: fdatasync d0/d20/f5c 0 2024-03-28T13:06:39.238 INFO:tasks.workunit.client.0.smithi076.stdout:4/579: dwrite d0/d3b/d40/d42/d47/d7c/f91 [0,4194304] 0 2024-03-28T13:06:39.288 INFO:tasks.workunit.client.0.smithi076.stdout:1/481: mkdir d14/d19/d85/d2e/d31/d51/d92/da4/db5 0 2024-03-28T13:06:39.297 INFO:tasks.workunit.client.0.smithi076.stdout:1/482: fsync d14/f97 0 2024-03-28T13:06:39.375 INFO:tasks.workunit.client.0.smithi076.stdout:0/538: mknod db/dc/df/d11/d40/d77/d87/cc1 0 2024-03-28T13:06:39.676 INFO:tasks.workunit.client.0.smithi076.stdout:7/544: creat d1/dc/fb8 x:0 0 0 2024-03-28T13:06:40.017 INFO:tasks.workunit.client.0.smithi076.stdout:2/537: mkdir d2/d5/db/d3b/d5a/daa 0 2024-03-28T13:06:40.033 INFO:tasks.workunit.client.0.smithi076.stdout:2/538: write d2/d5/d7/d8/d21/f5e [5180364,85361] 0 2024-03-28T13:06:40.033 INFO:tasks.workunit.client.0.smithi076.stdout:2/539: chown d2/d5/db/c2b 806 1 2024-03-28T13:06:40.082 INFO:tasks.workunit.client.0.smithi076.stdout:3/435: mknod d1/d7/d30/d38/d14/ca2 0 2024-03-28T13:06:40.082 INFO:tasks.workunit.client.0.smithi076.stdout:3/436: fsync d1/d7/f78 0 2024-03-28T13:06:40.082 INFO:tasks.workunit.client.0.smithi076.stdout:3/437: chown d1/d7/d30/d38/d14/d36/d56/d5b/d89/f9c 161816 1 2024-03-28T13:06:40.190 INFO:tasks.workunit.client.0.smithi076.stdout:1/483: symlink d14/d19/d85/d2e/d3c/lb6 0 2024-03-28T13:06:40.191 INFO:tasks.workunit.client.0.smithi076.stdout:1/484: fsync d14/d19/d85/d2e/d91/fa0 0 2024-03-28T13:06:40.191 INFO:tasks.workunit.client.0.smithi076.stdout:1/485: getdents d14/d19/d85/d2e/d91/da8 0 2024-03-28T13:06:40.191 INFO:tasks.workunit.client.0.smithi076.stdout:1/486: fsync d14/d19/d85/d3f/f54 0 2024-03-28T13:06:40.219 INFO:tasks.workunit.client.0.smithi076.stdout:1/487: dwrite d14/d19/d85/d2e/f58 [0,4194304] 0 2024-03-28T13:06:40.231 INFO:tasks.workunit.client.0.smithi076.stdout:1/488: dread d14/d19/d85/d2e/d31/d3b/f4e [0,4194304] 0 2024-03-28T13:06:40.291 INFO:tasks.workunit.client.0.smithi076.stdout:0/539: rename db/dc/df/d18/d1d/d75/l59 to db/dc/df/d11/lc2 0 2024-03-28T13:06:40.819 INFO:tasks.workunit.client.0.smithi076.stdout:8/535: dwrite de/d23/d2b/f30 [0,4194304] 0 2024-03-28T13:06:40.827 INFO:tasks.workunit.client.0.smithi076.stdout:8/536: dread de/d25/f85 [0,4194304] 0 2024-03-28T13:06:40.914 INFO:tasks.workunit.client.0.smithi076.stdout:7/545: creat d1/fb9 x:0 0 0 2024-03-28T13:06:41.024 INFO:tasks.workunit.client.0.smithi076.stdout:2/540: rmdir d2/d5/db/d3b/d94 39 2024-03-28T13:06:41.071 INFO:tasks.workunit.client.0.smithi076.stdout:5/522: rmdir d5/d9/d35/d3b/d8e 0 2024-03-28T13:06:41.071 INFO:tasks.workunit.client.0.smithi076.stdout:5/523: readlink d5/db/l1a 0 2024-03-28T13:06:41.154 INFO:tasks.workunit.client.0.smithi076.stdout:3/438: mknod d1/d7/d30/d38/d9b/ca3 0 2024-03-28T13:06:41.155 INFO:tasks.workunit.client.0.smithi076.stdout:3/439: chown d1/d2/l7c 23820640 1 2024-03-28T13:06:41.286 INFO:tasks.workunit.client.0.smithi076.stdout:1/489: truncate d14/d19/d20/f56 3927593 0 2024-03-28T13:06:41.287 INFO:tasks.workunit.client.0.smithi076.stdout:1/490: write d14/d19/d85/d2e/d31/d51/d92/fb3 [859637,76124] 0 2024-03-28T13:06:41.518 INFO:tasks.workunit.client.0.smithi076.stdout:8/537: creat de/d23/db3/fb7 x:0 0 0 2024-03-28T13:06:41.645 INFO:tasks.workunit.client.0.smithi076.stdout:2/541: rename d2/d5/db/f78 to d2/d5/d7/d28/d64/fab 0 2024-03-28T13:06:41.645 INFO:tasks.workunit.client.0.smithi076.stdout:2/542: write d2/d5/db/d3b/d42/f73 [268024,39698] 0 2024-03-28T13:06:41.646 INFO:tasks.workunit.client.0.smithi076.stdout:2/543: write d2/d5/d7/d3e/f81 [5473248,97207] 0 2024-03-28T13:06:41.646 INFO:tasks.workunit.client.0.smithi076.stdout:2/544: chown d2/d5/db/d3b/d60/d96 85593910 1 2024-03-28T13:06:41.806 INFO:tasks.workunit.client.0.smithi076.stdout:5/524: creat d5/d9/d4c/d98/fc6 x:0 0 0 2024-03-28T13:06:41.880 INFO:tasks.workunit.client.0.smithi076.stdout:9/550: write d9/dd/f85 [2341571,17185] 0 2024-03-28T13:06:41.944 INFO:tasks.workunit.client.0.smithi076.stdout:1/491: mkdir d14/d19/d85/d2e/d31/d51/d92/da4/db7 0 2024-03-28T13:06:41.960 INFO:tasks.workunit.client.0.smithi076.stdout:1/492: dread d14/d19/d85/d2e/d31/d49/f64 [0,4194304] 0 2024-03-28T13:06:41.998 INFO:tasks.workunit.client.0.smithi076.stdout:0/540: symlink db/dc/d3d/lc3 0 2024-03-28T13:06:42.037 INFO:tasks.workunit.client.0.smithi076.stdout:8/538: creat de/d4e/d54/d68/fb8 x:0 0 0 2024-03-28T13:06:42.057 INFO:tasks.workunit.client.0.smithi076.stdout:8/539: dread de/d4e/d54/f64 [0,4194304] 0 2024-03-28T13:06:42.065 INFO:tasks.workunit.client.0.smithi076.stdout:6/611: write d6/da/fe [477602,2796] 0 2024-03-28T13:06:42.088 INFO:tasks.workunit.client.0.smithi076.stdout:6/612: dwrite d6/d99/f30 [0,4194304] 0 2024-03-28T13:06:42.088 INFO:tasks.workunit.client.0.smithi076.stdout:6/613: readlink d6/da/d89/lb3 0 2024-03-28T13:06:42.120 INFO:tasks.workunit.client.0.smithi076.stdout:6/614: dwrite d6/da/d23/fa7 [0,4194304] 0 2024-03-28T13:06:42.137 INFO:tasks.workunit.client.0.smithi076.stdout:6/615: dread d6/da/d1e/f50 [0,4194304] 0 2024-03-28T13:06:42.184 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:06:42.188 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:06:42.281 INFO:tasks.workunit.client.0.smithi076.stdout:9/551: creat d9/dd/d48/dad/fb6 x:0 0 0 2024-03-28T13:06:42.282 INFO:tasks.workunit.client.0.smithi076.stdout:5/525: read d5/d9/d1c/d1d/d31/f37 [510780,59761] 0 2024-03-28T13:06:42.314 INFO:tasks.workunit.client.0.smithi076.stdout:1/493: creat d14/d19/d85/d2e/d31/d51/d92/da4/db5/fb8 x:0 0 0 2024-03-28T13:06:42.428 INFO:tasks.workunit.client.0.smithi076.stdout:0/541: truncate db/dc/df/d18/d1d/d75/d51/d60/f70 2705659 0 2024-03-28T13:06:42.429 INFO:tasks.workunit.client.0.smithi076.stdout:8/540: symlink de/d23/d2b/d51/d62/lb9 0 2024-03-28T13:06:42.589 INFO:tasks.workunit.client.0.smithi076.stdout:9/552: unlink d9/da/l23 0 2024-03-28T13:06:42.589 INFO:tasks.workunit.client.0.smithi076.stdout:9/553: stat d9/dd/df/d11/d37/c5f 0 2024-03-28T13:06:42.589 INFO:tasks.workunit.client.0.smithi076.stdout:9/554: fsync d9/dd/f57 0 2024-03-28T13:06:42.589 INFO:tasks.workunit.client.0.smithi076.stdout:9/555: chown d9/dd/df/d11/d14/d58/d6e/f21 0 1 2024-03-28T13:06:42.643 INFO:tasks.workunit.client.0.smithi076.stdout:9/556: dwrite d9/d3c/faa [0,4194304] 0 2024-03-28T13:06:42.643 INFO:tasks.workunit.client.0.smithi076.stdout:9/557: read d9/dd/df/f5e [92148,37823] 0 2024-03-28T13:06:42.643 INFO:tasks.workunit.client.0.smithi076.stdout:9/558: write d9/dd/d48/dad/fb6 [273513,106806] 0 2024-03-28T13:06:42.656 INFO:tasks.workunit.client.0.smithi076.stdout:5/526: creat d5/d9/d35/d3b/db6/fc7 x:0 0 0 2024-03-28T13:06:42.657 INFO:tasks.workunit.client.0.smithi076.stdout:5/527: write d5/d9/d1c/d25/dbd/fbe [36414,115703] 0 2024-03-28T13:06:42.708 INFO:tasks.workunit.client.0.smithi076.stdout:1/494: truncate d14/d19/d20/f27 156522 0 2024-03-28T13:06:42.786 INFO:tasks.workunit.client.0.smithi076.stdout:0/542: mknod db/dc/df/d11/d40/d77/da2/d6d/db9/cc4 0 2024-03-28T13:06:43.009 INFO:tasks.workunit.client.0.smithi076.stdout:9/559: link d9/dd/fa0 d9/dd/df/d11/d14/d58/da1/fb7 0 2024-03-28T13:06:43.023 INFO:tasks.workunit.client.0.smithi076.stdout:9/560: dread d9/dd/df/f25 [0,4194304] 0 2024-03-28T13:06:43.023 INFO:tasks.workunit.client.0.smithi076.stdout:9/561: fsync d9/dd/df/d11/f4f 0 2024-03-28T13:06:43.023 INFO:tasks.workunit.client.0.smithi076.stdout:9/562: fsync d9/da/f6f 0 2024-03-28T13:06:43.023 INFO:tasks.workunit.client.0.smithi076.stdout:9/563: stat d9/dd/df/d11/d14/d58/d6e/f21 0 2024-03-28T13:06:43.158 INFO:tasks.workunit.client.0.smithi076.stdout:5/528: unlink d5/db/c1e 0 2024-03-28T13:06:43.159 INFO:tasks.workunit.client.0.smithi076.stdout:5/529: dread - d5/f9a zero size 2024-03-28T13:06:43.194 INFO:tasks.workunit.client.0.smithi076.stdout:1/495: truncate d14/f6b 1244110 0 2024-03-28T13:06:43.194 INFO:tasks.workunit.client.0.smithi076.stdout:1/496: read d14/d19/d85/d2e/d31/d49/f64 [3702312,68681] 0 2024-03-28T13:06:43.231 INFO:tasks.workunit.client.0.smithi076.stdout:0/543: mknod db/dc/df/d71/cc5 0 2024-03-28T13:06:43.232 INFO:tasks.workunit.client.0.smithi076.stdout:0/544: write db/dc/df/d11/fa0 [244728,107929] 0 2024-03-28T13:06:43.232 INFO:tasks.workunit.client.0.smithi076.stdout:0/545: write db/dc/df/d18/d1d/d75/f39 [1135994,33076] 0 2024-03-28T13:06:43.235 INFO:tasks.workunit.client.0.smithi076.stdout:1/497: dwrite d14/d19/d85/d2e/d31/f53 [0,4194304] 0 2024-03-28T13:06:43.426 INFO:tasks.workunit.client.0.smithi076.stdout:4/580: sync 2024-03-28T13:06:43.816 INFO:tasks.workunit.client.0.smithi076.stdout:5/530: dread d5/db/d19/d34/f6e [0,4194304] 0 2024-03-28T13:06:43.993 INFO:tasks.workunit.client.0.smithi076.stdout:1/498: unlink d14/d19/d85/f38 0 2024-03-28T13:06:44.020 INFO:tasks.workunit.client.0.smithi076.stdout:1/499: dwrite d14/d19/d85/d2e/f58 [0,4194304] 0 2024-03-28T13:06:44.020 INFO:tasks.workunit.client.0.smithi076.stdout:1/500: chown d14/d19/d85/d2e/d31/f8c 302411 1 2024-03-28T13:06:44.020 INFO:tasks.workunit.client.0.smithi076.stdout:1/501: chown d14/d19/d85/d2e 5 1 2024-03-28T13:06:44.024 INFO:tasks.workunit.client.0.smithi076.stdout:1/502: dread d14/d19/d85/d2e/d31/d51/f77 [0,4194304] 0 2024-03-28T13:06:44.044 INFO:tasks.workunit.client.0.smithi076.stdout:1/503: read d14/d19/d85/d2e/d31/d3b/f55 [1795254,95087] 0 2024-03-28T13:06:44.049 INFO:tasks.workunit.client.0.smithi076.stdout:7/546: write d1/d18/d3c/f24 [4148721,16250] 0 2024-03-28T13:06:44.049 INFO:tasks.workunit.client.0.smithi076.stdout:7/547: write d1/f16 [2361757,10303] 0 2024-03-28T13:06:44.049 INFO:tasks.workunit.client.0.smithi076.stdout:7/548: dread - d1/fb9 zero size 2024-03-28T13:06:44.049 INFO:tasks.workunit.client.0.smithi076.stdout:7/549: write d1/d18/d3c/d48/f77 [609147,41731] 0 2024-03-28T13:06:44.104 INFO:tasks.workunit.client.0.smithi076.stdout:4/581: unlink d0/d3b/d40/d42/d31/d4d/d63/c85 0 2024-03-28T13:06:44.213 INFO:tasks.workunit.client.0.smithi076.stdout:5/531: mknod d5/d9/d1c/d25/d73/cc8 0 2024-03-28T13:06:44.213 INFO:tasks.workunit.client.0.smithi076.stdout:5/532: chown d5/d9/d35/d3b/c48 124413892 1 2024-03-28T13:06:44.402 INFO:tasks.workunit.client.0.smithi076.stdout:1/504: link d14/d19/d85/d2e/d31/f39 d14/d6c/fb9 0 2024-03-28T13:06:44.451 INFO:tasks.workunit.client.0.smithi076.stdout:1/505: dwrite d14/f52 [0,4194304] 0 2024-03-28T13:06:44.486 INFO:tasks.workunit.client.0.smithi076.stdout:7/550: rmdir d1/d8/d37/d53/dac 0 2024-03-28T13:06:44.725 INFO:tasks.workunit.client.0.smithi076.stdout:3/440: sync 2024-03-28T13:06:44.725 INFO:tasks.workunit.client.0.smithi076.stdout:4/582: chown d0/d3b/d40/d42/c25 3420 1 2024-03-28T13:06:44.725 INFO:tasks.workunit.client.0.smithi076.stdout:5/533: mknod d5/d9/d4c/d63/cc9 0 2024-03-28T13:06:44.725 INFO:tasks.workunit.client.0.smithi076.stdout:4/583: chown d0/d20/d7b/d81/l86 0 1 2024-03-28T13:06:44.725 INFO:tasks.workunit.client.0.smithi076.stdout:3/441: chown d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/l4b 1640 1 2024-03-28T13:06:44.725 INFO:tasks.workunit.client.0.smithi076.stdout:3/442: chown d1/d7/d30/f4c 18615960 1 2024-03-28T13:06:44.725 INFO:tasks.workunit.client.0.smithi076.stdout:4/584: write d0/d3b/d50/d64/d89/d2d/f35 [1418129,6243] 0 2024-03-28T13:06:44.734 INFO:tasks.workunit.client.0.smithi076.stdout:3/443: dread d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/f3b [0,4194304] 0 2024-03-28T13:06:44.734 INFO:tasks.workunit.client.0.smithi076.stdout:3/444: fdatasync d1/d7/f32 0 2024-03-28T13:06:44.735 INFO:tasks.workunit.client.0.smithi076.stdout:3/445: dread - d1/d7/d30/d5f/f9d zero size 2024-03-28T13:06:44.750 INFO:tasks.workunit.client.0.smithi076.stdout:3/446: dread d1/f1b [0,4194304] 0 2024-03-28T13:06:44.750 INFO:tasks.workunit.client.0.smithi076.stdout:3/447: fdatasync d1/f63 0 2024-03-28T13:06:44.796 INFO:tasks.workunit.client.0.smithi076.stdout:3/448: dwrite d1/d7/d30/d38/d14/d27/f7e [0,4194304] 0 2024-03-28T13:06:44.846 INFO:tasks.workunit.client.0.smithi076.stdout:1/506: mknod d14/d19/d85/d2e/cba 0 2024-03-28T13:06:44.898 INFO:tasks.workunit.client.0.smithi076.stdout:7/551: mkdir d1/dc/dba 0 2024-03-28T13:06:45.002 INFO:tasks.workunit.client.0.smithi076.stdout:4/585: mkdir d0/d3b/d40/d42/d31/d5e/dc3 0 2024-03-28T13:06:45.084 INFO:tasks.workunit.client.0.smithi076.stdout:3/449: mkdir d1/d7/da4 0 2024-03-28T13:06:45.084 INFO:tasks.workunit.client.0.smithi076.stdout:3/450: chown d1/d7/da4 3 1 2024-03-28T13:06:45.152 INFO:tasks.workunit.client.0.smithi076.stdout:7/552: creat d1/d18/d3c/d8c/fbb x:0 0 0 2024-03-28T13:06:45.317 INFO:tasks.workunit.client.0.smithi076.stdout:3/451: creat d1/d7/d30/d38/d14/d97/fa5 x:0 0 0 2024-03-28T13:06:45.317 INFO:tasks.workunit.client.0.smithi076.stdout:3/452: write d1/d7/f32 [1329317,57525] 0 2024-03-28T13:06:45.317 INFO:tasks.workunit.client.0.smithi076.stdout:3/453: chown d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d58/f6f 19656 1 2024-03-28T13:06:45.317 INFO:tasks.workunit.client.0.smithi076.stdout:3/454: read d1/d7/f32 [753821,102825] 0 2024-03-28T13:06:45.351 INFO:tasks.workunit.client.0.smithi076.stdout:3/455: dwrite d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/f82 [0,4194304] 0 2024-03-28T13:06:45.381 INFO:tasks.workunit.client.0.smithi076.stdout:0/546: dwrite db/dc/df/d18/d1d/d75/d51/d60/f70 [0,4194304] 0 2024-03-28T13:06:45.381 INFO:tasks.workunit.client.0.smithi076.stdout:0/547: readlink la 0 2024-03-28T13:06:45.390 INFO:tasks.workunit.client.0.smithi076.stdout:3/456: dwrite d1/d7/d30/d38/d14/d36/d56/d5b/f76 [0,4194304] 0 2024-03-28T13:06:45.428 INFO:tasks.workunit.client.0.smithi076.stdout:7/553: symlink d1/d8/d37/d53/dae/lbc 0 2024-03-28T13:06:45.893 INFO:tasks.workunit.client.0.smithi076.stdout:8/541: dwrite de/d23/d2b/d5d/d76/f21 [0,4194304] 0 2024-03-28T13:06:45.947 INFO:tasks.workunit.client.0.smithi076.stdout:8/542: dwrite de/d4e/d54/d68/fb8 [0,4194304] 0 2024-03-28T13:06:45.947 INFO:tasks.workunit.client.0.smithi076.stdout:8/543: readlink de/d23/d2b/d5d/d76/l14 0 2024-03-28T13:06:45.961 INFO:tasks.workunit.client.0.smithi076.stdout:8/544: dread de/d25/f36 [4194304,4194304] 0 2024-03-28T13:06:45.961 INFO:tasks.workunit.client.0.smithi076.stdout:8/545: fsync de/d23/f1e 0 2024-03-28T13:06:45.961 INFO:tasks.workunit.client.0.smithi076.stdout:8/546: chown de/d23/d2b/d5d/d76/d18/d3c/l4d 292449490 1 2024-03-28T13:06:45.962 INFO:tasks.workunit.client.0.smithi076.stdout:8/547: fsync de/d23/d2b/d5d/d76/f72 0 2024-03-28T13:06:46.070 INFO:tasks.workunit.client.0.smithi076.stdout:5/534: symlink d5/d9/lca 0 2024-03-28T13:06:46.104 INFO:tasks.workunit.client.0.smithi076.stdout:2/545: creat d2/d5/fac x:0 0 0 2024-03-28T13:06:46.104 INFO:tasks.workunit.client.0.smithi076.stdout:2/546: getdents d2/d5/db/d3b/d5a/d8d 0 2024-03-28T13:06:46.350 INFO:tasks.workunit.client.0.smithi076.stdout:4/586: symlink d0/d3b/d50/d64/d89/lc4 0 2024-03-28T13:06:46.359 INFO:tasks.workunit.client.0.smithi076.stdout:1/507: rmdir d14/d19/d85/d2e/d91/da8 0 2024-03-28T13:06:46.465 INFO:tasks.workunit.client.0.smithi076.stdout:0/548: symlink db/dc/df/d71/lc6 0 2024-03-28T13:06:46.466 INFO:tasks.workunit.client.0.smithi076.stdout:0/549: dread - db/d16/fb6 zero size 2024-03-28T13:06:46.492 INFO:tasks.workunit.client.0.smithi076.stdout:0/550: dwrite db/dc/df/d11/fa0 [0,4194304] 0 2024-03-28T13:06:46.494 INFO:tasks.workunit.client.0.smithi076.stdout:0/551: chown db/dc/df/d18/d1d/d75/ca7 991584664 1 2024-03-28T13:06:46.648 INFO:tasks.workunit.client.0.smithi076.stdout:7/554: symlink d1/d18/d3c/d7b/d84/lbd 0 2024-03-28T13:06:46.992 INFO:tasks.workunit.client.0.smithi076.stdout:8/548: getdents de/d4e/d54/d68 0 2024-03-28T13:06:47.321 INFO:tasks.workunit.client.0.smithi076.stdout:2/547: symlink d2/d5/d4b/d39/d57/lad 0 2024-03-28T13:06:47.321 INFO:tasks.workunit.client.0.smithi076.stdout:2/548: write d2/d5/d7/d8/f44 [687053,29029] 0 2024-03-28T13:06:47.321 INFO:tasks.workunit.client.0.smithi076.stdout:2/549: stat d2/d5/db/d3b/d42/l86 0 2024-03-28T13:06:47.375 INFO:tasks.workunit.client.0.smithi076.stdout:4/587: creat d0/d3b/d40/d42/d31/d5e/fc5 x:0 0 0 2024-03-28T13:06:47.437 INFO:tasks.workunit.client.0.smithi076.stdout:4/588: dwrite d0/f1f [0,4194304] 0 2024-03-28T13:06:47.437 INFO:tasks.workunit.client.0.smithi076.stdout:4/589: truncate d0/d3b/d50/d64/d89/d2d/f4f 5543394 0 2024-03-28T13:06:47.797 INFO:tasks.workunit.client.0.smithi076.stdout:0/552: mkdir db/dc/df/d11/d40/dc7 0 2024-03-28T13:06:47.857 INFO:tasks.workunit.client.0.smithi076.stdout:7/555: mknod d1/d18/d3c/d7b/d84/cbe 0 2024-03-28T13:06:47.951 INFO:tasks.workunit.client.0.smithi076.stdout:0/553: mknod db/d16/cc8 0 2024-03-28T13:06:47.951 INFO:tasks.workunit.client.0.smithi076.stdout:0/554: chown db/dc/df/d11/f1c 1041094869 1 2024-03-28T13:06:47.971 INFO:tasks.workunit.client.0.smithi076.stdout:0/555: dread db/dc/df/d18/d1d/d73/f81 [0,4194304] 0 2024-03-28T13:06:48.051 INFO:tasks.workunit.client.0.smithi076.stdout:0/556: creat db/dc/df/d18/d1d/fc9 x:0 0 0 2024-03-28T13:06:48.279 INFO:tasks.workunit.client.0.smithi076.stdout:6/616: rename d6/da/fe to d6/fcb 0 2024-03-28T13:06:48.281 INFO:tasks.workunit.client.0.smithi076.stdout:6/617: dread d6/da/d1e/f47 [0,4194304] 0 2024-03-28T13:06:48.285 INFO:tasks.workunit.client.0.smithi076.stdout:0/557: symlink db/dc/df/d18/d9f/lca 0 2024-03-28T13:06:48.293 INFO:tasks.workunit.client.0.smithi076.stdout:0/558: dread f5 [0,4194304] 0 2024-03-28T13:06:48.293 INFO:tasks.workunit.client.0.smithi076.stdout:0/559: stat db/dc/df/d11/f63 0 2024-03-28T13:06:48.300 INFO:tasks.workunit.client.0.smithi076.stdout:0/560: dread db/dc/df/f44 [0,4194304] 0 2024-03-28T13:06:48.398 INFO:tasks.workunit.client.0.smithi076.stdout:8/549: rename de/d4e/c86 to de/d23/d2b/d5d/d76/d18/cba 0 2024-03-28T13:06:48.471 INFO:tasks.workunit.client.0.smithi076.stdout:6/618: symlink d6/da/d40/d56/d84/lcc 0 2024-03-28T13:06:48.605 INFO:tasks.workunit.client.0.smithi076.stdout:8/550: symlink de/d23/d2b/d58/d8e/lbb 0 2024-03-28T13:06:48.612 INFO:tasks.workunit.client.0.smithi076.stdout:8/551: dread de/f3f [0,4194304] 0 2024-03-28T13:06:48.706 INFO:tasks.workunit.client.0.smithi076.stdout:6/619: mknod d6/da/d89/ccd 0 2024-03-28T13:06:48.757 INFO:tasks.workunit.client.0.smithi076.stdout:6/620: dwrite d6/da/d40/d56/d8f/fa0 [4194304,4194304] 0 2024-03-28T13:06:48.757 INFO:tasks.workunit.client.0.smithi076.stdout:6/621: chown d6/l57 873594 1 2024-03-28T13:06:48.757 INFO:tasks.workunit.client.0.smithi076.stdout:6/622: write d6/da/d40/d56/d58/f8e [161654,13882] 0 2024-03-28T13:06:48.770 INFO:tasks.workunit.client.0.smithi076.stdout:0/561: truncate db/dc/df/d18/d1d/d75/f53 1296719 0 2024-03-28T13:06:48.785 INFO:tasks.workunit.client.0.smithi076.stdout:0/562: dread db/dc/df/d18/d1d/f29 [0,4194304] 0 2024-03-28T13:06:48.831 INFO:tasks.workunit.client.0.smithi076.stdout:8/552: creat de/d13/d27/d8c/fbc x:0 0 0 2024-03-28T13:06:48.904 INFO:tasks.workunit.client.0.smithi076.stdout:4/590: getdents d0/d3b/d50/d64/d89 0 2024-03-28T13:06:49.048 INFO:tasks.workunit.client.0.smithi076.stdout:6/623: mkdir d6/da/d1e/dce 0 2024-03-28T13:06:49.293 INFO:tasks.workunit.client.0.smithi076.stdout:0/563: unlink db/dc/df/d71/d4a/d7e/la1 0 2024-03-28T13:06:49.293 INFO:tasks.workunit.client.0.smithi076.stdout:8/553: mkdir de/d23/d2b/d5d/d76/d18/d49/dbd 0 2024-03-28T13:06:49.417 INFO:tasks.workunit.client.0.smithi076.stdout:4/591: link d0/d3b/d40/d42/d31/d5e/f83 d0/d3b/d40/d42/d31/d5e/d72/fc6 0 2024-03-28T13:06:49.417 INFO:tasks.workunit.client.0.smithi076.stdout:4/592: chown d0/f43 15175153 1 2024-03-28T13:06:49.431 INFO:tasks.workunit.client.0.smithi076.stdout:5/535: unlink d5/d9/d1c/fab 0 2024-03-28T13:06:49.431 INFO:tasks.workunit.client.0.smithi076.stdout:5/536: write d5/db/d3f/fa0 [507556,70656] 0 2024-03-28T13:06:49.455 INFO:tasks.workunit.client.0.smithi076.stdout:4/593: write d0/d3b/d40/d42/d47/d7c/f91 [1562834,77126] 0 2024-03-28T13:06:49.455 INFO:tasks.workunit.client.0.smithi076.stdout:4/594: chown d0/d3b/d50/d64/d89/d2d/c77 985 1 2024-03-28T13:06:49.497 INFO:tasks.workunit.client.0.smithi076.stdout:3/457: dwrite d1/d7/d30/d38/d14/d36/d56/d5b/f76 [4194304,4194304] 0 2024-03-28T13:06:49.497 INFO:tasks.workunit.client.0.smithi076.stdout:3/458: chown d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/c96 0 1 2024-03-28T13:06:49.588 INFO:tasks.workunit.client.0.smithi076.stdout:6/624: rename d6/c16 to d6/da/d40/d56/d58/ccf 0 2024-03-28T13:06:49.588 INFO:tasks.workunit.client.0.smithi076.stdout:6/625: chown d6/da/d23/l25 18450 1 2024-03-28T13:06:49.593 INFO:tasks.workunit.client.0.smithi076.stdout:6/626: read d6/fcb [354016,16315] 0 2024-03-28T13:06:49.672 INFO:tasks.workunit.client.0.smithi076.stdout:6/627: dwrite d6/da/d40/d56/d58/f88 [0,4194304] 0 2024-03-28T13:06:49.673 INFO:tasks.workunit.client.0.smithi076.stdout:0/564: creat db/dc/df/d11/d40/d77/da2/d6d/db9/fcb x:0 0 0 2024-03-28T13:06:49.874 INFO:tasks.workunit.client.0.smithi076.stdout:8/554: creat de/d23/d2b/d58/d78/fbe x:0 0 0 2024-03-28T13:06:50.099 INFO:tasks.workunit.client.0.smithi076.stdout:5/537: mkdir d5/d9/d1c/d1d/d22/d9d/dcb 0 2024-03-28T13:06:50.215 INFO:tasks.workunit.client.0.smithi076.stdout:4/595: mkdir d0/d20/d7b/dc7 0 2024-03-28T13:06:50.342 INFO:tasks.workunit.client.0.smithi076.stdout:3/459: creat d1/d7/d30/d71/fa6 x:0 0 0 2024-03-28T13:06:50.342 INFO:tasks.workunit.client.0.smithi076.stdout:3/460: fdatasync d1/d7/d30/d38/d14/d36/d56/f8b 0 2024-03-28T13:06:50.343 INFO:tasks.workunit.client.0.smithi076.stdout:3/461: chown d1/d7/d30/d38/d14/d36/d56 575 1 2024-03-28T13:06:50.363 INFO:tasks.workunit.client.0.smithi076.stdout:3/462: dread d1/d7/d30/d38/d14/d36/f19 [0,4194304] 0 2024-03-28T13:06:50.509 INFO:tasks.workunit.client.0.smithi076.stdout:6/628: rmdir d6/da/d39 39 2024-03-28T13:06:50.531 INFO:tasks.workunit.client.0.smithi076.stdout:0/565: symlink db/dc/df/d11/d40/d77/d87/lcc 0 2024-03-28T13:06:50.625 INFO:tasks.workunit.client.0.smithi076.stdout:8/555: mknod de/d23/d2b/d51/d71/cbf 0 2024-03-28T13:06:50.652 INFO:tasks.workunit.client.0.smithi076.stdout:5/538: stat d5/d9/d1c/d25/dbd/d7a/d7c/c81 0 2024-03-28T13:06:50.656 INFO:tasks.workunit.client.0.smithi076.stdout:8/556: dwrite de/d13/d27/f5e [0,4194304] 0 2024-03-28T13:06:50.656 INFO:tasks.workunit.client.0.smithi076.stdout:8/557: dread - de/d23/d2b/d5d/d76/d18/d3c/f9a zero size 2024-03-28T13:06:50.656 INFO:tasks.workunit.client.0.smithi076.stdout:8/558: truncate de/d23/d2b/d51/d62/d8b/f91 119588 0 2024-03-28T13:06:50.657 INFO:tasks.workunit.client.0.smithi076.stdout:5/539: dread d5/d9/d1c/d1d/d22/f33 [0,4194304] 0 2024-03-28T13:06:50.657 INFO:tasks.workunit.client.0.smithi076.stdout:5/540: fdatasync d5/db/d19/f8c 0 2024-03-28T13:06:50.680 INFO:tasks.workunit.client.0.smithi076.stdout:4/596: readlink d0/d3b/d40/d42/l88 0 2024-03-28T13:06:50.690 INFO:tasks.workunit.client.0.smithi076.stdout:8/559: dwrite de/d23/d2b/d5d/d76/d18/d3c/f44 [0,4194304] 0 2024-03-28T13:06:50.698 INFO:tasks.workunit.client.0.smithi076.stdout:4/597: dread d0/d3b/f79 [0,4194304] 0 2024-03-28T13:06:50.698 INFO:tasks.workunit.client.0.smithi076.stdout:4/598: readlink d0/l6 0 2024-03-28T13:06:50.749 INFO:tasks.workunit.client.0.smithi076.stdout:4/599: dwrite d0/d3b/d40/d42/d28/f7e [0,4194304] 0 2024-03-28T13:06:50.759 INFO:tasks.workunit.client.0.smithi076.stdout:3/463: mknod d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d58/ca7 0 2024-03-28T13:06:50.759 INFO:tasks.workunit.client.0.smithi076.stdout:3/464: fsync d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/f82 0 2024-03-28T13:06:50.765 INFO:tasks.workunit.client.0.smithi076.stdout:4/600: dread d0/d3b/d40/d42/f24 [0,4194304] 0 2024-03-28T13:06:50.803 INFO:tasks.workunit.client.0.smithi076.stdout:6/629: mknod d6/da/d5f/cd0 0 2024-03-28T13:06:50.824 INFO:tasks.workunit.client.0.smithi076.stdout:6/630: write d6/da/d40/d62/f7d [360735,63562] 0 2024-03-28T13:06:50.900 INFO:tasks.workunit.client.0.smithi076.stdout:5/541: mkdir d5/d9/d1c/dcc 0 2024-03-28T13:06:50.995 INFO:tasks.workunit.client.0.smithi076.stdout:8/560: rmdir de/d23/d2b/d5d/d76/d18/d3c 39 2024-03-28T13:06:50.995 INFO:tasks.workunit.client.0.smithi076.stdout:8/561: dread - de/d23/d2b/d58/d78/fa0 zero size 2024-03-28T13:06:51.029 INFO:tasks.workunit.client.0.smithi076.stdout:8/562: dwrite de/d23/db3/fb7 [0,4194304] 0 2024-03-28T13:06:51.065 INFO:tasks.workunit.client.0.smithi076.stdout:8/563: dwrite de/d4e/f67 [0,4194304] 0 2024-03-28T13:06:51.182 INFO:tasks.workunit.client.0.smithi076.stdout:3/465: creat d1/d7/d30/d38/d14/d4a/d66/fa8 x:0 0 0 2024-03-28T13:06:51.182 INFO:tasks.workunit.client.0.smithi076.stdout:3/466: write d1/d7/d30/d38/d14/d36/f16 [3094425,125234] 0 2024-03-28T13:06:51.182 INFO:tasks.workunit.client.0.smithi076.stdout:3/467: truncate d1/d7/d30/d38/f35 677270 0 2024-03-28T13:06:51.259 INFO:tasks.workunit.client.0.smithi076.stdout:2/550: write d2/d5/db/d3b/d3f/f4f [1335975,30460] 0 2024-03-28T13:06:51.279 INFO:tasks.workunit.client.0.smithi076.stdout:2/551: dwrite d2/d5/d7/dd/f32 [4194304,4194304] 0 2024-03-28T13:06:51.280 INFO:tasks.workunit.client.0.smithi076.stdout:2/552: readlink d2/d5/db/l1a 0 2024-03-28T13:06:51.294 INFO:tasks.workunit.client.0.smithi076.stdout:6/631: unlink d6/da/d39/f91 0 2024-03-28T13:06:51.294 INFO:tasks.workunit.client.0.smithi076.stdout:2/553: dread d2/d5/db/d3b/d3f/f4f [0,4194304] 0 2024-03-28T13:06:51.294 INFO:tasks.workunit.client.0.smithi076.stdout:2/554: readlink d2/d5/d4b/d39/d57/lad 0 2024-03-28T13:06:51.304 INFO:tasks.workunit.client.0.smithi076.stdout:6/632: dread d6/da/d40/d56/f6c [0,4194304] 0 2024-03-28T13:06:51.304 INFO:tasks.workunit.client.0.smithi076.stdout:6/633: chown d6/d99/d46/f74 431 1 2024-03-28T13:06:51.592 INFO:tasks.workunit.client.0.smithi076.stdout:7/556: write d1/d18/f5c [4523931,65616] 0 2024-03-28T13:06:51.595 INFO:tasks.workunit.client.0.smithi076.stdout:9/564: sync 2024-03-28T13:06:51.621 INFO:tasks.workunit.client.0.smithi076.stdout:9/565: dwrite d9/da/f7c [4194304,4194304] 0 2024-03-28T13:06:51.621 INFO:tasks.workunit.client.0.smithi076.stdout:9/566: write d9/d74/d7d/fa5 [159975,105886] 0 2024-03-28T13:06:51.721 INFO:tasks.workunit.client.0.smithi076.stdout:5/542: rename d5/d9/d35/d3b/db6/cb9 to d5/d9/d1c/d25/dbd/ccd 0 2024-03-28T13:06:52.075 INFO:tasks.workunit.client.0.smithi076.stdout:0/566: mknod db/dc/df/d18/ccd 0 2024-03-28T13:06:52.075 INFO:tasks.workunit.client.0.smithi076.stdout:8/564: symlink de/d23/d2b/d51/d62/d8b/lc0 0 2024-03-28T13:06:52.127 INFO:tasks.workunit.client.0.smithi076.stdout:3/468: mknod d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/ca9 0 2024-03-28T13:06:52.155 INFO:tasks.workunit.client.0.smithi076.stdout:3/469: dwrite d1/d7/d30/d5f/f9d [0,4194304] 0 2024-03-28T13:06:52.248 INFO:tasks.workunit.client.0.smithi076.stdout:2/555: creat d2/d5/db/d3b/d5a/d8d/fae x:0 0 0 2024-03-28T13:06:52.309 INFO:tasks.workunit.client.0.smithi076.stdout:4/601: fsync d0/d3b/d40/d42/d28/f7e 0 2024-03-28T13:06:52.341 INFO:tasks.workunit.client.0.smithi076.stdout:6/634: mkdir d6/da/d40/d56/dd1 0 2024-03-28T13:06:52.365 INFO:tasks.workunit.client.0.smithi076.stdout:6/635: dwrite d6/da/d5f/d6d/fb9 [0,4194304] 0 2024-03-28T13:06:52.404 INFO:tasks.workunit.client.0.smithi076.stdout:7/557: getdents d1/d18/d3c/d7b/d84 0 2024-03-28T13:06:52.404 INFO:tasks.workunit.client.0.smithi076.stdout:7/558: chown d1/d8/d37/d53/f6a 4 1 2024-03-28T13:06:52.405 INFO:tasks.workunit.client.0.smithi076.stdout:7/559: stat d1/d8/c41 0 2024-03-28T13:06:52.492 INFO:tasks.workunit.client.0.smithi076.stdout:1/508: sync 2024-03-28T13:06:52.533 INFO:tasks.workunit.client.0.smithi076.stdout:5/543: unlink d5/db/d19/f52 0 2024-03-28T13:06:52.818 INFO:tasks.workunit.client.0.smithi076.stdout:0/567: rmdir db/dc/df/d18/d1d/d73 39 2024-03-28T13:06:52.819 INFO:tasks.workunit.client.0.smithi076.stdout:0/568: fdatasync db/dc/df/d11/d40/f64 0 2024-03-28T13:06:52.819 INFO:tasks.workunit.client.0.smithi076.stdout:8/565: mkdir de/d23/d2b/d51/d60/dc1 0 2024-03-28T13:06:52.848 INFO:tasks.workunit.client.0.smithi076.stdout:0/569: dwrite db/dc/df/d18/d1d/d75/fb7 [0,4194304] 0 2024-03-28T13:06:52.988 INFO:tasks.workunit.client.0.smithi076.stdout:3/470: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/faa x:0 0 0 2024-03-28T13:06:53.063 INFO:tasks.workunit.client.0.smithi076.stdout:2/556: link d2/d5/d7/d3e/f81 d2/d5/d7/d3e/faf 0 2024-03-28T13:06:53.112 INFO:tasks.workunit.client.0.smithi076.stdout:4/602: unlink d0/d3b/d50/d64/d89/d2d/fba 0 2024-03-28T13:06:53.253 INFO:tasks.workunit.client.0.smithi076.stdout:6/636: truncate d6/da/d39/f65 1936866 0 2024-03-28T13:06:53.254 INFO:tasks.workunit.client.0.smithi076.stdout:6/637: fsync d6/da/d40/f48 0 2024-03-28T13:06:53.254 INFO:tasks.workunit.client.0.smithi076.stdout:6/638: fsync d6/da/d5f/d6d/fbb 0 2024-03-28T13:06:53.309 INFO:tasks.workunit.client.0.smithi076.stdout:7/560: mkdir d1/dc/d8b/dbf 0 2024-03-28T13:06:53.323 INFO:tasks.workunit.client.0.smithi076.stdout:7/561: read d1/d18/d3c/f44 [103095,11624] 0 2024-03-28T13:06:53.377 INFO:tasks.workunit.client.0.smithi076.stdout:1/509: unlink d14/d6c/fb9 0 2024-03-28T13:06:53.426 INFO:tasks.workunit.client.0.smithi076.stdout:5/544: creat d5/d9/d1c/d25/d60/fce x:0 0 0 2024-03-28T13:06:53.482 INFO:tasks.workunit.client.0.smithi076.stdout:8/566: write de/d4e/d54/d68/fb8 [4487113,14956] 0 2024-03-28T13:06:53.629 INFO:tasks.workunit.client.0.smithi076.stdout:0/570: creat db/dc/df/d11/d40/d77/fce x:0 0 0 2024-03-28T13:06:53.629 INFO:tasks.workunit.client.0.smithi076.stdout:0/571: write db/f4b [8469287,24961] 0 2024-03-28T13:06:53.629 INFO:tasks.workunit.client.0.smithi076.stdout:0/572: write db/dc/df/d11/d40/f64 [730725,33535] 0 2024-03-28T13:06:53.687 INFO:tasks.workunit.client.0.smithi076.stdout:3/471: unlink d1/d2/f2e 0 2024-03-28T13:06:53.687 INFO:tasks.workunit.client.0.smithi076.stdout:3/472: chown d1/d7/d30/f43 43699 1 2024-03-28T13:06:53.728 INFO:tasks.workunit.client.0.smithi076.stdout:3/473: dwrite d1/f92 [0,4194304] 0 2024-03-28T13:06:53.728 INFO:tasks.workunit.client.0.smithi076.stdout:3/474: fsync d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/f7a 0 2024-03-28T13:06:53.835 INFO:tasks.workunit.client.0.smithi076.stdout:2/557: creat d2/d67/fb0 x:0 0 0 2024-03-28T13:06:53.855 INFO:tasks.workunit.client.0.smithi076.stdout:4/603: link d0/d3b/d50/d64/d89/d2d/f35 d0/d20/d7b/d94/fc8 0 2024-03-28T13:06:53.870 INFO:tasks.workunit.client.0.smithi076.stdout:4/604: dread d0/d3b/d50/d64/d89/f18 [0,4194304] 0 2024-03-28T13:06:53.979 INFO:tasks.workunit.client.0.smithi076.stdout:6/639: mkdir d6/da/d40/d56/dd2 0 2024-03-28T13:06:54.037 INFO:tasks.workunit.client.0.smithi076.stdout:7/562: creat d1/d8/d37/fc0 x:0 0 0 2024-03-28T13:06:54.067 INFO:tasks.workunit.client.0.smithi076.stdout:7/563: dwrite d1/d18/d3c/d48/f77 [0,4194304] 0 2024-03-28T13:06:54.071 INFO:tasks.workunit.client.0.smithi076.stdout:7/564: dread d1/d18/d3c/d48/d69/f70 [0,4194304] 0 2024-03-28T13:06:54.071 INFO:tasks.workunit.client.0.smithi076.stdout:7/565: chown d1/fb9 7 1 2024-03-28T13:06:54.113 INFO:tasks.workunit.client.0.smithi076.stdout:1/510: unlink d14/d19/d85/d2e/d3c/d7e/f9d 0 2024-03-28T13:06:54.113 INFO:tasks.workunit.client.0.smithi076.stdout:1/511: fdatasync d14/d19/d85/d2e/d31/f8c 0 2024-03-28T13:06:54.113 INFO:tasks.workunit.client.0.smithi076.stdout:1/512: write d14/fb1 [165371,128630] 0 2024-03-28T13:06:54.237 INFO:tasks.workunit.client.0.smithi076.stdout:5/545: link d5/db/d19/f8c d5/d9/d4c/d63/fcf 0 2024-03-28T13:06:54.237 INFO:tasks.workunit.client.0.smithi076.stdout:8/567: creat de/d23/fc2 x:0 0 0 2024-03-28T13:06:54.507 INFO:tasks.workunit.client.0.smithi076.stdout:3/475: truncate d1/d7/d30/d38/d14/d27/f7e 3143540 0 2024-03-28T13:06:54.508 INFO:tasks.workunit.client.0.smithi076.stdout:3/476: fdatasync d1/d2/f4f 0 2024-03-28T13:06:54.534 INFO:tasks.workunit.client.0.smithi076.stdout:2/558: readlink d2/d5/l2c 0 2024-03-28T13:06:54.795 INFO:tasks.workunit.client.0.smithi076.stdout:9/567: creat d9/dd/df/fb8 x:0 0 0 2024-03-28T13:06:54.801 INFO:tasks.workunit.client.0.smithi076.stdout:9/568: dread d9/dd/df/f5e [0,4194304] 0 2024-03-28T13:06:54.801 INFO:tasks.workunit.client.0.smithi076.stdout:9/569: readlink d9/dd/df/l88 0 2024-03-28T13:06:54.801 INFO:tasks.workunit.client.0.smithi076.stdout:9/570: chown d9/d3c 10742 1 2024-03-28T13:06:55.728 INFO:tasks.workunit.client.0.smithi076.stdout:7/566: getdents d1/d8/d37/d53 0 2024-03-28T13:06:55.820 INFO:tasks.workunit.client.0.smithi076.stdout:1/513: read d14/d19/d85/d2e/d31/d49/f63 [188829,103454] 0 2024-03-28T13:06:55.820 INFO:tasks.workunit.client.0.smithi076.stdout:1/514: chown d14/d19/d85/d2e/d31/d46/c4f 13062248 1 2024-03-28T13:06:55.820 INFO:tasks.workunit.client.0.smithi076.stdout:1/515: read d14/d19/d85/d2e/d31/d51/f60 [740703,10251] 0 2024-03-28T13:06:55.895 INFO:tasks.workunit.client.0.smithi076.stdout:5/546: creat d5/d9/d4c/da4/fd0 x:0 0 0 2024-03-28T13:06:55.938 INFO:tasks.workunit.client.0.smithi076.stdout:5/547: dwrite d5/d9/d1c/d25/d60/d82/fb3 [0,4194304] 0 2024-03-28T13:06:55.938 INFO:tasks.workunit.client.0.smithi076.stdout:5/548: write d5/d9/d35/f85 [268222,40757] 0 2024-03-28T13:06:55.954 INFO:tasks.workunit.client.0.smithi076.stdout:5/549: dread d5/d9/f89 [0,4194304] 0 2024-03-28T13:06:55.976 INFO:tasks.workunit.client.0.smithi076.stdout:8/568: creat de/d25/d7f/fc3 x:0 0 0 2024-03-28T13:06:55.989 INFO:tasks.workunit.client.0.smithi076.stdout:8/569: dread de/d23/d2b/f30 [0,4194304] 0 2024-03-28T13:06:56.117 INFO:tasks.workunit.client.0.smithi076.stdout:3/477: mknod d1/d7/d30/d38/d14/d27/d69/cab 0 2024-03-28T13:06:56.181 INFO:tasks.workunit.client.0.smithi076.stdout:2/559: mkdir d2/d5/db/d3b/d9f/d9e/db1 0 2024-03-28T13:06:56.312 INFO:tasks.workunit.client.0.smithi076.stdout:9/571: link d9/dd/df/d11/d14/l92 d9/d74/db3/lb9 0 2024-03-28T13:06:56.387 INFO:tasks.workunit.client.0.smithi076.stdout:7/567: unlink d1/dc/f1c 0 2024-03-28T13:06:56.387 INFO:tasks.workunit.client.0.smithi076.stdout:7/568: chown d1/d8/c2f 7 1 2024-03-28T13:06:56.426 INFO:tasks.workunit.client.0.smithi076.stdout:7/569: dwrite d1/d8/d37/d53/f73 [0,4194304] 0 2024-03-28T13:06:56.581 INFO:tasks.workunit.client.0.smithi076.stdout:5/550: creat d5/db/d3f/d42/fd1 x:0 0 0 2024-03-28T13:06:56.757 INFO:tasks.workunit.client.0.smithi076.stdout:3/478: creat d1/d7/d30/d38/d14/d51/fac x:0 0 0 2024-03-28T13:06:56.757 INFO:tasks.workunit.client.0.smithi076.stdout:3/479: read d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/f5e [2594452,90032] 0 2024-03-28T13:06:56.841 INFO:tasks.workunit.client.0.smithi076.stdout:9/572: creat d9/dd/df/d11/d14/d58/da1/fba x:0 0 0 2024-03-28T13:06:56.947 INFO:tasks.workunit.client.0.smithi076.stdout:7/570: getdents d1/d18 0 2024-03-28T13:06:56.947 INFO:tasks.workunit.client.0.smithi076.stdout:7/571: write d1/d8/d37/f58 [233760,73121] 0 2024-03-28T13:06:57.010 INFO:tasks.workunit.client.0.smithi076.stdout:5/551: link d5/db/d19/l78 d5/d9/d4c/ld2 0 2024-03-28T13:06:57.010 INFO:tasks.workunit.client.0.smithi076.stdout:5/552: getdents d5/db/d19/d34 0 2024-03-28T13:06:57.010 INFO:tasks.workunit.client.0.smithi076.stdout:5/553: chown d5/db/d3f/c8b 122 1 2024-03-28T13:06:57.010 INFO:tasks.workunit.client.0.smithi076.stdout:5/554: chown d5/d9/d4c/d63/f66 5 1 2024-03-28T13:06:57.133 INFO:tasks.workunit.client.0.smithi076.stdout:9/573: mkdir d9/dd/dbb 0 2024-03-28T13:06:57.133 INFO:tasks.workunit.client.0.smithi076.stdout:9/574: fdatasync d9/dd/df/d11/f4f 0 2024-03-28T13:06:57.134 INFO:tasks.workunit.client.0.smithi076.stdout:7/572: symlink d1/d8/d37/lc1 0 2024-03-28T13:06:57.187 INFO:tasks.workunit.client.0.smithi076.stdout:5/555: link d5/db/d3f/d97/fa8 d5/db/df/fd3 0 2024-03-28T13:06:57.187 INFO:tasks.workunit.client.0.smithi076.stdout:5/556: truncate d5/f9a 979782 0 2024-03-28T13:06:57.302 INFO:tasks.workunit.client.0.smithi076.stdout:9/575: read d9/dd/df/d11/d37/f8a [138389,17231] 0 2024-03-28T13:06:57.303 INFO:tasks.workunit.client.0.smithi076.stdout:9/576: stat d9/dd/d48/c4c 0 2024-03-28T13:06:57.373 INFO:tasks.workunit.client.0.smithi076.stdout:7/573: mkdir d1/d8/dc2 0 2024-03-28T13:06:57.444 INFO:tasks.workunit.client.0.smithi076.stdout:5/557: rename d5/d9/d1c/d1d/d22/la7 to d5/d9/d1c/ld4 0 2024-03-28T13:06:57.531 INFO:tasks.workunit.client.0.smithi076.stdout:9/577: creat d9/d74/db3/db5/fbc x:0 0 0 2024-03-28T13:06:57.550 INFO:tasks.workunit.client.0.smithi076.stdout:9/578: write d9/dd/df/d11/d14/f31 [3155248,51640] 0 2024-03-28T13:06:57.634 INFO:tasks.workunit.client.0.smithi076.stdout:7/574: rmdir d1/d18/d3c/d7b/d84 39 2024-03-28T13:06:57.975 INFO:tasks.workunit.client.0.smithi076.stdout:5/558: creat d5/d9/d4c/d63/d91/fd5 x:0 0 0 2024-03-28T13:06:57.975 INFO:tasks.workunit.client.0.smithi076.stdout:9/579: chown d9/dd/df/d11/d37/f1c 11 1 2024-03-28T13:06:57.975 INFO:tasks.workunit.client.0.smithi076.stdout:9/580: read d9/dd/df/d11/d14/f6a [172839,47428] 0 2024-03-28T13:06:57.975 INFO:tasks.workunit.client.0.smithi076.stdout:9/581: stat d9/dd/df/d11/d14/f31 0 2024-03-28T13:06:58.018 INFO:tasks.workunit.client.0.smithi076.stdout:5/559: dwrite d5/d9/d1c/d25/f5d [0,4194304] 0 2024-03-28T13:06:58.020 INFO:tasks.workunit.client.0.smithi076.stdout:9/582: dwrite d9/dd/df/fb0 [0,4194304] 0 2024-03-28T13:06:58.042 INFO:tasks.workunit.client.0.smithi076.stdout:3/480: creat d1/d7/d30/d38/fad x:0 0 0 2024-03-28T13:06:58.042 INFO:tasks.workunit.client.0.smithi076.stdout:7/575: rename d1/d18/d3c/d7b/d84 to d1/d81/dc3 0 2024-03-28T13:06:58.070 INFO:tasks.workunit.client.0.smithi076.stdout:9/583: dwrite d9/dd/df/d11/d14/d58/d6e/f60 [0,4194304] 0 2024-03-28T13:06:58.088 INFO:tasks.workunit.client.0.smithi076.stdout:9/584: write d9/dd/df/fb0 [2819963,36197] 0 2024-03-28T13:06:58.089 INFO:tasks.workunit.client.0.smithi076.stdout:9/585: readlink d9/dd/df/d11/d14/l27 0 2024-03-28T13:06:58.089 INFO:tasks.workunit.client.0.smithi076.stdout:9/586: truncate d9/d3c/f32 1939462 0 2024-03-28T13:06:58.233 INFO:tasks.workunit.client.0.smithi076.stdout:5/560: mknod d5/d9/d35/cd6 0 2024-03-28T13:06:58.577 INFO:tasks.workunit.client.0.smithi076.stdout:3/481: stat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/c96 0 2024-03-28T13:06:58.791 INFO:tasks.workunit.client.0.smithi076.stdout:7/576: mkdir d1/d8/dc2/dc4 0 2024-03-28T13:06:58.791 INFO:tasks.workunit.client.0.smithi076.stdout:7/577: chown d1/lab 30833 1 2024-03-28T13:06:58.791 INFO:tasks.workunit.client.0.smithi076.stdout:7/578: write d1/d8/f25 [1043174,20583] 0 2024-03-28T13:06:58.979 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:26:16.167 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:06:58.984 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:26:16.172 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:06:58.997 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:26:16.111 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:06:59.003 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:26:16.117 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:06:59.021 INFO:tasks.workunit.client.0.smithi076.stdout:9/587: mkdir d9/d3c/dbd 0 2024-03-28T13:06:59.021 INFO:tasks.workunit.client.0.smithi076.stdout:5/561: mkdir d5/db/d3f/d97/dd7 0 2024-03-28T13:06:59.027 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:26:16.142 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:06:59.038 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:26:16.226 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:06:59.039 INFO:tasks.workunit.client.0.smithi076.stdout:5/562: dread d5/d9/d1c/d25/d73/fba [0,4194304] 0 2024-03-28T13:06:59.047 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:26:16.162 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:06:59.055 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:26:16.170 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:06:59.102 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:26:16.217 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:06:59.226 INFO:tasks.workunit.client.0.smithi076.stdout:3/482: creat d1/d7/d30/d38/d14/d4a/fae x:0 0 0 2024-03-28T13:06:59.263 INFO:tasks.workunit.client.0.smithi076.stdout:7/579: mknod d1/d8/d37/cc5 0 2024-03-28T13:06:59.628 INFO:tasks.workunit.client.0.smithi076.stdout:5/563: mknod d5/d9/d1c/d1d/d22/d9d/dcb/cd8 0 2024-03-28T13:06:59.755 INFO:tasks.workunit.client.0.smithi076.stdout:3/483: rmdir d1/d7/d30/d38 39 2024-03-28T13:06:59.755 INFO:tasks.workunit.client.0.smithi076.stdout:3/484: write d1/d7/d30/d38/d14/d36/d56/d5b/d6d/f83 [907414,28549] 0 2024-03-28T13:06:59.770 INFO:tasks.workunit.client.0.smithi076.stdout:3/485: dread d1/d7/d30/d38/d14/d27/d42/f68 [4194304,4194304] 0 2024-03-28T13:07:00.056 INFO:tasks.workunit.client.0.smithi076.stdout:5/564: symlink d5/d9/d1c/d25/dbd/d7a/ld9 0 2024-03-28T13:07:00.078 INFO:tasks.workunit.client.0.smithi076.stdout:5/565: dread d5/db/df/fd3 [0,4194304] 0 2024-03-28T13:07:00.078 INFO:tasks.workunit.client.0.smithi076.stdout:5/566: dread - d5/d9/d4c/d9b/fb8 zero size 2024-03-28T13:07:00.096 INFO:tasks.workunit.client.0.smithi076.stdout:5/567: write d5/db/f13 [473857,34260] 0 2024-03-28T13:07:00.097 INFO:tasks.workunit.client.0.smithi076.stdout:5/568: dread - d5/d9/d1c/d1d/d22/fae zero size 2024-03-28T13:07:00.222 INFO:tasks.workunit.client.0.smithi076.stdout:0/573: rmdir db/dc/df/d18 39 2024-03-28T13:07:00.223 INFO:tasks.workunit.client.0.smithi076.stdout:0/574: chown db/dc/df/d71/d4a/f72 3 1 2024-03-28T13:07:00.313 INFO:tasks.workunit.client.0.smithi076.stdout:3/486: symlink d1/d7/d30/d81/laf 0 2024-03-28T13:07:00.342 INFO:tasks.workunit.client.0.smithi076.stdout:8/570: dwrite de/d23/d2b/d5d/d76/d18/f5c [0,4194304] 0 2024-03-28T13:07:00.342 INFO:tasks.workunit.client.0.smithi076.stdout:8/571: fsync de/d23/d2b/d5d/d76/f15 0 2024-03-28T13:07:00.349 INFO:tasks.workunit.client.0.smithi076.stdout:3/487: dwrite d1/d7/f17 [0,4194304] 0 2024-03-28T13:07:00.368 INFO:tasks.workunit.client.0.smithi076.stdout:3/488: dread d1/d7/d30/f43 [4194304,4194304] 0 2024-03-28T13:07:00.370 INFO:tasks.workunit.client.0.smithi076.stdout:8/572: dwrite de/d23/d2b/d5d/d76/d6e/d7a/f92 [0,4194304] 0 2024-03-28T13:07:00.446 INFO:tasks.workunit.client.0.smithi076.stdout:5/569: symlink d5/d9/d4c/da4/lda 0 2024-03-28T13:07:00.484 INFO:tasks.workunit.client.0.smithi076.stdout:5/570: dwrite d5/d9/d1c/f70 [0,4194304] 0 2024-03-28T13:07:00.488 INFO:tasks.workunit.client.0.smithi076.stdout:5/571: dread d5/d9/d35/f85 [0,4194304] 0 2024-03-28T13:07:00.718 INFO:tasks.workunit.client.0.smithi076.stdout:8/573: creat de/d23/d2b/d51/d62/fc4 x:0 0 0 2024-03-28T13:07:00.869 INFO:tasks.workunit.client.0.smithi076.stdout:8/574: rmdir de/d13/d27 39 2024-03-28T13:07:01.666 INFO:tasks.workunit.client.0.smithi076.stdout:7/580: creat d1/d18/d3c/fc6 x:0 0 0 2024-03-28T13:07:01.667 INFO:tasks.workunit.client.0.smithi076.stdout:8/575: creat de/d13/da2/fc5 x:0 0 0 2024-03-28T13:07:02.071 INFO:tasks.workunit.client.0.smithi076.stdout:7/581: unlink d1/d8/d37/l98 0 2024-03-28T13:07:02.216 INFO:tasks.workunit.client.0.smithi076.stdout:8/576: symlink de/lc6 0 2024-03-28T13:07:02.340 INFO:tasks.workunit.client.0.smithi076.stdout:7/582: chown d1/d18/d3c/c4e 658920 1 2024-03-28T13:07:02.348 INFO:tasks.workunit.client.0.smithi076.stdout:7/583: dread d1/f36 [0,4194304] 0 2024-03-28T13:07:02.369 INFO:tasks.workunit.client.0.smithi076.stdout:7/584: dwrite d1/f4f [0,4194304] 0 2024-03-28T13:07:02.435 INFO:tasks.workunit.client.0.smithi076.stdout:8/577: link de/d23/c20 de/d13/cc7 0 2024-03-28T13:07:02.452 INFO:tasks.workunit.client.0.smithi076.stdout:8/578: dread de/d23/d2b/d5d/d76/f15 [0,4194304] 0 2024-03-28T13:07:02.748 INFO:tasks.workunit.client.0.smithi076.stdout:0/575: write db/dc/df/d18/f5f [3726030,10386] 0 2024-03-28T13:07:02.748 INFO:tasks.workunit.client.0.smithi076.stdout:8/579: chown de/d23/d2b/d5d/d76/c63 2677310 1 2024-03-28T13:07:02.911 INFO:tasks.workunit.client.0.smithi076.stdout:6/640: rmdir d6/da/d39 39 2024-03-28T13:07:02.911 INFO:tasks.workunit.client.0.smithi076.stdout:9/588: mkdir d9/dbe 0 2024-03-28T13:07:02.913 INFO:tasks.workunit.client.0.smithi076.stdout:2/560: sync 2024-03-28T13:07:02.913 INFO:tasks.workunit.client.0.smithi076.stdout:1/516: sync 2024-03-28T13:07:02.913 INFO:tasks.workunit.client.0.smithi076.stdout:4/605: sync 2024-03-28T13:07:02.913 INFO:tasks.workunit.client.0.smithi076.stdout:4/606: chown d0/d3b/d50/d64/d89/d2d/d75 18474675 1 2024-03-28T13:07:02.913 INFO:tasks.workunit.client.0.smithi076.stdout:4/607: dread - d0/d3b/d40/d42/d31/f8f zero size 2024-03-28T13:07:02.913 INFO:tasks.workunit.client.0.smithi076.stdout:4/608: write d0/d20/f87 [1014638,106547] 0 2024-03-28T13:07:02.913 INFO:tasks.workunit.client.0.smithi076.stdout:4/609: stat d0/d3b/d40/d42/d31/d5e/d72/d78/c8b 0 2024-03-28T13:07:02.913 INFO:tasks.workunit.client.0.smithi076.stdout:4/610: getdents d0/d3b/d40/d42/d31/d5e/dc3 0 2024-03-28T13:07:02.913 INFO:tasks.workunit.client.0.smithi076.stdout:4/611: chown d0/d3b/d50/d64/d89/l8c 1178 1 2024-03-28T13:07:02.913 INFO:tasks.workunit.client.0.smithi076.stdout:4/612: chown d0/d20/f87 434677648 1 2024-03-28T13:07:02.944 INFO:tasks.workunit.client.0.smithi076.stdout:2/561: write d2/d5/d7/d3e/f45 [1921807,94195] 0 2024-03-28T13:07:02.972 INFO:tasks.workunit.client.0.smithi076.stdout:9/589: dwrite d9/da/f7c [0,4194304] 0 2024-03-28T13:07:02.972 INFO:tasks.workunit.client.0.smithi076.stdout:9/590: chown d9/dd/df/fb8 110 1 2024-03-28T13:07:02.977 INFO:tasks.workunit.client.0.smithi076.stdout:9/591: dread d9/dd/df/d11/d14/d58/d6e/d2a/f76 [0,4194304] 0 2024-03-28T13:07:02.977 INFO:tasks.workunit.client.0.smithi076.stdout:9/592: write d9/da/f68 [5047432,101370] 0 2024-03-28T13:07:03.175 INFO:tasks.workunit.client.0.smithi076.stdout:0/576: mknod db/dc/df/d18/d9f/ccf 0 2024-03-28T13:07:03.175 INFO:tasks.workunit.client.0.smithi076.stdout:8/580: symlink de/d4e/d54/lc8 0 2024-03-28T13:07:03.175 INFO:tasks.workunit.client.0.smithi076.stdout:0/577: write db/f14 [156219,10790] 0 2024-03-28T13:07:03.176 INFO:tasks.workunit.client.0.smithi076.stdout:8/581: write de/d23/d2b/d5d/d76/d6e/d8a/fa5 [956525,11745] 0 2024-03-28T13:07:03.313 INFO:tasks.workunit.client.0.smithi076.stdout:6/641: rmdir d6/da 39 2024-03-28T13:07:03.313 INFO:tasks.workunit.client.0.smithi076.stdout:1/517: creat d14/d19/d85/d2e/d31/d51/d92/fbb x:0 0 0 2024-03-28T13:07:03.391 INFO:tasks.workunit.client.0.smithi076.stdout:4/613: symlink d0/d3b/d40/d8d/lc9 0 2024-03-28T13:07:03.409 INFO:tasks.workunit.client.0.smithi076.stdout:4/614: write d0/d3b/d40/d42/f24 [4180140,117212] 0 2024-03-28T13:07:03.438 INFO:tasks.workunit.client.0.smithi076.stdout:4/615: dwrite d0/d3b/d40/d42/d31/d5e/fc5 [0,4194304] 0 2024-03-28T13:07:03.459 INFO:tasks.workunit.client.0.smithi076.stdout:4/616: write d0/d3b/d50/d64/d89/f18 [3410034,105869] 0 2024-03-28T13:07:03.737 INFO:tasks.workunit.client.0.smithi076.stdout:8/582: rmdir de/d23/d2b/d58/d8e 39 2024-03-28T13:07:03.950 INFO:tasks.workunit.client.0.smithi076.stdout:0/578: creat db/dc/df/d18/d1d/d75/d51/d60/d89/fd0 x:0 0 0 2024-03-28T13:07:04.031 INFO:tasks.workunit.client.0.smithi076.stdout:6/642: mknod d6/da/d39/cd3 0 2024-03-28T13:07:04.031 INFO:tasks.workunit.client.0.smithi076.stdout:6/643: fsync d6/da/d40/d56/da4/fb8 0 2024-03-28T13:07:04.086 INFO:tasks.workunit.client.0.smithi076.stdout:6/644: dwrite d6/da/d40/d56/d58/f88 [0,4194304] 0 2024-03-28T13:07:04.117 INFO:tasks.workunit.client.0.smithi076.stdout:6/645: dwrite d6/d99/f3e [0,4194304] 0 2024-03-28T13:07:04.134 INFO:tasks.workunit.client.0.smithi076.stdout:6/646: dread d6/da/d40/d56/d58/f88 [0,4194304] 0 2024-03-28T13:07:04.235 INFO:tasks.workunit.client.0.smithi076.stdout:4/617: creat d0/d3b/d40/d42/d31/d4d/fca x:0 0 0 2024-03-28T13:07:04.260 INFO:tasks.workunit.client.0.smithi076.stdout:7/585: write d1/d18/d3c/f5f [279307,31854] 0 2024-03-28T13:07:04.297 INFO:tasks.workunit.client.0.smithi076.stdout:9/593: link d9/dd/df/d11/d37/f78 d9/dd/df/fbf 0 2024-03-28T13:07:04.298 INFO:tasks.workunit.client.0.smithi076.stdout:9/594: chown d9/da/f9d 30879916 1 2024-03-28T13:07:04.346 INFO:tasks.workunit.client.0.smithi076.stdout:3/489: symlink d1/lb0 0 2024-03-28T13:07:04.405 INFO:tasks.workunit.client.0.smithi076.stdout:8/583: mkdir de/d13/dc9 0 2024-03-28T13:07:04.476 INFO:tasks.workunit.client.0.smithi076.stdout:1/518: truncate d14/d19/f34 817313 0 2024-03-28T13:07:04.476 INFO:tasks.workunit.client.0.smithi076.stdout:1/519: fsync fd 0 2024-03-28T13:07:04.499 INFO:tasks.workunit.client.0.smithi076.stdout:5/572: creat d5/db/fdb x:0 0 0 2024-03-28T13:07:04.663 INFO:tasks.workunit.client.0.smithi076.stdout:6/647: rename d6/da/d39/l72 to d6/da/d1e/ld4 0 2024-03-28T13:07:04.684 INFO:tasks.workunit.client.0.smithi076.stdout:4/618: truncate d0/d3b/f79 4173147 0 2024-03-28T13:07:04.684 INFO:tasks.workunit.client.0.smithi076.stdout:7/586: creat d1/d18/d3c/d8c/db5/fc7 x:0 0 0 2024-03-28T13:07:04.684 INFO:tasks.workunit.client.0.smithi076.stdout:9/595: truncate d9/f6b 555000 0 2024-03-28T13:07:04.845 INFO:tasks.workunit.client.0.smithi076.stdout:8/584: rmdir de/d23/d2b/d5d/d76/d6e/d7a 39 2024-03-28T13:07:04.845 INFO:tasks.workunit.client.0.smithi076.stdout:0/579: mkdir db/dd1 0 2024-03-28T13:07:04.965 INFO:tasks.workunit.client.0.smithi076.stdout:5/573: rmdir d5/d9/d4c/d63 39 2024-03-28T13:07:04.965 INFO:tasks.workunit.client.0.smithi076.stdout:5/574: chown d5/db/d3f/f8f 1326848 1 2024-03-28T13:07:05.146 INFO:tasks.workunit.client.0.smithi076.stdout:4/619: link d0/d3b/d50/d64/d89/f5f d0/d3b/d40/d42/d31/d4d/d63/fcb 0 2024-03-28T13:07:05.322 INFO:tasks.workunit.client.0.smithi076.stdout:7/587: mknod d1/d18/d3c/d8c/cc8 0 2024-03-28T13:07:05.379 INFO:tasks.workunit.client.0.smithi076.stdout:9/596: creat d9/dd/df/d11/d37/fc0 x:0 0 0 2024-03-28T13:07:05.379 INFO:tasks.workunit.client.0.smithi076.stdout:9/597: stat d9/dd/df/d11/d14/d58/d6e 0 2024-03-28T13:07:05.379 INFO:tasks.workunit.client.0.smithi076.stdout:9/598: truncate d9/dd/df/d11/d14/f8c 209624 0 2024-03-28T13:07:05.379 INFO:tasks.workunit.client.0.smithi076.stdout:9/599: readlink d9/l38 0 2024-03-28T13:07:05.379 INFO:tasks.workunit.client.0.smithi076.stdout:9/600: stat d9/dd/d48/c4c 0 2024-03-28T13:07:05.413 INFO:tasks.workunit.client.0.smithi076.stdout:8/585: symlink de/d4e/d54/lca 0 2024-03-28T13:07:05.431 INFO:tasks.workunit.client.0.smithi076.stdout:8/586: read de/d23/d2b/d5d/d76/d6e/f79 [1436442,20573] 0 2024-03-28T13:07:05.467 INFO:tasks.workunit.client.0.smithi076.stdout:0/580: write db/dc/df/f85 [73,61613] 0 2024-03-28T13:07:05.467 INFO:tasks.workunit.client.0.smithi076.stdout:0/581: chown l3 5905 1 2024-03-28T13:07:05.476 INFO:tasks.workunit.client.0.smithi076.stdout:0/582: dread db/dc/df/f85 [0,4194304] 0 2024-03-28T13:07:05.580 INFO:tasks.workunit.client.0.smithi076.stdout:3/490: rmdir d1/d7/d30/d38/d14/d36/d56/d5b/d6d 39 2024-03-28T13:07:05.580 INFO:tasks.workunit.client.0.smithi076.stdout:5/575: mknod d5/d9/d1c/d25/dbd/d7a/db1/cdc 0 2024-03-28T13:07:05.583 INFO:tasks.workunit.client.0.smithi076.stdout:3/491: dread d1/d7/d30/d38/fc [0,4194304] 0 2024-03-28T13:07:05.595 INFO:tasks.workunit.client.0.smithi076.stdout:5/576: write d5/d9/f28 [2891990,98578] 0 2024-03-28T13:07:05.661 INFO:tasks.workunit.client.0.smithi076.stdout:4/620: mkdir d0/d3b/d40/d42/d31/d5e/d72/d78/dcc 0 2024-03-28T13:07:05.747 INFO:tasks.workunit.client.0.smithi076.stdout:7/588: symlink d1/d18/d3c/d48/d69/lc9 0 2024-03-28T13:07:05.796 INFO:tasks.workunit.client.0.smithi076.stdout:9/601: rmdir d9/d3c/dbd 0 2024-03-28T13:07:05.796 INFO:tasks.workunit.client.0.smithi076.stdout:9/602: chown d9/d3c 4741 1 2024-03-28T13:07:05.796 INFO:tasks.workunit.client.0.smithi076.stdout:9/603: chown d9/dd/df/d11/d14/d58/d6e/f9b 3 1 2024-03-28T13:07:05.796 INFO:tasks.workunit.client.0.smithi076.stdout:9/604: chown d9/l98 43 1 2024-03-28T13:07:05.879 INFO:tasks.workunit.client.0.smithi076.stdout:8/587: symlink de/d23/d2b/d51/d62/lcb 0 2024-03-28T13:07:05.879 INFO:tasks.workunit.client.0.smithi076.stdout:8/588: stat de/d4e/d54/lc8 0 2024-03-28T13:07:06.011 INFO:tasks.workunit.client.0.smithi076.stdout:0/583: mkdir db/dc/df/d18/d1d/d21/dd2 0 2024-03-28T13:07:06.011 INFO:tasks.workunit.client.0.smithi076.stdout:3/492: link d1/d7/d30/d38/d14/ca2 d1/d7/d30/d38/d14/d27/cb1 0 2024-03-28T13:07:06.107 INFO:tasks.workunit.client.0.smithi076.stdout:5/577: creat d5/db/df/fdd x:0 0 0 2024-03-28T13:07:06.126 INFO:tasks.workunit.client.0.smithi076.stdout:4/621: mknod d0/d3b/d40/d42/d31/d5e/d72/d78/dcc/ccd 0 2024-03-28T13:07:06.166 INFO:tasks.workunit.client.0.smithi076.stdout:4/622: dwrite d0/d3b/d40/d42/d28/f5b [0,4194304] 0 2024-03-28T13:07:06.167 INFO:tasks.workunit.client.0.smithi076.stdout:4/623: write d0/d3b/d40/f6e [927965,49566] 0 2024-03-28T13:07:06.204 INFO:tasks.workunit.client.0.smithi076.stdout:7/589: readlink d1/d18/d3c/l22 0 2024-03-28T13:07:06.259 INFO:tasks.workunit.client.0.smithi076.stdout:9/605: link d9/dd/df/f9f d9/dd/d48/fc1 0 2024-03-28T13:07:06.259 INFO:tasks.workunit.client.0.smithi076.stdout:9/606: fsync d9/f91 0 2024-03-28T13:07:06.259 INFO:tasks.workunit.client.0.smithi076.stdout:9/607: fdatasync d9/dd/df/d11/d37/f1c 0 2024-03-28T13:07:06.259 INFO:tasks.workunit.client.0.smithi076.stdout:9/608: write d9/d74/db3/db5/fbc [693606,72463] 0 2024-03-28T13:07:06.259 INFO:tasks.workunit.client.0.smithi076.stdout:9/609: chown d9/d3c/f5a 7377793 1 2024-03-28T13:07:06.335 INFO:tasks.workunit.client.0.smithi076.stdout:8/589: creat de/d23/fcc x:0 0 0 2024-03-28T13:07:06.416 INFO:tasks.workunit.client.0.smithi076.stdout:1/520: mknod d14/d19/d85/cbc 0 2024-03-28T13:07:06.439 INFO:tasks.workunit.client.0.smithi076.stdout:0/584: getdents db/dc/df/d11/d40/d77 0 2024-03-28T13:07:06.460 INFO:tasks.workunit.client.0.smithi076.stdout:0/585: write db/dc/df/d18/d9f/fb2 [1066333,90802] 0 2024-03-28T13:07:06.481 INFO:tasks.workunit.client.0.smithi076.stdout:3/493: getdents d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d93 0 2024-03-28T13:07:06.482 INFO:tasks.workunit.client.0.smithi076.stdout:3/494: dread - d1/d7/d30/d38/d14/d36/d56/f9a zero size 2024-03-28T13:07:06.540 INFO:tasks.workunit.client.0.smithi076.stdout:5/578: getdents d5/d9/d1c/d1d/d22/d9d/dcb 0 2024-03-28T13:07:06.540 INFO:tasks.workunit.client.0.smithi076.stdout:5/579: chown d5/d9/d35/f85 76 1 2024-03-28T13:07:06.781 INFO:tasks.workunit.client.0.smithi076.stdout:4/624: rmdir d0/d3b/d50/da8/d97 0 2024-03-28T13:07:06.974 INFO:tasks.workunit.client.0.smithi076.stdout:9/610: creat d9/dd/d48/dad/fc2 x:0 0 0 2024-03-28T13:07:07.108 INFO:tasks.workunit.client.0.smithi076.stdout:8/590: truncate de/d13/d27/f5a 324599 0 2024-03-28T13:07:07.108 INFO:tasks.workunit.client.0.smithi076.stdout:1/521: rename d14/d19/d85/d62/fa9 to d14/d19/d85/d3f/fbd 0 2024-03-28T13:07:07.108 INFO:tasks.workunit.client.0.smithi076.stdout:0/586: creat db/dc/df/d71/fd3 x:0 0 0 2024-03-28T13:07:07.122 INFO:tasks.workunit.client.0.smithi076.stdout:0/587: dread db/dc/df/f19 [0,4194304] 0 2024-03-28T13:07:07.122 INFO:tasks.workunit.client.0.smithi076.stdout:0/588: fsync db/dc/df/d11/d40/d77/da2/d6d/db9/fcb 0 2024-03-28T13:07:07.130 INFO:tasks.workunit.client.0.smithi076.stdout:3/495: mknod d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d8f/cb2 0 2024-03-28T13:07:07.151 INFO:tasks.workunit.client.0.smithi076.stdout:2/562: sync 2024-03-28T13:07:07.164 INFO:tasks.workunit.client.0.smithi076.stdout:8/591: dwrite de/d23/d2b/d5d/d76/d18/f33 [0,4194304] 0 2024-03-28T13:07:07.169 INFO:tasks.workunit.client.0.smithi076.stdout:4/625: read d0/d3b/d40/d42/f3f [918031,94376] 0 2024-03-28T13:07:07.179 INFO:tasks.workunit.client.0.smithi076.stdout:3/496: dwrite d1/d7/d30/d38/d14/d36/d56/f8b [0,4194304] 0 2024-03-28T13:07:07.382 INFO:tasks.workunit.client.0.smithi076.stdout:9/611: creat d9/da/fc3 x:0 0 0 2024-03-28T13:07:07.474 INFO:tasks.workunit.client.0.smithi076.stdout:6/648: write d6/da/f15 [280756,604] 0 2024-03-28T13:07:07.474 INFO:tasks.workunit.client.0.smithi076.stdout:6/649: chown d6/da/d40/d56/d8f/l93 86 1 2024-03-28T13:07:07.561 INFO:tasks.workunit.client.0.smithi076.stdout:1/522: getdents d14/d19/d85/d2e/d31/d46 0 2024-03-28T13:07:07.648 INFO:tasks.workunit.client.0.smithi076.stdout:0/589: rename db/dc/df/d18/l79 to db/dc/df/d11/d40/d77/da2/d6d/ld4 0 2024-03-28T13:07:07.648 INFO:tasks.workunit.client.0.smithi076.stdout:0/590: readlink db/dc/df/d18/d1d/l28 0 2024-03-28T13:07:07.648 INFO:tasks.workunit.client.0.smithi076.stdout:0/591: write db/dc/df/f85 [221459,27746] 0 2024-03-28T13:07:07.662 INFO:tasks.workunit.client.0.smithi076.stdout:0/592: dread db/dc/df/d18/d1d/f29 [0,4194304] 0 2024-03-28T13:07:08.104 INFO:tasks.workunit.client.0.smithi076.stdout:2/563: mknod d2/d5/d7/d8/d21/cb2 0 2024-03-28T13:07:08.189 INFO:tasks.workunit.client.0.smithi076.stdout:8/592: mkdir de/d23/d2b/d5d/d76/d6e/dcd 0 2024-03-28T13:07:08.189 INFO:tasks.workunit.client.0.smithi076.stdout:8/593: chown de/d13/c41 21 1 2024-03-28T13:07:08.303 INFO:tasks.workunit.client.0.smithi076.stdout:4/626: mkdir d0/d3b/d40/d42/d47/d69/da9/dce 0 2024-03-28T13:07:08.570 INFO:tasks.workunit.client.0.smithi076.stdout:3/497: creat d1/d7/d30/d38/d14/d4a/d66/fb3 x:0 0 0 2024-03-28T13:07:08.570 INFO:tasks.workunit.client.0.smithi076.stdout:3/498: stat d1/d2/l7c 0 2024-03-28T13:07:09.067 INFO:tasks.workunit.client.0.smithi076.stdout:1/523: dwrite d14/d19/f47 [4194304,4194304] 0 2024-03-28T13:07:09.067 INFO:tasks.workunit.client.0.smithi076.stdout:1/524: chown d14/d19/d85/d2e/d31/d3b 14 1 2024-03-28T13:07:09.585 INFO:tasks.workunit.client.0.smithi076.stdout:0/593: unlink l8 0 2024-03-28T13:07:09.586 INFO:tasks.workunit.client.0.smithi076.stdout:2/564: rename d2/d5/d4b/f1f to d2/d5/d7/d28/d64/fb3 0 2024-03-28T13:07:09.594 INFO:tasks.workunit.client.0.smithi076.stdout:7/590: dwrite d1/f3d [0,4194304] 0 2024-03-28T13:07:09.617 INFO:tasks.workunit.client.0.smithi076.stdout:9/612: mkdir d9/dd/df/d11/d37/dc4 0 2024-03-28T13:07:09.869 INFO:tasks.workunit.client.0.smithi076.stdout:2/565: symlink d2/d5/d7/d3e/lb4 0 2024-03-28T13:07:10.037 INFO:tasks.workunit.client.0.smithi076.stdout:7/591: creat d1/d18/d3c/d7b/d7d/fca x:0 0 0 2024-03-28T13:07:10.249 INFO:tasks.workunit.client.0.smithi076.stdout:8/594: truncate de/d23/d2b/d51/d60/f73 1404873 0 2024-03-28T13:07:10.249 INFO:tasks.workunit.client.0.smithi076.stdout:8/595: dwrite de/d23/d2b/d5d/d76/d6e/f79 [0,4194304] 0 2024-03-28T13:07:10.602 INFO:tasks.workunit.client.0.smithi076.stdout:2/566: link d2/d5/d4b/d39/l41 d2/d5/d7/d28/lb5 0 2024-03-28T13:07:10.621 INFO:tasks.workunit.client.0.smithi076.stdout:2/567: read d2/d5/db/d3b/d42/f6d [420045,3297] 0 2024-03-28T13:07:10.695 INFO:tasks.workunit.client.0.smithi076.stdout:5/580: unlink d5/d9/f4d 0 2024-03-28T13:07:10.770 INFO:tasks.workunit.client.0.smithi076.stdout:4/627: dread d0/d3b/f79 [0,4194304] 0 2024-03-28T13:07:10.802 INFO:tasks.workunit.client.0.smithi076.stdout:7/592: symlink d1/d18/d3c/d7b/lcb 0 2024-03-28T13:07:10.817 INFO:tasks.workunit.client.0.smithi076.stdout:7/593: dread d1/d18/d3c/d48/d69/d79/f89 [0,4194304] 0 2024-03-28T13:07:10.922 INFO:tasks.workunit.client.0.smithi076.stdout:9/613: symlink d9/dd/df/d11/lc5 0 2024-03-28T13:07:10.922 INFO:tasks.workunit.client.0.smithi076.stdout:8/596: getdents de/d23/d2b/d5d/d76/d18 0 2024-03-28T13:07:10.922 INFO:tasks.workunit.client.0.smithi076.stdout:9/614: write d9/dd/df/f13 [1829379,39843] 0 2024-03-28T13:07:10.970 INFO:tasks.workunit.client.0.smithi076.stdout:2/568: getdents d2/d5 0 2024-03-28T13:07:10.971 INFO:tasks.workunit.client.0.smithi076.stdout:2/569: fsync d2/d5/f5f 0 2024-03-28T13:07:10.976 INFO:tasks.workunit.client.0.smithi076.stdout:9/615: dwrite d9/dd/df/f25 [4194304,4194304] 0 2024-03-28T13:07:10.976 INFO:tasks.workunit.client.0.smithi076.stdout:9/616: truncate d9/dd/df/d11/d14/d58/faf 1034073 0 2024-03-28T13:07:10.976 INFO:tasks.workunit.client.0.smithi076.stdout:9/617: fsync d9/dd/df/d11/d14/f4e 0 2024-03-28T13:07:10.986 INFO:tasks.workunit.client.0.smithi076.stdout:2/570: dread d2/d5/d7/d3e/f45 [0,4194304] 0 2024-03-28T13:07:11.316 INFO:tasks.workunit.client.0.smithi076.stdout:5/581: creat d5/d9/d4c/fde x:0 0 0 2024-03-28T13:07:11.356 INFO:tasks.workunit.client.0.smithi076.stdout:4/628: rmdir d0/d3b/d50/d64/d89/d2d 39 2024-03-28T13:07:11.356 INFO:tasks.workunit.client.0.smithi076.stdout:4/629: stat d0/d20/f5c 0 2024-03-28T13:07:11.380 INFO:tasks.workunit.client.0.smithi076.stdout:1/525: rmdir d14/d6c 39 2024-03-28T13:07:11.462 INFO:tasks.workunit.client.0.smithi076.stdout:1/526: dwrite d14/d19/d85/d2e/d3c/d5c/f65 [0,4194304] 0 2024-03-28T13:07:11.463 INFO:tasks.workunit.client.0.smithi076.stdout:1/527: fsync d14/d19/d85/d2e/d91/fae 0 2024-03-28T13:07:11.463 INFO:tasks.workunit.client.0.smithi076.stdout:1/528: dread - d14/d19/d85/d2e/d31/d46/f88 zero size 2024-03-28T13:07:11.463 INFO:tasks.workunit.client.0.smithi076.stdout:1/529: readlink d14/d19/d85/l4d 0 2024-03-28T13:07:11.463 INFO:tasks.workunit.client.0.smithi076.stdout:1/530: fdatasync d14/d19/d20/f27 0 2024-03-28T13:07:11.463 INFO:tasks.workunit.client.0.smithi076.stdout:1/531: write d14/d19/d85/d2e/d31/d3b/f43 [1000980,33075] 0 2024-03-28T13:07:11.667 INFO:tasks.workunit.client.0.smithi076.stdout:7/594: link d1/d8/d37/f47 d1/d8/dc2/dc4/fcc 0 2024-03-28T13:07:11.667 INFO:tasks.workunit.client.0.smithi076.stdout:7/595: readlink d1/d18/l39 0 2024-03-28T13:07:11.667 INFO:tasks.workunit.client.0.smithi076.stdout:7/596: getdents d1/d81/dc3 0 2024-03-28T13:07:11.700 INFO:tasks.workunit.client.0.smithi076.stdout:8/597: symlink de/d13/d27/lce 0 2024-03-28T13:07:11.700 INFO:tasks.workunit.client.0.smithi076.stdout:8/598: truncate de/d23/d2b/d5d/d76/d18/d3c/f9a 909734 0 2024-03-28T13:07:11.722 INFO:tasks.workunit.client.0.smithi076.stdout:0/594: dwrite db/dc/df/f33 [0,4194304] 0 2024-03-28T13:07:11.839 INFO:tasks.workunit.client.0.smithi076.stdout:9/618: creat d9/dd/d48/dad/fc6 x:0 0 0 2024-03-28T13:07:11.844 INFO:tasks.workunit.client.0.smithi076.stdout:9/619: read d9/d74/db3/db5/fbc [431429,116857] 0 2024-03-28T13:07:11.844 INFO:tasks.workunit.client.0.smithi076.stdout:9/620: fdatasync d9/dd/df/d11/d14/d58/d6e/d2a/f6d 0 2024-03-28T13:07:11.968 INFO:tasks.workunit.client.0.smithi076.stdout:2/571: rename d2/d5/d7/la9 to d2/d5/db/d3b/d94/da3/lb6 0 2024-03-28T13:07:12.069 INFO:tasks.workunit.client.0.smithi076.stdout:5/582: link d5/d9/d1c/d25/dbd/d7a/db1/fc4 d5/d9/d1c/d25/dbd/d7a/d7c/fdf 0 2024-03-28T13:07:12.146 INFO:tasks.workunit.client.0.smithi076.stdout:4/630: link d0/d3b/d40/c6c d0/d3b/d50/d64/d89/d2d/d75/ccf 0 2024-03-28T13:07:12.248 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:07:12.252 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:07:12.332 INFO:tasks.workunit.client.0.smithi076.stdout:1/532: creat d14/d19/d85/d2e/fbe x:0 0 0 2024-03-28T13:07:12.332 INFO:tasks.workunit.client.0.smithi076.stdout:1/533: dread - d14/d19/d85/d2e/d91/fa0 zero size 2024-03-28T13:07:12.332 INFO:tasks.workunit.client.0.smithi076.stdout:1/534: dread - d14/d6c/d74/f95 zero size 2024-03-28T13:07:12.332 INFO:tasks.workunit.client.0.smithi076.stdout:1/535: truncate d14/d6c/d74/fb4 642568 0 2024-03-28T13:07:12.332 INFO:tasks.workunit.client.0.smithi076.stdout:1/536: chown f12 7624 1 2024-03-28T13:07:12.462 INFO:tasks.workunit.client.0.smithi076.stdout:7/597: creat d1/d81/fcd x:0 0 0 2024-03-28T13:07:12.681 INFO:tasks.workunit.client.0.smithi076.stdout:8/599: creat de/d23/d2b/d5d/d76/d6e/d8a/d93/fcf x:0 0 0 2024-03-28T13:07:12.682 INFO:tasks.workunit.client.0.smithi076.stdout:0/595: mkdir db/dc/df/d11/d40/dd5 0 2024-03-28T13:07:12.682 INFO:tasks.workunit.client.0.smithi076.stdout:0/596: fsync db/dc/df/d18/d1d/fc9 0 2024-03-28T13:07:12.682 INFO:tasks.workunit.client.0.smithi076.stdout:0/597: fsync db/dc/df/d18/d1d/fc9 0 2024-03-28T13:07:12.683 INFO:tasks.workunit.client.0.smithi076.stdout:6/650: sync 2024-03-28T13:07:12.683 INFO:tasks.workunit.client.0.smithi076.stdout:3/499: sync 2024-03-28T13:07:12.686 INFO:tasks.workunit.client.0.smithi076.stdout:8/600: dread de/d4e/f8f [0,4194304] 0 2024-03-28T13:07:12.704 INFO:tasks.workunit.client.0.smithi076.stdout:8/601: dread de/d25/f5b [0,4194304] 0 2024-03-28T13:07:12.709 INFO:tasks.workunit.client.0.smithi076.stdout:9/621: truncate d9/f36 183090 0 2024-03-28T13:07:12.712 INFO:tasks.workunit.client.0.smithi076.stdout:8/602: dread de/f11 [0,4194304] 0 2024-03-28T13:07:12.718 INFO:tasks.workunit.client.0.smithi076.stdout:8/603: dread de/d23/d2b/d5d/d76/d6e/d8a/fa5 [0,4194304] 0 2024-03-28T13:07:12.816 INFO:tasks.workunit.client.0.smithi076.stdout:2/572: rename d2/d5/d4b/d39/l41 to d2/d5/db/d3b/d3f/d99/lb7 0 2024-03-28T13:07:12.816 INFO:tasks.workunit.client.0.smithi076.stdout:2/573: write d2/d5/db/d3b/d42/f73 [1242883,7492] 0 2024-03-28T13:07:12.905 INFO:tasks.workunit.client.0.smithi076.stdout:5/583: creat d5/db/df/fe0 x:0 0 0 2024-03-28T13:07:12.905 INFO:tasks.workunit.client.0.smithi076.stdout:5/584: readlink d5/d9/d1c/d25/dbd/la9 0 2024-03-28T13:07:12.905 INFO:tasks.workunit.client.0.smithi076.stdout:5/585: fdatasync d5/d9/d4c/d63/d91/f6f 0 2024-03-28T13:07:12.965 INFO:tasks.workunit.client.0.smithi076.stdout:4/631: symlink d0/d3b/d50/d64/ld0 0 2024-03-28T13:07:13.017 INFO:tasks.workunit.client.0.smithi076.stdout:1/537: mkdir d14/d19/d20/dbf 0 2024-03-28T13:07:13.029 INFO:tasks.workunit.client.0.smithi076.stdout:1/538: dread d14/d19/d85/d2e/d31/d51/f60 [0,4194304] 0 2024-03-28T13:07:13.328 INFO:tasks.workunit.client.0.smithi076.stdout:0/598: mknod db/dc/df/d18/d1d/d75/d51/d60/d89/cd6 0 2024-03-28T13:07:13.328 INFO:tasks.workunit.client.0.smithi076.stdout:0/599: truncate db/dc/df/d11/d40/d77/da2/f95 216178 0 2024-03-28T13:07:13.329 INFO:tasks.workunit.client.0.smithi076.stdout:6/651: getdents d6/da/d40 0 2024-03-28T13:07:13.349 INFO:tasks.workunit.client.0.smithi076.stdout:3/500: symlink d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/lb4 0 2024-03-28T13:07:13.441 INFO:tasks.workunit.client.0.smithi076.stdout:8/604: getdents de/d23/d2b/d5d/d76/d6e/d8a 0 2024-03-28T13:07:13.441 INFO:tasks.workunit.client.0.smithi076.stdout:8/605: truncate de/d23/fc2 817579 0 2024-03-28T13:07:13.478 INFO:tasks.workunit.client.0.smithi076.stdout:2/574: symlink d2/d5/d7/d28/d64/lb8 0 2024-03-28T13:07:13.478 INFO:tasks.workunit.client.0.smithi076.stdout:2/575: dread - d2/d5/f84 zero size 2024-03-28T13:07:13.503 INFO:tasks.workunit.client.0.smithi076.stdout:2/576: dread d2/d5/d7/d3e/f45 [0,4194304] 0 2024-03-28T13:07:13.558 INFO:tasks.workunit.client.0.smithi076.stdout:2/577: dwrite d2/d5/d4b/d39/d57/f85 [0,4194304] 0 2024-03-28T13:07:13.599 INFO:tasks.workunit.client.0.smithi076.stdout:2/578: dwrite d2/d5/d7/dd/f32 [0,4194304] 0 2024-03-28T13:07:13.607 INFO:tasks.workunit.client.0.smithi076.stdout:2/579: fdatasync d2/d5/db/d3b/d42/f73 0 2024-03-28T13:07:13.731 INFO:tasks.workunit.client.0.smithi076.stdout:4/632: symlink d0/d3b/d50/d64/ld1 0 2024-03-28T13:07:13.733 INFO:tasks.workunit.client.0.smithi076.stdout:1/539: symlink d14/d19/d85/d2e/d31/lc0 0 2024-03-28T13:07:13.735 INFO:tasks.workunit.client.0.smithi076.stdout:4/633: write d0/d20/d7b/fa6 [200419,45491] 0 2024-03-28T13:07:13.736 INFO:tasks.workunit.client.0.smithi076.stdout:4/634: fsync d0/d3b/d40/f6e 0 2024-03-28T13:07:13.892 INFO:tasks.workunit.client.0.smithi076.stdout:0/600: mkdir db/dc/df/d18/d1d/d75/d51/dd7 0 2024-03-28T13:07:13.892 INFO:tasks.workunit.client.0.smithi076.stdout:6/652: mkdir d6/da/d39/dd5 0 2024-03-28T13:07:13.949 INFO:tasks.workunit.client.0.smithi076.stdout:9/622: truncate d9/f6b 246436 0 2024-03-28T13:07:13.972 INFO:tasks.workunit.client.0.smithi076.stdout:8/606: stat de/d13/c52 0 2024-03-28T13:07:13.996 INFO:tasks.workunit.client.0.smithi076.stdout:9/623: dwrite d9/d3c/fa8 [0,4194304] 0 2024-03-28T13:07:14.014 INFO:tasks.workunit.client.0.smithi076.stdout:8/607: dwrite de/d25/d7f/fc3 [0,4194304] 0 2024-03-28T13:07:14.014 INFO:tasks.workunit.client.0.smithi076.stdout:8/608: chown f2 0 1 2024-03-28T13:07:14.386 INFO:tasks.workunit.client.0.smithi076.stdout:2/580: rename d2/d5/db/d3b/d94/da3 to d2/d5/d4b/d39/d57/db9 0 2024-03-28T13:07:14.386 INFO:tasks.workunit.client.0.smithi076.stdout:1/540: creat d14/d19/d85/d2e/d31/d8f/fc1 x:0 0 0 2024-03-28T13:07:14.400 INFO:tasks.workunit.client.0.smithi076.stdout:4/635: creat d0/d3b/d40/d42/d47/d69/fd2 x:0 0 0 2024-03-28T13:07:14.426 INFO:tasks.workunit.client.0.smithi076.stdout:2/581: dwrite d2/d5/d4b/d39/d57/f85 [0,4194304] 0 2024-03-28T13:07:14.427 INFO:tasks.workunit.client.0.smithi076.stdout:2/582: fsync d2/d5/f12 0 2024-03-28T13:07:14.536 INFO:tasks.workunit.client.0.smithi076.stdout:7/598: link d1/d18/d3c/c38 d1/d18/d3c/cce 0 2024-03-28T13:07:14.536 INFO:tasks.workunit.client.0.smithi076.stdout:6/653: mknod d6/da/d40/d56/dd2/cd6 0 2024-03-28T13:07:14.536 INFO:tasks.workunit.client.0.smithi076.stdout:6/654: dread - d6/da/d40/d56/d8f/f9e zero size 2024-03-28T13:07:14.536 INFO:tasks.workunit.client.0.smithi076.stdout:3/501: mkdir d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/db5 0 2024-03-28T13:07:14.558 INFO:tasks.workunit.client.0.smithi076.stdout:6/655: dread d6/da/d40/d56/d58/f66 [0,4194304] 0 2024-03-28T13:07:14.566 INFO:tasks.workunit.client.0.smithi076.stdout:6/656: dread d6/da/d1e/f50 [4194304,4194304] 0 2024-03-28T13:07:14.566 INFO:tasks.workunit.client.0.smithi076.stdout:6/657: truncate d6/da/d89/fa1 3494 0 2024-03-28T13:07:14.613 INFO:tasks.workunit.client.0.smithi076.stdout:6/658: dwrite d6/fc2 [0,4194304] 0 2024-03-28T13:07:14.864 INFO:tasks.workunit.client.0.smithi076.stdout:8/609: rmdir de/d23/d2b/d5d/d76/d6e/d7a 39 2024-03-28T13:07:15.057 INFO:tasks.workunit.client.0.smithi076.stdout:1/541: truncate d14/d19/d85/d2e/d3c/d7e/f99 2293727 0 2024-03-28T13:07:15.057 INFO:tasks.workunit.client.0.smithi076.stdout:1/542: fdatasync f12 0 2024-03-28T13:07:15.057 INFO:tasks.workunit.client.0.smithi076.stdout:1/543: readlink d14/d19/d85/d2e/d31/l67 0 2024-03-28T13:07:15.060 INFO:tasks.workunit.client.0.smithi076.stdout:5/586: creat d5/d9/d1c/fe1 x:0 0 0 2024-03-28T13:07:15.060 INFO:tasks.workunit.client.0.smithi076.stdout:4/636: creat d0/d3b/d50/d64/fd3 x:0 0 0 2024-03-28T13:07:15.200 INFO:tasks.workunit.client.0.smithi076.stdout:2/583: rmdir d2/d5/d4b/d39/d57/d9c 0 2024-03-28T13:07:15.200 INFO:tasks.workunit.client.0.smithi076.stdout:2/584: stat d2/d5/d7/d8 0 2024-03-28T13:07:15.328 INFO:tasks.workunit.client.0.smithi076.stdout:0/601: mkdir db/dd8 0 2024-03-28T13:07:15.328 INFO:tasks.workunit.client.0.smithi076.stdout:7/599: creat d1/d18/d2d/fcf x:0 0 0 2024-03-28T13:07:15.353 INFO:tasks.workunit.client.0.smithi076.stdout:7/600: write d1/d18/d3c/d48/d69/f6d [835147,55781] 0 2024-03-28T13:07:15.525 INFO:tasks.workunit.client.0.smithi076.stdout:3/502: mknod d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/cb6 0 2024-03-28T13:07:15.667 INFO:tasks.workunit.client.0.smithi076.stdout:6/659: creat d6/fd7 x:0 0 0 2024-03-28T13:07:16.159 INFO:tasks.workunit.client.0.smithi076.stdout:1/544: symlink d14/d19/d85/d2e/d31/d51/d92/da4/db7/lc2 0 2024-03-28T13:07:16.159 INFO:tasks.workunit.client.0.smithi076.stdout:1/545: readlink d14/d19/d85/l42 0 2024-03-28T13:07:16.235 INFO:tasks.workunit.client.0.smithi076.stdout:4/637: mknod d0/d3b/d40/d42/d31/d5e/dc3/cd4 0 2024-03-28T13:07:16.288 INFO:tasks.workunit.client.0.smithi076.stdout:2/585: rmdir d2/d5/d7/d28/d64 39 2024-03-28T13:07:16.337 INFO:tasks.workunit.client.0.smithi076.stdout:0/602: link db/dc/df/d18/d9f/ccf db/dc/df/d11/d40/cd9 0 2024-03-28T13:07:16.424 INFO:tasks.workunit.client.0.smithi076.stdout:7/601: creat d1/d18/d3c/d48/d69/fd0 x:0 0 0 2024-03-28T13:07:16.488 INFO:tasks.workunit.client.0.smithi076.stdout:3/503: creat d1/d7/d30/d38/fb7 x:0 0 0 2024-03-28T13:07:16.511 INFO:tasks.workunit.client.0.smithi076.stdout:3/504: dread d1/d7/f17 [0,4194304] 0 2024-03-28T13:07:16.592 INFO:tasks.workunit.client.0.smithi076.stdout:3/505: dwrite d1/d7/d30/d38/d14/f8c [0,4194304] 0 2024-03-28T13:07:16.592 INFO:tasks.workunit.client.0.smithi076.stdout:3/506: dread - d1/d7/d30/d5f/f85 zero size 2024-03-28T13:07:16.687 INFO:tasks.workunit.client.0.smithi076.stdout:6/660: rename d6/f59 to d6/da/d5f/d7e/dc8/fd8 0 2024-03-28T13:07:16.738 INFO:tasks.workunit.client.0.smithi076.stdout:1/546: mkdir d14/d19/d85/dc3 0 2024-03-28T13:07:16.789 INFO:tasks.workunit.client.0.smithi076.stdout:4/638: creat d0/d20/d7f/fd5 x:0 0 0 2024-03-28T13:07:16.789 INFO:tasks.workunit.client.0.smithi076.stdout:4/639: chown d0/d3b/d40/d42/d31/l5a 211 1 2024-03-28T13:07:16.878 INFO:tasks.workunit.client.0.smithi076.stdout:5/587: write d5/d9/d4c/d63/d91/f6f [111809,29125] 0 2024-03-28T13:07:16.878 INFO:tasks.workunit.client.0.smithi076.stdout:2/586: symlink d2/d5/db/d3b/d9f/d9e/db1/lba 0 2024-03-28T13:07:16.900 INFO:tasks.workunit.client.0.smithi076.stdout:5/588: write d5/db/f12 [2528721,68301] 0 2024-03-28T13:07:16.900 INFO:tasks.workunit.client.0.smithi076.stdout:5/589: dread - d5/d9/d1c/d25/dbd/d7a/db1/fc4 zero size 2024-03-28T13:07:16.919 INFO:tasks.workunit.client.0.smithi076.stdout:5/590: write d5/d9/d1c/d25/f3a [136501,89358] 0 2024-03-28T13:07:16.919 INFO:tasks.workunit.client.0.smithi076.stdout:5/591: chown d5/l30 257189939 1 2024-03-28T13:07:16.976 INFO:tasks.workunit.client.0.smithi076.stdout:0/603: rename db/dc/df/d18/ccd to db/dc/df/d18/d1d/d75/d51/cda 0 2024-03-28T13:07:16.976 INFO:tasks.workunit.client.0.smithi076.stdout:0/604: chown db/dc 277837701 1 2024-03-28T13:07:17.353 INFO:tasks.workunit.client.0.smithi076.stdout:5/592: mkdir d5/d9/d1c/d25/dbd/d7a/de2 0 2024-03-28T13:07:17.404 INFO:tasks.workunit.client.0.smithi076.stdout:5/593: dwrite d5/d9/d1c/d25/dbd/d7a/db1/fc4 [0,4194304] 0 2024-03-28T13:07:17.437 INFO:tasks.workunit.client.0.smithi076.stdout:5/594: dwrite d5/d9/d1c/d25/dbd/d7a/fbb [0,4194304] 0 2024-03-28T13:07:17.501 INFO:tasks.workunit.client.0.smithi076.stdout:7/602: rename d1/d18/d2d/fa3 to d1/d8/d37/d53/dae/fd1 0 2024-03-28T13:07:17.501 INFO:tasks.workunit.client.0.smithi076.stdout:7/603: write d1/f1b [4421798,50255] 0 2024-03-28T13:07:17.502 INFO:tasks.workunit.client.0.smithi076.stdout:0/605: getdents db/dc/df/d18/d1d/d73 0 2024-03-28T13:07:17.548 INFO:tasks.workunit.client.0.smithi076.stdout:9/624: write d9/dd/fa0 [554100,84146] 0 2024-03-28T13:07:17.732 INFO:tasks.workunit.client.0.smithi076.stdout:5/595: truncate d5/d9/d1c/d25/d60/d82/fc0 460120 0 2024-03-28T13:07:17.862 INFO:tasks.workunit.client.0.smithi076.stdout:6/661: rename d6/ca8 to d6/da/d39/dd5/cd9 0 2024-03-28T13:07:18.111 INFO:tasks.workunit.client.0.smithi076.stdout:0/606: creat db/dc/df/d11/d40/d77/d87/d88/fdb x:0 0 0 2024-03-28T13:07:18.111 INFO:tasks.workunit.client.0.smithi076.stdout:0/607: truncate db/dc/df/d18/d1d/fc9 181512 0 2024-03-28T13:07:18.111 INFO:tasks.workunit.client.0.smithi076.stdout:0/608: dread - db/dc/df/d18/d1d/d75/d51/d60/d89/faf zero size 2024-03-28T13:07:18.127 INFO:tasks.workunit.client.0.smithi076.stdout:0/609: write db/dc/df/d71/d4a/f5c [638231,99290] 0 2024-03-28T13:07:18.232 INFO:tasks.workunit.client.0.smithi076.stdout:9/625: symlink d9/dd/df/d11/d14/d58/d6e/lc7 0 2024-03-28T13:07:18.241 INFO:tasks.workunit.client.0.smithi076.stdout:5/596: mknod d5/d9/d1c/d25/dbd/d7a/db1/ce3 0 2024-03-28T13:07:18.241 INFO:tasks.workunit.client.0.smithi076.stdout:5/597: chown d5/d9/d1c/d25/dbd 316 1 2024-03-28T13:07:18.241 INFO:tasks.workunit.client.0.smithi076.stdout:5/598: write d5/db/f79 [992256,14483] 0 2024-03-28T13:07:18.241 INFO:tasks.workunit.client.0.smithi076.stdout:5/599: read d5/d9/d1c/d1d/d22/f33 [401135,34475] 0 2024-03-28T13:07:18.328 INFO:tasks.workunit.client.0.smithi076.stdout:6/662: dread d6/da/d1e/f5a [0,4194304] 0 2024-03-28T13:07:18.618 INFO:tasks.workunit.client.0.smithi076.stdout:0/610: getdents db/dc/df/d11 0 2024-03-28T13:07:18.637 INFO:tasks.workunit.client.0.smithi076.stdout:0/611: dread db/dc/df/d11/fa0 [0,4194304] 0 2024-03-28T13:07:18.723 INFO:tasks.workunit.client.0.smithi076.stdout:5/600: rename d5/db/d19/d34/f6e to d5/d9/d1c/d1d/d31/fe4 0 2024-03-28T13:07:18.818 INFO:tasks.workunit.client.0.smithi076.stdout:6/663: unlink d6/da/d1e/f3d 0 2024-03-28T13:07:18.893 INFO:tasks.workunit.client.0.smithi076.stdout:0/612: symlink db/dc/df/d11/d40/d77/d87/ldc 0 2024-03-28T13:07:18.944 INFO:tasks.workunit.client.0.smithi076.stdout:5/601: mknod d5/d9/d1c/d25/d60/d82/ce5 0 2024-03-28T13:07:19.029 INFO:tasks.workunit.client.0.smithi076.stdout:6/664: creat d6/da/d5f/d6d/daf/fda x:0 0 0 2024-03-28T13:07:19.302 INFO:tasks.workunit.client.0.smithi076.stdout:5/602: creat d5/d9/d35/fe6 x:0 0 0 2024-03-28T13:07:19.591 INFO:tasks.workunit.client.0.smithi076.stdout:6/665: creat d6/da/d40/d56/fdb x:0 0 0 2024-03-28T13:07:19.591 INFO:tasks.workunit.client.0.smithi076.stdout:5/603: mknod d5/d9/d4c/d98/ce7 0 2024-03-28T13:07:19.591 INFO:tasks.workunit.client.0.smithi076.stdout:6/666: chown d6/da/d1e/f1f 0 1 2024-03-28T13:07:19.593 INFO:tasks.workunit.client.0.smithi076.stdout:8/610: sync 2024-03-28T13:07:19.646 INFO:tasks.workunit.client.0.smithi076.stdout:6/667: dwrite d6/da/d40/d62/db0/fbc [0,4194304] 0 2024-03-28T13:07:19.685 INFO:tasks.workunit.client.0.smithi076.stdout:3/507: sync 2024-03-28T13:07:19.685 INFO:tasks.workunit.client.0.smithi076.stdout:3/508: chown d1/d2/f70 16182 1 2024-03-28T13:07:19.686 INFO:tasks.workunit.client.0.smithi076.stdout:3/509: chown d1/d7/d30/d38/d14/d4a/d66 17 1 2024-03-28T13:07:19.691 INFO:tasks.workunit.client.0.smithi076.stdout:6/668: dwrite d6/da/d1e/fa6 [0,4194304] 0 2024-03-28T13:07:19.737 INFO:tasks.workunit.client.0.smithi076.stdout:6/669: dwrite d6/da/f14 [0,4194304] 0 2024-03-28T13:07:19.923 INFO:tasks.workunit.client.0.smithi076.stdout:5/604: creat d5/d9/d35/d3b/fe8 x:0 0 0 2024-03-28T13:07:19.923 INFO:tasks.workunit.client.0.smithi076.stdout:5/605: readlink d5/d9/d1c/d25/dbd/la9 0 2024-03-28T13:07:19.930 INFO:tasks.workunit.client.0.smithi076.stdout:1/547: write d14/f6b [932232,33257] 0 2024-03-28T13:07:19.931 INFO:tasks.workunit.client.0.smithi076.stdout:8/611: mkdir de/d23/d2b/d5d/d76/d18/d49/dd0 0 2024-03-28T13:07:19.966 INFO:tasks.workunit.client.0.smithi076.stdout:4/640: dwrite d0/d3b/d50/da8/f71 [4194304,4194304] 0 2024-03-28T13:07:20.115 INFO:tasks.workunit.client.0.smithi076.stdout:3/510: creat d1/d7/d30/d38/d14/d51/fb8 x:0 0 0 2024-03-28T13:07:20.292 INFO:tasks.workunit.client.0.smithi076.stdout:5/606: unlink d5/d9/d4c/d98/f99 0 2024-03-28T13:07:20.292 INFO:tasks.workunit.client.0.smithi076.stdout:8/612: symlink de/d13/dc9/ld1 0 2024-03-28T13:07:20.292 INFO:tasks.workunit.client.0.smithi076.stdout:8/613: write de/d13/da2/fc5 [886301,79864] 0 2024-03-28T13:07:20.292 INFO:tasks.workunit.client.0.smithi076.stdout:8/614: stat de/d13/d27/d8c/fbc 0 2024-03-28T13:07:20.293 INFO:tasks.workunit.client.0.smithi076.stdout:1/548: dread d14/d6c/d74/fb4 [0,4194304] 0 2024-03-28T13:07:20.301 INFO:tasks.workunit.client.0.smithi076.stdout:4/641: creat d0/d20/d7b/fd6 x:0 0 0 2024-03-28T13:07:20.304 INFO:tasks.workunit.client.0.smithi076.stdout:6/670: dread d6/f12 [0,4194304] 0 2024-03-28T13:07:20.305 INFO:tasks.workunit.client.0.smithi076.stdout:6/671: readlink d6/da/d5f/d6d/l85 0 2024-03-28T13:07:20.305 INFO:tasks.workunit.client.0.smithi076.stdout:6/672: chown d6/da/d40/d56/l79 235244732 1 2024-03-28T13:07:20.313 INFO:tasks.workunit.client.0.smithi076.stdout:8/615: dread de/d13/f35 [0,4194304] 0 2024-03-28T13:07:20.353 INFO:tasks.workunit.client.0.smithi076.stdout:8/616: dwrite de/d13/d27/d8c/f97 [0,4194304] 0 2024-03-28T13:07:20.888 INFO:tasks.workunit.client.0.smithi076.stdout:3/511: mkdir d1/d7/d30/d38/d14/d36/d56/d5b/d89/db9 0 2024-03-28T13:07:20.889 INFO:tasks.workunit.client.0.smithi076.stdout:5/607: mkdir d5/d9/d4c/d63/d91/de9 0 2024-03-28T13:07:21.224 INFO:tasks.workunit.client.0.smithi076.stdout:4/642: stat d0/d3b/d50/d64/d89/c60 0 2024-03-28T13:07:21.224 INFO:tasks.workunit.client.0.smithi076.stdout:6/673: creat d6/da/d40/d56/d8f/fdc x:0 0 0 2024-03-28T13:07:21.320 INFO:tasks.workunit.client.0.smithi076.stdout:8/617: creat de/d23/d2b/d5d/d76/fd2 x:0 0 0 2024-03-28T13:07:21.395 INFO:tasks.workunit.client.0.smithi076.stdout:3/512: creat d1/d2/fba x:0 0 0 2024-03-28T13:07:21.415 INFO:tasks.workunit.client.0.smithi076.stdout:7/604: write d1/d8/d37/f47 [1551409,79831] 0 2024-03-28T13:07:21.415 INFO:tasks.workunit.client.0.smithi076.stdout:7/605: chown d1/d8/c2f 522403099 1 2024-03-28T13:07:21.615 INFO:tasks.workunit.client.0.smithi076.stdout:9/626: dwrite d9/f36 [0,4194304] 0 2024-03-28T13:07:21.641 INFO:tasks.workunit.client.0.smithi076.stdout:4/643: symlink d0/d3b/d50/d64/d89/d2d/d75/ld7 0 2024-03-28T13:07:21.740 INFO:tasks.workunit.client.0.smithi076.stdout:6/674: rmdir d6/da/d40/d56/da4 39 2024-03-28T13:07:21.849 INFO:tasks.workunit.client.0.smithi076.stdout:3/513: symlink d1/d7/lbb 0 2024-03-28T13:07:22.070 INFO:tasks.workunit.client.0.smithi076.stdout:9/627: mknod d9/dd/df/d11/cc8 0 2024-03-28T13:07:22.070 INFO:tasks.workunit.client.0.smithi076.stdout:4/644: rename d0/d20/d7f/fd5 to d0/d3b/d40/d42/d31/d5e/d72/d78/dcc/fd8 0 2024-03-28T13:07:22.210 INFO:tasks.workunit.client.0.smithi076.stdout:8/618: truncate de/d13/d27/f5a 564642 0 2024-03-28T13:07:22.210 INFO:tasks.workunit.client.0.smithi076.stdout:2/587: creat d2/d5/d7/fbb x:0 0 0 2024-03-28T13:07:22.229 INFO:tasks.workunit.client.0.smithi076.stdout:8/619: dread de/d13/d27/f29 [0,4194304] 0 2024-03-28T13:07:22.229 INFO:tasks.workunit.client.0.smithi076.stdout:8/620: truncate de/d23/fcc 159430 0 2024-03-28T13:07:22.356 INFO:tasks.workunit.client.0.smithi076.stdout:3/514: rmdir d1/d7/d30/d38/d14/d36/d56/d5b 39 2024-03-28T13:07:22.356 INFO:tasks.workunit.client.0.smithi076.stdout:3/515: fsync d1/d7/d30/d38/d14/d27/f4e 0 2024-03-28T13:07:22.393 INFO:tasks.workunit.client.0.smithi076.stdout:9/628: truncate d9/dd/df/d11/d14/d58/faf 901660 0 2024-03-28T13:07:22.410 INFO:tasks.workunit.client.0.smithi076.stdout:9/629: dread d9/dd/df/d11/d14/d58/f6c [0,4194304] 0 2024-03-28T13:07:22.427 INFO:tasks.workunit.client.0.smithi076.stdout:9/630: write d9/f54 [1761013,112104] 0 2024-03-28T13:07:22.625 INFO:tasks.workunit.client.0.smithi076.stdout:7/606: rmdir d1/d18/d3c/d8c 39 2024-03-28T13:07:22.790 INFO:tasks.workunit.client.0.smithi076.stdout:2/588: stat d2/l36 0 2024-03-28T13:07:22.790 INFO:tasks.workunit.client.0.smithi076.stdout:8/621: rename de/d23/db3/fb7 to de/d23/d2b/d5d/d76/d18/fd3 0 2024-03-28T13:07:22.790 INFO:tasks.workunit.client.0.smithi076.stdout:2/589: write d2/d5/d7/fbb [952657,117136] 0 2024-03-28T13:07:22.790 INFO:tasks.workunit.client.0.smithi076.stdout:2/590: write d2/d5/db/d3b/d3f/f4f [1850652,47105] 0 2024-03-28T13:07:22.808 INFO:tasks.workunit.client.0.smithi076.stdout:2/591: dread d2/d5/db/d3b/d3f/f4f [0,4194304] 0 2024-03-28T13:07:22.896 INFO:tasks.workunit.client.0.smithi076.stdout:3/516: getdents d1/d7/d30/d38/d14/d36/d56 0 2024-03-28T13:07:22.896 INFO:tasks.workunit.client.0.smithi076.stdout:3/517: stat d1/d7/d30/d38/d14/d51 0 2024-03-28T13:07:23.060 INFO:tasks.workunit.client.0.smithi076.stdout:7/607: getdents d1/d8/d37 0 2024-03-28T13:07:23.163 INFO:tasks.workunit.client.0.smithi076.stdout:8/622: symlink de/d13/da2/ld4 0 2024-03-28T13:07:23.164 INFO:tasks.workunit.client.0.smithi076.stdout:8/623: chown de/d23/d2b/d58 30 1 2024-03-28T13:07:23.164 INFO:tasks.workunit.client.0.smithi076.stdout:2/592: symlink d2/d5/db/d3b/d5a/d8d/lbc 0 2024-03-28T13:07:23.165 INFO:tasks.workunit.client.0.smithi076.stdout:2/593: dread - d2/d5/fac zero size 2024-03-28T13:07:23.165 INFO:tasks.workunit.client.0.smithi076.stdout:2/594: read d2/d5/d7/fe [755042,66288] 0 2024-03-28T13:07:23.317 INFO:tasks.workunit.client.0.smithi076.stdout:3/518: symlink d1/d7/d30/d38/d14/d27/d69/lbc 0 2024-03-28T13:07:23.380 INFO:tasks.workunit.client.0.smithi076.stdout:7/608: creat d1/d18/d3c/d7b/fd2 x:0 0 0 2024-03-28T13:07:23.396 INFO:tasks.workunit.client.0.smithi076.stdout:7/609: read d1/d18/d3c/d48/f77 [2139763,78415] 0 2024-03-28T13:07:23.425 INFO:tasks.workunit.client.0.smithi076.stdout:8/624: mknod de/d23/d2b/d5d/d76/d18/d49/dd0/cd5 0 2024-03-28T13:07:23.500 INFO:tasks.workunit.client.0.smithi076.stdout:2/595: link d2/d5/d7/d28/f8b d2/d5/d4b/d39/d57/fbd 0 2024-03-28T13:07:23.567 INFO:tasks.workunit.client.0.smithi076.stdout:3/519: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d93/fbd x:0 0 0 2024-03-28T13:07:23.567 INFO:tasks.workunit.client.0.smithi076.stdout:3/520: readlink d1/d7/d30/d38/d14/d36/l3e 0 2024-03-28T13:07:23.588 INFO:tasks.workunit.client.0.smithi076.stdout:3/521: dread d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/f40 [0,4194304] 0 2024-03-28T13:07:23.610 INFO:tasks.workunit.client.0.smithi076.stdout:3/522: dwrite d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/f3b [0,4194304] 0 2024-03-28T13:07:23.635 INFO:tasks.workunit.client.0.smithi076.stdout:7/610: mknod d1/d8/dc2/dc4/cd3 0 2024-03-28T13:07:23.671 INFO:tasks.workunit.client.0.smithi076.stdout:7/611: dwrite d1/d18/f93 [0,4194304] 0 2024-03-28T13:07:23.671 INFO:tasks.workunit.client.0.smithi076.stdout:7/612: write d1/d18/d3c/d48/d69/f70 [1275564,63078] 0 2024-03-28T13:07:23.671 INFO:tasks.workunit.client.0.smithi076.stdout:7/613: write d1/d8/d37/d53/f91 [312495,83738] 0 2024-03-28T13:07:23.851 INFO:tasks.workunit.client.0.smithi076.stdout:8/625: creat de/d4e/d54/d98/fd6 x:0 0 0 2024-03-28T13:07:23.851 INFO:tasks.workunit.client.0.smithi076.stdout:2/596: symlink d2/d5/db/d3b/d94/lbe 0 2024-03-28T13:07:23.851 INFO:tasks.workunit.client.0.smithi076.stdout:8/626: stat de/d23/d2b/f30 0 2024-03-28T13:07:23.851 INFO:tasks.workunit.client.0.smithi076.stdout:2/597: fdatasync d2/d5/d7/f8c 0 2024-03-28T13:07:23.979 INFO:tasks.workunit.client.0.smithi076.stdout:1/549: write d14/f26 [433454,120213] 0 2024-03-28T13:07:23.979 INFO:tasks.workunit.client.0.smithi076.stdout:1/550: chown d14/d19/f47 936128 1 2024-03-28T13:07:24.046 INFO:tasks.workunit.client.0.smithi076.stdout:7/614: creat d1/dc/d8b/fd4 x:0 0 0 2024-03-28T13:07:24.096 INFO:tasks.workunit.client.0.smithi076.stdout:2/598: getdents d2 0 2024-03-28T13:07:24.125 INFO:tasks.workunit.client.0.smithi076.stdout:2/599: dwrite d2/d5/d4b/d39/f97 [0,4194304] 0 2024-03-28T13:07:24.126 INFO:tasks.workunit.client.0.smithi076.stdout:2/600: getdents d2/d5/d7/d8/d21/da0 0 2024-03-28T13:07:24.147 INFO:tasks.workunit.client.0.smithi076.stdout:8/627: creat de/d23/db3/fd7 x:0 0 0 2024-03-28T13:07:24.153 INFO:tasks.workunit.client.0.smithi076.stdout:8/628: write de/d13/da2/fc5 [660758,103938] 0 2024-03-28T13:07:24.154 INFO:tasks.workunit.client.0.smithi076.stdout:8/629: truncate de/d4e/f4f 4757732 0 2024-03-28T13:07:24.154 INFO:tasks.workunit.client.0.smithi076.stdout:8/630: truncate de/d13/f75 248012 0 2024-03-28T13:07:24.274 INFO:tasks.workunit.client.0.smithi076.stdout:7/615: truncate d1/f5 842329 0 2024-03-28T13:07:24.404 INFO:tasks.workunit.client.0.smithi076.stdout:2/601: creat d2/d5/db/d3b/d3f/fbf x:0 0 0 2024-03-28T13:07:24.449 INFO:tasks.workunit.client.0.smithi076.stdout:8/631: unlink de/d23/d2b/d58/d8e/ca4 0 2024-03-28T13:07:24.449 INFO:tasks.workunit.client.0.smithi076.stdout:8/632: chown de/d4e/d54/lc8 692355113 1 2024-03-28T13:07:24.491 INFO:tasks.workunit.client.0.smithi076.stdout:8/633: dwrite de/d4e/d54/f64 [4194304,4194304] 0 2024-03-28T13:07:24.498 INFO:tasks.workunit.client.0.smithi076.stdout:8/634: dread de/d23/f1e [0,4194304] 0 2024-03-28T13:07:24.498 INFO:tasks.workunit.client.0.smithi076.stdout:8/635: readlink de/d25/l53 0 2024-03-28T13:07:24.518 INFO:tasks.workunit.client.0.smithi076.stdout:8/636: dread de/d23/d2b/d5d/d76/f15 [0,4194304] 0 2024-03-28T13:07:24.559 INFO:tasks.workunit.client.0.smithi076.stdout:5/608: write d5/d9/d1c/d1d/d31/f37 [963002,43313] 0 2024-03-28T13:07:24.578 INFO:tasks.workunit.client.0.smithi076.stdout:2/602: mknod d2/d75/cc0 0 2024-03-28T13:07:24.578 INFO:tasks.workunit.client.0.smithi076.stdout:2/603: chown d2/d5/db/d3b/d5a/d8d/fae 0 1 2024-03-28T13:07:24.578 INFO:tasks.workunit.client.0.smithi076.stdout:2/604: write d2/d5/d4b/d39/f7f [855460,29292] 0 2024-03-28T13:07:24.578 INFO:tasks.workunit.client.0.smithi076.stdout:2/605: chown d2/d5/db/d3b/d94/ca6 366 1 2024-03-28T13:07:24.926 INFO:tasks.workunit.client.0.smithi076.stdout:0/613: sync 2024-03-28T13:07:24.941 INFO:tasks.workunit.client.0.smithi076.stdout:0/614: dread db/dc/df/d18/d9f/fa5 [0,4194304] 0 2024-03-28T13:07:24.968 INFO:tasks.workunit.client.0.smithi076.stdout:6/675: sync 2024-03-28T13:07:25.271 INFO:tasks.workunit.client.0.smithi076.stdout:8/637: creat de/d23/d2b/d5d/d76/fd8 x:0 0 0 2024-03-28T13:07:25.290 INFO:tasks.workunit.client.0.smithi076.stdout:8/638: dread de/f1d [0,4194304] 0 2024-03-28T13:07:25.290 INFO:tasks.workunit.client.0.smithi076.stdout:8/639: truncate de/d4e/d54/d68/fb8 4702689 0 2024-03-28T13:07:25.331 INFO:tasks.workunit.client.0.smithi076.stdout:5/609: creat d5/d9/d35/fea x:0 0 0 2024-03-28T13:07:25.331 INFO:tasks.workunit.client.0.smithi076.stdout:5/610: write d5/d9/d4c/d9b/fb8 [863133,47989] 0 2024-03-28T13:07:25.622 INFO:tasks.workunit.client.0.smithi076.stdout:2/606: getdents d2/d92 0 2024-03-28T13:07:25.688 INFO:tasks.workunit.client.0.smithi076.stdout:6/676: mkdir d6/da/d40/d62/dca/ddd 0 2024-03-28T13:07:25.920 INFO:tasks.workunit.client.0.smithi076.stdout:8/640: rmdir de/d23/d2b/d51/d62/d8b 39 2024-03-28T13:07:25.921 INFO:tasks.workunit.client.0.smithi076.stdout:5/611: rmdir d5/d9/d35/d3b/db6 39 2024-03-28T13:07:25.921 INFO:tasks.workunit.client.0.smithi076.stdout:2/607: mkdir d2/d5/db/d3b/d5a/d8d/dc1 0 2024-03-28T13:07:25.926 INFO:tasks.workunit.client.0.smithi076.stdout:2/608: dread d2/d5/f5f [0,4194304] 0 2024-03-28T13:07:25.926 INFO:tasks.workunit.client.0.smithi076.stdout:2/609: dread - d2/d5/f84 zero size 2024-03-28T13:07:25.926 INFO:tasks.workunit.client.0.smithi076.stdout:2/610: dread - d2/d5/f84 zero size 2024-03-28T13:07:25.926 INFO:tasks.workunit.client.0.smithi076.stdout:6/677: getdents d6/da/d40/d56/d58 0 2024-03-28T13:07:25.926 INFO:tasks.workunit.client.0.smithi076.stdout:6/678: readlink d6/da/d40/l51 0 2024-03-28T13:07:25.959 INFO:tasks.workunit.client.0.smithi076.stdout:6/679: dwrite d6/da/d40/f82 [0,4194304] 0 2024-03-28T13:07:26.265 INFO:tasks.workunit.client.0.smithi076.stdout:4/645: rmdir d0/d3b/d50/d64 39 2024-03-28T13:07:26.265 INFO:tasks.workunit.client.0.smithi076.stdout:4/646: write d0/d3b/d40/d42/fc1 [277410,70340] 0 2024-03-28T13:07:26.291 INFO:tasks.workunit.client.0.smithi076.stdout:9/631: write d9/dd/df/fbf [1509306,38078] 0 2024-03-28T13:07:26.372 INFO:tasks.workunit.client.0.smithi076.stdout:5/612: creat d5/db/d3f/feb x:0 0 0 2024-03-28T13:07:26.422 INFO:tasks.workunit.client.0.smithi076.stdout:2/611: creat d2/d5/d4b/d39/d57/db9/fc2 x:0 0 0 2024-03-28T13:07:26.423 INFO:tasks.workunit.client.0.smithi076.stdout:2/612: write d2/d5/db/d3b/f9a [240764,18604] 0 2024-03-28T13:07:26.423 INFO:tasks.workunit.client.0.smithi076.stdout:2/613: stat d2/d5/db/d3b/d5a/l74 0 2024-03-28T13:07:26.423 INFO:tasks.workunit.client.0.smithi076.stdout:2/614: write d2/d5/d7/f40 [1359480,79747] 0 2024-03-28T13:07:26.439 INFO:tasks.workunit.client.0.smithi076.stdout:2/615: write d2/d5/d7/d8/d21/f5e [3781138,17144] 0 2024-03-28T13:07:26.496 INFO:tasks.workunit.client.0.smithi076.stdout:6/680: mkdir d6/da/d1e/dde 0 2024-03-28T13:07:26.525 INFO:tasks.workunit.client.0.smithi076.stdout:6/681: dwrite d6/d99/d46/f74 [0,4194304] 0 2024-03-28T13:07:26.587 INFO:tasks.workunit.client.0.smithi076.stdout:4/647: symlink d0/d3b/d40/d42/d47/d7c/ld9 0 2024-03-28T13:07:26.689 INFO:tasks.workunit.client.0.smithi076.stdout:9/632: link d9/dd/df/d11/d14/d58/f6c d9/dd/df/d11/d14/d58/d6e/fc9 0 2024-03-28T13:07:26.707 INFO:tasks.workunit.client.0.smithi076.stdout:9/633: dread d9/dd/f56 [0,4194304] 0 2024-03-28T13:07:26.717 INFO:tasks.workunit.client.0.smithi076.stdout:8/641: symlink de/d23/d2b/d58/d78/ld9 0 2024-03-28T13:07:26.726 INFO:tasks.workunit.client.0.smithi076.stdout:9/634: dwrite d9/dd/df/d11/d14/d58/d6e/d2a/f49 [0,4194304] 0 2024-03-28T13:07:26.730 INFO:tasks.workunit.client.0.smithi076.stdout:9/635: read d9/dd/df/d11/d14/d58/d6e/d2a/f8b [220913,94478] 0 2024-03-28T13:07:26.801 INFO:tasks.workunit.client.0.smithi076.stdout:2/616: getdents d2/d5/db/d3b/d5a 0 2024-03-28T13:07:26.802 INFO:tasks.workunit.client.0.smithi076.stdout:2/617: truncate d2/d5/d7/d28/f8b 597256 0 2024-03-28T13:07:26.835 INFO:tasks.workunit.client.0.smithi076.stdout:2/618: dwrite d2/d5/db/d3b/d5a/d8d/fae [0,4194304] 0 2024-03-28T13:07:26.835 INFO:tasks.workunit.client.0.smithi076.stdout:2/619: dread - d2/d5/d7/d28/fa4 zero size 2024-03-28T13:07:26.835 INFO:tasks.workunit.client.0.smithi076.stdout:2/620: stat d2/d5/db/l8a 0 2024-03-28T13:07:26.965 INFO:tasks.workunit.client.0.smithi076.stdout:6/682: mkdir d6/da/d23/ddf 0 2024-03-28T13:07:26.966 INFO:tasks.workunit.client.0.smithi076.stdout:6/683: fsync d6/f2f 0 2024-03-28T13:07:26.978 INFO:tasks.workunit.client.0.smithi076.stdout:6/684: dread d6/f12 [0,4194304] 0 2024-03-28T13:07:26.978 INFO:tasks.workunit.client.0.smithi076.stdout:6/685: truncate d6/da/d40/d56/da4/fb8 571852 0 2024-03-28T13:07:26.997 INFO:tasks.workunit.client.0.smithi076.stdout:7/616: creat d1/d8/fd5 x:0 0 0 2024-03-28T13:07:27.032 INFO:tasks.workunit.client.0.smithi076.stdout:8/642: mknod de/d23/d2b/d51/d62/cda 0 2024-03-28T13:07:27.061 INFO:tasks.workunit.client.0.smithi076.stdout:8/643: dwrite de/d4e/d54/d98/f9d [0,4194304] 0 2024-03-28T13:07:27.378 INFO:tasks.workunit.client.0.smithi076.stdout:3/523: rename d1/f48 to d1/d7/d30/d38/d14/d4a/fbe 0 2024-03-28T13:07:27.378 INFO:tasks.workunit.client.0.smithi076.stdout:3/524: fdatasync d1/d7/d30/d38/fb7 0 2024-03-28T13:07:27.573 INFO:tasks.workunit.client.0.smithi076.stdout:9/636: symlink d9/lca 0 2024-03-28T13:07:27.843 INFO:tasks.workunit.client.0.smithi076.stdout:2/621: rmdir d2/d5/d4b/d39 39 2024-03-28T13:07:27.844 INFO:tasks.workunit.client.0.smithi076.stdout:2/622: readlink d2/d5/d7/d8/l2f 0 2024-03-28T13:07:27.844 INFO:tasks.workunit.client.0.smithi076.stdout:2/623: readlink d2/l2e 0 2024-03-28T13:07:27.844 INFO:tasks.workunit.client.0.smithi076.stdout:0/615: creat db/dc/df/d11/d40/d77/fdd x:0 0 0 2024-03-28T13:07:27.901 INFO:tasks.workunit.client.0.smithi076.stdout:6/686: symlink d6/da/d5f/d7e/le0 0 2024-03-28T13:07:28.193 INFO:tasks.workunit.client.0.smithi076.stdout:7/617: mknod d1/d81/dc3/cd6 0 2024-03-28T13:07:28.258 INFO:tasks.workunit.client.0.smithi076.stdout:8/644: creat de/d13/da2/fdb x:0 0 0 2024-03-28T13:07:28.547 INFO:tasks.workunit.client.0.smithi076.stdout:1/551: rename d14/d6c/lad to d14/d19/d85/d2e/d31/d8f/lc4 0 2024-03-28T13:07:28.579 INFO:tasks.workunit.client.0.smithi076.stdout:1/552: dwrite d14/d19/d85/d2e/d31/d51/f70 [0,4194304] 0 2024-03-28T13:07:28.579 INFO:tasks.workunit.client.0.smithi076.stdout:1/553: chown d14/d6c/d74/fb4 1725312 1 2024-03-28T13:07:28.599 INFO:tasks.workunit.client.0.smithi076.stdout:3/525: link d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d58/f6f d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/fbf 0 2024-03-28T13:07:29.232 INFO:tasks.workunit.client.0.smithi076.stdout:9/637: rmdir d9/dd/df/d11/d14/d58 39 2024-03-28T13:07:29.232 INFO:tasks.workunit.client.0.smithi076.stdout:9/638: write d9/fb1 [31033,3283] 0 2024-03-28T13:07:29.233 INFO:tasks.workunit.client.0.smithi076.stdout:9/639: dread - d9/dd/df/d11/f4f zero size 2024-03-28T13:07:29.291 INFO:tasks.workunit.client.0.smithi076.stdout:0/616: creat db/dc/df/d18/d1d/d21/dd2/fde x:0 0 0 2024-03-28T13:07:29.481 INFO:tasks.workunit.client.0.smithi076.stdout:8/645: creat de/d23/fdc x:0 0 0 2024-03-28T13:07:29.546 INFO:tasks.workunit.client.0.smithi076.stdout:4/648: rename d0/d3b/d50/d64/d89 to d0/d20/d7f/dda 0 2024-03-28T13:07:29.598 INFO:tasks.workunit.client.0.smithi076.stdout:4/649: dwrite d0/d3b/d40/d42/d31/d4d/d63/f6a [4194304,4194304] 0 2024-03-28T13:07:29.598 INFO:tasks.workunit.client.0.smithi076.stdout:4/650: chown d0/d3b/d40/d42/d47/d69/lbf 3918 1 2024-03-28T13:07:29.598 INFO:tasks.workunit.client.0.smithi076.stdout:4/651: readlink d0/d3b/d40/d42/d31/l45 0 2024-03-28T13:07:29.598 INFO:tasks.workunit.client.0.smithi076.stdout:4/652: fsync d0/d20/f87 0 2024-03-28T13:07:29.645 INFO:tasks.workunit.client.0.smithi076.stdout:1/554: creat d14/d19/d85/d2e/d31/d51/d92/da4/db7/fc5 x:0 0 0 2024-03-28T13:07:29.762 INFO:tasks.workunit.client.0.smithi076.stdout:3/526: unlink d1/f1b 0 2024-03-28T13:07:29.816 INFO:tasks.workunit.client.0.smithi076.stdout:0/617: truncate db/dc/df/f33 2140285 0 2024-03-28T13:07:29.816 INFO:tasks.workunit.client.0.smithi076.stdout:0/618: chown db/dc/df/d18/d1d/l28 73085983 1 2024-03-28T13:07:29.845 INFO:tasks.workunit.client.0.smithi076.stdout:3/527: dwrite d1/f63 [0,4194304] 0 2024-03-28T13:07:29.866 INFO:tasks.workunit.client.0.smithi076.stdout:6/687: truncate d6/f4b 681904 0 2024-03-28T13:07:29.902 INFO:tasks.workunit.client.0.smithi076.stdout:8/646: mkdir de/d23/d2b/d58/ddd 0 2024-03-28T13:07:29.903 INFO:tasks.workunit.client.0.smithi076.stdout:8/647: fdatasync fd 0 2024-03-28T13:07:29.979 INFO:tasks.workunit.client.0.smithi076.stdout:2/624: rename d2/d5/d7/d8/c1c to d2/d5/db/d3b/d3f/cc3 0 2024-03-28T13:07:30.173 INFO:tasks.workunit.client.0.smithi076.stdout:0/619: link db/dc/df/d71/d4a/d7e/l8f db/dc/df/d11/d40/dc7/ldf 0 2024-03-28T13:07:30.298 INFO:tasks.workunit.client.0.smithi076.stdout:3/528: symlink d1/d7/d30/d81/lc0 0 2024-03-28T13:07:30.401 INFO:tasks.workunit.client.0.smithi076.stdout:6/688: creat d6/da/d40/d56/d8f/fe1 x:0 0 0 2024-03-28T13:07:30.655 INFO:tasks.workunit.client.0.smithi076.stdout:8/648: mkdir de/d4e/db6/dde 0 2024-03-28T13:07:30.655 INFO:tasks.workunit.client.0.smithi076.stdout:8/649: read - de/d13/d27/d8c/f99 zero size 2024-03-28T13:07:30.852 INFO:tasks.workunit.client.0.smithi076.stdout:2/625: creat d2/d5/db/d3b/d5a/d8d/fc4 x:0 0 0 2024-03-28T13:07:30.852 INFO:tasks.workunit.client.0.smithi076.stdout:2/626: truncate d2/d75/f91 135973 0 2024-03-28T13:07:30.946 INFO:tasks.workunit.client.0.smithi076.stdout:0/620: mknod db/dc/df/d18/ce0 0 2024-03-28T13:07:31.088 INFO:tasks.workunit.client.0.smithi076.stdout:3/529: readlink d1/d7/d30/d38/d14/l67 0 2024-03-28T13:07:31.103 INFO:tasks.workunit.client.0.smithi076.stdout:6/689: mknod d6/da/d89/ce2 0 2024-03-28T13:07:31.134 INFO:tasks.workunit.client.0.smithi076.stdout:8/650: dread de/d23/d2b/d5d/d76/f4a [0,4194304] 0 2024-03-28T13:07:31.134 INFO:tasks.workunit.client.0.smithi076.stdout:8/651: fsync de/d25/f5b 0 2024-03-28T13:07:31.134 INFO:tasks.workunit.client.0.smithi076.stdout:8/652: truncate de/d13/f80 22225 0 2024-03-28T13:07:31.191 INFO:tasks.workunit.client.0.smithi076.stdout:2/627: creat d2/d5/db/d3b/d9f/d9e/fc5 x:0 0 0 2024-03-28T13:07:31.227 INFO:tasks.workunit.client.0.smithi076.stdout:0/621: truncate db/dc/df/f23 990602 0 2024-03-28T13:07:31.527 INFO:tasks.workunit.client.0.smithi076.stdout:6/690: unlink d6/da/d40/d56/d8f/fe1 0 2024-03-28T13:07:31.563 INFO:tasks.workunit.client.0.smithi076.stdout:7/618: dwrite d1/d18/d3c/d48/d69/fb0 [0,4194304] 0 2024-03-28T13:07:31.591 INFO:tasks.workunit.client.0.smithi076.stdout:7/619: dwrite d1/dc/f32 [0,4194304] 0 2024-03-28T13:07:31.614 INFO:tasks.workunit.client.0.smithi076.stdout:8/653: mkdir de/d23/d2b/d5d/d76/d6e/d7a/ddf 0 2024-03-28T13:07:31.614 INFO:tasks.workunit.client.0.smithi076.stdout:8/654: write de/d13/da2/fdb [106895,26672] 0 2024-03-28T13:07:31.669 INFO:tasks.workunit.client.0.smithi076.stdout:2/628: unlink d2/d5/db/d3b/d3f/f4f 0 2024-03-28T13:07:31.921 INFO:tasks.workunit.client.0.smithi076.stdout:6/691: dread d6/da/d5f/d6d/d95/fb2 [0,4194304] 0 2024-03-28T13:07:31.921 INFO:tasks.workunit.client.0.smithi076.stdout:6/692: write d6/f87 [4419200,122480] 0 2024-03-28T13:07:31.965 INFO:tasks.workunit.client.0.smithi076.stdout:5/613: mkdir d5/d9/d1c/dec 0 2024-03-28T13:07:32.146 INFO:tasks.workunit.client.0.smithi076.stdout:7/620: mkdir d1/d81/dd7 0 2024-03-28T13:07:32.167 INFO:tasks.workunit.client.0.smithi076.stdout:0/622: dwrite db/dc/df/f33 [0,4194304] 0 2024-03-28T13:07:32.239 INFO:tasks.workunit.client.0.smithi076.stdout:8/655: mknod de/d23/d2b/d51/d60/ce0 0 2024-03-28T13:07:32.422 INFO:tasks.workunit.client.0.smithi076.stdout:2/629: creat d2/d5/db/d3b/d5a/d8d/dc1/fc6 x:0 0 0 2024-03-28T13:07:32.423 INFO:tasks.workunit.client.0.smithi076.stdout:2/630: fsync d2/d5/d4b/d39/d57/db9/fc2 0 2024-03-28T13:07:32.442 INFO:tasks.workunit.client.0.smithi076.stdout:2/631: write d2/d5/f12 [182303,13310] 0 2024-03-28T13:07:32.671 INFO:tasks.workunit.client.0.smithi076.stdout:6/693: link d6/da/d23/f45 d6/da/d5f/d6d/fe3 0 2024-03-28T13:07:32.672 INFO:tasks.workunit.client.0.smithi076.stdout:5/614: getdents d5/d9/d1c/d25 0 2024-03-28T13:07:32.672 INFO:tasks.workunit.client.0.smithi076.stdout:5/615: dread - d5/d9/d1c/d25/d60/fc5 zero size 2024-03-28T13:07:32.707 INFO:tasks.workunit.client.0.smithi076.stdout:7/621: symlink d1/d8/dc2/dc4/ld8 0 2024-03-28T13:07:32.781 INFO:tasks.workunit.client.0.smithi076.stdout:0/623: creat db/dc/df/fe1 x:0 0 0 2024-03-28T13:07:32.849 INFO:tasks.workunit.client.0.smithi076.stdout:8/656: creat de/d23/d2b/d5d/d76/d18/d49/dd0/fe1 x:0 0 0 2024-03-28T13:07:32.849 INFO:tasks.workunit.client.0.smithi076.stdout:8/657: write de/fa7 [379164,90359] 0 2024-03-28T13:07:32.870 INFO:tasks.workunit.client.0.smithi076.stdout:8/658: read de/d23/d2b/d5d/d76/d18/f33 [723665,3851] 0 2024-03-28T13:07:32.922 INFO:tasks.workunit.client.0.smithi076.stdout:2/632: unlink d2/d5/d4b/d39/f7f 0 2024-03-28T13:07:32.922 INFO:tasks.workunit.client.0.smithi076.stdout:2/633: write d2/d5/d7/d3e/faf [905867,129046] 0 2024-03-28T13:07:33.078 INFO:tasks.workunit.client.0.smithi076.stdout:6/694: symlink d6/da/d40/d62/dca/le4 0 2024-03-28T13:07:33.078 INFO:tasks.workunit.client.0.smithi076.stdout:6/695: truncate d6/f2f 4372588 0 2024-03-28T13:07:33.136 INFO:tasks.workunit.client.0.smithi076.stdout:5/616: getdents d5/d9/d35 0 2024-03-28T13:07:33.180 INFO:tasks.workunit.client.0.smithi076.stdout:7/622: symlink d1/d18/d3c/d8c/ld9 0 2024-03-28T13:07:33.180 INFO:tasks.workunit.client.0.smithi076.stdout:7/623: chown d1/d8/c41 858 1 2024-03-28T13:07:33.229 INFO:tasks.workunit.client.0.smithi076.stdout:0/624: mknod db/dc/df/d11/d40/ce2 0 2024-03-28T13:07:33.245 INFO:tasks.workunit.client.0.smithi076.stdout:0/625: write db/dc/df/d18/d1d/f29 [2599264,69784] 0 2024-03-28T13:07:33.269 INFO:tasks.workunit.client.0.smithi076.stdout:0/626: write db/dc/df/d11/fa3 [2036565,14554] 0 2024-03-28T13:07:33.289 INFO:tasks.workunit.client.0.smithi076.stdout:8/659: mknod de/d23/d2b/d51/d60/dc1/ce2 0 2024-03-28T13:07:33.310 INFO:tasks.workunit.client.0.smithi076.stdout:2/634: mknod d2/d5/db/d3b/d3f/cc7 0 2024-03-28T13:07:33.310 INFO:tasks.workunit.client.0.smithi076.stdout:2/635: write d2/d5/db/d3b/d9f/f77 [2602147,107982] 0 2024-03-28T13:07:33.313 INFO:tasks.workunit.client.0.smithi076.stdout:2/636: read d2/d5/db/d3b/d42/f73 [482748,75879] 0 2024-03-28T13:07:33.313 INFO:tasks.workunit.client.0.smithi076.stdout:2/637: fdatasync d2/d5/fac 0 2024-03-28T13:07:33.314 INFO:tasks.workunit.client.0.smithi076.stdout:2/638: dread d2/d75/f91 [0,4194304] 0 2024-03-28T13:07:33.323 INFO:tasks.workunit.client.0.smithi076.stdout:2/639: dread d2/d5/d7/fbb [0,4194304] 0 2024-03-28T13:07:33.323 INFO:tasks.workunit.client.0.smithi076.stdout:2/640: truncate d2/d75/f91 464461 0 2024-03-28T13:07:33.346 INFO:tasks.workunit.client.0.smithi076.stdout:2/641: read d2/d5/d7/d8/d21/f69 [2989806,55401] 0 2024-03-28T13:07:33.378 INFO:tasks.workunit.client.0.smithi076.stdout:2/642: dwrite d2/d5/d7/d28/d64/fb3 [4194304,4194304] 0 2024-03-28T13:07:33.417 INFO:tasks.workunit.client.0.smithi076.stdout:2/643: dwrite d2/d5/d7/f8c [0,4194304] 0 2024-03-28T13:07:33.457 INFO:tasks.workunit.client.0.smithi076.stdout:0/627: rmdir db/dc/df/d18/d1d 39 2024-03-28T13:07:33.457 INFO:tasks.workunit.client.0.smithi076.stdout:0/628: write db/dc/faa [858929,121924] 0 2024-03-28T13:07:33.723 INFO:tasks.workunit.client.0.smithi076.stdout:2/644: mkdir d2/d5/d7/dd/dc8 0 2024-03-28T13:07:33.833 INFO:tasks.workunit.client.0.smithi076.stdout:0/629: mkdir db/dc/df/d18/d1d/d75/d51/dd7/de3 0 2024-03-28T13:07:34.284 INFO:tasks.workunit.client.0.smithi076.stdout:0/630: symlink db/dd8/le4 0 2024-03-28T13:07:34.601 INFO:tasks.workunit.client.0.smithi076.stdout:0/631: creat db/dc/df/d11/d40/dc7/fe5 x:0 0 0 2024-03-28T13:07:34.656 INFO:tasks.workunit.client.0.smithi076.stdout:0/632: creat db/da6/fe6 x:0 0 0 2024-03-28T13:07:34.670 INFO:tasks.workunit.client.0.smithi076.stdout:0/633: dread db/dc/df/d11/fa0 [0,4194304] 0 2024-03-28T13:07:35.097 INFO:tasks.workunit.client.0.smithi076.stdout:0/634: link db/dc/l3a db/dc/df/d18/le7 0 2024-03-28T13:07:35.258 INFO:tasks.workunit.client.0.smithi076.stdout:0/635: mknod db/dc/df/d18/d1d/d21/ce8 0 2024-03-28T13:07:35.310 INFO:tasks.workunit.client.0.smithi076.stdout:0/636: dwrite db/dc/df/d11/f63 [0,4194304] 0 2024-03-28T13:07:35.310 INFO:tasks.workunit.client.0.smithi076.stdout:0/637: chown db/dc/df/d71 7 1 2024-03-28T13:07:35.483 INFO:tasks.workunit.client.0.smithi076.stdout:9/640: rename c8 to d9/d74/db3/ccb 0 2024-03-28T13:07:35.499 INFO:tasks.workunit.client.0.smithi076.stdout:6/696: write d6/da/d40/d56/d8f/fa0 [7801797,55782] 0 2024-03-28T13:07:35.881 INFO:tasks.workunit.client.0.smithi076.stdout:0/638: chown db/dc/df/f1e 82341478 1 2024-03-28T13:07:35.881 INFO:tasks.workunit.client.0.smithi076.stdout:0/639: chown db/dc/df/d11/fa0 217 1 2024-03-28T13:07:35.932 INFO:tasks.workunit.client.0.smithi076.stdout:4/653: rename d0/d3b/d40/d42/d47/cbc to d0/d3b/d50/d64/cdb 0 2024-03-28T13:07:35.981 INFO:tasks.workunit.client.0.smithi076.stdout:9/641: getdents d9/dd/df/d11/d14/d58/da1 0 2024-03-28T13:07:36.012 INFO:tasks.workunit.client.0.smithi076.stdout:6/697: truncate d6/da/d1e/f50 6933392 0 2024-03-28T13:07:36.068 INFO:tasks.workunit.client.0.smithi076.stdout:0/640: link db/dc/df/d11/fa3 db/d16/fe9 0 2024-03-28T13:07:36.068 INFO:tasks.workunit.client.0.smithi076.stdout:0/641: dread - db/dc/df/fc0 zero size 2024-03-28T13:07:36.136 INFO:tasks.workunit.client.0.smithi076.stdout:1/555: rename d14/d19/d85/d2e/d31/f39 to d14/d19/d85/dc3/fc6 0 2024-03-28T13:07:36.165 INFO:tasks.workunit.client.0.smithi076.stdout:4/654: symlink d0/d20/d7b/ldc 0 2024-03-28T13:07:36.328 INFO:tasks.workunit.client.0.smithi076.stdout:0/642: mknod db/dc/df/d18/d1d/d75/d51/d60/d92/cea 0 2024-03-28T13:07:36.328 INFO:tasks.workunit.client.0.smithi076.stdout:0/643: chown db/dc/df/d18/c8b 43 1 2024-03-28T13:07:36.328 INFO:tasks.workunit.client.0.smithi076.stdout:0/644: fdatasync db/dc/df/f1e 0 2024-03-28T13:07:36.468 INFO:tasks.workunit.client.0.smithi076.stdout:5/617: rename d5/d9/d4c/d63 to d5/d9/d1c/d1d/d31/ded 0 2024-03-28T13:07:36.472 INFO:tasks.workunit.client.0.smithi076.stdout:1/556: mknod d14/d19/d85/d2e/d31/cc7 0 2024-03-28T13:07:36.490 INFO:tasks.workunit.client.0.smithi076.stdout:2/645: dwrite d2/d5/db/d3b/f4e [0,4194304] 0 2024-03-28T13:07:36.490 INFO:tasks.workunit.client.0.smithi076.stdout:2/646: chown d2/d5/db/d3b/d9f/d9e 999 1 2024-03-28T13:07:36.490 INFO:tasks.workunit.client.0.smithi076.stdout:2/647: write d2/d5/d7/f40 [7263229,12820] 0 2024-03-28T13:07:36.507 INFO:tasks.workunit.client.0.smithi076.stdout:4/655: mknod d0/d20/d7f/dda/d2d/cdd 0 2024-03-28T13:07:36.507 INFO:tasks.workunit.client.0.smithi076.stdout:4/656: write d0/d3b/d40/fa1 [701564,78504] 0 2024-03-28T13:07:36.580 INFO:tasks.workunit.client.0.smithi076.stdout:7/624: rmdir d1/d8 39 2024-03-28T13:07:36.580 INFO:tasks.workunit.client.0.smithi076.stdout:7/625: readlink d1/d18/d3c/d48/d69/lc9 0 2024-03-28T13:07:36.713 INFO:tasks.workunit.client.0.smithi076.stdout:8/660: unlink de/c6a 0 2024-03-28T13:07:37.074 INFO:tasks.workunit.client.0.smithi076.stdout:6/698: rename d6/da/d40/d56/da4/cb5 to d6/da/d40/d56/d84/ce5 0 2024-03-28T13:07:37.184 INFO:tasks.workunit.client.0.smithi076.stdout:5/618: mknod d5/d9/d1c/d25/dbd/d7a/d7c/cee 0 2024-03-28T13:07:37.184 INFO:tasks.workunit.client.0.smithi076.stdout:1/557: unlink d14/d19/d85/l6d 0 2024-03-28T13:07:37.184 INFO:tasks.workunit.client.0.smithi076.stdout:1/558: chown d14/d19/d85/d2e/d31/d6f 1397570 1 2024-03-28T13:07:37.209 INFO:tasks.workunit.client.0.smithi076.stdout:1/559: dwrite d14/d19/d85/d2e/d31/d46/fac [0,4194304] 0 2024-03-28T13:07:37.212 INFO:tasks.workunit.client.0.smithi076.stdout:1/560: dread d14/d19/d20/f27 [0,4194304] 0 2024-03-28T13:07:37.212 INFO:tasks.workunit.client.0.smithi076.stdout:1/561: chown d14/d19/d85/d2e/d3c/d5c 1041474899 1 2024-03-28T13:07:37.213 INFO:tasks.workunit.client.0.smithi076.stdout:1/562: chown d14/d19/d85/d2e/fbe 15 1 2024-03-28T13:07:37.229 INFO:tasks.workunit.client.0.smithi076.stdout:1/563: dread f5 [0,4194304] 0 2024-03-28T13:07:37.377 INFO:tasks.workunit.client.0.smithi076.stdout:3/530: creat d1/d7/d30/fc1 x:0 0 0 2024-03-28T13:07:37.403 INFO:tasks.workunit.client.0.smithi076.stdout:3/531: dwrite d1/d2/f4f [0,4194304] 0 2024-03-28T13:07:37.480 INFO:tasks.workunit.client.0.smithi076.stdout:2/648: mknod d2/d5/db/d3b/d3f/d99/cc9 0 2024-03-28T13:07:37.755 INFO:tasks.workunit.client.0.smithi076.stdout:7/626: link d1/d81/dc3/lbd d1/d18/d3c/d48/d69/d79/lda 0 2024-03-28T13:07:38.064 INFO:tasks.workunit.client.0.smithi076.stdout:5/619: mknod d5/d9/d1c/dec/cef 0 2024-03-28T13:07:38.065 INFO:tasks.workunit.client.0.smithi076.stdout:8/661: rename de/d23/db3/fd7 to de/d4e/db6/fe3 0 2024-03-28T13:07:38.065 INFO:tasks.workunit.client.0.smithi076.stdout:5/620: chown d5/db 1 1 2024-03-28T13:07:38.065 INFO:tasks.workunit.client.0.smithi076.stdout:8/662: chown de/d23/c20 7 1 2024-03-28T13:07:38.291 INFO:tasks.workunit.client.0.smithi076.stdout:3/532: symlink d1/d7/d30/d38/d14/d36/d56/d5b/d89/lc2 0 2024-03-28T13:07:38.291 INFO:tasks.workunit.client.0.smithi076.stdout:2/649: link d2/d5/d4b/l58 d2/d5/d7/d8/lca 0 2024-03-28T13:07:38.316 INFO:tasks.workunit.client.0.smithi076.stdout:3/533: dread d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/fbf [0,4194304] 0 2024-03-28T13:07:38.317 INFO:tasks.workunit.client.0.smithi076.stdout:3/534: truncate d1/d7/d30/d38/d14/d36/d56/f9a 853315 0 2024-03-28T13:07:38.333 INFO:tasks.workunit.client.0.smithi076.stdout:7/627: symlink d1/d8/dc2/ldb 0 2024-03-28T13:07:38.353 INFO:tasks.workunit.client.0.smithi076.stdout:3/535: dwrite d1/d7/d30/d38/d14/d51/f87 [0,4194304] 0 2024-03-28T13:07:38.416 INFO:tasks.workunit.client.0.smithi076.stdout:5/621: creat d5/db/d19/ff0 x:0 0 0 2024-03-28T13:07:38.437 INFO:tasks.workunit.client.0.smithi076.stdout:5/622: dwrite d5/db/d3f/d97/fa8 [0,4194304] 0 2024-03-28T13:07:38.437 INFO:tasks.workunit.client.0.smithi076.stdout:5/623: write d5/db/f13 [4937676,110792] 0 2024-03-28T13:07:38.508 INFO:tasks.workunit.client.0.smithi076.stdout:8/663: creat de/d23/d2b/d5d/d76/d6e/fe4 x:0 0 0 2024-03-28T13:07:38.602 INFO:tasks.workunit.client.0.smithi076.stdout:2/650: mknod d2/d92/ccb 0 2024-03-28T13:07:38.649 INFO:tasks.workunit.client.0.smithi076.stdout:2/651: dwrite d2/d5/f12 [0,4194304] 0 2024-03-28T13:07:38.683 INFO:tasks.workunit.client.0.smithi076.stdout:7/628: creat d1/d8/fdc x:0 0 0 2024-03-28T13:07:39.128 INFO:tasks.workunit.client.0.smithi076.stdout:5/624: unlink d5/d9/d1c/d25/d60/d82/fb3 0 2024-03-28T13:07:39.128 INFO:tasks.workunit.client.0.smithi076.stdout:8/664: stat de/d23/d2b/d51/d60/d89/l90 0 2024-03-28T13:07:39.207 INFO:tasks.workunit.client.0.smithi076.stdout:2/652: creat d2/d5/d7/dd/dc8/fcc x:0 0 0 2024-03-28T13:07:39.220 INFO:tasks.workunit.client.0.smithi076.stdout:2/653: dread d2/d5/d7/f71 [0,4194304] 0 2024-03-28T13:07:39.245 INFO:tasks.workunit.client.0.smithi076.stdout:2/654: dwrite d2/d75/f91 [0,4194304] 0 2024-03-28T13:07:39.273 INFO:tasks.workunit.client.0.smithi076.stdout:2/655: dwrite d2/d5/db/d3b/d9f/f8e [0,4194304] 0 2024-03-28T13:07:39.293 INFO:tasks.workunit.client.0.smithi076.stdout:7/629: symlink d1/d8/d37/d53/ldd 0 2024-03-28T13:07:39.294 INFO:tasks.workunit.client.0.smithi076.stdout:7/630: truncate d1/dc/f55 1405326 0 2024-03-28T13:07:39.353 INFO:tasks.workunit.client.0.smithi076.stdout:5/625: truncate d5/d9/d1c/f70 1319999 0 2024-03-28T13:07:39.353 INFO:tasks.workunit.client.0.smithi076.stdout:5/626: fdatasync d5/d9/f28 0 2024-03-28T13:07:39.364 INFO:tasks.workunit.client.0.smithi076.stdout:5/627: dread d5/d9/d1c/d25/f2b [0,4194304] 0 2024-03-28T13:07:39.404 INFO:tasks.workunit.client.0.smithi076.stdout:8/665: creat de/d23/d2b/d51/fe5 x:0 0 0 2024-03-28T13:07:39.560 INFO:tasks.workunit.client.0.smithi076.stdout:2/656: creat d2/d5/d7/d28/d64/fcd x:0 0 0 2024-03-28T13:07:39.641 INFO:tasks.workunit.client.0.smithi076.stdout:5/628: link d5/d9/f59 d5/db/ff1 0 2024-03-28T13:07:39.649 INFO:tasks.workunit.client.0.smithi076.stdout:5/629: dread d5/db/f12 [0,4194304] 0 2024-03-28T13:07:39.650 INFO:tasks.workunit.client.0.smithi076.stdout:5/630: chown d5/db/d3f/d97/cc3 202438556 1 2024-03-28T13:07:39.674 INFO:tasks.workunit.client.0.smithi076.stdout:5/631: dwrite d5/db/df/fdd [0,4194304] 0 2024-03-28T13:07:40.071 INFO:tasks.workunit.client.0.smithi076.stdout:5/632: mknod d5/d9/d1c/d25/dbd/d7a/de2/cf2 0 2024-03-28T13:07:40.152 INFO:tasks.workunit.client.0.smithi076.stdout:5/633: read d5/d9/d1c/d1d/d31/fe4 [2647820,87983] 0 2024-03-28T13:07:40.181 INFO:tasks.workunit.client.0.smithi076.stdout:5/634: dwrite d5/d9/d1c/d25/f5d [0,4194304] 0 2024-03-28T13:07:40.200 INFO:tasks.workunit.client.0.smithi076.stdout:5/635: dread d5/d9/d1c/d25/dbd/d7a/db1/fc4 [0,4194304] 0 2024-03-28T13:07:40.350 INFO:tasks.workunit.client.0.smithi076.stdout:9/642: sync 2024-03-28T13:07:40.350 INFO:tasks.workunit.client.0.smithi076.stdout:0/645: sync 2024-03-28T13:07:40.350 INFO:tasks.workunit.client.0.smithi076.stdout:9/643: stat d9/dd/df/d11/d14/fa3 0 2024-03-28T13:07:40.353 INFO:tasks.workunit.client.0.smithi076.stdout:4/657: sync 2024-03-28T13:07:40.377 INFO:tasks.workunit.client.0.smithi076.stdout:0/646: dwrite db/dc/df/d18/d1d/d73/f81 [4194304,4194304] 0 2024-03-28T13:07:40.386 INFO:tasks.workunit.client.0.smithi076.stdout:4/658: dwrite d0/d3b/d40/d42/d28/f32 [4194304,4194304] 0 2024-03-28T13:07:40.386 INFO:tasks.workunit.client.0.smithi076.stdout:4/659: write d0/d3b/d40/d42/d31/d4d/fca [397872,86989] 0 2024-03-28T13:07:40.386 INFO:tasks.workunit.client.0.smithi076.stdout:4/660: chown d0/d20/l55 2 1 2024-03-28T13:07:40.386 INFO:tasks.workunit.client.0.smithi076.stdout:0/647: dread f5 [0,4194304] 0 2024-03-28T13:07:40.538 INFO:tasks.workunit.client.0.smithi076.stdout:3/536: mkdir d1/d7/d30/d38/d14/dc3 0 2024-03-28T13:07:40.592 INFO:tasks.workunit.client.0.smithi076.stdout:1/564: truncate d14/d19/d85/d2e/d31/d46/fac 3004047 0 2024-03-28T13:07:40.759 INFO:tasks.workunit.client.0.smithi076.stdout:5/636: write d5/db/d3f/d42/f83 [8625127,52847] 0 2024-03-28T13:07:40.788 INFO:tasks.workunit.client.0.smithi076.stdout:5/637: dwrite d5/db/f46 [4194304,4194304] 0 2024-03-28T13:07:40.788 INFO:tasks.workunit.client.0.smithi076.stdout:5/638: chown d5/d9/d4c/d9b/ca1 13731 1 2024-03-28T13:07:40.842 INFO:tasks.workunit.client.0.smithi076.stdout:9/644: dread d9/dd/df/d11/d14/fa3 [0,4194304] 0 2024-03-28T13:07:40.979 INFO:tasks.workunit.client.0.smithi076.stdout:0/648: creat db/dc/df/d11/d40/feb x:0 0 0 2024-03-28T13:07:41.026 INFO:tasks.workunit.client.0.smithi076.stdout:0/649: dwrite db/f12 [0,4194304] 0 2024-03-28T13:07:41.026 INFO:tasks.workunit.client.0.smithi076.stdout:0/650: chown db/dc/df/d18/d1d/d75/d51/dd7/de3 26397 1 2024-03-28T13:07:41.100 INFO:tasks.workunit.client.0.smithi076.stdout:1/565: mkdir d14/d19/d85/d2e/d31/d51/d92/da4/db7/dc8 0 2024-03-28T13:07:41.191 INFO:tasks.workunit.client.0.smithi076.stdout:5/639: symlink d5/d9/d1c/lf3 0 2024-03-28T13:07:41.245 INFO:tasks.workunit.client.0.smithi076.stdout:9/645: creat d9/dd/df/d11/db2/fcc x:0 0 0 2024-03-28T13:07:41.321 INFO:tasks.workunit.client.0.smithi076.stdout:1/566: mknod d14/d19/d85/d2e/d31/d51/cc9 0 2024-03-28T13:07:41.421 INFO:tasks.workunit.client.0.smithi076.stdout:6/699: rename d6/d99/f3e to d6/fe6 0 2024-03-28T13:07:41.461 INFO:tasks.workunit.client.0.smithi076.stdout:6/700: dwrite d6/fc2 [4194304,4194304] 0 2024-03-28T13:07:41.477 INFO:tasks.workunit.client.0.smithi076.stdout:6/701: dread d6/d99/d46/f74 [0,4194304] 0 2024-03-28T13:07:41.487 INFO:tasks.workunit.client.0.smithi076.stdout:6/702: dread d6/da/d40/d62/f7d [0,4194304] 0 2024-03-28T13:07:41.487 INFO:tasks.workunit.client.0.smithi076.stdout:6/703: dread - d6/da/d40/d56/d8f/f9e zero size 2024-03-28T13:07:41.505 INFO:tasks.workunit.client.0.smithi076.stdout:9/646: creat d9/dd/df/d11/d37/dc4/fcd x:0 0 0 2024-03-28T13:07:41.661 INFO:tasks.workunit.client.0.smithi076.stdout:1/567: unlink d14/d19/d85/d2e/d31/d8f/lc4 0 2024-03-28T13:07:41.795 INFO:tasks.workunit.client.0.smithi076.stdout:4/661: rename d0/d3b/d40/d42/d31/d4d/f52 to d0/d3b/d40/d42/d31/fde 0 2024-03-28T13:07:41.875 INFO:tasks.workunit.client.0.smithi076.stdout:6/704: truncate d6/da/d23/f80 2820190 0 2024-03-28T13:07:41.875 INFO:tasks.workunit.client.0.smithi076.stdout:6/705: fsync d6/da/d40/d56/d58/f8e 0 2024-03-28T13:07:41.876 INFO:tasks.workunit.client.0.smithi076.stdout:6/706: chown d6/da/d5f/l6a 658740037 1 2024-03-28T13:07:41.968 INFO:tasks.workunit.client.0.smithi076.stdout:9/647: truncate d9/dd/d48/f59 253508 0 2024-03-28T13:07:41.968 INFO:tasks.workunit.client.0.smithi076.stdout:9/648: readlink d9/d3c/l55 0 2024-03-28T13:07:41.968 INFO:tasks.workunit.client.0.smithi076.stdout:9/649: write d9/dd/df/d11/d14/d58/d6e/f21 [317566,17388] 0 2024-03-28T13:07:41.968 INFO:tasks.workunit.client.0.smithi076.stdout:9/650: fdatasync d9/dd/df/d11/d14/d58/d6e/d2a/f8b 0 2024-03-28T13:07:42.265 INFO:tasks.workunit.client.0.smithi076.stdout:2/657: truncate d2/d5/db/d3b/d9f/f8e 2730315 0 2024-03-28T13:07:42.372 INFO:tasks.workunit.client.0.smithi076.stdout:4/662: symlink d0/d3b/d40/d42/d31/ldf 0 2024-03-28T13:07:42.534 INFO:tasks.workunit.client.0.smithi076.stdout:6/707: symlink d6/da/d1e/dde/le7 0 2024-03-28T13:07:42.534 INFO:tasks.workunit.client.0.smithi076.stdout:6/708: chown d6/f24 231016 1 2024-03-28T13:07:42.603 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:07:42.607 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:07:42.649 INFO:tasks.workunit.client.0.smithi076.stdout:2/658: mknod d2/d5/d7/d3e/cce 0 2024-03-28T13:07:42.649 INFO:tasks.workunit.client.0.smithi076.stdout:2/659: chown d2/d5/d7/l14 46 1 2024-03-28T13:07:42.715 INFO:tasks.workunit.client.0.smithi076.stdout:4/663: creat d0/d3b/d40/d42/d47/d69/fe0 x:0 0 0 2024-03-28T13:07:42.910 INFO:tasks.workunit.client.0.smithi076.stdout:2/660: write d2/d5/d4b/d39/d57/f7d [717838,15313] 0 2024-03-28T13:07:42.910 INFO:tasks.workunit.client.0.smithi076.stdout:2/661: stat d2/d5/f84 0 2024-03-28T13:07:42.992 INFO:tasks.workunit.client.0.smithi076.stdout:4/664: mkdir d0/d20/d7f/de1 0 2024-03-28T13:07:43.032 INFO:tasks.workunit.client.0.smithi076.stdout:4/665: dwrite d0/d20/f48 [0,4194304] 0 2024-03-28T13:07:43.195 INFO:tasks.workunit.client.0.smithi076.stdout:2/662: rename d2/d5/db/d3b/d3f/c90 to d2/d5/db/d3b/d5a/daa/ccf 0 2024-03-28T13:07:43.196 INFO:tasks.workunit.client.0.smithi076.stdout:0/651: unlink db/dc/df/d18/l61 0 2024-03-28T13:07:43.205 INFO:tasks.workunit.client.0.smithi076.stdout:2/663: dread d2/d5/d7/fe [0,4194304] 0 2024-03-28T13:07:43.252 INFO:tasks.workunit.client.0.smithi076.stdout:2/664: dwrite d2/d5/db/d3b/d9f/f77 [0,4194304] 0 2024-03-28T13:07:43.275 INFO:tasks.workunit.client.0.smithi076.stdout:2/665: write d2/d5/d7/d28/f43 [386825,28580] 0 2024-03-28T13:07:43.276 INFO:tasks.workunit.client.0.smithi076.stdout:2/666: chown d2/d5/d7/d28/c82 20 1 2024-03-28T13:07:43.290 INFO:tasks.workunit.client.0.smithi076.stdout:2/667: dread d2/d5/d4b/d39/d57/f85 [0,4194304] 0 2024-03-28T13:07:43.291 INFO:tasks.workunit.client.0.smithi076.stdout:2/668: read d2/d5/d4b/d39/d57/f7d [126285,110391] 0 2024-03-28T13:07:43.291 INFO:tasks.workunit.client.0.smithi076.stdout:2/669: truncate d2/d5/d7/d3e/f45 4792468 0 2024-03-28T13:07:43.291 INFO:tasks.workunit.client.0.smithi076.stdout:2/670: write d2/d5/d7/d3e/f45 [1145369,4490] 0 2024-03-28T13:07:43.434 INFO:tasks.workunit.client.0.smithi076.stdout:4/666: creat d0/d20/d7f/dda/db7/fe2 x:0 0 0 2024-03-28T13:07:43.434 INFO:tasks.workunit.client.0.smithi076.stdout:4/667: chown d0/d3b/d40/d42/d47/d69/da9/dce 8286837 1 2024-03-28T13:07:43.434 INFO:tasks.workunit.client.0.smithi076.stdout:4/668: truncate d0/f73 4778095 0 2024-03-28T13:07:43.434 INFO:tasks.workunit.client.0.smithi076.stdout:4/669: read - d0/d3b/d40/d42/d31/f8f zero size 2024-03-28T13:07:43.434 INFO:tasks.workunit.client.0.smithi076.stdout:4/670: fdatasync d0/d3b/d40/d42/d47/d7c/f91 0 2024-03-28T13:07:43.434 INFO:tasks.workunit.client.0.smithi076.stdout:4/671: chown d0/d3b/d40/d42/d31/d5e/d72 9590 1 2024-03-28T13:07:43.562 INFO:tasks.workunit.client.0.smithi076.stdout:0/652: rename db/dc/fe to db/da6/fec 0 2024-03-28T13:07:43.562 INFO:tasks.workunit.client.0.smithi076.stdout:4/672: rename d0/d20/d7b to d0/d20/d7b/de3 22 2024-03-28T13:07:43.688 INFO:tasks.workunit.client.0.smithi076.stdout:0/653: unlink db/dc/df/d18/d1d/d21/l6e 0 2024-03-28T13:07:43.689 INFO:tasks.workunit.client.0.smithi076.stdout:0/654: chown db/dc/df/f1e 24390 1 2024-03-28T13:07:43.730 INFO:tasks.workunit.client.0.smithi076.stdout:8/666: sync 2024-03-28T13:07:43.730 INFO:tasks.workunit.client.0.smithi076.stdout:7/631: sync 2024-03-28T13:07:43.730 INFO:tasks.workunit.client.0.smithi076.stdout:7/632: dread - d1/d18/d3c/fb7 zero size 2024-03-28T13:07:43.825 INFO:tasks.workunit.client.0.smithi076.stdout:0/655: mkdir db/dc/df/d11/d40/dd5/ded 0 2024-03-28T13:07:43.825 INFO:tasks.workunit.client.0.smithi076.stdout:0/656: dread - db/d16/fb6 zero size 2024-03-28T13:07:43.913 INFO:tasks.workunit.client.0.smithi076.stdout:8/667: mknod de/d23/d2b/d5d/d76/d6e/d8a/ce6 0 2024-03-28T13:07:44.120 INFO:tasks.workunit.client.0.smithi076.stdout:5/640: write d5/db/ff1 [2460318,13300] 0 2024-03-28T13:07:44.294 INFO:tasks.workunit.client.0.smithi076.stdout:0/657: creat db/dc/df/fee x:0 0 0 2024-03-28T13:07:44.294 INFO:tasks.workunit.client.0.smithi076.stdout:0/658: write db/fbb [67641,27888] 0 2024-03-28T13:07:44.294 INFO:tasks.workunit.client.0.smithi076.stdout:0/659: fdatasync db/dc/df/f1e 0 2024-03-28T13:07:44.301 INFO:tasks.workunit.client.0.smithi076.stdout:0/660: dread db/d16/f6f [0,4194304] 0 2024-03-28T13:07:44.321 INFO:tasks.workunit.client.0.smithi076.stdout:0/661: dread db/dc/df/d11/fa0 [0,4194304] 0 2024-03-28T13:07:44.321 INFO:tasks.workunit.client.0.smithi076.stdout:0/662: fdatasync db/dc/df/d18/d1d/d75/d51/d60/d89/faf 0 2024-03-28T13:07:44.321 INFO:tasks.workunit.client.0.smithi076.stdout:0/663: truncate db/dc/df/f44 1452778 0 2024-03-28T13:07:44.365 INFO:tasks.workunit.client.0.smithi076.stdout:8/668: creat de/d23/d2b/d5d/fe7 x:0 0 0 2024-03-28T13:07:44.386 INFO:tasks.workunit.client.0.smithi076.stdout:8/669: dwrite fa [4194304,4194304] 0 2024-03-28T13:07:44.479 INFO:tasks.workunit.client.0.smithi076.stdout:5/641: unlink d5/d9/d35/d3b/laf 0 2024-03-28T13:07:44.479 INFO:tasks.workunit.client.0.smithi076.stdout:5/642: dread - d5/db/d19/f8c zero size 2024-03-28T13:07:44.487 INFO:tasks.workunit.client.0.smithi076.stdout:5/643: dread d5/db/f79 [0,4194304] 0 2024-03-28T13:07:44.524 INFO:tasks.workunit.client.0.smithi076.stdout:0/664: creat db/dd8/fef x:0 0 0 2024-03-28T13:07:44.679 INFO:tasks.workunit.client.0.smithi076.stdout:8/670: creat de/d23/d2b/d51/d60/d89/fe8 x:0 0 0 2024-03-28T13:07:44.679 INFO:tasks.workunit.client.0.smithi076.stdout:8/671: write de/d25/d7f/fc3 [4928086,80359] 0 2024-03-28T13:07:44.915 INFO:tasks.workunit.client.0.smithi076.stdout:5/644: creat d5/d9/d35/d3b/db6/ff4 x:0 0 0 2024-03-28T13:07:44.985 INFO:tasks.workunit.client.0.smithi076.stdout:9/651: dwrite d9/dd/df/d11/d14/f8c [0,4194304] 0 2024-03-28T13:07:44.985 INFO:tasks.workunit.client.0.smithi076.stdout:9/652: fsync d9/dd/df/d11/d14/d58/d6e/f70 0 2024-03-28T13:07:44.985 INFO:tasks.workunit.client.0.smithi076.stdout:9/653: dread - d9/dd/df/d11/fa9 zero size 2024-03-28T13:07:44.985 INFO:tasks.workunit.client.0.smithi076.stdout:9/654: readlink d9/dd/df/l88 0 2024-03-28T13:07:45.206 INFO:tasks.workunit.client.0.smithi076.stdout:5/645: symlink d5/db/d3f/d97/lf5 0 2024-03-28T13:07:45.215 INFO:tasks.workunit.client.0.smithi076.stdout:6/709: write d6/da/d1e/f50 [6488352,34834] 0 2024-03-28T13:07:45.216 INFO:tasks.workunit.client.0.smithi076.stdout:6/710: fsync d6/da/d39/f3b 0 2024-03-28T13:07:45.216 INFO:tasks.workunit.client.0.smithi076.stdout:6/711: chown d6/da/d1e/f70 322580115 1 2024-03-28T13:07:45.232 INFO:tasks.workunit.client.0.smithi076.stdout:9/655: truncate d9/dd/df/d11/d37/f8a 55310 0 2024-03-28T13:07:45.383 INFO:tasks.workunit.client.0.smithi076.stdout:5/646: truncate d5/d9/d1c/d25/dbd/d7a/db1/fc4 3728852 0 2024-03-28T13:07:45.383 INFO:tasks.workunit.client.0.smithi076.stdout:5/647: chown d5/d9/d35/fac 223 1 2024-03-28T13:07:45.405 INFO:tasks.workunit.client.0.smithi076.stdout:5/648: dwrite d5/d9/d1c/fe1 [0,4194304] 0 2024-03-28T13:07:45.405 INFO:tasks.workunit.client.0.smithi076.stdout:5/649: chown d5/d9/d1c/d25/dbd/d7a/db1/cdc 63350254 1 2024-03-28T13:07:46.030 INFO:tasks.workunit.client.0.smithi076.stdout:0/665: getdents db/dc 0 2024-03-28T13:07:46.030 INFO:tasks.workunit.client.0.smithi076.stdout:0/666: truncate db/dc/df/d18/d1d/d75/d51/d60/d89/faf 25351 0 2024-03-28T13:07:46.181 INFO:tasks.workunit.client.0.smithi076.stdout:0/667: symlink db/dc/df/d11/d40/lf0 0 2024-03-28T13:07:46.181 INFO:tasks.workunit.client.0.smithi076.stdout:6/712: truncate d6/da/d5f/f6b 1587581 0 2024-03-28T13:07:46.200 INFO:tasks.workunit.client.0.smithi076.stdout:4/673: write d0/d3b/f79 [73868,60471] 0 2024-03-28T13:07:46.325 INFO:tasks.workunit.client.0.smithi076.stdout:0/668: mkdir db/dc/df/d18/d1d/d21/dd2/df1 0 2024-03-28T13:07:46.376 INFO:tasks.workunit.client.0.smithi076.stdout:0/669: dwrite db/dc/f9a [0,4194304] 0 2024-03-28T13:07:46.398 INFO:tasks.workunit.client.0.smithi076.stdout:6/713: truncate d6/da/d1e/f28 1451459 0 2024-03-28T13:07:46.399 INFO:tasks.workunit.client.0.smithi076.stdout:6/714: readlink d6/l57 0 2024-03-28T13:07:46.806 INFO:tasks.workunit.client.0.smithi076.stdout:0/670: creat db/dc/df/d18/d1d/d75/d51/dd7/de3/ff2 x:0 0 0 2024-03-28T13:07:46.806 INFO:tasks.workunit.client.0.smithi076.stdout:0/671: getdents db/dc/df/d18/d1d/d75/d51/d97 0 2024-03-28T13:07:46.857 INFO:tasks.workunit.client.0.smithi076.stdout:6/715: creat d6/fe8 x:0 0 0 2024-03-28T13:07:47.138 INFO:tasks.workunit.client.0.smithi076.stdout:0/672: creat db/dc/df/d18/d1d/d21/ff3 x:0 0 0 2024-03-28T13:07:47.142 INFO:tasks.workunit.client.0.smithi076.stdout:2/671: unlink d2/d5/l2c 0 2024-03-28T13:07:47.180 INFO:tasks.workunit.client.0.smithi076.stdout:8/672: dwrite de/d13/f80 [0,4194304] 0 2024-03-28T13:07:47.260 INFO:tasks.workunit.client.0.smithi076.stdout:6/716: rename d6/f24 to d6/da/d23/ddf/fe9 0 2024-03-28T13:07:47.260 INFO:tasks.workunit.client.0.smithi076.stdout:6/717: getdents d6/da/d40/d56/dc7 0 2024-03-28T13:07:47.260 INFO:tasks.workunit.client.0.smithi076.stdout:6/718: read d6/d99/f5b [440367,109355] 0 2024-03-28T13:07:47.260 INFO:tasks.workunit.client.0.smithi076.stdout:6/719: truncate d6/da/d1e/f42 617608 0 2024-03-28T13:07:47.288 INFO:tasks.workunit.client.0.smithi076.stdout:2/672: truncate d2/d5/d7/d28/f43 3273995 0 2024-03-28T13:07:47.331 INFO:tasks.workunit.client.0.smithi076.stdout:2/673: dwrite d2/d5/fac [0,4194304] 0 2024-03-28T13:07:47.331 INFO:tasks.workunit.client.0.smithi076.stdout:2/674: readlink d2/d5/db/d3b/d3f/d99/lb7 0 2024-03-28T13:07:47.379 INFO:tasks.workunit.client.0.smithi076.stdout:2/675: dwrite d2/d5/d7/d3e/f81 [8388608,4194304] 0 2024-03-28T13:07:47.379 INFO:tasks.workunit.client.0.smithi076.stdout:2/676: readlink d2/d5/db/l8a 0 2024-03-28T13:07:47.430 INFO:tasks.workunit.client.0.smithi076.stdout:9/656: symlink d9/lce 0 2024-03-28T13:07:47.431 INFO:tasks.workunit.client.0.smithi076.stdout:9/657: read d9/d3c/f43 [675523,79603] 0 2024-03-28T13:07:47.497 INFO:tasks.workunit.client.0.smithi076.stdout:3/537: creat d1/d7/d30/fc4 x:0 0 0 2024-03-28T13:07:47.877 INFO:tasks.workunit.client.0.smithi076.stdout:8/673: rmdir de/d25 39 2024-03-28T13:07:47.877 INFO:tasks.workunit.client.0.smithi076.stdout:8/674: chown de/d23/d2b/d5d/d76 2 1 2024-03-28T13:07:47.924 INFO:tasks.workunit.client.0.smithi076.stdout:2/677: creat d2/d5/db/d3b/d42/fd0 x:0 0 0 2024-03-28T13:07:47.955 INFO:tasks.workunit.client.0.smithi076.stdout:2/678: dwrite d2/d5/db/d3b/d5a/d8d/dc1/fc6 [0,4194304] 0 2024-03-28T13:07:48.038 INFO:tasks.workunit.client.0.smithi076.stdout:9/658: unlink d9/lce 0 2024-03-28T13:07:48.039 INFO:tasks.workunit.client.0.smithi076.stdout:9/659: chown d9/dd/df/d11/d14/l99 6302635 1 2024-03-28T13:07:48.102 INFO:tasks.workunit.client.0.smithi076.stdout:3/538: symlink d1/d7/d30/d5f/lc5 0 2024-03-28T13:07:48.102 INFO:tasks.workunit.client.0.smithi076.stdout:3/539: readlink d1/d7/lbb 0 2024-03-28T13:07:48.102 INFO:tasks.workunit.client.0.smithi076.stdout:3/540: write d1/d7/d30/d38/d14/d4a/d66/f6a [580477,57820] 0 2024-03-28T13:07:48.203 INFO:tasks.workunit.client.0.smithi076.stdout:8/675: symlink de/d23/d2b/d5d/d76/d6e/d7a/le9 0 2024-03-28T13:07:48.206 INFO:tasks.workunit.client.0.smithi076.stdout:8/676: write de/d4e/f8f [287660,23899] 0 2024-03-28T13:07:48.405 INFO:tasks.workunit.client.0.smithi076.stdout:9/660: creat d9/dd/d48/dad/fcf x:0 0 0 2024-03-28T13:07:48.405 INFO:tasks.workunit.client.0.smithi076.stdout:9/661: fsync d9/dd/df/d11/d14/f8c 0 2024-03-28T13:07:48.405 INFO:tasks.workunit.client.0.smithi076.stdout:9/662: fdatasync d9/dd/df/f9f 0 2024-03-28T13:07:48.469 INFO:tasks.workunit.client.0.smithi076.stdout:3/541: creat d1/d7/d30/d38/d14/d36/fc6 x:0 0 0 2024-03-28T13:07:48.533 INFO:tasks.workunit.client.0.smithi076.stdout:8/677: creat de/d13/d27/d8c/fea x:0 0 0 2024-03-28T13:07:48.595 INFO:tasks.workunit.client.0.smithi076.stdout:9/663: creat d9/dd/df/d11/d37/fd0 x:0 0 0 2024-03-28T13:07:48.595 INFO:tasks.workunit.client.0.smithi076.stdout:9/664: write d9/dd/df/d11/d14/d58/d6e/f50 [783999,3591] 0 2024-03-28T13:07:48.628 INFO:tasks.workunit.client.0.smithi076.stdout:3/542: mkdir d1/d7/d30/d38/d14/d27/dc7 0 2024-03-28T13:07:48.702 INFO:tasks.workunit.client.0.smithi076.stdout:8/678: truncate de/d25/f85 466839 0 2024-03-28T13:07:49.009 INFO:tasks.workunit.client.0.smithi076.stdout:5/650: write d5/d9/d1c/d1d/d31/fe4 [127149,16117] 0 2024-03-28T13:07:49.010 INFO:tasks.workunit.client.0.smithi076.stdout:9/665: creat d9/dd/df/d11/fd1 x:0 0 0 2024-03-28T13:07:49.031 INFO:tasks.workunit.client.0.smithi076.stdout:8/679: unlink de/d13/dc9/ld1 0 2024-03-28T13:07:49.032 INFO:tasks.workunit.client.0.smithi076.stdout:3/543: link d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/f59 d1/d7/d30/d38/d9b/fc8 0 2024-03-28T13:07:49.467 INFO:tasks.workunit.client.0.smithi076.stdout:4/674: sync 2024-03-28T13:07:49.467 INFO:tasks.workunit.client.0.smithi076.stdout:7/633: sync 2024-03-28T13:07:49.467 INFO:tasks.workunit.client.0.smithi076.stdout:1/568: sync 2024-03-28T13:07:49.467 INFO:tasks.workunit.client.0.smithi076.stdout:4/675: truncate d0/d3b/d40/d42/d47/d69/fd2 363153 0 2024-03-28T13:07:49.482 INFO:tasks.workunit.client.0.smithi076.stdout:4/676: dread d0/d3b/d40/d42/d31/fde [4194304,4194304] 0 2024-03-28T13:07:49.482 INFO:tasks.workunit.client.0.smithi076.stdout:4/677: fdatasync d0/d3b/d40/d42/d28/f49 0 2024-03-28T13:07:49.550 INFO:tasks.workunit.client.0.smithi076.stdout:5/651: unlink d5/db/l1a 0 2024-03-28T13:07:49.708 INFO:tasks.workunit.client.0.smithi076.stdout:9/666: getdents d9/dd/df/d11/d14 0 2024-03-28T13:07:49.794 INFO:tasks.workunit.client.0.smithi076.stdout:3/544: rmdir d1/d7/d30/d38/d14/dc3 0 2024-03-28T13:07:49.877 INFO:tasks.workunit.client.0.smithi076.stdout:7/634: creat d1/d8/d37/fde x:0 0 0 2024-03-28T13:07:49.916 INFO:tasks.workunit.client.0.smithi076.stdout:1/569: symlink d14/d19/d85/d2e/d31/d51/lca 0 2024-03-28T13:07:49.916 INFO:tasks.workunit.client.0.smithi076.stdout:1/570: write d14/d19/d85/d2e/f6a [1007056,30514] 0 2024-03-28T13:07:50.038 INFO:tasks.workunit.client.0.smithi076.stdout:4/678: mkdir d0/d3b/d40/d42/d31/d4d/d63/de4 0 2024-03-28T13:07:50.041 INFO:tasks.workunit.client.0.smithi076.stdout:4/679: write d0/d20/d7f/dda/f5f [429041,38074] 0 2024-03-28T13:07:50.125 INFO:tasks.workunit.client.0.smithi076.stdout:5/652: creat d5/d9/d1c/d25/dbd/d7a/d7c/ff6 x:0 0 0 2024-03-28T13:07:50.125 INFO:tasks.workunit.client.0.smithi076.stdout:5/653: write d5/d9/d1c/d1d/d31/ded/f66 [968829,86923] 0 2024-03-28T13:07:50.146 INFO:tasks.workunit.client.0.smithi076.stdout:5/654: dwrite d5/d9/d4c/d98/fc6 [0,4194304] 0 2024-03-28T13:07:50.202 INFO:tasks.workunit.client.0.smithi076.stdout:3/545: getdents d1/d7/d30/d60 0 2024-03-28T13:07:50.275 INFO:tasks.workunit.client.0.smithi076.stdout:7/635: link d1/c9 d1/d18/d2d/cdf 0 2024-03-28T13:07:50.275 INFO:tasks.workunit.client.0.smithi076.stdout:7/636: read - d1/d8/fd5 zero size 2024-03-28T13:07:50.332 INFO:tasks.workunit.client.0.smithi076.stdout:1/571: creat d14/d6c/fcb x:0 0 0 2024-03-28T13:07:50.332 INFO:tasks.workunit.client.0.smithi076.stdout:1/572: readlink d14/d19/d85/d2e/d31/d3b/l8a 0 2024-03-28T13:07:50.332 INFO:tasks.workunit.client.0.smithi076.stdout:1/573: write d14/d19/d20/f27 [594993,35591] 0 2024-03-28T13:07:50.365 INFO:tasks.workunit.client.0.smithi076.stdout:1/574: dwrite d14/d19/d85/d2e/f5a [0,4194304] 0 2024-03-28T13:07:50.422 INFO:tasks.workunit.client.0.smithi076.stdout:4/680: dwrite d0/d3b/d40/d42/d31/d5e/d72/fc6 [4194304,4194304] 0 2024-03-28T13:07:50.531 INFO:tasks.workunit.client.0.smithi076.stdout:5/655: rmdir d5/d9/d4c/d98 39 2024-03-28T13:07:50.541 INFO:tasks.workunit.client.0.smithi076.stdout:5/656: fsync d5/d9/d1c/d1d/d31/ded/f66 0 2024-03-28T13:07:50.609 INFO:tasks.workunit.client.0.smithi076.stdout:5/657: dwrite d5/db/f46 [4194304,4194304] 0 2024-03-28T13:07:50.628 INFO:tasks.workunit.client.0.smithi076.stdout:7/637: link d1/d8/f25 d1/d8/fe0 0 2024-03-28T13:07:50.628 INFO:tasks.workunit.client.0.smithi076.stdout:7/638: write d1/d8/fdc [350542,31963] 0 2024-03-28T13:07:50.628 INFO:tasks.workunit.client.0.smithi076.stdout:7/639: write d1/dc/fb8 [568991,45853] 0 2024-03-28T13:07:50.649 INFO:tasks.workunit.client.0.smithi076.stdout:5/658: dwrite d5/d9/d1c/d1d/d31/ded/d91/f6f [0,4194304] 0 2024-03-28T13:07:50.676 INFO:tasks.workunit.client.0.smithi076.stdout:5/659: dwrite d5/d9/f28 [4194304,4194304] 0 2024-03-28T13:07:50.676 INFO:tasks.workunit.client.0.smithi076.stdout:5/660: fdatasync d5/d9/d1c/d25/f2b 0 2024-03-28T13:07:50.676 INFO:tasks.workunit.client.0.smithi076.stdout:5/661: truncate d5/d9/d1c/d1d/d22/fb4 551497 0 2024-03-28T13:07:50.676 INFO:tasks.workunit.client.0.smithi076.stdout:5/662: dread - d5/d9/d35/fea zero size 2024-03-28T13:07:50.797 INFO:tasks.workunit.client.0.smithi076.stdout:1/575: creat d14/d19/d85/d2e/d3c/d7e/fcc x:0 0 0 2024-03-28T13:07:51.204 INFO:tasks.workunit.client.0.smithi076.stdout:7/640: creat d1/d18/d3c/d48/d69/fe1 x:0 0 0 2024-03-28T13:07:51.204 INFO:tasks.workunit.client.0.smithi076.stdout:7/641: stat d1/f56 0 2024-03-28T13:07:51.298 INFO:tasks.workunit.client.0.smithi076.stdout:0/673: rename db/dc/df/l26 to db/dc/df/d11/d40/lf4 0 2024-03-28T13:07:51.321 INFO:tasks.workunit.client.0.smithi076.stdout:0/674: dread db/dc/df/d11/f1c [0,4194304] 0 2024-03-28T13:07:51.377 INFO:tasks.workunit.client.0.smithi076.stdout:5/663: mkdir d5/d9/d35/d3b/db6/df7 0 2024-03-28T13:07:51.415 INFO:tasks.workunit.client.0.smithi076.stdout:1/576: mknod d14/d19/d85/d2e/d31/d8f/ccd 0 2024-03-28T13:07:51.509 INFO:tasks.workunit.client.0.smithi076.stdout:8/680: creat de/d23/d2b/feb x:0 0 0 2024-03-28T13:07:51.509 INFO:tasks.workunit.client.0.smithi076.stdout:8/681: chown de/d4e/l6b 1513978 1 2024-03-28T13:07:51.509 INFO:tasks.workunit.client.0.smithi076.stdout:8/682: write de/f10 [2787189,61646] 0 2024-03-28T13:07:51.537 INFO:tasks.workunit.client.0.smithi076.stdout:7/642: getdents d1/dc 0 2024-03-28T13:07:51.538 INFO:tasks.workunit.client.0.smithi076.stdout:7/643: truncate d1/d8/fdc 939685 0 2024-03-28T13:07:51.654 INFO:tasks.workunit.client.0.smithi076.stdout:6/720: rename d6/da/d40/l54 to d6/da/d40/d62/lea 0 2024-03-28T13:07:51.748 INFO:tasks.workunit.client.0.smithi076.stdout:0/675: unlink db/dc/df/d71/fd3 0 2024-03-28T13:07:51.748 INFO:tasks.workunit.client.0.smithi076.stdout:0/676: read db/d16/fe9 [2323938,67675] 0 2024-03-28T13:07:51.855 INFO:tasks.workunit.client.0.smithi076.stdout:5/664: creat d5/d9/d35/d3b/db6/ff8 x:0 0 0 2024-03-28T13:07:51.855 INFO:tasks.workunit.client.0.smithi076.stdout:1/577: unlink d14/d19/d85/d2e/d31/d46/fac 0 2024-03-28T13:07:51.968 INFO:tasks.workunit.client.0.smithi076.stdout:8/683: getdents de/d23/d2b/d58 0 2024-03-28T13:07:52.048 INFO:tasks.workunit.client.0.smithi076.stdout:7/644: truncate d1/d8/f25 114942 0 2024-03-28T13:07:52.048 INFO:tasks.workunit.client.0.smithi076.stdout:3/546: rename d1/c21 to d1/d7/d30/d38/d14/d4a/cc9 0 2024-03-28T13:07:52.195 INFO:tasks.workunit.client.0.smithi076.stdout:0/677: truncate db/dc/df/d71/d4a/f5c 7527484 0 2024-03-28T13:07:52.227 INFO:tasks.workunit.client.0.smithi076.stdout:0/678: dwrite db/d16/fe9 [4194304,4194304] 0 2024-03-28T13:07:52.227 INFO:tasks.workunit.client.0.smithi076.stdout:0/679: write db/dc/df/d18/d9f/fb2 [1955572,5031] 0 2024-03-28T13:07:52.227 INFO:tasks.workunit.client.0.smithi076.stdout:0/680: truncate db/fbb 904897 0 2024-03-28T13:07:52.266 INFO:tasks.workunit.client.0.smithi076.stdout:5/665: creat d5/d9/d1c/d1d/d22/d9d/dcb/ff9 x:0 0 0 2024-03-28T13:07:52.275 INFO:tasks.workunit.client.0.smithi076.stdout:5/666: dread d5/db/df/fa2 [4194304,4194304] 0 2024-03-28T13:07:52.276 INFO:tasks.workunit.client.0.smithi076.stdout:5/667: write d5/db/df/f5a [4574063,113995] 0 2024-03-28T13:07:52.300 INFO:tasks.workunit.client.0.smithi076.stdout:5/668: write d5/d9/f28 [6373225,122438] 0 2024-03-28T13:07:52.329 INFO:tasks.workunit.client.0.smithi076.stdout:5/669: dwrite d5/d9/d35/fea [0,4194304] 0 2024-03-28T13:07:52.329 INFO:tasks.workunit.client.0.smithi076.stdout:5/670: fdatasync d5/db/d19/ff0 0 2024-03-28T13:07:52.356 INFO:tasks.workunit.client.0.smithi076.stdout:1/578: creat d14/d19/d85/d2e/fce x:0 0 0 2024-03-28T13:07:52.360 INFO:tasks.workunit.client.0.smithi076.stdout:5/671: dwrite d5/d9/d35/fac [0,4194304] 0 2024-03-28T13:07:52.655 INFO:tasks.workunit.client.0.smithi076.stdout:7/645: link d1/d18/d3c/d48/d69/f6d d1/d18/fe2 0 2024-03-28T13:07:52.661 INFO:tasks.workunit.client.0.smithi076.stdout:3/547: link d1/d7/d30/d38/d14/d36/d56/d5b/la1 d1/d7/d30/d38/d14/d36/d56/d5b/lca 0 2024-03-28T13:07:52.707 INFO:tasks.workunit.client.0.smithi076.stdout:9/667: write d9/d3c/f5b [862007,45705] 0 2024-03-28T13:07:53.082 INFO:tasks.workunit.client.0.smithi076.stdout:1/579: rmdir d14/d19/d85/d2e/d31/d46 39 2024-03-28T13:07:53.083 INFO:tasks.workunit.client.0.smithi076.stdout:0/681: creat db/dd8/ff5 x:0 0 0 2024-03-28T13:07:53.083 INFO:tasks.workunit.client.0.smithi076.stdout:0/682: chown db/dc/df/d11/d40/d77/da2/d6d/ld4 7824607 1 2024-03-28T13:07:53.641 INFO:tasks.workunit.client.0.smithi076.stdout:7/646: creat d1/d18/d3c/d8c/db5/fe3 x:0 0 0 2024-03-28T13:07:53.641 INFO:tasks.workunit.client.0.smithi076.stdout:3/548: rmdir d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d93 39 2024-03-28T13:07:53.641 INFO:tasks.workunit.client.0.smithi076.stdout:9/668: creat d9/dd/fd2 x:0 0 0 2024-03-28T13:07:53.642 INFO:tasks.workunit.client.0.smithi076.stdout:3/549: fdatasync d1/d7/d30/d38/d14/d97/fa5 0 2024-03-28T13:07:53.642 INFO:tasks.workunit.client.0.smithi076.stdout:9/669: dread - d9/da/fc3 zero size 2024-03-28T13:07:53.642 INFO:tasks.workunit.client.0.smithi076.stdout:9/670: truncate d9/da/f68 5521892 0 2024-03-28T13:07:53.664 INFO:tasks.workunit.client.0.smithi076.stdout:9/671: dwrite d9/dd/f56 [0,4194304] 0 2024-03-28T13:07:53.688 INFO:tasks.workunit.client.0.smithi076.stdout:9/672: read d9/dd/df/d11/d14/d58/d6e/f60 [758259,28874] 0 2024-03-28T13:07:53.759 INFO:tasks.workunit.client.0.smithi076.stdout:4/681: write d0/f73 [1240699,27315] 0 2024-03-28T13:07:53.765 INFO:tasks.workunit.client.0.smithi076.stdout:4/682: dread d0/d3b/d40/f6e [0,4194304] 0 2024-03-28T13:07:53.861 INFO:tasks.workunit.client.0.smithi076.stdout:7/647: mknod d1/d8/dc2/ce4 0 2024-03-28T13:07:54.038 INFO:tasks.workunit.client.0.smithi076.stdout:9/673: rmdir d9/dbe 0 2024-03-28T13:07:54.106 INFO:tasks.workunit.client.0.smithi076.stdout:2/679: sync 2024-03-28T13:07:54.178 INFO:tasks.workunit.client.0.smithi076.stdout:7/648: mkdir d1/d18/d3c/d48/de5 0 2024-03-28T13:07:54.178 INFO:tasks.workunit.client.0.smithi076.stdout:7/649: write d1/d81/fcd [383325,4573] 0 2024-03-28T13:07:54.258 INFO:tasks.workunit.client.0.smithi076.stdout:9/674: mknod d9/dd/d48/cd3 0 2024-03-28T13:07:54.321 INFO:tasks.workunit.client.0.smithi076.stdout:2/680: unlink d2/d5/d7/d3e/f45 0 2024-03-28T13:07:54.321 INFO:tasks.workunit.client.0.smithi076.stdout:2/681: write d2/d5/d7/d28/d64/fb3 [8634869,52251] 0 2024-03-28T13:07:54.387 INFO:tasks.workunit.client.0.smithi076.stdout:7/650: truncate d1/d8/d37/d53/f8f 825928 0 2024-03-28T13:07:54.455 INFO:tasks.workunit.client.0.smithi076.stdout:9/675: symlink d9/dd/df/d11/d14/d58/d6e/ld4 0 2024-03-28T13:07:54.502 INFO:tasks.workunit.client.0.smithi076.stdout:9/676: dwrite d9/dd/df/d11/d37/fd0 [0,4194304] 0 2024-03-28T13:07:54.517 INFO:tasks.workunit.client.0.smithi076.stdout:2/682: getdents d2/d5/db/d3b/d9f/d9e/db1 0 2024-03-28T13:07:54.664 INFO:tasks.workunit.client.0.smithi076.stdout:7/651: truncate d1/dc/f2b 3868044 0 2024-03-28T13:07:54.742 INFO:tasks.workunit.client.0.smithi076.stdout:9/677: mknod d9/dd/df/d11/d37/dc4/cd5 0 2024-03-28T13:07:54.796 INFO:tasks.workunit.client.0.smithi076.stdout:6/721: rename d6/l5e to d6/da/d40/d56/dc7/leb 0 2024-03-28T13:07:54.796 INFO:tasks.workunit.client.0.smithi076.stdout:6/722: readlink d6/da/d40/d56/l77 0 2024-03-28T13:07:54.796 INFO:tasks.workunit.client.0.smithi076.stdout:6/723: dread - d6/da/d40/d56/fdb zero size 2024-03-28T13:07:54.796 INFO:tasks.workunit.client.0.smithi076.stdout:6/724: write d6/d99/f5b [1026128,73097] 0 2024-03-28T13:07:54.843 INFO:tasks.workunit.client.0.smithi076.stdout:2/683: creat d2/d5/d4b/d39/d57/fd1 x:0 0 0 2024-03-28T13:07:54.957 INFO:tasks.workunit.client.0.smithi076.stdout:7/652: mknod d1/dc/ce6 0 2024-03-28T13:07:55.025 INFO:tasks.workunit.client.0.smithi076.stdout:9/678: unlink d9/dd/df/f9f 0 2024-03-28T13:07:55.039 INFO:tasks.workunit.client.0.smithi076.stdout:9/679: read d9/dd/df/d11/d37/f1c [2695177,110870] 0 2024-03-28T13:07:55.039 INFO:tasks.workunit.client.0.smithi076.stdout:9/680: write d9/dd/f85 [3421950,47041] 0 2024-03-28T13:07:55.183 INFO:tasks.workunit.client.0.smithi076.stdout:8/684: rename de/d4e/f8f to de/d13/fec 0 2024-03-28T13:07:55.197 INFO:tasks.workunit.client.0.smithi076.stdout:6/725: link d6/da/d39/faa d6/da/d39/fec 0 2024-03-28T13:07:55.223 INFO:tasks.workunit.client.0.smithi076.stdout:2/684: truncate d2/d5/db/d3b/d42/f6d 325784 0 2024-03-28T13:07:55.260 INFO:tasks.workunit.client.0.smithi076.stdout:2/685: dwrite d2/d75/f91 [0,4194304] 0 2024-03-28T13:07:55.264 INFO:tasks.workunit.client.0.smithi076.stdout:2/686: read d2/d5/db/d3b/f9a [9461,38231] 0 2024-03-28T13:07:55.281 INFO:tasks.workunit.client.0.smithi076.stdout:7/653: creat d1/d8/d37/fe7 x:0 0 0 2024-03-28T13:07:55.281 INFO:tasks.workunit.client.0.smithi076.stdout:2/687: dread d2/d5/d4b/d39/d57/f85 [0,4194304] 0 2024-03-28T13:07:55.313 INFO:tasks.workunit.client.0.smithi076.stdout:7/654: dwrite d1/fa1 [0,4194304] 0 2024-03-28T13:07:55.313 INFO:tasks.workunit.client.0.smithi076.stdout:7/655: chown d1/dc/dba 17432 1 2024-03-28T13:07:55.313 INFO:tasks.workunit.client.0.smithi076.stdout:7/656: write d1/d18/d3c/d7b/fb4 [201362,34626] 0 2024-03-28T13:07:55.550 INFO:tasks.workunit.client.0.smithi076.stdout:1/580: rename d14/d19/d85/faf to d14/d19/d85/d2e/d31/d49/fcf 0 2024-03-28T13:07:55.550 INFO:tasks.workunit.client.0.smithi076.stdout:8/685: truncate de/f3f 1083670 0 2024-03-28T13:07:55.550 INFO:tasks.workunit.client.0.smithi076.stdout:8/686: write de/d23/d2b/d5d/d76/d6e/d7a/fb4 [93967,123057] 0 2024-03-28T13:07:55.550 INFO:tasks.workunit.client.0.smithi076.stdout:1/581: write d14/d19/d85/d2e/d91/fa0 [586375,112905] 0 2024-03-28T13:07:55.594 INFO:tasks.workunit.client.0.smithi076.stdout:1/582: dwrite d14/d19/d85/d2e/f5a [0,4194304] 0 2024-03-28T13:07:55.594 INFO:tasks.workunit.client.0.smithi076.stdout:1/583: chown d14/d19/d85/c33 109106 1 2024-03-28T13:07:55.611 INFO:tasks.workunit.client.0.smithi076.stdout:1/584: write d14/d19/d85/d2e/f58 [3616971,97157] 0 2024-03-28T13:07:55.634 INFO:tasks.workunit.client.0.smithi076.stdout:6/726: chown d6/da/d40/d56/da4/fb8 991103 1 2024-03-28T13:07:55.654 INFO:tasks.workunit.client.0.smithi076.stdout:1/585: dwrite d14/d19/d85/d2e/d31/f8c [0,4194304] 0 2024-03-28T13:07:55.722 INFO:tasks.workunit.client.0.smithi076.stdout:0/683: write db/dc/df/d18/d1d/d73/f81 [7290245,39693] 0 2024-03-28T13:07:55.763 INFO:tasks.workunit.client.0.smithi076.stdout:0/684: dwrite db/dc/fd [4194304,4194304] 0 2024-03-28T13:07:55.864 INFO:tasks.workunit.client.0.smithi076.stdout:2/688: truncate d2/d5/d7/d3e/faf 4334219 0 2024-03-28T13:07:55.865 INFO:tasks.workunit.client.0.smithi076.stdout:2/689: readlink d2/l36 0 2024-03-28T13:07:55.865 INFO:tasks.workunit.client.0.smithi076.stdout:2/690: chown d2/d5/d7/c35 30089046 1 2024-03-28T13:07:55.865 INFO:tasks.workunit.client.0.smithi076.stdout:2/691: truncate d2/d5/d7/d28/d64/fcd 1011479 0 2024-03-28T13:07:56.519 INFO:tasks.workunit.client.0.smithi076.stdout:9/681: rename d9/da/f7c to d9/dd/df/d11/d14/d58/d6e/fd6 0 2024-03-28T13:07:56.523 INFO:tasks.workunit.client.0.smithi076.stdout:8/687: creat de/d23/d2b/d51/d62/d8b/fed x:0 0 0 2024-03-28T13:07:56.613 INFO:tasks.workunit.client.0.smithi076.stdout:6/727: creat d6/d99/fed x:0 0 0 2024-03-28T13:07:56.614 INFO:tasks.workunit.client.0.smithi076.stdout:6/728: dread - d6/da/d23/f97 zero size 2024-03-28T13:07:56.705 INFO:tasks.workunit.client.0.smithi076.stdout:1/586: creat d14/d19/d85/d2e/d3c/d5c/fd0 x:0 0 0 2024-03-28T13:07:56.829 INFO:tasks.workunit.client.0.smithi076.stdout:0/685: mknod db/dc/df/d71/d4a/d7e/cf6 0 2024-03-28T13:07:56.945 INFO:tasks.workunit.client.0.smithi076.stdout:9/682: mkdir d9/dd/d48/dd7 0 2024-03-28T13:07:56.975 INFO:tasks.workunit.client.0.smithi076.stdout:8/688: mkdir de/d13/da2/dee 0 2024-03-28T13:07:57.015 INFO:tasks.workunit.client.0.smithi076.stdout:8/689: dwrite de/d13/fec [0,4194304] 0 2024-03-28T13:07:57.064 INFO:tasks.workunit.client.0.smithi076.stdout:1/587: truncate d14/d19/d85/d2e/d31/d51/f70 4733650 0 2024-03-28T13:07:57.105 INFO:tasks.workunit.client.0.smithi076.stdout:0/686: mknod db/da6/cf7 0 2024-03-28T13:07:57.142 INFO:tasks.workunit.client.0.smithi076.stdout:9/683: truncate d9/d74/f8e 3847281 0 2024-03-28T13:07:57.158 INFO:tasks.workunit.client.0.smithi076.stdout:9/684: read d9/dd/df/d11/d14/d58/f6c [2337294,51233] 0 2024-03-28T13:07:57.158 INFO:tasks.workunit.client.0.smithi076.stdout:9/685: readlink d9/l77 0 2024-03-28T13:07:57.158 INFO:tasks.workunit.client.0.smithi076.stdout:9/686: stat d9/dd/df/d11/d14/d58/d6e/ld4 0 2024-03-28T13:07:57.297 INFO:tasks.workunit.client.0.smithi076.stdout:8/690: truncate de/d23/d2b/d5d/d76/d18/d3c/f9a 596405 0 2024-03-28T13:07:57.366 INFO:tasks.workunit.client.0.smithi076.stdout:1/588: rename d14/d19/d85/d2e/d31/d51/cc9 to d14/d19/d85/d2e/d31/d8f/cd1 0 2024-03-28T13:07:57.484 INFO:tasks.workunit.client.0.smithi076.stdout:0/687: rmdir db/dc/df/d18/d1d/d21/dd2 39 2024-03-28T13:07:57.484 INFO:tasks.workunit.client.0.smithi076.stdout:0/688: chown db/dc/df/d18/d1d/d21/c27 3308133 1 2024-03-28T13:07:57.484 INFO:tasks.workunit.client.0.smithi076.stdout:0/689: chown db/da6/fec 1146391939 1 2024-03-28T13:07:57.533 INFO:tasks.workunit.client.0.smithi076.stdout:8/691: mkdir de/d13/dc9/def 0 2024-03-28T13:07:57.610 INFO:tasks.workunit.client.0.smithi076.stdout:0/690: creat db/ff8 x:0 0 0 2024-03-28T13:07:57.610 INFO:tasks.workunit.client.0.smithi076.stdout:0/691: readlink db/dc/df/d11/d40/lf4 0 2024-03-28T13:07:57.611 INFO:tasks.workunit.client.0.smithi076.stdout:0/692: chown db/dc/df/f19 6894 1 2024-03-28T13:07:57.675 INFO:tasks.workunit.client.0.smithi076.stdout:8/692: rename de/d13/d27/d8c/l9e to de/d4e/db6/dde/lf0 0 2024-03-28T13:07:57.675 INFO:tasks.workunit.client.0.smithi076.stdout:8/693: stat de/d23/d2b/d5d/d76/d6e/d7a/fb4 0 2024-03-28T13:07:58.216 INFO:tasks.workunit.client.0.smithi076.stdout:5/672: sync 2024-03-28T13:07:58.237 INFO:tasks.workunit.client.0.smithi076.stdout:5/673: dread d5/d9/d1c/d1d/d31/f57 [0,4194304] 0 2024-03-28T13:07:58.247 INFO:tasks.workunit.client.0.smithi076.stdout:0/693: creat db/dd8/ff9 x:0 0 0 2024-03-28T13:07:58.423 INFO:tasks.workunit.client.0.smithi076.stdout:8/694: symlink de/d23/d2b/d51/d60/d89/lf1 0 2024-03-28T13:07:58.622 INFO:tasks.workunit.client.0.smithi076.stdout:5/674: symlink d5/db/d19/lfa 0 2024-03-28T13:07:58.850 INFO:tasks.workunit.client.0.smithi076.stdout:8/695: rmdir de/d23/d2b/d5d/d76/d18/d49/dd0 39 2024-03-28T13:07:58.850 INFO:tasks.workunit.client.0.smithi076.stdout:8/696: chown de/d4e/f4f 1 1 2024-03-28T13:07:58.879 INFO:tasks.workunit.client.0.smithi076.stdout:8/697: dwrite de/d13/f94 [0,4194304] 0 2024-03-28T13:07:58.891 INFO:tasks.workunit.client.0.smithi076.stdout:3/550: rmdir d1/d7/d30/d60 39 2024-03-28T13:07:58.891 INFO:tasks.workunit.client.0.smithi076.stdout:4/683: sync 2024-03-28T13:07:58.891 INFO:tasks.workunit.client.0.smithi076.stdout:4/684: chown d0/d20/d7b/ldc 1889 1 2024-03-28T13:07:58.932 INFO:tasks.workunit.client.0.smithi076.stdout:8/698: dwrite de/d23/d2b/d5d/d76/fd8 [0,4194304] 0 2024-03-28T13:07:58.932 INFO:tasks.workunit.client.0.smithi076.stdout:8/699: fdatasync de/d4e/d54/d68/fb8 0 2024-03-28T13:07:59.043 INFO:tasks.workunit.client.0.smithi076.stdout:0/694: unlink db/l50 0 2024-03-28T13:07:59.043 INFO:tasks.workunit.client.0.smithi076.stdout:5/675: link d5/db/d3f/fa0 d5/d9/d1c/dcc/ffb 0 2024-03-28T13:07:59.051 INFO:tasks.workunit.client.0.smithi076.stdout:5/676: dread d5/db/d19/f20 [0,4194304] 0 2024-03-28T13:07:59.270 INFO:tasks.workunit.client.0.smithi076.stdout:3/551: creat d1/d2/fcb x:0 0 0 2024-03-28T13:07:59.270 INFO:tasks.workunit.client.0.smithi076.stdout:4/685: rename d0/d20/d7b/d94/cb4 to d0/d3b/d50/ce5 0 2024-03-28T13:07:59.328 INFO:tasks.workunit.client.0.smithi076.stdout:2/692: creat d2/d5/db/d3b/d5a/d8d/fd2 x:0 0 0 2024-03-28T13:07:59.533 INFO:tasks.workunit.client.0.smithi076.stdout:8/700: creat de/d23/d2b/d5d/d76/d6e/d87/ff2 x:0 0 0 2024-03-28T13:07:59.672 INFO:tasks.workunit.client.0.smithi076.stdout:0/695: link db/f4b db/dc/df/d18/d1d/d75/d51/dd7/ffa 0 2024-03-28T13:07:59.673 INFO:tasks.workunit.client.0.smithi076.stdout:0/696: chown db/ff8 4372 1 2024-03-28T13:07:59.756 INFO:tasks.workunit.client.0.smithi076.stdout:5/677: rename d5/d9/d1c/d1d/d31/ded/cc9 to d5/d9/d1c/dcc/cfc 0 2024-03-28T13:07:59.756 INFO:tasks.workunit.client.0.smithi076.stdout:5/678: write d5/db/f79 [1929266,89106] 0 2024-03-28T13:07:59.792 INFO:tasks.workunit.client.0.smithi076.stdout:5/679: dwrite d5/d9/d35/d3b/fe8 [0,4194304] 0 2024-03-28T13:07:59.831 INFO:tasks.workunit.client.0.smithi076.stdout:4/686: unlink d0/d3b/d40/d8d/c96 0 2024-03-28T13:07:59.877 INFO:tasks.workunit.client.0.smithi076.stdout:3/552: creat d1/d7/d30/d38/d14/d97/fcc x:0 0 0 2024-03-28T13:07:59.890 INFO:tasks.workunit.client.0.smithi076.stdout:3/553: dread d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/f24 [0,4194304] 0 2024-03-28T13:07:59.914 INFO:tasks.workunit.client.0.smithi076.stdout:3/554: dwrite d1/d7/d30/d38/d14/d4a/fae [0,4194304] 0 2024-03-28T13:07:59.914 INFO:tasks.workunit.client.0.smithi076.stdout:3/555: write d1/d2/fcb [430650,33458] 0 2024-03-28T13:07:59.915 INFO:tasks.workunit.client.0.smithi076.stdout:3/556: chown d1/d7/d30/d38/d14/d36/d56/l5d 3 1 2024-03-28T13:07:59.958 INFO:tasks.workunit.client.0.smithi076.stdout:2/693: creat d2/d5/db/d3b/fd3 x:0 0 0 2024-03-28T13:08:00.034 INFO:tasks.workunit.client.0.smithi076.stdout:8/701: creat de/d23/d2b/d58/d8e/ff3 x:0 0 0 2024-03-28T13:08:00.065 INFO:tasks.workunit.client.0.smithi076.stdout:7/657: sync 2024-03-28T13:08:00.095 INFO:tasks.workunit.client.0.smithi076.stdout:0/697: creat db/dc/df/d18/d1d/d21/dd2/ffb x:0 0 0 2024-03-28T13:08:00.095 INFO:tasks.workunit.client.0.smithi076.stdout:0/698: read db/dc/df/d18/f5f [2811279,89714] 0 2024-03-28T13:08:00.096 INFO:tasks.workunit.client.0.smithi076.stdout:0/699: stat db/dc/df/d71/lc6 0 2024-03-28T13:08:00.096 INFO:tasks.workunit.client.0.smithi076.stdout:0/700: chown db/dc/df/d11/d40/dc7/fe5 46183103 1 2024-03-28T13:08:00.356 INFO:tasks.workunit.client.0.smithi076.stdout:5/680: rename d5/d9/d1c/d25/f2b to d5/d9/d1c/d25/dbd/d7a/db1/ffd 0 2024-03-28T13:08:00.356 INFO:tasks.workunit.client.0.smithi076.stdout:5/681: write d5/db/d3f/f8f [853179,62956] 0 2024-03-28T13:08:00.361 INFO:tasks.workunit.client.0.smithi076.stdout:4/687: mkdir d0/d3b/d50/de6 0 2024-03-28T13:08:00.382 INFO:tasks.workunit.client.0.smithi076.stdout:4/688: dread d0/d3b/d40/d42/d28/f7e [0,4194304] 0 2024-03-28T13:08:00.418 INFO:tasks.workunit.client.0.smithi076.stdout:4/689: dwrite d0/d3b/d40/d42/d31/f56 [8388608,4194304] 0 2024-03-28T13:08:00.418 INFO:tasks.workunit.client.0.smithi076.stdout:4/690: readlink d0/d20/d7f/dda/d2d/l67 0 2024-03-28T13:08:00.418 INFO:tasks.workunit.client.0.smithi076.stdout:4/691: fdatasync d0/d20/f87 0 2024-03-28T13:08:00.424 INFO:tasks.workunit.client.0.smithi076.stdout:4/692: dread d0/d3b/d40/d42/d31/d4d/d63/fcb [0,4194304] 0 2024-03-28T13:08:00.479 INFO:tasks.workunit.client.0.smithi076.stdout:3/557: rmdir d1/d7/d30/d38 39 2024-03-28T13:08:00.557 INFO:tasks.workunit.client.0.smithi076.stdout:2/694: mknod d2/d5/db/cd4 0 2024-03-28T13:08:00.698 INFO:tasks.workunit.client.0.smithi076.stdout:8/702: mknod de/d23/d2b/d5d/d76/d6e/d7a/cf4 0 2024-03-28T13:08:00.848 INFO:tasks.workunit.client.0.smithi076.stdout:0/701: mkdir db/dc/df/d11/dfc 0 2024-03-28T13:08:00.848 INFO:tasks.workunit.client.0.smithi076.stdout:5/682: mknod d5/d9/d1c/d25/dbd/cfe 0 2024-03-28T13:08:00.848 INFO:tasks.workunit.client.0.smithi076.stdout:5/683: truncate d5/d9/d1c/d25/d60/fce 416037 0 2024-03-28T13:08:01.047 INFO:tasks.workunit.client.0.smithi076.stdout:4/693: truncate d0/d3b/d40/d42/f65 3346316 0 2024-03-28T13:08:01.325 INFO:tasks.workunit.client.0.smithi076.stdout:8/703: creat de/d23/d2b/d5d/d76/ff5 x:0 0 0 2024-03-28T13:08:01.325 INFO:tasks.workunit.client.0.smithi076.stdout:8/704: write de/d13/d27/d8c/f99 [306773,12824] 0 2024-03-28T13:08:01.503 INFO:tasks.workunit.client.0.smithi076.stdout:6/729: dwrite d6/da/d23/f4d [0,4194304] 0 2024-03-28T13:08:01.503 INFO:tasks.workunit.client.0.smithi076.stdout:6/730: fsync d6/da/d23/f45 0 2024-03-28T13:08:01.541 INFO:tasks.workunit.client.0.smithi076.stdout:0/702: mkdir db/dc/df/d11/dfc/dfd 0 2024-03-28T13:08:01.574 INFO:tasks.workunit.client.0.smithi076.stdout:5/684: getdents d5/d9/d4c/d9b 0 2024-03-28T13:08:01.662 INFO:tasks.workunit.client.0.smithi076.stdout:3/558: rename d1/d7/d30/d38/d14/d36/d56/d5b/d89 to d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/dcd 0 2024-03-28T13:08:01.732 INFO:tasks.workunit.client.0.smithi076.stdout:4/694: creat d0/d20/d7f/dda/d2d/d75/fe7 x:0 0 0 2024-03-28T13:08:01.755 INFO:tasks.workunit.client.0.smithi076.stdout:4/695: dread d0/d3b/d40/d42/d28/f49 [4194304,4194304] 0 2024-03-28T13:08:01.779 INFO:tasks.workunit.client.0.smithi076.stdout:8/705: truncate de/d13/f80 2115821 0 2024-03-28T13:08:01.944 INFO:tasks.workunit.client.0.smithi076.stdout:6/731: creat d6/da/d5f/d6d/d95/fee x:0 0 0 2024-03-28T13:08:02.018 INFO:tasks.workunit.client.0.smithi076.stdout:0/703: creat db/dc/d3d/d57/ffe x:0 0 0 2024-03-28T13:08:02.018 INFO:tasks.workunit.client.0.smithi076.stdout:0/704: chown db/dc/df/d18/d1d/d75/d51/fbc 1 1 2024-03-28T13:08:02.047 INFO:tasks.workunit.client.0.smithi076.stdout:5/685: getdents d5/d9/d1c/d25/dbd/d7a/de2 0 2024-03-28T13:08:02.047 INFO:tasks.workunit.client.0.smithi076.stdout:5/686: dread - d5/db/d3f/feb zero size 2024-03-28T13:08:02.052 INFO:tasks.workunit.client.0.smithi076.stdout:9/687: dwrite d9/dd/df/d11/d14/f31 [0,4194304] 0 2024-03-28T13:08:02.197 INFO:tasks.workunit.client.0.smithi076.stdout:3/559: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/fce x:0 0 0 2024-03-28T13:08:02.213 INFO:tasks.workunit.client.0.smithi076.stdout:3/560: dread d1/d7/d30/d5f/f9d [0,4194304] 0 2024-03-28T13:08:02.265 INFO:tasks.workunit.client.0.smithi076.stdout:8/706: truncate de/d13/fec 912185 0 2024-03-28T13:08:02.444 INFO:tasks.workunit.client.0.smithi076.stdout:5/687: creat d5/d9/d1c/d1d/d22/d9d/dcb/fff x:0 0 0 2024-03-28T13:08:02.750 INFO:tasks.workunit.client.0.smithi076.stdout:5/688: truncate d5/db/d3f/d42/f58 3881622 0 2024-03-28T13:08:02.931 INFO:tasks.workunit.client.0.smithi076.stdout:5/689: mkdir d5/d9/d4c/d9b/d100 0 2024-03-28T13:08:03.197 INFO:tasks.workunit.client.0.smithi076.stdout:5/690: mknod d5/db/df/c101 0 2024-03-28T13:08:04.375 INFO:tasks.workunit.client.0.smithi076.stdout:7/658: write d1/d8/fe0 [1112280,91729] 0 2024-03-28T13:08:04.375 INFO:tasks.workunit.client.0.smithi076.stdout:7/659: chown d1/dc/dba 1601293702 1 2024-03-28T13:08:04.390 INFO:tasks.workunit.client.0.smithi076.stdout:7/660: dread d1/d18/d3c/d7b/d7d/f82 [0,4194304] 0 2024-03-28T13:08:05.323 INFO:tasks.workunit.client.0.smithi076.stdout:9/688: write d9/dd/df/d11/d14/d58/faf [1235849,53137] 0 2024-03-28T13:08:05.409 INFO:tasks.workunit.client.0.smithi076.stdout:3/561: write d1/d7/d30/d38/d14/d36/f57 [275414,116476] 0 2024-03-28T13:08:05.485 INFO:tasks.workunit.client.0.smithi076.stdout:3/562: dwrite d1/d7/d30/d5f/f85 [0,4194304] 0 2024-03-28T13:08:05.560 INFO:tasks.workunit.client.0.smithi076.stdout:8/707: creat de/d13/ff6 x:0 0 0 2024-03-28T13:08:05.560 INFO:tasks.workunit.client.0.smithi076.stdout:8/708: write de/d23/d2b/d58/d78/fa0 [869848,22284] 0 2024-03-28T13:08:05.572 INFO:tasks.workunit.client.0.smithi076.stdout:1/589: mknod d14/d19/d85/d2e/cd2 0 2024-03-28T13:08:05.582 INFO:tasks.workunit.client.0.smithi076.stdout:5/691: creat d5/d9/d1c/d1d/d31/ded/f102 x:0 0 0 2024-03-28T13:08:05.582 INFO:tasks.workunit.client.0.smithi076.stdout:5/692: chown d5/db/d19/d34/l7e 35980696 1 2024-03-28T13:08:05.731 INFO:tasks.workunit.client.0.smithi076.stdout:9/689: rmdir d9/dd/df 39 2024-03-28T13:08:05.731 INFO:tasks.workunit.client.0.smithi076.stdout:9/690: chown d9/d3c/f5a 15235 1 2024-03-28T13:08:05.994 INFO:tasks.workunit.client.0.smithi076.stdout:8/709: rmdir de/d23/d2b/d58/ddd 0 2024-03-28T13:08:06.118 INFO:tasks.workunit.client.0.smithi076.stdout:1/590: rmdir d14/d19/d85/dc3 39 2024-03-28T13:08:06.118 INFO:tasks.workunit.client.0.smithi076.stdout:5/693: creat d5/d9/d1c/d25/dbd/f103 x:0 0 0 2024-03-28T13:08:06.118 INFO:tasks.workunit.client.0.smithi076.stdout:5/694: readlink d5/d9/l2e 0 2024-03-28T13:08:06.259 INFO:tasks.workunit.client.0.smithi076.stdout:9/691: truncate d9/dd/df/d11/f93 375044 0 2024-03-28T13:08:06.270 INFO:tasks.workunit.client.0.smithi076.stdout:9/692: dread d9/dd/df/fbf [0,4194304] 0 2024-03-28T13:08:06.270 INFO:tasks.workunit.client.0.smithi076.stdout:9/693: fdatasync d9/dd/df/d11/d14/f6a 0 2024-03-28T13:08:06.347 INFO:tasks.workunit.client.0.smithi076.stdout:8/710: mknod de/d23/d2b/d58/d8e/cf7 0 2024-03-28T13:08:06.383 INFO:tasks.workunit.client.0.smithi076.stdout:8/711: dwrite de/d25/d7f/fc3 [0,4194304] 0 2024-03-28T13:08:06.383 INFO:tasks.workunit.client.0.smithi076.stdout:8/712: write de/d23/d2b/d5d/d76/d18/f1a [80163,102321] 0 2024-03-28T13:08:06.728 INFO:tasks.workunit.client.0.smithi076.stdout:8/713: mknod de/d4e/d54/cf8 0 2024-03-28T13:08:06.728 INFO:tasks.workunit.client.0.smithi076.stdout:8/714: dread - de/d23/d2b/d58/d8e/ff3 zero size 2024-03-28T13:08:06.845 INFO:tasks.workunit.client.0.smithi076.stdout:9/694: symlink d9/dd/df/d11/d37/ld8 0 2024-03-28T13:08:06.845 INFO:tasks.workunit.client.0.smithi076.stdout:9/695: write d9/dd/df/d11/d14/d58/d6e/f9b [265918,5430] 0 2024-03-28T13:08:06.895 INFO:tasks.workunit.client.0.smithi076.stdout:4/696: rename d0/d20/d7f/de1 to d0/d3b/de8 0 2024-03-28T13:08:06.945 INFO:tasks.workunit.client.0.smithi076.stdout:2/695: sync 2024-03-28T13:08:07.075 INFO:tasks.workunit.client.0.smithi076.stdout:6/732: rename d6/da/d5f/d7e/le0 to d6/da/d1e/dde/lef 0 2024-03-28T13:08:07.097 INFO:tasks.workunit.client.0.smithi076.stdout:6/733: dread d6/fc2 [0,4194304] 0 2024-03-28T13:08:07.116 INFO:tasks.workunit.client.0.smithi076.stdout:6/734: dread d6/da/d23/ddf/fe9 [0,4194304] 0 2024-03-28T13:08:07.139 INFO:tasks.workunit.client.0.smithi076.stdout:4/697: creat d0/d3b/d40/d42/d47/d69/da9/fe9 x:0 0 0 2024-03-28T13:08:07.284 INFO:tasks.workunit.client.0.smithi076.stdout:7/661: rename d1/d18/l39 to d1/d18/d3c/d7b/d7d/le8 0 2024-03-28T13:08:07.289 INFO:tasks.workunit.client.0.smithi076.stdout:7/662: dread d1/d18/d3c/d7b/fb4 [0,4194304] 0 2024-03-28T13:08:07.501 INFO:tasks.workunit.client.0.smithi076.stdout:3/563: write d1/d7/d30/d38/d14/d27/f7e [1852435,30880] 0 2024-03-28T13:08:07.501 INFO:tasks.workunit.client.0.smithi076.stdout:3/564: fsync d1/d7/d30/d38/d14/d51/fac 0 2024-03-28T13:08:07.501 INFO:tasks.workunit.client.0.smithi076.stdout:3/565: fdatasync d1/d7/d30/d5f/f9d 0 2024-03-28T13:08:07.682 INFO:tasks.workunit.client.0.smithi076.stdout:9/696: mkdir d9/dd/d48/dd7/dd9 0 2024-03-28T13:08:07.683 INFO:tasks.workunit.client.0.smithi076.stdout:9/697: stat d9/dd/df/d11/d14/d58/faf 0 2024-03-28T13:08:07.761 INFO:tasks.workunit.client.0.smithi076.stdout:1/591: rename d14/d6c/d74/d9e/fa2 to d14/d6c/d74/fd3 0 2024-03-28T13:08:07.838 INFO:tasks.workunit.client.0.smithi076.stdout:1/592: dwrite d14/d19/d85/d2e/d31/d51/d92/da4/db7/fc5 [0,4194304] 0 2024-03-28T13:08:08.034 INFO:tasks.workunit.client.0.smithi076.stdout:4/698: link d0/d3b/d40/d42/ca0 d0/d3b/d50/d64/cea 0 2024-03-28T13:08:08.229 INFO:tasks.workunit.client.0.smithi076.stdout:2/696: rename d2/d5/d7/d8/d21/cb2 to d2/d5/d7/cd5 0 2024-03-28T13:08:08.229 INFO:tasks.workunit.client.0.smithi076.stdout:2/697: chown d2/d5/db/d3b/d3f/cc7 4394321 1 2024-03-28T13:08:08.229 INFO:tasks.workunit.client.0.smithi076.stdout:2/698: chown d2/d5/d7/fbb 10 1 2024-03-28T13:08:08.286 INFO:tasks.workunit.client.0.smithi076.stdout:1/593: rename d14/d19/d85/d2e/d31/d51/c80 to d14/d19/d85/d2e/d31/d51/cd4 0 2024-03-28T13:08:08.286 INFO:tasks.workunit.client.0.smithi076.stdout:1/594: readlink lf 0 2024-03-28T13:08:08.338 INFO:tasks.workunit.client.0.smithi076.stdout:4/699: symlink d0/d3b/d40/d42/d31/d4d/leb 0 2024-03-28T13:08:08.411 INFO:tasks.workunit.client.0.smithi076.stdout:9/698: rename d9/dd/c61 to d9/d74/db3/cda 0 2024-03-28T13:08:08.443 INFO:tasks.workunit.client.0.smithi076.stdout:9/699: dwrite d9/d74/db3/db5/fbc [0,4194304] 0 2024-03-28T13:08:08.443 INFO:tasks.workunit.client.0.smithi076.stdout:1/595: dread d14/d19/d85/d2e/d31/f8c [0,4194304] 0 2024-03-28T13:08:08.518 INFO:tasks.workunit.client.0.smithi076.stdout:4/700: creat d0/d3b/d40/d42/fec x:0 0 0 2024-03-28T13:08:08.541 INFO:tasks.workunit.client.0.smithi076.stdout:4/701: write d0/d3b/d40/d42/d31/fde [10098731,32855] 0 2024-03-28T13:08:08.550 INFO:tasks.workunit.client.0.smithi076.stdout:2/699: truncate d2/d5/d7/d3e/f81 3839468 0 2024-03-28T13:08:08.550 INFO:tasks.workunit.client.0.smithi076.stdout:2/700: write d2/d5/db/d3b/d9f/f8e [3116053,54016] 0 2024-03-28T13:08:08.603 INFO:tasks.workunit.client.0.smithi076.stdout:2/701: dwrite d2/d5/db/d3b/d5a/d8d/dc1/fc6 [0,4194304] 0 2024-03-28T13:08:08.657 INFO:tasks.workunit.client.0.smithi076.stdout:7/663: rename d1/d18/d3c/d8c to d1/d18/d3c/d48/d69/d79/de9 0 2024-03-28T13:08:08.708 INFO:tasks.workunit.client.0.smithi076.stdout:7/664: dwrite d1/d18/d3c/f30 [0,4194304] 0 2024-03-28T13:08:08.955 INFO:tasks.workunit.client.0.smithi076.stdout:0/705: sync 2024-03-28T13:08:08.955 INFO:tasks.workunit.client.0.smithi076.stdout:5/695: sync 2024-03-28T13:08:08.955 INFO:tasks.workunit.client.0.smithi076.stdout:0/706: chown db/dc/df/d18/d1d/l1f 1792077 1 2024-03-28T13:08:08.955 INFO:tasks.workunit.client.0.smithi076.stdout:5/696: fdatasync d5/db/d3f/d42/f83 0 2024-03-28T13:08:09.030 INFO:tasks.workunit.client.0.smithi076.stdout:1/596: rmdir d14/d6c 39 2024-03-28T13:08:09.058 INFO:tasks.workunit.client.0.smithi076.stdout:1/597: dwrite f5 [4194304,4194304] 0 2024-03-28T13:08:09.106 INFO:tasks.workunit.client.0.smithi076.stdout:8/715: unlink de/d4e/d54/d68/lb0 0 2024-03-28T13:08:09.261 INFO:tasks.workunit.client.0.smithi076.stdout:6/735: write d6/da/d23/f43 [1229643,54527] 0 2024-03-28T13:08:09.307 INFO:tasks.workunit.client.0.smithi076.stdout:6/736: dwrite d6/fb [4194304,4194304] 0 2024-03-28T13:08:09.308 INFO:tasks.workunit.client.0.smithi076.stdout:6/737: read - d6/da/d40/d56/d8f/fdc zero size 2024-03-28T13:08:09.308 INFO:tasks.workunit.client.0.smithi076.stdout:6/738: chown d6/da/d40/d56/d8f 3 1 2024-03-28T13:08:09.308 INFO:tasks.workunit.client.0.smithi076.stdout:6/739: dread - d6/da/d5f/d6d/daf/fda zero size 2024-03-28T13:08:09.395 INFO:tasks.workunit.client.0.smithi076.stdout:2/702: creat d2/d5/db/d3b/d5a/fd6 x:0 0 0 2024-03-28T13:08:09.395 INFO:tasks.workunit.client.0.smithi076.stdout:2/703: stat d2/d5/d7/d3e/cce 0 2024-03-28T13:08:09.585 INFO:tasks.workunit.client.0.smithi076.stdout:7/665: mkdir d1/d18/d3c/d7b/dea 0 2024-03-28T13:08:09.585 INFO:tasks.workunit.client.0.smithi076.stdout:7/666: fdatasync d1/dc/f32 0 2024-03-28T13:08:09.585 INFO:tasks.workunit.client.0.smithi076.stdout:7/667: write d1/d18/d3c/d7b/fb4 [270892,10239] 0 2024-03-28T13:08:09.722 INFO:tasks.workunit.client.0.smithi076.stdout:8/716: mkdir de/d23/d2b/d51/d62/df9 0 2024-03-28T13:08:09.783 INFO:tasks.workunit.client.0.smithi076.stdout:6/740: creat d6/da/d40/d56/dd2/ff0 x:0 0 0 2024-03-28T13:08:09.882 INFO:tasks.workunit.client.0.smithi076.stdout:2/704: creat d2/d5/db/d3b/d3f/d99/fd7 x:0 0 0 2024-03-28T13:08:09.882 INFO:tasks.workunit.client.0.smithi076.stdout:2/705: truncate d2/d5/db/d3b/d5a/d8d/dc1/fc6 4394608 0 2024-03-28T13:08:09.882 INFO:tasks.workunit.client.0.smithi076.stdout:2/706: fsync d2/d5/d7/fe 0 2024-03-28T13:08:09.954 INFO:tasks.workunit.client.0.smithi076.stdout:2/707: dwrite d2/d5/db/d3b/d3f/fbf [0,4194304] 0 2024-03-28T13:08:09.984 INFO:tasks.workunit.client.0.smithi076.stdout:7/668: rmdir d1/d18/d3c/d7b/dea 0 2024-03-28T13:08:09.984 INFO:tasks.workunit.client.0.smithi076.stdout:7/669: read - d1/d18/d3c/d48/d69/d79/de9/fbb zero size 2024-03-28T13:08:10.203 INFO:tasks.workunit.client.0.smithi076.stdout:6/741: truncate d6/da/d40/d56/da4/fb8 243360 0 2024-03-28T13:08:10.331 INFO:tasks.workunit.client.0.smithi076.stdout:2/708: mknod d2/d5/d7/d8/cd8 0 2024-03-28T13:08:10.393 INFO:tasks.workunit.client.0.smithi076.stdout:7/670: creat d1/d18/feb x:0 0 0 2024-03-28T13:08:10.579 INFO:tasks.workunit.client.0.smithi076.stdout:2/709: truncate d2/d5/db/d3b/d9f/f77 2997112 0 2024-03-28T13:08:10.736 INFO:tasks.workunit.client.0.smithi076.stdout:2/710: unlink d2/d5/d7/c35 0 2024-03-28T13:08:10.796 INFO:tasks.workunit.client.0.smithi076.stdout:3/566: sync 2024-03-28T13:08:10.796 INFO:tasks.workunit.client.0.smithi076.stdout:3/567: chown d1/d7/d30/d38/d14/d36/d56/d5b/la1 260001 1 2024-03-28T13:08:10.911 INFO:tasks.workunit.client.0.smithi076.stdout:3/568: mknod d1/d7/ccf 0 2024-03-28T13:08:11.014 INFO:tasks.workunit.client.0.smithi076.stdout:3/569: symlink d1/d7/d30/d38/d14/d36/d56/d5b/d6d/ld0 0 2024-03-28T13:08:11.051 INFO:tasks.workunit.client.0.smithi076.stdout:9/700: sync 2024-03-28T13:08:11.051 INFO:tasks.workunit.client.0.smithi076.stdout:9/701: dread - d9/dd/df/d11/d14/f7f zero size 2024-03-28T13:08:11.051 INFO:tasks.workunit.client.0.smithi076.stdout:9/702: stat d9/dd/df/d11/d14/fa3 0 2024-03-28T13:08:11.051 INFO:tasks.workunit.client.0.smithi076.stdout:9/703: dread - d9/dd/df/fb8 zero size 2024-03-28T13:08:11.051 INFO:tasks.workunit.client.0.smithi076.stdout:9/704: dread - d9/dd/df/d11/f4f zero size 2024-03-28T13:08:11.051 INFO:tasks.workunit.client.0.smithi076.stdout:9/705: chown d9/dd/f2e 281 1 2024-03-28T13:08:11.095 INFO:tasks.workunit.client.0.smithi076.stdout:3/570: creat d1/d7/d30/d38/d14/d51/fd1 x:0 0 0 2024-03-28T13:08:11.112 INFO:tasks.workunit.client.0.smithi076.stdout:3/571: dread d1/d7/d30/d38/d14/d36/d56/f8b [0,4194304] 0 2024-03-28T13:08:11.112 INFO:tasks.workunit.client.0.smithi076.stdout:3/572: truncate d1/d7/d30/d38/d14/d36/fc6 191976 0 2024-03-28T13:08:11.137 INFO:tasks.workunit.client.0.smithi076.stdout:3/573: read d1/d7/d30/d38/d14/d51/f87 [410031,5264] 0 2024-03-28T13:08:11.166 INFO:tasks.workunit.client.0.smithi076.stdout:3/574: write d1/f63 [2497206,6139] 0 2024-03-28T13:08:11.166 INFO:tasks.workunit.client.0.smithi076.stdout:3/575: write d1/d7/d30/d38/d14/d4a/d66/fa8 [899867,71484] 0 2024-03-28T13:08:11.241 INFO:tasks.workunit.client.0.smithi076.stdout:9/706: mknod d9/dd/df/d11/db2/cdb 0 2024-03-28T13:08:11.481 INFO:tasks.workunit.client.0.smithi076.stdout:3/576: rmdir d1/d7/d30/d38/d14 39 2024-03-28T13:08:11.482 INFO:tasks.workunit.client.0.smithi076.stdout:3/577: write d1/d2/f4f [5127284,48040] 0 2024-03-28T13:08:11.588 INFO:tasks.workunit.client.0.smithi076.stdout:5/697: dwrite d5/db/f2a [0,4194304] 0 2024-03-28T13:08:11.603 INFO:tasks.workunit.client.0.smithi076.stdout:9/707: dread d9/d74/f8e [0,4194304] 0 2024-03-28T13:08:11.688 INFO:tasks.workunit.client.0.smithi076.stdout:9/708: truncate d9/dd/df/d11/d14/d58/f6c 3053460 0 2024-03-28T13:08:11.699 INFO:tasks.workunit.client.0.smithi076.stdout:9/709: dread d9/dd/df/d11/d14/d58/d6e/f70 [0,4194304] 0 2024-03-28T13:08:11.879 INFO:tasks.workunit.client.0.smithi076.stdout:8/717: write de/d23/d2b/d5d/d76/f3e [855525,40291] 0 2024-03-28T13:08:12.184 INFO:tasks.workunit.client.0.smithi076.stdout:6/742: write d6/f52 [1182655,22170] 0 2024-03-28T13:08:12.184 INFO:tasks.workunit.client.0.smithi076.stdout:4/702: rename d0/d3b/f79 to d0/d3b/d40/d42/d31/d4d/d63/fed 0 2024-03-28T13:08:12.223 INFO:tasks.workunit.client.0.smithi076.stdout:4/703: dwrite d0/d3b/d40/d42/d28/f92 [0,4194304] 0 2024-03-28T13:08:12.242 INFO:tasks.workunit.client.0.smithi076.stdout:7/671: dwrite d1/f40 [0,4194304] 0 2024-03-28T13:08:12.657 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:08:12.661 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:08:12.695 INFO:tasks.workunit.client.0.smithi076.stdout:9/710: chown d9/dd/df/d11/d37/c5f 457554703 1 2024-03-28T13:08:12.741 INFO:tasks.workunit.client.0.smithi076.stdout:8/718: mknod de/d23/d2b/d5d/d76/d18/cfa 0 2024-03-28T13:08:12.796 INFO:tasks.workunit.client.0.smithi076.stdout:6/743: symlink d6/da/lf1 0 2024-03-28T13:08:12.796 INFO:tasks.workunit.client.0.smithi076.stdout:6/744: write d6/da/d40/d56/d58/fbd [18335,51223] 0 2024-03-28T13:08:12.815 INFO:tasks.workunit.client.0.smithi076.stdout:6/745: read d6/da/d40/d56/d58/f66 [3918148,30025] 0 2024-03-28T13:08:12.980 INFO:tasks.workunit.client.0.smithi076.stdout:0/707: sync 2024-03-28T13:08:12.980 INFO:tasks.workunit.client.0.smithi076.stdout:2/711: sync 2024-03-28T13:08:12.980 INFO:tasks.workunit.client.0.smithi076.stdout:2/712: truncate d2/d5/d7/d8/f6a 5198780 0 2024-03-28T13:08:12.980 INFO:tasks.workunit.client.0.smithi076.stdout:2/713: truncate d2/d5/db/d3b/d5a/d8d/fc4 410216 0 2024-03-28T13:08:13.050 INFO:tasks.workunit.client.0.smithi076.stdout:4/704: creat d0/d20/d7f/dda/fee x:0 0 0 2024-03-28T13:08:13.150 INFO:tasks.workunit.client.0.smithi076.stdout:7/672: link d1/d18/d3c/fc6 d1/d8/dc2/dc4/fec 0 2024-03-28T13:08:13.423 INFO:tasks.workunit.client.0.smithi076.stdout:2/714: link d2/d5/f5f d2/d5/db/d3b/d3f/d99/fd9 0 2024-03-28T13:08:13.423 INFO:tasks.workunit.client.0.smithi076.stdout:2/715: write d2/d5/d7/d28/d64/fb3 [512867,85168] 0 2024-03-28T13:08:13.423 INFO:tasks.workunit.client.0.smithi076.stdout:2/716: stat d2/d5/d7/d3e/cce 0 2024-03-28T13:08:13.430 INFO:tasks.workunit.client.0.smithi076.stdout:2/717: write d2/d5/d7/fbb [207963,98055] 0 2024-03-28T13:08:13.511 INFO:tasks.workunit.client.0.smithi076.stdout:4/705: rmdir d0/d3b/d40/d42/d47 39 2024-03-28T13:08:13.613 INFO:tasks.workunit.client.0.smithi076.stdout:7/673: creat d1/d8/fed x:0 0 0 2024-03-28T13:08:13.666 INFO:tasks.workunit.client.0.smithi076.stdout:0/708: symlink db/dc/df/d11/d40/d77/d87/lff 0 2024-03-28T13:08:13.777 INFO:tasks.workunit.client.0.smithi076.stdout:2/718: creat d2/d75/fda x:0 0 0 2024-03-28T13:08:13.856 INFO:tasks.workunit.client.0.smithi076.stdout:4/706: getdents d0/d3b/d40/d42/d31 0 2024-03-28T13:08:13.856 INFO:tasks.workunit.client.0.smithi076.stdout:4/707: chown d0/d20/d7f/dda/d2d/d75/ccf 12987 1 2024-03-28T13:08:13.856 INFO:tasks.workunit.client.0.smithi076.stdout:4/708: truncate d0/d20/d7b/fbd 675057 0 2024-03-28T13:08:13.856 INFO:tasks.workunit.client.0.smithi076.stdout:4/709: dread - d0/d3b/d50/d64/fd3 zero size 2024-03-28T13:08:13.930 INFO:tasks.workunit.client.0.smithi076.stdout:7/674: mknod d1/d18/d3c/d48/d69/d79/cee 0 2024-03-28T13:08:14.447 INFO:tasks.workunit.client.0.smithi076.stdout:4/710: creat d0/d20/d7f/dda/fef x:0 0 0 2024-03-28T13:08:14.447 INFO:tasks.workunit.client.0.smithi076.stdout:4/711: chown d0/d3b/d40/c6c 4876642 1 2024-03-28T13:08:14.771 INFO:tasks.workunit.client.0.smithi076.stdout:7/675: mknod d1/d8/d37/d53/dae/cef 0 2024-03-28T13:08:14.771 INFO:tasks.workunit.client.0.smithi076.stdout:7/676: write d1/d8/d37/f58 [385207,67748] 0 2024-03-28T13:08:14.773 INFO:tasks.workunit.client.0.smithi076.stdout:4/712: write d0/d3b/d40/d42/f98 [523022,42656] 0 2024-03-28T13:08:14.775 INFO:tasks.workunit.client.0.smithi076.stdout:7/677: dread d1/d18/d3c/f5f [0,4194304] 0 2024-03-28T13:08:14.782 INFO:tasks.workunit.client.0.smithi076.stdout:9/711: dread d9/dd/df/d11/d14/d58/f6c [0,4194304] 0 2024-03-28T13:08:14.790 INFO:tasks.workunit.client.0.smithi076.stdout:4/713: dread d0/d3b/d40/d42/d28/f49 [0,4194304] 0 2024-03-28T13:08:14.790 INFO:tasks.workunit.client.0.smithi076.stdout:9/712: dread d9/dd/f57 [0,4194304] 0 2024-03-28T13:08:14.796 INFO:tasks.workunit.client.0.smithi076.stdout:1/598: rename d14/f2f to d14/d19/d85/d3f/fd5 0 2024-03-28T13:08:14.796 INFO:tasks.workunit.client.0.smithi076.stdout:1/599: truncate d14/d19/d20/f27 1629514 0 2024-03-28T13:08:14.796 INFO:tasks.workunit.client.0.smithi076.stdout:1/600: write d14/d19/d85/d2e/f7b [546995,6990] 0 2024-03-28T13:08:14.817 INFO:tasks.workunit.client.0.smithi076.stdout:9/713: write d9/f36 [3976217,102708] 0 2024-03-28T13:08:14.817 INFO:tasks.workunit.client.0.smithi076.stdout:9/714: chown d9/da/f6f 1 1 2024-03-28T13:08:14.935 INFO:tasks.workunit.client.0.smithi076.stdout:4/714: creat d0/d20/d7f/dda/db7/ff0 x:0 0 0 2024-03-28T13:08:14.935 INFO:tasks.workunit.client.0.smithi076.stdout:4/715: readlink d0/d3b/d50/d64/lae 0 2024-03-28T13:08:14.935 INFO:tasks.workunit.client.0.smithi076.stdout:4/716: fsync d0/d3b/d50/d64/fd3 0 2024-03-28T13:08:14.935 INFO:tasks.workunit.client.0.smithi076.stdout:4/717: write d0/d20/d7b/f9d [5080722,50558] 0 2024-03-28T13:08:14.991 INFO:tasks.workunit.client.0.smithi076.stdout:3/578: rename d1/d7/d30/d5f/lc5 to d1/d7/da4/ld2 0 2024-03-28T13:08:15.015 INFO:tasks.workunit.client.0.smithi076.stdout:3/579: write d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/f82 [4469312,63769] 0 2024-03-28T13:08:15.015 INFO:tasks.workunit.client.0.smithi076.stdout:3/580: fdatasync d1/d7/d30/d38/d14/f8c 0 2024-03-28T13:08:15.048 INFO:tasks.workunit.client.0.smithi076.stdout:3/581: dwrite d1/d7/f78 [0,4194304] 0 2024-03-28T13:08:15.048 INFO:tasks.workunit.client.0.smithi076.stdout:3/582: fdatasync d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d93/fbd 0 2024-03-28T13:08:15.062 INFO:tasks.workunit.client.0.smithi076.stdout:1/601: mkdir d14/d19/d85/dd6 0 2024-03-28T13:08:15.150 INFO:tasks.workunit.client.0.smithi076.stdout:9/715: stat d9/dd/df/d11/d37/f8a 0 2024-03-28T13:08:15.150 INFO:tasks.workunit.client.0.smithi076.stdout:9/716: truncate d9/dd/df/d11/d14/d58/da1/fba 636014 0 2024-03-28T13:08:15.405 INFO:tasks.workunit.client.0.smithi076.stdout:5/698: rename d5/f6c to d5/d9/d1c/d1d/d31/f104 0 2024-03-28T13:08:15.406 INFO:tasks.workunit.client.0.smithi076.stdout:5/699: dread - d5/d9/d1c/d25/dbd/f103 zero size 2024-03-28T13:08:15.406 INFO:tasks.workunit.client.0.smithi076.stdout:5/700: fsync d5/db/df/fe0 0 2024-03-28T13:08:15.564 INFO:tasks.workunit.client.0.smithi076.stdout:3/583: mkdir d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/dd3 0 2024-03-28T13:08:15.728 INFO:tasks.workunit.client.0.smithi076.stdout:9/717: creat d9/dd/df/d11/d14/d58/d6e/d2a/fdc x:0 0 0 2024-03-28T13:08:15.852 INFO:tasks.workunit.client.0.smithi076.stdout:8/719: rename de/d13/f75 to de/d23/d2b/d5d/d76/d18/d3c/ffb 0 2024-03-28T13:08:15.852 INFO:tasks.workunit.client.0.smithi076.stdout:8/720: chown de/d4e/d54/lca 1554943 1 2024-03-28T13:08:15.855 INFO:tasks.workunit.client.0.smithi076.stdout:0/709: sync 2024-03-28T13:08:15.855 INFO:tasks.workunit.client.0.smithi076.stdout:2/719: sync 2024-03-28T13:08:15.855 INFO:tasks.workunit.client.0.smithi076.stdout:0/710: read f5 [939040,37046] 0 2024-03-28T13:08:15.856 INFO:tasks.workunit.client.0.smithi076.stdout:2/720: write d2/d5/db/d3b/f9a [790581,38981] 0 2024-03-28T13:08:15.914 INFO:tasks.workunit.client.0.smithi076.stdout:5/701: mkdir d5/d9/d1c/d1d/d31/ded/d91/d105 0 2024-03-28T13:08:15.989 INFO:tasks.workunit.client.0.smithi076.stdout:3/584: mkdir d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d93/dd4 0 2024-03-28T13:08:15.989 INFO:tasks.workunit.client.0.smithi076.stdout:3/585: truncate d1/d7/d30/fc4 503526 0 2024-03-28T13:08:16.038 INFO:tasks.workunit.client.0.smithi076.stdout:3/586: dwrite d1/d7/d30/d38/d14/d51/f87 [0,4194304] 0 2024-03-28T13:08:16.038 INFO:tasks.workunit.client.0.smithi076.stdout:3/587: write d1/d7/d30/d38/d14/d4a/d66/f6a [1187970,16484] 0 2024-03-28T13:08:16.051 INFO:tasks.workunit.client.0.smithi076.stdout:9/718: mknod d9/dd/df/cdd 0 2024-03-28T13:08:16.051 INFO:tasks.workunit.client.0.smithi076.stdout:9/719: chown d9/d74/f8e 8685 1 2024-03-28T13:08:16.051 INFO:tasks.workunit.client.0.smithi076.stdout:9/720: dread - d9/dd/df/d11/f4f zero size 2024-03-28T13:08:16.051 INFO:tasks.workunit.client.0.smithi076.stdout:9/721: stat d9/dd/df/d11/f4f 0 2024-03-28T13:08:16.052 INFO:tasks.workunit.client.0.smithi076.stdout:9/722: chown d9/dd/df/d11/d14/f8c 37 1 2024-03-28T13:08:16.183 INFO:tasks.workunit.client.0.smithi076.stdout:6/746: rename d6/da/d23/f4d to d6/da/d39/dd5/ff2 0 2024-03-28T13:08:16.228 INFO:tasks.workunit.client.0.smithi076.stdout:6/747: dwrite d6/da/d23/f45 [0,4194304] 0 2024-03-28T13:08:16.695 INFO:tasks.workunit.client.0.smithi076.stdout:2/721: creat d2/d5/db/d3b/d9f/d9e/db1/fdb x:0 0 0 2024-03-28T13:08:16.815 INFO:tasks.workunit.client.0.smithi076.stdout:5/702: link d5/d9/d35/fac d5/d9/d1c/f106 0 2024-03-28T13:08:16.816 INFO:tasks.workunit.client.0.smithi076.stdout:5/703: readlink d5/d9/d4c/l96 0 2024-03-28T13:08:16.816 INFO:tasks.workunit.client.0.smithi076.stdout:5/704: fsync d5/d9/d4c/d9b/fb8 0 2024-03-28T13:08:16.828 INFO:tasks.workunit.client.0.smithi076.stdout:5/705: dread d5/db/f46 [0,4194304] 0 2024-03-28T13:08:16.891 INFO:tasks.workunit.client.0.smithi076.stdout:7/678: sync 2024-03-28T13:08:16.891 INFO:tasks.workunit.client.0.smithi076.stdout:3/588: chown d1/d2/l5 35 1 2024-03-28T13:08:16.935 INFO:tasks.workunit.client.0.smithi076.stdout:3/589: dwrite d1/d7/d30/d38/d14/d4a/d66/fa8 [0,4194304] 0 2024-03-28T13:08:16.944 INFO:tasks.workunit.client.0.smithi076.stdout:9/723: creat d9/dd/df/fde x:0 0 0 2024-03-28T13:08:16.944 INFO:tasks.workunit.client.0.smithi076.stdout:9/724: write d9/fb1 [717284,59617] 0 2024-03-28T13:08:16.944 INFO:tasks.workunit.client.0.smithi076.stdout:9/725: chown d9/dd/df/d11/d14/d58/d6e/f3d 411672 1 2024-03-28T13:08:16.944 INFO:tasks.workunit.client.0.smithi076.stdout:9/726: truncate d9/dd/df/d11/d14/d58/d6e/f50 1151892 0 2024-03-28T13:08:16.944 INFO:tasks.workunit.client.0.smithi076.stdout:9/727: truncate d9/dd/df/d11/d14/f6a 473016 0 2024-03-28T13:08:16.944 INFO:tasks.workunit.client.0.smithi076.stdout:9/728: readlink d9/dd/df/l88 0 2024-03-28T13:08:17.050 INFO:tasks.workunit.client.0.smithi076.stdout:4/718: rename d0/d3b/d50/d64/ld1 to d0/d3b/d40/d42/d47/d69/lf1 0 2024-03-28T13:08:17.095 INFO:tasks.workunit.client.0.smithi076.stdout:6/748: creat d6/da/d5f/d7e/ff3 x:0 0 0 2024-03-28T13:08:17.095 INFO:tasks.workunit.client.0.smithi076.stdout:6/749: chown d6/da/d23/ddf/fe9 4 1 2024-03-28T13:08:17.240 INFO:tasks.workunit.client.0.smithi076.stdout:8/721: link de/d25/d7f/cab de/d23/d2b/d5d/d76/cfc 0 2024-03-28T13:08:17.332 INFO:tasks.workunit.client.0.smithi076.stdout:0/711: mkdir db/dc/df/d11/d40/dd5/ded/d100 0 2024-03-28T13:08:17.332 INFO:tasks.workunit.client.0.smithi076.stdout:1/602: write d14/d19/d85/d2e/d31/d49/f7a [744826,31853] 0 2024-03-28T13:08:17.332 INFO:tasks.workunit.client.0.smithi076.stdout:1/603: fsync d14/d19/d85/d2e/d91/f9f 0 2024-03-28T13:08:17.538 INFO:tasks.workunit.client.0.smithi076.stdout:5/706: creat d5/d9/d35/d3b/f107 x:0 0 0 2024-03-28T13:08:17.591 INFO:tasks.workunit.client.0.smithi076.stdout:7/679: link d1/dc/d8b/fd4 d1/dc/ff0 0 2024-03-28T13:08:17.622 INFO:tasks.workunit.client.0.smithi076.stdout:7/680: dwrite d1/d18/d3c/f44 [0,4194304] 0 2024-03-28T13:08:17.783 INFO:tasks.workunit.client.0.smithi076.stdout:3/590: mknod d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d58/cd5 0 2024-03-28T13:08:17.783 INFO:tasks.workunit.client.0.smithi076.stdout:3/591: chown d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/f3b 0 1 2024-03-28T13:08:17.783 INFO:tasks.workunit.client.0.smithi076.stdout:3/592: chown d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/f59 515968918 1 2024-03-28T13:08:17.792 INFO:tasks.workunit.client.0.smithi076.stdout:3/593: dread d1/d7/d30/d38/d14/d4a/f5a [0,4194304] 0 2024-03-28T13:08:17.807 INFO:tasks.workunit.client.0.smithi076.stdout:3/594: dread d1/d7/d30/d38/d14/d27/d42/f68 [0,4194304] 0 2024-03-28T13:08:17.885 INFO:tasks.workunit.client.0.smithi076.stdout:9/729: rename d9/dd/df/d11/d14/d58/d6e/d2a/c5c to d9/dd/d48/dd7/dd9/cdf 0 2024-03-28T13:08:17.900 INFO:tasks.workunit.client.0.smithi076.stdout:9/730: read d9/dd/df/d11/d14/f8c [1786352,24212] 0 2024-03-28T13:08:17.916 INFO:tasks.workunit.client.0.smithi076.stdout:9/731: dread d9/d74/f8e [0,4194304] 0 2024-03-28T13:08:17.917 INFO:tasks.workunit.client.0.smithi076.stdout:9/732: stat d9/dd/df/d11/d14/d58/faf 0 2024-03-28T13:08:17.917 INFO:tasks.workunit.client.0.smithi076.stdout:9/733: write d9/d3c/f43 [1491859,24407] 0 2024-03-28T13:08:18.124 INFO:tasks.workunit.client.0.smithi076.stdout:6/750: creat d6/d99/d46/ff4 x:0 0 0 2024-03-28T13:08:18.124 INFO:tasks.workunit.client.0.smithi076.stdout:6/751: fdatasync d6/da/d5f/d6d/fb9 0 2024-03-28T13:08:18.183 INFO:tasks.workunit.client.0.smithi076.stdout:8/722: creat de/d4e/d54/d68/ffd x:0 0 0 2024-03-28T13:08:18.289 INFO:tasks.workunit.client.0.smithi076.stdout:0/712: rename db/dc/df/d71/d4a/d7e/cf6 to db/dc/df/d71/d4a/d7e/c101 0 2024-03-28T13:08:18.344 INFO:tasks.workunit.client.0.smithi076.stdout:1/604: mkdir d14/d19/d20/dd7 0 2024-03-28T13:08:18.367 INFO:tasks.workunit.client.0.smithi076.stdout:1/605: dwrite d14/d19/d85/d2e/d3c/d5c/f65 [0,4194304] 0 2024-03-28T13:08:18.556 INFO:tasks.workunit.client.0.smithi076.stdout:5/707: unlink d5/d9/d1c/d25/dbd/c9f 0 2024-03-28T13:08:18.556 INFO:tasks.workunit.client.0.smithi076.stdout:5/708: chown d5/d9/d1c/d1d/d22/fae 8054703 1 2024-03-28T13:08:18.670 INFO:tasks.workunit.client.0.smithi076.stdout:7/681: link d1/dc/l59 d1/d18/d3c/d48/de5/lf1 0 2024-03-28T13:08:18.743 INFO:tasks.workunit.client.0.smithi076.stdout:4/719: rename d0/d3b/d40/d42/d31/d4d/fca to d0/d3b/d40/d42/d31/d4d/d63/ff2 0 2024-03-28T13:08:18.743 INFO:tasks.workunit.client.0.smithi076.stdout:4/720: fdatasync d0/d3b/d40/d42/d31/d4d/d63/fcb 0 2024-03-28T13:08:18.743 INFO:tasks.workunit.client.0.smithi076.stdout:4/721: write d0/d3b/d40/d42/d47/d69/fe0 [125223,89113] 0 2024-03-28T13:08:18.881 INFO:tasks.workunit.client.0.smithi076.stdout:6/752: mkdir d6/da/d39/d63/df5 0 2024-03-28T13:08:18.961 INFO:tasks.workunit.client.0.smithi076.stdout:8/723: truncate de/d4e/d54/d68/fb8 545855 0 2024-03-28T13:08:18.961 INFO:tasks.workunit.client.0.smithi076.stdout:8/724: read - de/d4e/db6/fe3 zero size 2024-03-28T13:08:19.023 INFO:tasks.workunit.client.0.smithi076.stdout:0/713: creat db/dc/df/d11/dfc/f102 x:0 0 0 2024-03-28T13:08:19.023 INFO:tasks.workunit.client.0.smithi076.stdout:0/714: chown db/f14 12475 1 2024-03-28T13:08:19.047 INFO:tasks.workunit.client.0.smithi076.stdout:0/715: dwrite db/dc/df/d18/d1d/d75/d51/dd7/ffa [0,4194304] 0 2024-03-28T13:08:19.047 INFO:tasks.workunit.client.0.smithi076.stdout:0/716: chown db/dc/df/d18/d1d/d75/fb7 7788134 1 2024-03-28T13:08:19.047 INFO:tasks.workunit.client.0.smithi076.stdout:0/717: fdatasync db/f4b 0 2024-03-28T13:08:19.081 INFO:tasks.workunit.client.0.smithi076.stdout:5/709: read d5/d9/d1c/d25/d60/fce [317105,4016] 0 2024-03-28T13:08:19.300 INFO:tasks.workunit.client.0.smithi076.stdout:7/682: read d1/dc/f2b [868494,19349] 0 2024-03-28T13:08:19.506 INFO:tasks.workunit.client.0.smithi076.stdout:6/753: creat d6/da/d40/d56/dd1/ff6 x:0 0 0 2024-03-28T13:08:19.656 INFO:tasks.workunit.client.0.smithi076.stdout:8/725: creat de/d23/d2b/d51/d62/ffe x:0 0 0 2024-03-28T13:08:19.741 INFO:tasks.workunit.client.0.smithi076.stdout:0/718: symlink db/dc/df/d11/d40/d77/l103 0 2024-03-28T13:08:19.790 INFO:tasks.workunit.client.0.smithi076.stdout:0/719: dwrite db/dc/f66 [0,4194304] 0 2024-03-28T13:08:19.790 INFO:tasks.workunit.client.0.smithi076.stdout:0/720: chown db/dd1 7798129 1 2024-03-28T13:08:19.831 INFO:tasks.workunit.client.0.smithi076.stdout:5/710: creat d5/d9/d1c/d1d/d31/ded/d91/f108 x:0 0 0 2024-03-28T13:08:19.851 INFO:tasks.workunit.client.0.smithi076.stdout:5/711: dread d5/d9/d1c/f106 [0,4194304] 0 2024-03-28T13:08:19.851 INFO:tasks.workunit.client.0.smithi076.stdout:5/712: fdatasync d5/f76 0 2024-03-28T13:08:19.851 INFO:tasks.workunit.client.0.smithi076.stdout:5/713: stat d5/db/df 0 2024-03-28T13:08:19.882 INFO:tasks.workunit.client.0.smithi076.stdout:7/683: truncate d1/dc/f2b 4111901 0 2024-03-28T13:08:19.906 INFO:tasks.workunit.client.0.smithi076.stdout:7/684: dread d1/d18/d3c/d48/d69/fb0 [0,4194304] 0 2024-03-28T13:08:19.945 INFO:tasks.workunit.client.0.smithi076.stdout:3/595: rename d1/d2/l7c to d1/d7/d30/d38/ld6 0 2024-03-28T13:08:19.945 INFO:tasks.workunit.client.0.smithi076.stdout:3/596: read d1/d7/d30/d38/d14/d36/d56/f7f [258130,29380] 0 2024-03-28T13:08:19.945 INFO:tasks.workunit.client.0.smithi076.stdout:3/597: chown d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/fbf 0 1 2024-03-28T13:08:20.548 INFO:tasks.workunit.client.0.smithi076.stdout:8/726: dread de/d23/fc2 [0,4194304] 0 2024-03-28T13:08:20.549 INFO:tasks.workunit.client.0.smithi076.stdout:8/727: write de/d13/da2/fdb [586786,12313] 0 2024-03-28T13:08:20.549 INFO:tasks.workunit.client.0.smithi076.stdout:8/728: write de/d23/d2b/d51/fe5 [247151,12863] 0 2024-03-28T13:08:20.588 INFO:tasks.workunit.client.0.smithi076.stdout:8/729: dwrite de/d23/d2b/d5d/d76/d18/d49/dd0/fe1 [0,4194304] 0 2024-03-28T13:08:20.714 INFO:tasks.workunit.client.0.smithi076.stdout:0/721: mknod db/dd1/c104 0 2024-03-28T13:08:20.714 INFO:tasks.workunit.client.0.smithi076.stdout:0/722: dread - db/dc/df/d18/d1d/d21/fac zero size 2024-03-28T13:08:20.715 INFO:tasks.workunit.client.0.smithi076.stdout:0/723: chown db/dc/c10 3683 1 2024-03-28T13:08:20.784 INFO:tasks.workunit.client.0.smithi076.stdout:2/722: unlink d2/l2e 0 2024-03-28T13:08:20.784 INFO:tasks.workunit.client.0.smithi076.stdout:2/723: chown d2/d5/d7/dd/l8f 503372 1 2024-03-28T13:08:20.839 INFO:tasks.workunit.client.0.smithi076.stdout:5/714: rmdir d5/db/d3f 39 2024-03-28T13:08:20.839 INFO:tasks.workunit.client.0.smithi076.stdout:5/715: chown d5/d9/d1c/d1d/d31/ded/d91/f9c 28 1 2024-03-28T13:08:20.852 INFO:tasks.workunit.client.0.smithi076.stdout:5/716: dread d5/db/f12 [0,4194304] 0 2024-03-28T13:08:20.966 INFO:tasks.workunit.client.0.smithi076.stdout:7/685: unlink d1/dc/c46 0 2024-03-28T13:08:20.966 INFO:tasks.workunit.client.0.smithi076.stdout:9/734: rename d9/d3c/faa to d9/dd/df/d11/db2/fe0 0 2024-03-28T13:08:20.966 INFO:tasks.workunit.client.0.smithi076.stdout:7/686: write d1/d8/d37/fde [636343,95193] 0 2024-03-28T13:08:21.033 INFO:tasks.workunit.client.0.smithi076.stdout:3/598: stat d1/d7/d30/d38/l44 0 2024-03-28T13:08:21.033 INFO:tasks.workunit.client.0.smithi076.stdout:3/599: chown d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/f24 15081 1 2024-03-28T13:08:21.304 INFO:tasks.workunit.client.0.smithi076.stdout:2/724: creat d2/d75/fdc x:0 0 0 2024-03-28T13:08:21.304 INFO:tasks.workunit.client.0.smithi076.stdout:2/725: dread - d2/d5/d7/d28/fa4 zero size 2024-03-28T13:08:21.398 INFO:tasks.workunit.client.0.smithi076.stdout:5/717: creat d5/d9/d1c/d25/dbd/d7a/d7c/f109 x:0 0 0 2024-03-28T13:08:21.653 INFO:tasks.workunit.client.0.smithi076.stdout:9/735: rmdir d9/dd/d48/dd7/dd9 39 2024-03-28T13:08:21.653 INFO:tasks.workunit.client.0.smithi076.stdout:9/736: write d9/dd/df/d11/db2/fe0 [4371494,46932] 0 2024-03-28T13:08:21.658 INFO:tasks.workunit.client.0.smithi076.stdout:9/737: dread d9/d74/d7d/fa5 [0,4194304] 0 2024-03-28T13:08:21.658 INFO:tasks.workunit.client.0.smithi076.stdout:9/738: chown d9/da/f6f 2020 1 2024-03-28T13:08:21.660 INFO:tasks.workunit.client.0.smithi076.stdout:9/739: write d9/dd/df/d11/d14/d58/d6e/d2a/f76 [56031,111614] 0 2024-03-28T13:08:21.761 INFO:tasks.workunit.client.0.smithi076.stdout:7/687: creat d1/d18/d3c/d48/de5/ff2 x:0 0 0 2024-03-28T13:08:21.763 INFO:tasks.workunit.client.0.smithi076.stdout:3/600: read d1/d7/d30/d38/d14/d36/d56/f9a [470097,116989] 0 2024-03-28T13:08:21.763 INFO:tasks.workunit.client.0.smithi076.stdout:3/601: chown d1/d7/d30/d38/f29 160347187 1 2024-03-28T13:08:21.819 INFO:tasks.workunit.client.0.smithi076.stdout:0/724: truncate db/dc/df/d71/d4a/f9d 1770512 0 2024-03-28T13:08:21.859 INFO:tasks.workunit.client.0.smithi076.stdout:5/718: mknod d5/d9/d35/d3b/c10a 0 2024-03-28T13:08:21.859 INFO:tasks.workunit.client.0.smithi076.stdout:5/719: dread - d5/d9/d1c/d1d/d31/ded/d91/fd5 zero size 2024-03-28T13:08:21.859 INFO:tasks.workunit.client.0.smithi076.stdout:2/726: dread d2/d5/db/d3b/d5a/d8d/fc4 [0,4194304] 0 2024-03-28T13:08:21.866 INFO:tasks.workunit.client.0.smithi076.stdout:4/722: write d0/d3b/d40/d42/f3f [4417971,11508] 0 2024-03-28T13:08:21.873 INFO:tasks.workunit.client.0.smithi076.stdout:2/727: dread d2/d75/f91 [0,4194304] 0 2024-03-28T13:08:21.873 INFO:tasks.workunit.client.0.smithi076.stdout:2/728: chown d2/d5/d7/fa 158727129 1 2024-03-28T13:08:21.882 INFO:tasks.workunit.client.0.smithi076.stdout:4/723: write d0/d20/d7b/f9d [1308422,65545] 0 2024-03-28T13:08:22.010 INFO:tasks.workunit.client.0.smithi076.stdout:9/740: creat d9/dd/dbb/fe1 x:0 0 0 2024-03-28T13:08:22.079 INFO:tasks.workunit.client.0.smithi076.stdout:3/602: creat d1/d7/d30/d38/d14/d36/d56/fd7 x:0 0 0 2024-03-28T13:08:22.079 INFO:tasks.workunit.client.0.smithi076.stdout:3/603: fdatasync d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/f82 0 2024-03-28T13:08:22.086 INFO:tasks.workunit.client.0.smithi076.stdout:3/604: write d1/d7/d30/d38/d14/d36/d56/d5b/d6d/f83 [427352,90462] 0 2024-03-28T13:08:22.144 INFO:tasks.workunit.client.0.smithi076.stdout:0/725: symlink db/dc/df/d18/d1d/d21/dd2/df1/l105 0 2024-03-28T13:08:22.231 INFO:tasks.workunit.client.0.smithi076.stdout:5/720: mkdir d5/d9/d35/d10b 0 2024-03-28T13:08:22.244 INFO:tasks.workunit.client.0.smithi076.stdout:5/721: dread d5/d9/d1c/d1d/d31/fe4 [0,4194304] 0 2024-03-28T13:08:22.244 INFO:tasks.workunit.client.0.smithi076.stdout:5/722: write d5/d9/d1c/d1d/d31/ded/d91/f108 [212492,29998] 0 2024-03-28T13:08:22.389 INFO:tasks.workunit.client.0.smithi076.stdout:4/724: creat d0/d20/d7f/dda/db7/ff3 x:0 0 0 2024-03-28T13:08:22.389 INFO:tasks.workunit.client.0.smithi076.stdout:4/725: chown d0/d3b/d50/d64/cea 4 1 2024-03-28T13:08:22.404 INFO:tasks.workunit.client.0.smithi076.stdout:2/729: dread d2/d5/d4b/d39/f97 [0,4194304] 0 2024-03-28T13:08:22.416 INFO:tasks.workunit.client.0.smithi076.stdout:4/726: dwrite d0/d20/d7f/f84 [0,4194304] 0 2024-03-28T13:08:22.416 INFO:tasks.workunit.client.0.smithi076.stdout:4/727: chown d0/d3b/d40/d42/d28/f5b 24973 1 2024-03-28T13:08:22.463 INFO:tasks.workunit.client.0.smithi076.stdout:4/728: dwrite d0/d20/d7f/dda/d2d/f35 [0,4194304] 0 2024-03-28T13:08:22.501 INFO:tasks.workunit.client.0.smithi076.stdout:4/729: dwrite d0/d3b/d40/d42/d31/f56 [4194304,4194304] 0 2024-03-28T13:08:22.501 INFO:tasks.workunit.client.0.smithi076.stdout:4/730: fsync d0/d20/d7f/f84 0 2024-03-28T13:08:22.524 INFO:tasks.workunit.client.0.smithi076.stdout:4/731: write d0/d3b/d40/d42/d31/d5e/f83 [3791835,121553] 0 2024-03-28T13:08:22.524 INFO:tasks.workunit.client.0.smithi076.stdout:4/732: truncate d0/d3b/d40/d42/d28/f49 9257343 0 2024-03-28T13:08:22.542 INFO:tasks.workunit.client.0.smithi076.stdout:4/733: write d0/d3b/d40/d42/d31/d5e/fc5 [2428856,4160] 0 2024-03-28T13:08:22.813 INFO:tasks.workunit.client.0.smithi076.stdout:8/730: link de/d23/d2b/d51/d62/fc4 de/d23/d2b/fff 0 2024-03-28T13:08:22.814 INFO:tasks.workunit.client.0.smithi076.stdout:8/731: chown de/d23/c20 44333366 1 2024-03-28T13:08:22.840 INFO:tasks.workunit.client.0.smithi076.stdout:0/726: symlink db/dc/df/d18/d1d/d75/l106 0 2024-03-28T13:08:22.857 INFO:tasks.workunit.client.0.smithi076.stdout:0/727: dread db/dc/df/d18/d1d/f29 [0,4194304] 0 2024-03-28T13:08:22.979 INFO:tasks.workunit.client.0.smithi076.stdout:5/723: creat d5/d9/d1c/d25/d73/f10c x:0 0 0 2024-03-28T13:08:22.984 INFO:tasks.workunit.client.0.smithi076.stdout:2/730: mkdir d2/d5/db/d3b/ddd 0 2024-03-28T13:08:22.984 INFO:tasks.workunit.client.0.smithi076.stdout:2/731: fsync d2/d5/db/d3b/d9f/d9e/db1/fdb 0 2024-03-28T13:08:22.999 INFO:tasks.workunit.client.0.smithi076.stdout:2/732: dread d2/d5/f12 [4194304,4194304] 0 2024-03-28T13:08:23.128 INFO:tasks.workunit.client.0.smithi076.stdout:4/734: mkdir d0/d3b/d40/d42/d31/d5e/df4 0 2024-03-28T13:08:23.183 INFO:tasks.workunit.client.0.smithi076.stdout:0/728: rmdir db/dc/df/d11/d40/dd5 39 2024-03-28T13:08:23.184 INFO:tasks.workunit.client.0.smithi076.stdout:0/729: chown db/dd8/fef 3 1 2024-03-28T13:08:23.256 INFO:tasks.workunit.client.0.smithi076.stdout:5/724: creat d5/d9/d1c/d1d/d31/ded/d91/de9/f10d x:0 0 0 2024-03-28T13:08:23.265 INFO:tasks.workunit.client.0.smithi076.stdout:2/733: creat d2/d5/db/d3b/d9f/fde x:0 0 0 2024-03-28T13:08:23.689 INFO:tasks.workunit.client.0.smithi076.stdout:6/754: sync 2024-03-28T13:08:23.710 INFO:tasks.workunit.client.0.smithi076.stdout:6/755: read d6/f2f [1168779,111058] 0 2024-03-28T13:08:23.710 INFO:tasks.workunit.client.0.smithi076.stdout:6/756: readlink d6/l57 0 2024-03-28T13:08:23.729 INFO:tasks.workunit.client.0.smithi076.stdout:6/757: dread d6/da/d1e/fa6 [0,4194304] 0 2024-03-28T13:08:23.844 INFO:tasks.workunit.client.0.smithi076.stdout:0/730: rmdir db/dc/df/d11/d40/d77 39 2024-03-28T13:08:23.915 INFO:tasks.workunit.client.0.smithi076.stdout:5/725: symlink d5/d9/d35/d3b/db6/df7/l10e 0 2024-03-28T13:08:23.915 INFO:tasks.workunit.client.0.smithi076.stdout:5/726: write d5/d9/d4c/d98/fc6 [4776381,33373] 0 2024-03-28T13:08:24.137 INFO:tasks.workunit.client.0.smithi076.stdout:2/734: unlink d2/d5/f5f 0 2024-03-28T13:08:24.137 INFO:tasks.workunit.client.0.smithi076.stdout:2/735: chown d2/d5/db/d3b/d42 2 1 2024-03-28T13:08:24.137 INFO:tasks.workunit.client.0.smithi076.stdout:2/736: fsync d2/d5/db/d3b/d42/f6d 0 2024-03-28T13:08:24.137 INFO:tasks.workunit.client.0.smithi076.stdout:6/758: rmdir d6/da/d5f 39 2024-03-28T13:08:24.137 INFO:tasks.workunit.client.0.smithi076.stdout:6/759: stat d6/d99/f67 0 2024-03-28T13:08:24.137 INFO:tasks.workunit.client.0.smithi076.stdout:6/760: write d6/f2f [5354640,64843] 0 2024-03-28T13:08:24.140 INFO:tasks.workunit.client.0.smithi076.stdout:0/731: mkdir db/dc/df/d71/d4a/d107 0 2024-03-28T13:08:24.140 INFO:tasks.workunit.client.0.smithi076.stdout:0/732: write db/dc/df/d18/d1d/d21/dd2/fde [15716,111000] 0 2024-03-28T13:08:24.182 INFO:tasks.workunit.client.0.smithi076.stdout:5/727: mknod d5/d9/d4c/d9b/c10f 0 2024-03-28T13:08:24.325 INFO:tasks.workunit.client.0.smithi076.stdout:2/737: creat d2/d75/fdf x:0 0 0 2024-03-28T13:08:24.420 INFO:tasks.workunit.client.0.smithi076.stdout:6/761: mknod d6/da/d1e/dde/cf7 0 2024-03-28T13:08:24.433 INFO:tasks.workunit.client.0.smithi076.stdout:6/762: dread d6/da/d39/f61 [0,4194304] 0 2024-03-28T13:08:24.433 INFO:tasks.workunit.client.0.smithi076.stdout:6/763: chown d6/d99/f30 15779 1 2024-03-28T13:08:24.444 INFO:tasks.workunit.client.0.smithi076.stdout:6/764: write d6/da/d5f/d6d/fbb [3773945,115145] 0 2024-03-28T13:08:24.449 INFO:tasks.workunit.client.0.smithi076.stdout:6/765: write d6/da/d1e/f35 [4976466,86369] 0 2024-03-28T13:08:24.450 INFO:tasks.workunit.client.0.smithi076.stdout:6/766: write d6/da/d5f/d6d/fbb [367243,127963] 0 2024-03-28T13:08:24.607 INFO:tasks.workunit.client.0.smithi076.stdout:0/733: truncate db/d16/fe9 1967723 0 2024-03-28T13:08:24.607 INFO:tasks.workunit.client.0.smithi076.stdout:0/734: dread - db/dc/df/d11/d40/d77/da2/d6d/db9/fcb zero size 2024-03-28T13:08:24.607 INFO:tasks.workunit.client.0.smithi076.stdout:0/735: truncate db/dc/df/d71/d4a/f72 2449174 0 2024-03-28T13:08:24.613 INFO:tasks.workunit.client.0.smithi076.stdout:5/728: mkdir d5/d9/d1c/d1d/d22/d110 0 2024-03-28T13:08:24.755 INFO:tasks.workunit.client.0.smithi076.stdout:6/767: symlink d6/da/d40/d56/dc7/lf8 0 2024-03-28T13:08:25.060 INFO:tasks.workunit.client.0.smithi076.stdout:6/768: creat d6/da/ff9 x:0 0 0 2024-03-28T13:08:25.061 INFO:tasks.workunit.client.0.smithi076.stdout:9/741: write d9/dd/df/d11/d14/f4e [2639097,47114] 0 2024-03-28T13:08:25.482 INFO:tasks.workunit.client.0.smithi076.stdout:6/769: rmdir d6/da/d23/ddf 39 2024-03-28T13:08:25.516 INFO:tasks.workunit.client.0.smithi076.stdout:6/770: dwrite d6/da/d23/ddf/fe9 [4194304,4194304] 0 2024-03-28T13:08:25.525 INFO:tasks.workunit.client.0.smithi076.stdout:9/742: mknod d9/d3c/ce2 0 2024-03-28T13:08:25.568 INFO:tasks.workunit.client.0.smithi076.stdout:4/735: mkdir d0/d3b/d40/df5 0 2024-03-28T13:08:25.905 INFO:tasks.workunit.client.0.smithi076.stdout:4/736: getdents d0/d20/d7f/dda/d2d/d75 0 2024-03-28T13:08:26.096 INFO:tasks.workunit.client.0.smithi076.stdout:4/737: symlink d0/d3b/d40/d42/d47/d7c/lf6 0 2024-03-28T13:08:26.096 INFO:tasks.workunit.client.0.smithi076.stdout:4/738: readlink d0/d20/d7f/dda/d2d/l67 0 2024-03-28T13:08:26.135 INFO:tasks.workunit.client.0.smithi076.stdout:4/739: dwrite d0/d3b/d40/d42/d47/d69/da9/fe9 [0,4194304] 0 2024-03-28T13:08:26.138 INFO:tasks.workunit.client.0.smithi076.stdout:4/740: truncate d0/d3b/d40/d42/d31/d5e/fc5 4972998 0 2024-03-28T13:08:26.191 INFO:tasks.workunit.client.0.smithi076.stdout:4/741: dwrite d0/d3b/d40/d42/d31/d5e/d72/fc6 [0,4194304] 0 2024-03-28T13:08:26.205 INFO:tasks.workunit.client.0.smithi076.stdout:4/742: dread d0/f43 [0,4194304] 0 2024-03-28T13:08:26.205 INFO:tasks.workunit.client.0.smithi076.stdout:4/743: fsync d0/f30 0 2024-03-28T13:08:26.318 INFO:tasks.workunit.client.0.smithi076.stdout:4/744: creat d0/d3b/d50/ff7 x:0 0 0 2024-03-28T13:08:26.529 INFO:tasks.workunit.client.0.smithi076.stdout:1/606: rename d14/d19/l4c to d14/d19/d85/d3f/ld8 0 2024-03-28T13:08:26.529 INFO:tasks.workunit.client.0.smithi076.stdout:4/745: symlink d0/d20/d7f/dda/db7/lf8 0 2024-03-28T13:08:26.529 INFO:tasks.workunit.client.0.smithi076.stdout:1/607: chown d14/d19/d85/d2e/d31/d51/d92/lb0 3600708 1 2024-03-28T13:08:26.529 INFO:tasks.workunit.client.0.smithi076.stdout:1/608: write d14/d19/d85/d2e/d91/fae [905658,120165] 0 2024-03-28T13:08:26.529 INFO:tasks.workunit.client.0.smithi076.stdout:1/609: chown d14/d6c 49 1 2024-03-28T13:08:26.529 INFO:tasks.workunit.client.0.smithi076.stdout:1/610: fdatasync d14/d6c/d74/fd3 0 2024-03-28T13:08:26.560 INFO:tasks.workunit.client.0.smithi076.stdout:5/729: creat d5/d9/f111 x:0 0 0 2024-03-28T13:08:26.560 INFO:tasks.workunit.client.0.smithi076.stdout:5/730: dread - d5/d9/d1c/d25/dbd/d7a/d7c/f109 zero size 2024-03-28T13:08:26.608 INFO:tasks.workunit.client.0.smithi076.stdout:5/731: dwrite d5/d9/d1c/d1d/d31/f104 [0,4194304] 0 2024-03-28T13:08:26.608 INFO:tasks.workunit.client.0.smithi076.stdout:5/732: truncate d5/d9/d4c/da4/fd0 160760 0 2024-03-28T13:08:26.802 INFO:tasks.workunit.client.0.smithi076.stdout:9/743: dwrite d9/dd/df/d11/d14/d58/da1/fba [0,4194304] 0 2024-03-28T13:08:27.184 INFO:tasks.workunit.client.0.smithi076.stdout:4/746: mkdir d0/d3b/d40/d42/d31/d5e/df9 0 2024-03-28T13:08:27.291 INFO:tasks.workunit.client.0.smithi076.stdout:3/605: sync 2024-03-28T13:08:27.291 INFO:tasks.workunit.client.0.smithi076.stdout:3/606: stat d1/d2/l13 0 2024-03-28T13:08:27.291 INFO:tasks.workunit.client.0.smithi076.stdout:3/607: dread - d1/d7/d30/d38/fb7 zero size 2024-03-28T13:08:27.645 INFO:tasks.workunit.client.0.smithi076.stdout:7/688: rename d1/dc/ce6 to d1/d18/d3c/d48/d69/d79/de9/db5/cf3 0 2024-03-28T13:08:27.661 INFO:tasks.workunit.client.0.smithi076.stdout:5/733: dread d5/d9/d1c/d25/dbd/d7a/d7c/fdf [0,4194304] 0 2024-03-28T13:08:27.680 INFO:tasks.workunit.client.0.smithi076.stdout:5/734: write d5/db/df/fdd [3380416,88941] 0 2024-03-28T13:08:27.707 INFO:tasks.workunit.client.0.smithi076.stdout:5/735: dwrite d5/d9/d35/f85 [0,4194304] 0 2024-03-28T13:08:27.962 INFO:tasks.workunit.client.0.smithi076.stdout:4/747: mknod d0/d3b/d50/de6/cfa 0 2024-03-28T13:08:27.962 INFO:tasks.workunit.client.0.smithi076.stdout:4/748: fdatasync d0/d3b/d40/d42/f65 0 2024-03-28T13:08:27.962 INFO:tasks.workunit.client.0.smithi076.stdout:4/749: dread - d0/d20/d7f/dda/fef zero size 2024-03-28T13:08:28.614 INFO:tasks.workunit.client.0.smithi076.stdout:1/611: dwrite d14/d19/d85/d2e/d31/d8f/f9c [0,4194304] 0 2024-03-28T13:08:28.809 INFO:tasks.workunit.client.0.smithi076.stdout:8/732: rename de/d23/d2b/d51/d62/d8b/lc0 to de/d4e/db6/l100 0 2024-03-28T13:08:28.809 INFO:tasks.workunit.client.0.smithi076.stdout:8/733: readlink de/d23/d2b/d5d/d76/d6e/l96 0 2024-03-28T13:08:28.856 INFO:tasks.workunit.client.0.smithi076.stdout:8/734: dwrite de/d23/d2b/f30 [0,4194304] 0 2024-03-28T13:08:28.860 INFO:tasks.workunit.client.0.smithi076.stdout:8/735: dread fd [0,4194304] 0 2024-03-28T13:08:28.888 INFO:tasks.workunit.client.0.smithi076.stdout:7/689: creat d1/d18/d3c/d48/d69/d79/de9/ff4 x:0 0 0 2024-03-28T13:08:28.888 INFO:tasks.workunit.client.0.smithi076.stdout:7/690: chown d1/f13 665 1 2024-03-28T13:08:29.079 INFO:tasks.workunit.client.0.smithi076.stdout:5/736: mknod d5/d9/d1c/d25/dbd/d7a/d7c/c112 0 2024-03-28T13:08:29.187 INFO:tasks.workunit.client.0.smithi076.stdout:4/750: symlink d0/d3b/de8/lfb 0 2024-03-28T13:08:29.370 INFO:tasks.workunit.client.0.smithi076.stdout:9/744: dwrite d9/d74/f8e [0,4194304] 0 2024-03-28T13:08:29.473 INFO:tasks.workunit.client.0.smithi076.stdout:8/736: read de/d4e/d54/f64 [620717,110022] 0 2024-03-28T13:08:29.473 INFO:tasks.workunit.client.0.smithi076.stdout:8/737: dread - de/d23/d2b/d5d/d76/d6e/fe4 zero size 2024-03-28T13:08:29.473 INFO:tasks.workunit.client.0.smithi076.stdout:8/738: dread - de/d4e/d54/d68/ffd zero size 2024-03-28T13:08:29.489 INFO:tasks.workunit.client.0.smithi076.stdout:5/737: rmdir d5/db/df 39 2024-03-28T13:08:29.704 INFO:tasks.workunit.client.0.smithi076.stdout:4/751: mknod d0/d20/d7f/dda/db7/cfc 0 2024-03-28T13:08:29.704 INFO:tasks.workunit.client.0.smithi076.stdout:9/745: link d9/d74/d7d/fa5 d9/dd/df/d11/fe3 0 2024-03-28T13:08:29.716 INFO:tasks.workunit.client.0.smithi076.stdout:7/691: truncate d1/d8/d37/d53/f8f 1498902 0 2024-03-28T13:08:29.716 INFO:tasks.workunit.client.0.smithi076.stdout:8/739: creat de/d23/d2b/d5d/d76/d6e/d7a/f101 x:0 0 0 2024-03-28T13:08:29.716 INFO:tasks.workunit.client.0.smithi076.stdout:7/692: write d1/d81/fcd [1425368,94374] 0 2024-03-28T13:08:29.760 INFO:tasks.workunit.client.0.smithi076.stdout:8/740: dwrite de/d23/d2b/d5d/d76/d6e/f9c [0,4194304] 0 2024-03-28T13:08:30.144 INFO:tasks.workunit.client.0.smithi076.stdout:5/738: mknod d5/db/df/c113 0 2024-03-28T13:08:30.144 INFO:tasks.workunit.client.0.smithi076.stdout:5/739: write d5/d9/d1c/d1d/d31/ded/fcf [521048,15880] 0 2024-03-28T13:08:30.149 INFO:tasks.workunit.client.0.smithi076.stdout:2/738: rename d2/d5/l50 to d2/d5/d4b/d39/le0 0 2024-03-28T13:08:30.229 INFO:tasks.workunit.client.0.smithi076.stdout:3/608: sync 2024-03-28T13:08:30.275 INFO:tasks.workunit.client.0.smithi076.stdout:9/746: dread d9/dd/df/d11/d14/d58/d6e/d2a/f44 [0,4194304] 0 2024-03-28T13:08:30.312 INFO:tasks.workunit.client.0.smithi076.stdout:9/747: dwrite d9/dd/df/d11/d14/d58/d6e/f9b [0,4194304] 0 2024-03-28T13:08:30.474 INFO:tasks.workunit.client.0.smithi076.stdout:1/612: dwrite d14/d19/d85/d2e/d31/d51/f70 [0,4194304] 0 2024-03-28T13:08:30.612 INFO:tasks.workunit.client.0.smithi076.stdout:7/693: getdents d1/d8/d37/d53/dae 0 2024-03-28T13:08:30.638 INFO:tasks.workunit.client.0.smithi076.stdout:7/694: dwrite d1/d18/d3c/d48/d69/d79/de9/ff4 [0,4194304] 0 2024-03-28T13:08:30.638 INFO:tasks.workunit.client.0.smithi076.stdout:7/695: chown d1/d8/c2f 10992127 1 2024-03-28T13:08:30.638 INFO:tasks.workunit.client.0.smithi076.stdout:7/696: chown d1/d81/dd7 514 1 2024-03-28T13:08:30.755 INFO:tasks.workunit.client.0.smithi076.stdout:8/741: mknod de/d13/dc9/def/c102 0 2024-03-28T13:08:30.755 INFO:tasks.workunit.client.0.smithi076.stdout:5/740: link d5/db/d19/f8c d5/db/d3f/d97/f114 0 2024-03-28T13:08:30.761 INFO:tasks.workunit.client.0.smithi076.stdout:0/736: rename db/da6/fec to db/dc/d3d/d57/f108 0 2024-03-28T13:08:30.761 INFO:tasks.workunit.client.0.smithi076.stdout:2/739: symlink d2/d5/d4b/d39/d57/db9/le1 0 2024-03-28T13:08:30.874 INFO:tasks.workunit.client.0.smithi076.stdout:9/748: creat d9/fe4 x:0 0 0 2024-03-28T13:08:30.874 INFO:tasks.workunit.client.0.smithi076.stdout:9/749: fdatasync d9/dd/dbb/fe1 0 2024-03-28T13:08:30.879 INFO:tasks.workunit.client.0.smithi076.stdout:9/750: dread d9/dd/df/d11/d14/d58/da1/fb7 [0,4194304] 0 2024-03-28T13:08:30.879 INFO:tasks.workunit.client.0.smithi076.stdout:9/751: chown d9/d74 314 1 2024-03-28T13:08:30.883 INFO:tasks.workunit.client.0.smithi076.stdout:9/752: write d9/dd/df/d11/fac [567096,121211] 0 2024-03-28T13:08:30.985 INFO:tasks.workunit.client.0.smithi076.stdout:1/613: mknod d14/d19/d85/d62/cd9 0 2024-03-28T13:08:31.012 INFO:tasks.workunit.client.0.smithi076.stdout:7/697: creat d1/d8/dc2/dc4/ff5 x:0 0 0 2024-03-28T13:08:31.012 INFO:tasks.workunit.client.0.smithi076.stdout:7/698: dread - d1/d8/dc2/dc4/fec zero size 2024-03-28T13:08:31.079 INFO:tasks.workunit.client.0.smithi076.stdout:5/741: unlink d5/db/df/ca3 0 2024-03-28T13:08:31.079 INFO:tasks.workunit.client.0.smithi076.stdout:5/742: truncate d5/d9/d1c/d1d/d31/ded/d91/fd5 275697 0 2024-03-28T13:08:31.079 INFO:tasks.workunit.client.0.smithi076.stdout:5/743: write d5/db/f12 [2429219,8366] 0 2024-03-28T13:08:31.173 INFO:tasks.workunit.client.0.smithi076.stdout:6/771: rename d6/da/d39/dd5 to d6/da/d40/d62/dfa 0 2024-03-28T13:08:31.173 INFO:tasks.workunit.client.0.smithi076.stdout:6/772: write d6/da/d23/f97 [533232,86202] 0 2024-03-28T13:08:31.351 INFO:tasks.workunit.client.0.smithi076.stdout:2/740: link d2/d5/d4b/l58 d2/d5/d7/le2 0 2024-03-28T13:08:31.352 INFO:tasks.workunit.client.0.smithi076.stdout:2/741: chown d2/d5/d7 21078 1 2024-03-28T13:08:31.352 INFO:tasks.workunit.client.0.smithi076.stdout:0/737: symlink db/dc/df/d18/d1d/d75/d51/d60/d89/l109 0 2024-03-28T13:08:31.377 INFO:tasks.workunit.client.0.smithi076.stdout:2/742: dwrite d2/d5/d7/fa [0,4194304] 0 2024-03-28T13:08:31.378 INFO:tasks.workunit.client.0.smithi076.stdout:9/753: rmdir d9/d74/db3/db5 39 2024-03-28T13:08:31.378 INFO:tasks.workunit.client.0.smithi076.stdout:9/754: dread - d9/dd/df/d11/db2/fcc zero size 2024-03-28T13:08:31.425 INFO:tasks.workunit.client.0.smithi076.stdout:1/614: symlink d14/d19/d20/dbf/lda 0 2024-03-28T13:08:31.502 INFO:tasks.workunit.client.0.smithi076.stdout:7/699: symlink d1/dc/d8b/dbf/lf6 0 2024-03-28T13:08:31.502 INFO:tasks.workunit.client.0.smithi076.stdout:7/700: readlink d1/d18/d3c/d48/d69/lc9 0 2024-03-28T13:08:31.586 INFO:tasks.workunit.client.0.smithi076.stdout:5/744: mkdir d5/d9/d35/d3b/d115 0 2024-03-28T13:08:31.586 INFO:tasks.workunit.client.0.smithi076.stdout:5/745: chown d5/db/d3f/fc2 0 1 2024-03-28T13:08:31.702 INFO:tasks.workunit.client.0.smithi076.stdout:4/752: rename d0/d3b/d40/d42/d47/d69/fd2 to d0/d3b/d50/ffd 0 2024-03-28T13:08:32.063 INFO:tasks.workunit.client.0.smithi076.stdout:0/738: creat db/dc/df/d18/d1d/d75/d51/d97/f10a x:0 0 0 2024-03-28T13:08:32.064 INFO:tasks.workunit.client.0.smithi076.stdout:0/739: fdatasync db/dc/df/d18/d1d/d21/fac 0 2024-03-28T13:08:32.082 INFO:tasks.workunit.client.0.smithi076.stdout:0/740: write db/dc/df/d18/d1d/d75/d51/dd7/ffa [328407,23225] 0 2024-03-28T13:08:32.113 INFO:tasks.workunit.client.0.smithi076.stdout:2/743: dread d2/d5/d4b/d39/d57/fbd [0,4194304] 0 2024-03-28T13:08:32.323 INFO:tasks.workunit.client.0.smithi076.stdout:1/615: symlink d14/d19/d85/d2e/d3c/d5c/ldb 0 2024-03-28T13:08:32.413 INFO:tasks.workunit.client.0.smithi076.stdout:7/701: mknod d1/d18/d3c/d48/d69/d79/de9/cf7 0 2024-03-28T13:08:33.299 INFO:tasks.workunit.client.0.smithi076.stdout:4/753: creat d0/d3b/d40/d42/d31/d4d/d63/ffe x:0 0 0 2024-03-28T13:08:33.299 INFO:tasks.workunit.client.0.smithi076.stdout:4/754: write d0/d3b/d40/d42/f3f [1100413,30236] 0 2024-03-28T13:08:33.377 INFO:tasks.workunit.client.0.smithi076.stdout:0/741: write db/dc/df/d11/d40/f64 [2630418,96103] 0 2024-03-28T13:08:33.561 INFO:tasks.workunit.client.0.smithi076.stdout:3/609: rename d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/f7a to d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d93/fd8 0 2024-03-28T13:08:33.561 INFO:tasks.workunit.client.0.smithi076.stdout:3/610: write d1/d7/d30/d38/d14/d4a/fae [5222325,29988] 0 2024-03-28T13:08:33.569 INFO:tasks.workunit.client.0.smithi076.stdout:3/611: dread d1/d7/d30/d38/d14/d36/d56/d5b/d6d/f83 [0,4194304] 0 2024-03-28T13:08:34.022 INFO:tasks.workunit.client.0.smithi076.stdout:8/742: rename de/d23/d2b/d5d/d76/d18/d3c/l4d to de/d4e/d54/d98/l103 0 2024-03-28T13:08:34.022 INFO:tasks.workunit.client.0.smithi076.stdout:8/743: chown de/d13/d27 413 1 2024-03-28T13:08:34.022 INFO:tasks.workunit.client.0.smithi076.stdout:1/616: truncate d14/d19/d85/d2e/f61 1514052 0 2024-03-28T13:08:34.022 INFO:tasks.workunit.client.0.smithi076.stdout:8/744: write de/fa7 [625730,50130] 0 2024-03-28T13:08:34.176 INFO:tasks.workunit.client.0.smithi076.stdout:6/773: rename d6/da/d89/ccd to d6/d99/cfb 0 2024-03-28T13:08:34.177 INFO:tasks.workunit.client.0.smithi076.stdout:6/774: read d6/da/d1e/f4a [2273265,88891] 0 2024-03-28T13:08:34.180 INFO:tasks.workunit.client.0.smithi076.stdout:6/775: dread d6/da/d40/d56/d58/f8e [0,4194304] 0 2024-03-28T13:08:34.475 INFO:tasks.workunit.client.0.smithi076.stdout:2/744: rename d2/d5/d4b/d39/d57/f85 to d2/d5/d7/d8/d21/fe3 0 2024-03-28T13:08:34.657 INFO:tasks.workunit.client.0.smithi076.stdout:2/745: mknod d2/d5/db/d3b/d9f/d9e/ce4 0 2024-03-28T13:08:35.049 INFO:tasks.workunit.client.0.smithi076.stdout:9/755: link d9/d74/db3/lb9 d9/dd/df/d11/le5 0 2024-03-28T13:08:35.049 INFO:tasks.workunit.client.0.smithi076.stdout:9/756: chown d9/d74/db3 105 1 2024-03-28T13:08:35.306 INFO:tasks.workunit.client.0.smithi076.stdout:0/742: dwrite db/dc/df/d71/d4a/f9d [0,4194304] 0 2024-03-28T13:08:35.306 INFO:tasks.workunit.client.0.smithi076.stdout:0/743: chown db/dc/df/d11/d40/d77/d87/d88 61737 1 2024-03-28T13:08:35.306 INFO:tasks.workunit.client.0.smithi076.stdout:0/744: write db/dc/df/d18/d1d/d75/d51/dd7/de3/ff2 [306304,39099] 0 2024-03-28T13:08:35.344 INFO:tasks.workunit.client.0.smithi076.stdout:1/617: symlink d14/d19/ldc 0 2024-03-28T13:08:35.355 INFO:tasks.workunit.client.0.smithi076.stdout:8/745: write de/d23/d2b/d51/d62/d8b/f91 [393172,77219] 0 2024-03-28T13:08:35.361 INFO:tasks.workunit.client.0.smithi076.stdout:7/702: link d1/d8/f68 d1/ff8 0 2024-03-28T13:08:35.370 INFO:tasks.workunit.client.0.smithi076.stdout:3/612: dwrite d1/d7/d30/fc4 [0,4194304] 0 2024-03-28T13:08:35.417 INFO:tasks.workunit.client.0.smithi076.stdout:9/757: fsync d9/dd/d48/dad/fc2 0 2024-03-28T13:08:35.420 INFO:tasks.workunit.client.0.smithi076.stdout:6/776: dwrite d6/da/d5f/d6d/d95/fb2 [0,4194304] 0 2024-03-28T13:08:35.420 INFO:tasks.workunit.client.0.smithi076.stdout:6/777: fdatasync d6/d99/d46/ff4 0 2024-03-28T13:08:35.485 INFO:tasks.workunit.client.0.smithi076.stdout:2/746: truncate d2/d5/db/d3b/d9f/f77 2539565 0 2024-03-28T13:08:35.485 INFO:tasks.workunit.client.0.smithi076.stdout:2/747: read - d2/d67/fb0 zero size 2024-03-28T13:08:35.485 INFO:tasks.workunit.client.0.smithi076.stdout:2/748: write d2/d5/db/d3b/d42/f6d [57662,38463] 0 2024-03-28T13:08:35.649 INFO:tasks.workunit.client.0.smithi076.stdout:0/745: symlink db/dc/df/d18/d1d/d21/dd2/df1/l10b 0 2024-03-28T13:08:35.649 INFO:tasks.workunit.client.0.smithi076.stdout:0/746: write db/dc/df/fee [1035260,58627] 0 2024-03-28T13:08:35.670 INFO:tasks.workunit.client.0.smithi076.stdout:0/747: write db/dc/df/d71/d4a/f9d [1115214,125489] 0 2024-03-28T13:08:35.777 INFO:tasks.workunit.client.0.smithi076.stdout:7/703: rename d1/d18/d2d/fa7 to d1/d18/d3c/d48/d69/d79/de9/db5/ff9 0 2024-03-28T13:08:35.777 INFO:tasks.workunit.client.0.smithi076.stdout:7/704: stat d1/c21 0 2024-03-28T13:08:35.777 INFO:tasks.workunit.client.0.smithi076.stdout:8/746: mknod de/d23/d2b/d5d/d76/d6e/d8a/d93/c104 0 2024-03-28T13:08:35.798 INFO:tasks.workunit.client.0.smithi076.stdout:7/705: dread d1/d18/f95 [0,4194304] 0 2024-03-28T13:08:35.811 INFO:tasks.workunit.client.0.smithi076.stdout:7/706: dread d1/d18/f5c [0,4194304] 0 2024-03-28T13:08:35.953 INFO:tasks.workunit.client.0.smithi076.stdout:3/613: creat d1/d7/d30/d38/d14/d4a/fd9 x:0 0 0 2024-03-28T13:08:35.953 INFO:tasks.workunit.client.0.smithi076.stdout:3/614: stat d1/d7/d30/d38/l44 0 2024-03-28T13:08:35.953 INFO:tasks.workunit.client.0.smithi076.stdout:3/615: read - d1/d7/d30/d38/d14/d4a/fd9 zero size 2024-03-28T13:08:35.994 INFO:tasks.workunit.client.0.smithi076.stdout:9/758: dread d9/f6b [0,4194304] 0 2024-03-28T13:08:36.131 INFO:tasks.workunit.client.0.smithi076.stdout:6/778: link d6/da/d89/fa1 d6/d99/d46/ffc 0 2024-03-28T13:08:36.131 INFO:tasks.workunit.client.0.smithi076.stdout:6/779: truncate d6/f3c 2334919 0 2024-03-28T13:08:36.133 INFO:tasks.workunit.client.0.smithi076.stdout:5/746: sync 2024-03-28T13:08:36.166 INFO:tasks.workunit.client.0.smithi076.stdout:5/747: dwrite d5/d9/f111 [0,4194304] 0 2024-03-28T13:08:36.166 INFO:tasks.workunit.client.0.smithi076.stdout:5/748: getdents d5/db/d3f/d97/dd7 0 2024-03-28T13:08:36.235 INFO:tasks.workunit.client.0.smithi076.stdout:2/749: creat d2/d5/d7/d8/d21/fe5 x:0 0 0 2024-03-28T13:08:36.285 INFO:tasks.workunit.client.0.smithi076.stdout:4/755: sync 2024-03-28T13:08:36.334 INFO:tasks.workunit.client.0.smithi076.stdout:0/748: creat db/dc/df/d18/d1d/f10c x:0 0 0 2024-03-28T13:08:36.455 INFO:tasks.workunit.client.0.smithi076.stdout:7/707: stat d1/c9 0 2024-03-28T13:08:36.455 INFO:tasks.workunit.client.0.smithi076.stdout:7/708: chown d1/d18/d3c/d48/d69/lc9 1 1 2024-03-28T13:08:36.565 INFO:tasks.workunit.client.0.smithi076.stdout:3/616: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/fda x:0 0 0 2024-03-28T13:08:36.565 INFO:tasks.workunit.client.0.smithi076.stdout:3/617: chown d1/d7/d30/d38/d14/d4a/fbe 355942 1 2024-03-28T13:08:36.565 INFO:tasks.workunit.client.0.smithi076.stdout:3/618: chown d1/c46 14 1 2024-03-28T13:08:37.040 INFO:tasks.workunit.client.0.smithi076.stdout:1/618: sync 2024-03-28T13:08:37.040 INFO:tasks.workunit.client.0.smithi076.stdout:9/759: mkdir d9/da/de6 0 2024-03-28T13:08:37.040 INFO:tasks.workunit.client.0.smithi076.stdout:9/760: stat d9/dd/f2e 0 2024-03-28T13:08:37.041 INFO:tasks.workunit.client.0.smithi076.stdout:1/619: dread - d14/d19/d85/d2e/d31/d8f/fc1 zero size 2024-03-28T13:08:37.062 INFO:tasks.workunit.client.0.smithi076.stdout:9/761: write d9/dd/df/f25 [8265925,37958] 0 2024-03-28T13:08:37.591 INFO:tasks.workunit.client.0.smithi076.stdout:6/780: truncate d6/da/d23/fc6 236915 0 2024-03-28T13:08:37.597 INFO:tasks.workunit.client.0.smithi076.stdout:5/749: mknod d5/d9/d4c/d98/c116 0 2024-03-28T13:08:37.597 INFO:tasks.workunit.client.0.smithi076.stdout:8/747: sync 2024-03-28T13:08:37.598 INFO:tasks.workunit.client.0.smithi076.stdout:5/750: write d5/d9/d1c/d25/dbd/f103 [394302,104340] 0 2024-03-28T13:08:37.599 INFO:tasks.workunit.client.0.smithi076.stdout:2/750: truncate d2/d5/d7/fbb 995812 0 2024-03-28T13:08:37.600 INFO:tasks.workunit.client.0.smithi076.stdout:4/756: rename d0/d3b/d40/d42/d47/c90 to d0/d3b/d40/d42/d31/d5e/d72/d78/dcc/cff 0 2024-03-28T13:08:37.600 INFO:tasks.workunit.client.0.smithi076.stdout:2/751: fdatasync d2/d5/d7/fbb 0 2024-03-28T13:08:37.602 INFO:tasks.workunit.client.0.smithi076.stdout:0/749: rmdir db/dc/df/d71 39 2024-03-28T13:08:37.602 INFO:tasks.workunit.client.0.smithi076.stdout:7/709: mknod d1/d8/d37/d53/dae/cfa 0 2024-03-28T13:08:37.602 INFO:tasks.workunit.client.0.smithi076.stdout:0/750: write db/dc/df/d11/d40/d77/d87/d88/fab [557210,39112] 0 2024-03-28T13:08:37.729 INFO:tasks.workunit.client.0.smithi076.stdout:3/619: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/fdb x:0 0 0 2024-03-28T13:08:37.801 INFO:tasks.workunit.client.0.smithi076.stdout:1/620: mkdir d14/d19/d85/d2e/d3c/ddd 0 2024-03-28T13:08:37.875 INFO:tasks.workunit.client.0.smithi076.stdout:9/762: getdents d9/d3c 0 2024-03-28T13:08:37.879 INFO:tasks.workunit.client.0.smithi076.stdout:9/763: dread d9/dd/d48/dad/fb6 [0,4194304] 0 2024-03-28T13:08:38.089 INFO:tasks.workunit.client.0.smithi076.stdout:6/781: truncate d6/da/d5f/d7e/dc8/fd8 121539 0 2024-03-28T13:08:38.089 INFO:tasks.workunit.client.0.smithi076.stdout:6/782: stat d6/da/d40/d56/dd1/ff6 0 2024-03-28T13:08:38.164 INFO:tasks.workunit.client.0.smithi076.stdout:8/748: creat de/d23/d2b/f105 x:0 0 0 2024-03-28T13:08:38.206 INFO:tasks.workunit.client.0.smithi076.stdout:8/749: dwrite de/d23/d2b/d5d/d76/d6e/d87/ff2 [0,4194304] 0 2024-03-28T13:08:38.375 INFO:tasks.workunit.client.0.smithi076.stdout:5/751: mkdir d5/d9/d1c/d25/dbd/d117 0 2024-03-28T13:08:38.420 INFO:tasks.workunit.client.0.smithi076.stdout:4/757: getdents d0/d3b/d50/de6 0 2024-03-28T13:08:38.440 INFO:tasks.workunit.client.0.smithi076.stdout:4/758: read d0/d20/f48 [2885421,93261] 0 2024-03-28T13:08:38.855 INFO:tasks.workunit.client.0.smithi076.stdout:3/620: getdents d1 0 2024-03-28T13:08:38.877 INFO:tasks.workunit.client.0.smithi076.stdout:3/621: dread d1/d7/d30/d38/d14/d36/d56/d5b/f76 [0,4194304] 0 2024-03-28T13:08:38.877 INFO:tasks.workunit.client.0.smithi076.stdout:3/622: write d1/d7/d30/d38/d14/d36/d56/fd7 [837607,118874] 0 2024-03-28T13:08:38.877 INFO:tasks.workunit.client.0.smithi076.stdout:3/623: readlink d1/d7/lbb 0 2024-03-28T13:08:38.891 INFO:tasks.workunit.client.0.smithi076.stdout:1/621: getdents d14/d19/d85/d3f 0 2024-03-28T13:08:38.918 INFO:tasks.workunit.client.0.smithi076.stdout:3/624: dwrite d1/d7/d30/d38/d14/d27/f4e [0,4194304] 0 2024-03-28T13:08:38.937 INFO:tasks.workunit.client.0.smithi076.stdout:1/622: dwrite d14/d19/d85/d2e/f58 [0,4194304] 0 2024-03-28T13:08:38.952 INFO:tasks.workunit.client.0.smithi076.stdout:3/625: dwrite d1/d7/d30/d38/d14/d27/f7e [0,4194304] 0 2024-03-28T13:08:38.967 INFO:tasks.workunit.client.0.smithi076.stdout:3/626: dread d1/d7/d30/d38/d9b/fc8 [0,4194304] 0 2024-03-28T13:08:38.992 INFO:tasks.workunit.client.0.smithi076.stdout:9/764: link d9/dd/d48/dad/ca7 d9/dd/df/d11/d14/d58/ce7 0 2024-03-28T13:08:38.992 INFO:tasks.workunit.client.0.smithi076.stdout:9/765: write d9/dd/dbb/fe1 [414802,66877] 0 2024-03-28T13:08:39.049 INFO:tasks.workunit.client.0.smithi076.stdout:6/783: link d6/fe6 d6/da/d40/d56/dc7/ffd 0 2024-03-28T13:08:39.141 INFO:tasks.workunit.client.0.smithi076.stdout:8/750: getdents de/d23/d2b/d51 0 2024-03-28T13:08:39.160 INFO:tasks.workunit.client.0.smithi076.stdout:8/751: write de/d4e/f67 [3976153,7117] 0 2024-03-28T13:08:39.214 INFO:tasks.workunit.client.0.smithi076.stdout:8/752: dwrite de/d13/d27/f29 [0,4194304] 0 2024-03-28T13:08:39.233 INFO:tasks.workunit.client.0.smithi076.stdout:5/752: unlink d5/db/d19/f2d 0 2024-03-28T13:08:39.233 INFO:tasks.workunit.client.0.smithi076.stdout:5/753: fdatasync d5/db/f13 0 2024-03-28T13:08:39.233 INFO:tasks.workunit.client.0.smithi076.stdout:5/754: getdents d5/d9/d1c/d1d 0 2024-03-28T13:08:39.249 INFO:tasks.workunit.client.0.smithi076.stdout:5/755: dread d5/db/df/f5a [0,4194304] 0 2024-03-28T13:08:39.295 INFO:tasks.workunit.client.0.smithi076.stdout:4/759: unlink d0/d3b/d40/d42/d28/f92 0 2024-03-28T13:08:39.296 INFO:tasks.workunit.client.0.smithi076.stdout:4/760: stat d0/f1e 0 2024-03-28T13:08:39.455 INFO:tasks.workunit.client.0.smithi076.stdout:1/623: dread d14/d19/d85/d2e/d91/fa0 [0,4194304] 0 2024-03-28T13:08:39.465 INFO:tasks.workunit.client.0.smithi076.stdout:1/624: write d14/d19/d85/d2e/f6a [689929,80505] 0 2024-03-28T13:08:39.658 INFO:tasks.workunit.client.0.smithi076.stdout:9/766: mknod d9/d3c/ce8 0 2024-03-28T13:08:39.658 INFO:tasks.workunit.client.0.smithi076.stdout:9/767: truncate d9/dd/df/d11/d14/d58/d6e/d2a/f8b 1193769 0 2024-03-28T13:08:39.896 INFO:tasks.workunit.client.0.smithi076.stdout:8/753: mkdir de/d23/d2b/d5d/d76/d6e/d7a/d106 0 2024-03-28T13:08:40.098 INFO:tasks.workunit.client.0.smithi076.stdout:4/761: creat d0/d3b/d40/d42/d31/d5e/d72/d78/dcc/f100 x:0 0 0 2024-03-28T13:08:40.098 INFO:tasks.workunit.client.0.smithi076.stdout:1/625: mkdir d14/d19/d85/d2e/d31/d8f/dde 0 2024-03-28T13:08:40.295 INFO:tasks.workunit.client.0.smithi076.stdout:9/768: rename d9/dd/df/d11/db2/cdb to d9/d3c/ce9 0 2024-03-28T13:08:40.522 INFO:tasks.workunit.client.0.smithi076.stdout:1/626: mknod d14/d19/d85/d2e/d31/d51/d92/da4/db5/cdf 0 2024-03-28T13:08:40.522 INFO:tasks.workunit.client.0.smithi076.stdout:1/627: write d14/d6c/d74/f95 [565376,41311] 0 2024-03-28T13:08:40.522 INFO:tasks.workunit.client.0.smithi076.stdout:1/628: write d14/d19/d85/d2e/d31/d3b/f43 [4516643,20255] 0 2024-03-28T13:08:40.559 INFO:tasks.workunit.client.0.smithi076.stdout:0/751: dwrite db/f94 [0,4194304] 0 2024-03-28T13:08:40.559 INFO:tasks.workunit.client.0.smithi076.stdout:0/752: chown db/dc/df/d11/d40/d77/fdd 1 1 2024-03-28T13:08:40.606 INFO:tasks.workunit.client.0.smithi076.stdout:9/769: creat d9/dd/df/d11/db2/fea x:0 0 0 2024-03-28T13:08:40.668 INFO:tasks.workunit.client.0.smithi076.stdout:1/629: creat d14/d19/d85/d62/fe0 x:0 0 0 2024-03-28T13:08:40.668 INFO:tasks.workunit.client.0.smithi076.stdout:1/630: chown d14/d19/d85/d2e/d31/c8e 5538596 1 2024-03-28T13:08:40.668 INFO:tasks.workunit.client.0.smithi076.stdout:1/631: write d14/d6c/d74/f78 [1278414,28348] 0 2024-03-28T13:08:40.918 INFO:tasks.workunit.client.0.smithi076.stdout:9/770: link d9/dd/df/d11/d14/d58/d6e/fc9 d9/da/de6/feb 0 2024-03-28T13:08:40.918 INFO:tasks.workunit.client.0.smithi076.stdout:9/771: fsync d9/dd/d48/dad/fc2 0 2024-03-28T13:08:40.995 INFO:tasks.workunit.client.0.smithi076.stdout:2/752: sync 2024-03-28T13:08:40.995 INFO:tasks.workunit.client.0.smithi076.stdout:7/710: sync 2024-03-28T13:08:41.042 INFO:tasks.workunit.client.0.smithi076.stdout:7/711: dwrite d1/d18/d3c/f20 [4194304,4194304] 0 2024-03-28T13:08:41.109 INFO:tasks.workunit.client.0.smithi076.stdout:9/772: rename d9/d3c/f5b to d9/dd/df/d11/db2/fec 0 2024-03-28T13:08:41.175 INFO:tasks.workunit.client.0.smithi076.stdout:2/753: symlink d2/d5/d7/d8/d21/le6 0 2024-03-28T13:08:41.267 INFO:tasks.workunit.client.0.smithi076.stdout:7/712: symlink d1/d8/d37/d53/lfb 0 2024-03-28T13:08:41.359 INFO:tasks.workunit.client.0.smithi076.stdout:9/773: creat d9/dd/d48/dd7/dd9/fed x:0 0 0 2024-03-28T13:08:41.388 INFO:tasks.workunit.client.0.smithi076.stdout:2/754: mknod d2/d5/db/d3b/ce7 0 2024-03-28T13:08:41.443 INFO:tasks.workunit.client.0.smithi076.stdout:2/755: dwrite d2/d5/d7/d28/d64/fb3 [0,4194304] 0 2024-03-28T13:08:41.443 INFO:tasks.workunit.client.0.smithi076.stdout:2/756: dread - d2/d5/f84 zero size 2024-03-28T13:08:41.443 INFO:tasks.workunit.client.0.smithi076.stdout:2/757: fdatasync d2/d5/d7/d28/fa4 0 2024-03-28T13:08:41.443 INFO:tasks.workunit.client.0.smithi076.stdout:2/758: read - d2/d5/d4b/d39/d57/fd1 zero size 2024-03-28T13:08:41.462 INFO:tasks.workunit.client.0.smithi076.stdout:5/756: getdents d5/db/d19 0 2024-03-28T13:08:41.850 INFO:tasks.workunit.client.0.smithi076.stdout:7/713: mkdir d1/d81/dc3/dfc 0 2024-03-28T13:08:41.867 INFO:tasks.workunit.client.0.smithi076.stdout:3/627: write d1/d7/d30/d38/d14/d36/d56/f9a [1540011,122906] 0 2024-03-28T13:08:42.093 INFO:tasks.workunit.client.0.smithi076.stdout:6/784: write d6/fe6 [238496,115181] 0 2024-03-28T13:08:42.160 INFO:tasks.workunit.client.0.smithi076.stdout:8/754: sync 2024-03-28T13:08:42.212 INFO:tasks.workunit.client.0.smithi076.stdout:4/762: sync 2024-03-28T13:08:42.364 INFO:tasks.workunit.client.0.smithi076.stdout:9/774: creat d9/dd/d48/dd7/fee x:0 0 0 2024-03-28T13:08:42.365 INFO:tasks.workunit.client.0.smithi076.stdout:9/775: chown d9/dd/df/fbf 7955 1 2024-03-28T13:08:42.365 INFO:tasks.workunit.client.0.smithi076.stdout:9/776: chown d9/dd/df/d11/d14/d58/d6e/d2a/c72 1794 1 2024-03-28T13:08:42.365 INFO:tasks.workunit.client.0.smithi076.stdout:9/777: stat d9/dd/df/cdd 0 2024-03-28T13:08:42.367 INFO:tasks.workunit.client.0.smithi076.stdout:9/778: dread d9/dd/df/d11/d14/d58/da1/fb7 [0,4194304] 0 2024-03-28T13:08:42.400 INFO:tasks.workunit.client.0.smithi076.stdout:9/779: dwrite d9/dd/df/d11/d14/d58/d6e/f3d [4194304,4194304] 0 2024-03-28T13:08:42.401 INFO:tasks.workunit.client.0.smithi076.stdout:9/780: stat d9/dd/df/d11/d14/l99 0 2024-03-28T13:08:42.487 INFO:tasks.workunit.client.0.smithi076.stdout:2/759: truncate d2/d5/d7/d28/f43 3229338 0 2024-03-28T13:08:42.592 INFO:tasks.workunit.client.0.smithi076.stdout:5/757: creat d5/d9/d1c/d1d/d31/ded/d91/d105/f118 x:0 0 0 2024-03-28T13:08:42.592 INFO:tasks.workunit.client.0.smithi076.stdout:5/758: write d5/d9/d35/d3b/db6/ff4 [558337,32076] 0 2024-03-28T13:08:42.592 INFO:tasks.workunit.client.0.smithi076.stdout:5/759: stat d5/db/d3f/c9e 0 2024-03-28T13:08:42.711 INFO:tasks.workunit.client.0.smithi076.stdout:7/714: symlink d1/dc/d8b/lfd 0 2024-03-28T13:08:42.740 INFO:tasks.workunit.client.0.smithi076.stdout:3/628: mkdir d1/d7/d30/d38/d14/d4a/ddc 0 2024-03-28T13:08:42.743 INFO:tasks.workunit.client.0.smithi076.stdout:0/753: sync 2024-03-28T13:08:42.752 INFO:tasks.workunit.client.0.smithi076.stdout:3/629: dread d1/d7/d30/d60/f88 [0,4194304] 0 2024-03-28T13:08:42.787 INFO:tasks.workunit.client.0.smithi076.stdout:1/632: write d14/d19/d85/d2e/d31/d51/f77 [397067,1609] 0 2024-03-28T13:08:42.798 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:08:42.803 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:08:42.884 INFO:tasks.workunit.client.0.smithi076.stdout:4/763: link d0/d20/d7f/dda/db7/ff3 d0/d20/d7f/dda/d2d/f101 0 2024-03-28T13:08:42.884 INFO:tasks.workunit.client.0.smithi076.stdout:4/764: write d0/d3b/d40/d42/d31/d5e/d72/d78/dcc/fd8 [833291,91271] 0 2024-03-28T13:08:42.885 INFO:tasks.workunit.client.0.smithi076.stdout:4/765: truncate d0/d20/d7f/dda/fef 188352 0 2024-03-28T13:08:43.549 INFO:tasks.workunit.client.0.smithi076.stdout:2/760: truncate d2/d5/db/d3b/d60/f87 45447 0 2024-03-28T13:08:43.625 INFO:tasks.workunit.client.0.smithi076.stdout:5/760: unlink d5/d9/d1c/d1d/d31/ded/lb5 0 2024-03-28T13:08:43.840 INFO:tasks.workunit.client.0.smithi076.stdout:0/754: creat db/dc/df/d11/f10d x:0 0 0 2024-03-28T13:08:43.840 INFO:tasks.workunit.client.0.smithi076.stdout:3/630: mknod d1/cdd 0 2024-03-28T13:08:43.847 INFO:tasks.workunit.client.0.smithi076.stdout:0/755: read db/dc/df/fee [595875,24390] 0 2024-03-28T13:08:43.885 INFO:tasks.workunit.client.0.smithi076.stdout:8/755: mknod de/d23/d2b/d5d/d76/c107 0 2024-03-28T13:08:43.885 INFO:tasks.workunit.client.0.smithi076.stdout:8/756: truncate de/d23/d2b/d58/d78/fa0 1661694 0 2024-03-28T13:08:43.885 INFO:tasks.workunit.client.0.smithi076.stdout:8/757: write de/d23/d2b/feb [1017243,1773] 0 2024-03-28T13:08:43.944 INFO:tasks.workunit.client.0.smithi076.stdout:1/633: creat d14/d19/d85/dd6/fe1 x:0 0 0 2024-03-28T13:08:44.047 INFO:tasks.workunit.client.0.smithi076.stdout:4/766: rmdir d0/d20/d7f/dda/d2d 39 2024-03-28T13:08:44.062 INFO:tasks.workunit.client.0.smithi076.stdout:4/767: dread d0/d20/d7f/f84 [0,4194304] 0 2024-03-28T13:08:44.131 INFO:tasks.workunit.client.0.smithi076.stdout:2/761: creat d2/d92/fe8 x:0 0 0 2024-03-28T13:08:44.225 INFO:tasks.workunit.client.0.smithi076.stdout:5/761: link d5/db/f46 d5/d9/d1c/d25/dbd/d7a/f119 0 2024-03-28T13:08:44.225 INFO:tasks.workunit.client.0.smithi076.stdout:5/762: write d5/db/d3f/d42/fd1 [862536,90255] 0 2024-03-28T13:08:44.336 INFO:tasks.workunit.client.0.smithi076.stdout:3/631: rename d1/d7/d30/d38/d14/d51/f87 to d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d93/fde 0 2024-03-28T13:08:44.369 INFO:tasks.workunit.client.0.smithi076.stdout:0/756: mknod db/dc/df/d18/d1d/d75/d51/d60/d89/c10e 0 2024-03-28T13:08:44.369 INFO:tasks.workunit.client.0.smithi076.stdout:0/757: write db/dc/df/d18/d1d/d75/d51/f8d [755150,66655] 0 2024-03-28T13:08:44.452 INFO:tasks.workunit.client.0.smithi076.stdout:8/758: creat de/d23/d2b/d5d/d76/d18/d49/dbd/f108 x:0 0 0 2024-03-28T13:08:44.458 INFO:tasks.workunit.client.0.smithi076.stdout:8/759: fdatasync de/d23/d2b/feb 0 2024-03-28T13:08:44.483 INFO:tasks.workunit.client.0.smithi076.stdout:8/760: read de/d23/d2b/d5d/d76/d18/f5c [202749,124706] 0 2024-03-28T13:08:44.580 INFO:tasks.workunit.client.0.smithi076.stdout:1/634: symlink d14/d19/d85/d2e/d31/d51/d92/da4/db7/dc8/le2 0 2024-03-28T13:08:44.623 INFO:tasks.workunit.client.0.smithi076.stdout:1/635: dwrite d14/d19/d85/d2e/d91/fae [0,4194304] 0 2024-03-28T13:08:44.629 INFO:tasks.workunit.client.0.smithi076.stdout:1/636: dread d14/d19/d85/d2e/f3e [0,4194304] 0 2024-03-28T13:08:44.678 INFO:tasks.workunit.client.0.smithi076.stdout:4/768: mknod d0/d3b/d40/d42/d31/d5e/df4/c102 0 2024-03-28T13:08:44.754 INFO:tasks.workunit.client.0.smithi076.stdout:2/762: read d2/d5/d7/f40 [3059351,31023] 0 2024-03-28T13:08:44.972 INFO:tasks.workunit.client.0.smithi076.stdout:5/763: creat d5/d9/d1c/d1d/d31/ded/d91/d105/f11a x:0 0 0 2024-03-28T13:08:44.972 INFO:tasks.workunit.client.0.smithi076.stdout:5/764: stat d5/d9/d1c/dcc 0 2024-03-28T13:08:44.996 INFO:tasks.workunit.client.0.smithi076.stdout:3/632: stat d1/d7/da4/ld2 0 2024-03-28T13:08:45.764 INFO:tasks.workunit.client.0.smithi076.stdout:4/769: symlink d0/d3b/d40/d42/d28/l103 0 2024-03-28T13:08:45.838 INFO:tasks.workunit.client.0.smithi076.stdout:6/785: unlink d6/f4b 0 2024-03-28T13:08:45.916 INFO:tasks.workunit.client.0.smithi076.stdout:2/763: mkdir d2/d5/d4b/d39/d57/de9 0 2024-03-28T13:08:46.020 INFO:tasks.workunit.client.0.smithi076.stdout:5/765: creat d5/db/d19/d34/f11b x:0 0 0 2024-03-28T13:08:46.122 INFO:tasks.workunit.client.0.smithi076.stdout:3/633: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d93/dd4/fdf x:0 0 0 2024-03-28T13:08:46.123 INFO:tasks.workunit.client.0.smithi076.stdout:3/634: fdatasync d1/d7/d30/d60/f88 0 2024-03-28T13:08:46.123 INFO:tasks.workunit.client.0.smithi076.stdout:3/635: stat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d58/f6f 0 2024-03-28T13:08:46.160 INFO:tasks.workunit.client.0.smithi076.stdout:0/758: mknod db/c10f 0 2024-03-28T13:08:46.177 INFO:tasks.workunit.client.0.smithi076.stdout:3/636: dwrite d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d93/fbd [0,4194304] 0 2024-03-28T13:08:46.177 INFO:tasks.workunit.client.0.smithi076.stdout:3/637: readlink d1/d7/l1c 0 2024-03-28T13:08:46.252 INFO:tasks.workunit.client.0.smithi076.stdout:4/770: creat d0/d3b/de8/f104 x:0 0 0 2024-03-28T13:08:46.262 INFO:tasks.workunit.client.0.smithi076.stdout:4/771: dread d0/d20/f48 [0,4194304] 0 2024-03-28T13:08:46.298 INFO:tasks.workunit.client.0.smithi076.stdout:6/786: link d6/da/d40/d62/lea d6/da/d5f/lfe 0 2024-03-28T13:08:46.298 INFO:tasks.workunit.client.0.smithi076.stdout:6/787: chown d6/da/d40/d62/dfa/ff2 5680 1 2024-03-28T13:08:46.367 INFO:tasks.workunit.client.0.smithi076.stdout:8/761: getdents de/d23/d2b/d5d/d76 0 2024-03-28T13:08:46.367 INFO:tasks.workunit.client.0.smithi076.stdout:8/762: write de/d23/d2b/d5d/d76/ff5 [757471,87795] 0 2024-03-28T13:08:46.398 INFO:tasks.workunit.client.0.smithi076.stdout:2/764: creat d2/d5/db/d3b/d5a/fea x:0 0 0 2024-03-28T13:08:46.434 INFO:tasks.workunit.client.0.smithi076.stdout:2/765: dwrite d2/d5/d7/fe [0,4194304] 0 2024-03-28T13:08:46.435 INFO:tasks.workunit.client.0.smithi076.stdout:2/766: write d2/d5/db/d3b/d5a/fea [10404,86754] 0 2024-03-28T13:08:46.435 INFO:tasks.workunit.client.0.smithi076.stdout:2/767: read - d2/d5/db/d3b/fd3 zero size 2024-03-28T13:08:46.438 INFO:tasks.workunit.client.0.smithi076.stdout:7/715: creat d1/d18/d3c/ffe x:0 0 0 2024-03-28T13:08:46.559 INFO:tasks.workunit.client.0.smithi076.stdout:5/766: rename d5/d9/d1c/f106 to d5/d9/d1c/d25/dbd/d7a/de2/f11c 0 2024-03-28T13:08:46.609 INFO:tasks.workunit.client.0.smithi076.stdout:5/767: dwrite d5/db/d3f/f8d [0,4194304] 0 2024-03-28T13:08:46.688 INFO:tasks.workunit.client.0.smithi076.stdout:0/759: dwrite db/dc/df/f37 [0,4194304] 0 2024-03-28T13:08:46.754 INFO:tasks.workunit.client.0.smithi076.stdout:3/638: creat d1/d2/fe0 x:0 0 0 2024-03-28T13:08:46.854 INFO:tasks.workunit.client.0.smithi076.stdout:4/772: creat d0/d3b/d40/d42/d31/d4d/d63/de4/f105 x:0 0 0 2024-03-28T13:08:47.027 INFO:tasks.workunit.client.0.smithi076.stdout:6/788: mkdir d6/d99/d46/dff 0 2024-03-28T13:08:47.031 INFO:tasks.workunit.client.0.smithi076.stdout:8/763: link de/d23/d2b/d51/d62/lb2 de/d4e/db6/l109 0 2024-03-28T13:08:47.208 INFO:tasks.workunit.client.0.smithi076.stdout:2/768: symlink d2/d5/db/d3b/d9f/leb 0 2024-03-28T13:08:47.536 INFO:tasks.workunit.client.0.smithi076.stdout:5/768: creat d5/d9/d1c/d1d/d31/ded/d91/de9/f11d x:0 0 0 2024-03-28T13:08:47.584 INFO:tasks.workunit.client.0.smithi076.stdout:0/760: creat db/dc/df/d18/d1d/d75/d51/dd7/de3/f110 x:0 0 0 2024-03-28T13:08:47.664 INFO:tasks.workunit.client.0.smithi076.stdout:3/639: symlink d1/d7/d30/d60/le1 0 2024-03-28T13:08:47.717 INFO:tasks.workunit.client.0.smithi076.stdout:4/773: creat d0/d20/d7f/dda/db7/f106 x:0 0 0 2024-03-28T13:08:47.721 INFO:tasks.workunit.client.0.smithi076.stdout:4/774: dread d0/d3b/d40/d42/fc1 [0,4194304] 0 2024-03-28T13:08:47.862 INFO:tasks.workunit.client.0.smithi076.stdout:6/789: link d6/da/d23/f80 d6/d99/f100 0 2024-03-28T13:08:47.964 INFO:tasks.workunit.client.0.smithi076.stdout:8/764: rename de/d13/d27/c9f to de/d23/d2b/d5d/d76/d18/c10a 0 2024-03-28T13:08:47.964 INFO:tasks.workunit.client.0.smithi076.stdout:2/769: symlink d2/d75/lec 0 2024-03-28T13:08:47.964 INFO:tasks.workunit.client.0.smithi076.stdout:2/770: readlink d2/d5/l3c 0 2024-03-28T13:08:48.138 INFO:tasks.workunit.client.0.smithi076.stdout:0/761: chown db/dc/df/d71/d4a 45 1 2024-03-28T13:08:48.139 INFO:tasks.workunit.client.0.smithi076.stdout:0/762: truncate db/dc/df/d71/f6a 2495044 0 2024-03-28T13:08:48.139 INFO:tasks.workunit.client.0.smithi076.stdout:3/640: creat d1/d7/d30/d5f/fe2 x:0 0 0 2024-03-28T13:08:48.167 INFO:tasks.workunit.client.0.smithi076.stdout:3/641: dwrite d1/d7/d30/d38/d9b/fc8 [4194304,4194304] 0 2024-03-28T13:08:48.326 INFO:tasks.workunit.client.0.smithi076.stdout:8/765: link de/d23/d2b/d51/d62/lb2 de/d23/d2b/d5d/d76/d6e/d7a/ddf/l10b 0 2024-03-28T13:08:48.326 INFO:tasks.workunit.client.0.smithi076.stdout:2/771: fsync d2/d5/db/d3b/d3f/d99/fd7 0 2024-03-28T13:08:48.326 INFO:tasks.workunit.client.0.smithi076.stdout:2/772: write d2/d5/d7/d28/d64/fab [1003914,12119] 0 2024-03-28T13:08:48.354 INFO:tasks.workunit.client.0.smithi076.stdout:2/773: dwrite d2/d5/d7/d8/d21/f5e [0,4194304] 0 2024-03-28T13:08:48.466 INFO:tasks.workunit.client.0.smithi076.stdout:0/763: mknod db/dc/df/d18/d1d/d75/d51/d60/d92/c111 0 2024-03-28T13:08:48.473 INFO:tasks.workunit.client.0.smithi076.stdout:0/764: dread db/dc/df/d11/d40/d77/da2/f6b [0,4194304] 0 2024-03-28T13:08:48.771 INFO:tasks.workunit.client.0.smithi076.stdout:4/775: rmdir d0/d3b/d40/d42/d47/d69/da9 39 2024-03-28T13:08:48.771 INFO:tasks.workunit.client.0.smithi076.stdout:4/776: chown d0/d20/d7f/dda/le 200598741 1 2024-03-28T13:08:48.772 INFO:tasks.workunit.client.0.smithi076.stdout:2/774: mknod d2/d5/db/d3b/d94/ced 0 2024-03-28T13:08:48.772 INFO:tasks.workunit.client.0.smithi076.stdout:4/777: getdents d0/d3b/d40/d42/d31 0 2024-03-28T13:08:48.853 INFO:tasks.workunit.client.0.smithi076.stdout:0/765: dread db/dc/df/d11/fa3 [0,4194304] 0 2024-03-28T13:08:48.866 INFO:tasks.workunit.client.0.smithi076.stdout:9/781: sync 2024-03-28T13:08:49.008 INFO:tasks.workunit.client.0.smithi076.stdout:4/778: symlink d0/d20/l107 0 2024-03-28T13:08:49.008 INFO:tasks.workunit.client.0.smithi076.stdout:4/779: chown d0/d3b/d40/d42/d31/d5e/d72/d78/dcc/fd8 3238 1 2024-03-28T13:08:49.008 INFO:tasks.workunit.client.0.smithi076.stdout:4/780: chown d0/d3b/d40/d42/fec 61328 1 2024-03-28T13:08:49.008 INFO:tasks.workunit.client.0.smithi076.stdout:4/781: dread - d0/d20/d7f/dda/d2d/f101 zero size 2024-03-28T13:08:49.039 INFO:tasks.workunit.client.0.smithi076.stdout:2/775: truncate d2/d5/d7/d8/f6a 4706245 0 2024-03-28T13:08:49.196 INFO:tasks.workunit.client.0.smithi076.stdout:0/766: creat db/da6/f112 x:0 0 0 2024-03-28T13:08:49.374 INFO:tasks.workunit.client.0.smithi076.stdout:4/782: symlink d0/d3b/d40/d42/d28/l108 0 2024-03-28T13:08:49.375 INFO:tasks.workunit.client.0.smithi076.stdout:1/637: sync 2024-03-28T13:08:49.774 INFO:tasks.workunit.client.0.smithi076.stdout:0/767: dread db/fbb [0,4194304] 0 2024-03-28T13:08:49.860 INFO:tasks.workunit.client.0.smithi076.stdout:4/783: mknod d0/d3b/d40/d42/d31/d4d/c109 0 2024-03-28T13:08:49.889 INFO:tasks.workunit.client.0.smithi076.stdout:4/784: dwrite d0/d20/d7f/dda/d2d/d75/fe7 [0,4194304] 0 2024-03-28T13:08:49.890 INFO:tasks.workunit.client.0.smithi076.stdout:4/785: write d0/d20/d7f/dda/d2d/f101 [153714,26771] 0 2024-03-28T13:08:49.961 INFO:tasks.workunit.client.0.smithi076.stdout:1/638: mknod d14/d19/d85/d2e/d31/d49/ce3 0 2024-03-28T13:08:49.961 INFO:tasks.workunit.client.0.smithi076.stdout:1/639: fdatasync d14/d19/d85/d2e/f6a 0 2024-03-28T13:08:49.961 INFO:tasks.workunit.client.0.smithi076.stdout:1/640: chown d14/fb1 10779226 1 2024-03-28T13:08:49.962 INFO:tasks.workunit.client.0.smithi076.stdout:1/641: stat d14/d19/d85/d2e/d3c/ddd 0 2024-03-28T13:08:49.962 INFO:tasks.workunit.client.0.smithi076.stdout:1/642: write d14/d19/d85/d2e/d31/d6f/f81 [1411171,19446] 0 2024-03-28T13:08:50.008 INFO:tasks.workunit.client.0.smithi076.stdout:0/768: creat db/dc/d3d/f113 x:0 0 0 2024-03-28T13:08:50.008 INFO:tasks.workunit.client.0.smithi076.stdout:0/769: readlink db/dd8/le4 0 2024-03-28T13:08:50.123 INFO:tasks.workunit.client.0.smithi076.stdout:4/786: mknod d0/d3b/de8/c10a 0 2024-03-28T13:08:50.123 INFO:tasks.workunit.client.0.smithi076.stdout:4/787: readlink d0/d3b/d50/d64/lb2 0 2024-03-28T13:08:50.198 INFO:tasks.workunit.client.0.smithi076.stdout:0/770: creat db/dd1/f114 x:0 0 0 2024-03-28T13:08:50.199 INFO:tasks.workunit.client.0.smithi076.stdout:7/716: sync 2024-03-28T13:08:50.199 INFO:tasks.workunit.client.0.smithi076.stdout:0/771: write db/dc/df/d11/f84 [808446,79974] 0 2024-03-28T13:08:50.300 INFO:tasks.workunit.client.0.smithi076.stdout:7/717: symlink d1/d8/d37/d53/lff 0 2024-03-28T13:08:50.806 INFO:tasks.workunit.client.0.smithi076.stdout:0/772: creat db/dc/df/d11/d40/dd5/ded/f115 x:0 0 0 2024-03-28T13:08:50.840 INFO:tasks.workunit.client.0.smithi076.stdout:5/769: write d5/d9/d1c/d1d/d31/ded/d91/f108 [1270729,30494] 0 2024-03-28T13:08:51.004 INFO:tasks.workunit.client.0.smithi076.stdout:6/790: write d6/da/d39/f65 [1262152,109373] 0 2024-03-28T13:08:51.021 INFO:tasks.workunit.client.0.smithi076.stdout:6/791: read d6/d99/d46/f74 [719393,46996] 0 2024-03-28T13:08:51.042 INFO:tasks.workunit.client.0.smithi076.stdout:3/642: truncate d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/f59 4702799 0 2024-03-28T13:08:51.136 INFO:tasks.workunit.client.0.smithi076.stdout:0/773: mknod db/dc/df/d18/d1d/d21/c116 0 2024-03-28T13:08:51.186 INFO:tasks.workunit.client.0.smithi076.stdout:5/770: getdents d5/d9/d1c/d25/dbd 0 2024-03-28T13:08:51.334 INFO:tasks.workunit.client.0.smithi076.stdout:3/643: link d1/d7/d30/d38/d14/d36/d56/d5b/d6d/ld0 d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/db5/le3 0 2024-03-28T13:08:51.422 INFO:tasks.workunit.client.0.smithi076.stdout:5/771: symlink d5/db/d3f/d97/l11e 0 2024-03-28T13:08:52.125 INFO:tasks.workunit.client.0.smithi076.stdout:5/772: symlink d5/d9/d35/l11f 0 2024-03-28T13:08:52.125 INFO:tasks.workunit.client.0.smithi076.stdout:5/773: write d5/d9/d1c/d1d/d31/ded/d91/f9c [132724,98542] 0 2024-03-28T13:08:52.126 INFO:tasks.workunit.client.0.smithi076.stdout:5/774: chown d5/db/d3f/c9e 83 1 2024-03-28T13:08:52.326 INFO:tasks.workunit.client.0.smithi076.stdout:3/644: mkdir d1/d7/d30/d38/d14/d27/d42/de4 0 2024-03-28T13:08:52.363 INFO:tasks.workunit.client.0.smithi076.stdout:4/788: dwrite d0/d3b/d40/d42/f37 [0,4194304] 0 2024-03-28T13:08:52.363 INFO:tasks.workunit.client.0.smithi076.stdout:4/789: dread - d0/d3b/d40/d42/d31/d4d/d63/ffe zero size 2024-03-28T13:08:52.363 INFO:tasks.workunit.client.0.smithi076.stdout:4/790: dread - d0/d3b/d40/d42/d31/f8f zero size 2024-03-28T13:08:52.363 INFO:tasks.workunit.client.0.smithi076.stdout:4/791: dread - d0/d3b/d50/d64/fd3 zero size 2024-03-28T13:08:52.374 INFO:tasks.workunit.client.0.smithi076.stdout:3/645: dwrite d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/f24 [0,4194304] 0 2024-03-28T13:08:52.399 INFO:tasks.workunit.client.0.smithi076.stdout:3/646: dwrite d1/d7/d30/d38/fb7 [0,4194304] 0 2024-03-28T13:08:52.456 INFO:tasks.workunit.client.0.smithi076.stdout:2/776: mknod d2/d5/cee 0 2024-03-28T13:08:52.591 INFO:tasks.workunit.client.0.smithi076.stdout:5/775: creat d5/db/d3f/f120 x:0 0 0 2024-03-28T13:08:52.774 INFO:tasks.workunit.client.0.smithi076.stdout:3/647: truncate d1/d7/d30/d38/d14/d27/f80 1848482 0 2024-03-28T13:08:52.774 INFO:tasks.workunit.client.0.smithi076.stdout:6/792: write d6/f3c [919191,56985] 0 2024-03-28T13:08:52.774 INFO:tasks.workunit.client.0.smithi076.stdout:3/648: write d1/d7/d30/d38/d14/d36/d56/d5b/d6d/f83 [167687,37004] 0 2024-03-28T13:08:52.779 INFO:tasks.workunit.client.0.smithi076.stdout:3/649: write d1/d7/d30/d38/d14/f8e [39918,45572] 0 2024-03-28T13:08:52.801 INFO:tasks.workunit.client.0.smithi076.stdout:2/777: mknod d2/d5/d4b/cef 0 2024-03-28T13:08:52.806 INFO:tasks.workunit.client.0.smithi076.stdout:6/793: dwrite d6/da/d1e/f1f [0,4194304] 0 2024-03-28T13:08:52.835 INFO:tasks.workunit.client.0.smithi076.stdout:6/794: dwrite d6/da/d1e/f4a [8388608,4194304] 0 2024-03-28T13:08:53.008 INFO:tasks.workunit.client.0.smithi076.stdout:0/774: write db/d16/fe9 [1543352,90662] 0 2024-03-28T13:08:53.037 INFO:tasks.workunit.client.0.smithi076.stdout:0/775: dwrite db/dd8/ff9 [0,4194304] 0 2024-03-28T13:08:53.037 INFO:tasks.workunit.client.0.smithi076.stdout:0/776: read - db/dd8/ff5 zero size 2024-03-28T13:08:53.038 INFO:tasks.workunit.client.0.smithi076.stdout:0/777: fsync db/dc/faa 0 2024-03-28T13:08:53.133 INFO:tasks.workunit.client.0.smithi076.stdout:5/776: symlink d5/d9/d35/d3b/d115/l121 0 2024-03-28T13:08:53.133 INFO:tasks.workunit.client.0.smithi076.stdout:5/777: write d5/db/d3f/f8f [919288,40474] 0 2024-03-28T13:08:53.419 INFO:tasks.workunit.client.0.smithi076.stdout:8/766: rename de/d23/c82 to de/d4e/c10c 0 2024-03-28T13:08:53.419 INFO:tasks.workunit.client.0.smithi076.stdout:8/767: chown de/d23/d2b/d5d/d76/l14 20818365 1 2024-03-28T13:08:53.582 INFO:tasks.workunit.client.0.smithi076.stdout:9/782: creat d9/fef x:0 0 0 2024-03-28T13:08:53.764 INFO:tasks.workunit.client.0.smithi076.stdout:0/778: creat db/dc/df/d18/d1d/d75/d51/d60/f117 x:0 0 0 2024-03-28T13:08:53.764 INFO:tasks.workunit.client.0.smithi076.stdout:5/778: symlink d5/d9/d1c/d1d/d22/l122 0 2024-03-28T13:08:53.787 INFO:tasks.workunit.client.0.smithi076.stdout:0/779: dwrite db/dc/df/d18/d9f/fb2 [0,4194304] 0 2024-03-28T13:08:53.926 INFO:tasks.workunit.client.0.smithi076.stdout:8/768: creat de/d23/d2b/d5d/d76/d18/d49/f10d x:0 0 0 2024-03-28T13:08:53.928 INFO:tasks.workunit.client.0.smithi076.stdout:8/769: dread de/d23/fc2 [0,4194304] 0 2024-03-28T13:08:53.928 INFO:tasks.workunit.client.0.smithi076.stdout:8/770: chown de/d23/d2b/d5d/d76/d6e/d7a/ddf/l10b 139 1 2024-03-28T13:08:53.932 INFO:tasks.workunit.client.0.smithi076.stdout:9/783: unlink d9/dd/df/d11/d14/d58/d6e/f9b 0 2024-03-28T13:08:54.107 INFO:tasks.workunit.client.0.smithi076.stdout:5/779: symlink d5/d9/d1c/l123 0 2024-03-28T13:08:54.497 INFO:tasks.workunit.client.0.smithi076.stdout:0/780: creat db/dc/df/d18/d1d/d21/dd2/df1/f118 x:0 0 0 2024-03-28T13:08:54.498 INFO:tasks.workunit.client.0.smithi076.stdout:0/781: chown db/d16/cc8 27109 1 2024-03-28T13:08:54.504 INFO:tasks.workunit.client.0.smithi076.stdout:8/771: truncate de/d23/d2b/f30 1561632 0 2024-03-28T13:08:54.504 INFO:tasks.workunit.client.0.smithi076.stdout:8/772: fdatasync de/d23/d2b/d5d/d76/d6e/d7a/f101 0 2024-03-28T13:08:54.505 INFO:tasks.workunit.client.0.smithi076.stdout:5/780: mknod d5/d9/d1c/d1d/d22/d9d/dcb/c124 0 2024-03-28T13:08:54.691 INFO:tasks.workunit.client.0.smithi076.stdout:8/773: symlink de/d23/d2b/d5d/d76/d6e/dcd/l10e 0 2024-03-28T13:08:54.736 INFO:tasks.workunit.client.0.smithi076.stdout:5/781: creat d5/d9/d1c/d1d/d22/d9d/dcb/f125 x:0 0 0 2024-03-28T13:08:55.750 INFO:tasks.workunit.client.0.smithi076.stdout:3/650: sync 2024-03-28T13:08:55.751 INFO:tasks.workunit.client.0.smithi076.stdout:4/792: sync 2024-03-28T13:08:55.755 INFO:tasks.workunit.client.0.smithi076.stdout:3/651: dread d1/d7/d30/d38/d14/d4a/fbe [0,4194304] 0 2024-03-28T13:08:55.768 INFO:tasks.workunit.client.0.smithi076.stdout:4/793: dread d0/d3b/d40/d42/d31/fde [4194304,4194304] 0 2024-03-28T13:08:55.780 INFO:tasks.workunit.client.0.smithi076.stdout:1/643: rename d14/d19/d85/d2e/d31/f8c to d14/d6c/d74/fe4 0 2024-03-28T13:08:55.811 INFO:tasks.workunit.client.0.smithi076.stdout:6/795: dwrite d6/da/d40/d56/d84/fb6 [0,4194304] 0 2024-03-28T13:08:55.811 INFO:tasks.workunit.client.0.smithi076.stdout:6/796: fdatasync d6/da/d23/f43 0 2024-03-28T13:08:55.874 INFO:tasks.workunit.client.0.smithi076.stdout:3/652: symlink d1/d7/d30/d38/d14/d27/d42/de4/le5 0 2024-03-28T13:08:55.888 INFO:tasks.workunit.client.0.smithi076.stdout:3/653: dread d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d58/f6f [0,4194304] 0 2024-03-28T13:08:55.962 INFO:tasks.workunit.client.0.smithi076.stdout:4/794: link d0/d20/d7f/dda/f5f d0/d3b/d40/d42/d31/d5e/f10b 0 2024-03-28T13:08:56.000 INFO:tasks.workunit.client.0.smithi076.stdout:4/795: dwrite d0/d3b/d40/d42/d31/d5e/f4b [0,4194304] 0 2024-03-28T13:08:56.005 INFO:tasks.workunit.client.0.smithi076.stdout:4/796: dread d0/d3b/d40/d42/d31/d5e/d72/d78/dcc/fd8 [0,4194304] 0 2024-03-28T13:08:56.005 INFO:tasks.workunit.client.0.smithi076.stdout:4/797: write d0/d20/d7f/dda/db7/ff3 [582147,112620] 0 2024-03-28T13:08:56.005 INFO:tasks.workunit.client.0.smithi076.stdout:4/798: write d0/f43 [5205919,84479] 0 2024-03-28T13:08:56.066 INFO:tasks.workunit.client.0.smithi076.stdout:7/718: rename d1/d18/d3c/d48/d69/d79/de9 to d1/d8/dc2/d100 0 2024-03-28T13:08:56.133 INFO:tasks.workunit.client.0.smithi076.stdout:1/644: unlink d14/d19/d85/d2e/l5e 0 2024-03-28T13:08:56.322 INFO:tasks.workunit.client.0.smithi076.stdout:3/654: unlink d1/d7/d30/d38/d14/d27/d42/c9f 0 2024-03-28T13:08:56.322 INFO:tasks.workunit.client.0.smithi076.stdout:6/797: mkdir d6/da/d1e/dce/d101 0 2024-03-28T13:08:56.323 INFO:tasks.workunit.client.0.smithi076.stdout:6/798: chown d6/da/d89 1118 1 2024-03-28T13:08:56.432 INFO:tasks.workunit.client.0.smithi076.stdout:4/799: read d0/d3b/d40/d42/d31/d4d/f54 [6491497,38836] 0 2024-03-28T13:08:56.506 INFO:tasks.workunit.client.0.smithi076.stdout:2/778: rename d2/d5/db/c33 to d2/d5/d7/dd/cf0 0 2024-03-28T13:08:56.545 INFO:tasks.workunit.client.0.smithi076.stdout:7/719: rmdir d1/d8/d37 39 2024-03-28T13:08:56.576 INFO:tasks.workunit.client.0.smithi076.stdout:7/720: dwrite d1/d81/fcd [0,4194304] 0 2024-03-28T13:08:56.592 INFO:tasks.workunit.client.0.smithi076.stdout:1/645: mknod d14/d19/d85/d2e/d31/d3b/ce5 0 2024-03-28T13:08:56.821 INFO:tasks.workunit.client.0.smithi076.stdout:0/782: sync 2024-03-28T13:08:56.821 INFO:tasks.workunit.client.0.smithi076.stdout:8/774: sync 2024-03-28T13:08:56.821 INFO:tasks.workunit.client.0.smithi076.stdout:8/775: readlink de/d4e/db6/dde/lf0 0 2024-03-28T13:08:56.990 INFO:tasks.workunit.client.0.smithi076.stdout:3/655: unlink d1/c46 0 2024-03-28T13:08:57.224 INFO:tasks.workunit.client.0.smithi076.stdout:4/800: symlink d0/d3b/d50/da8/l10c 0 2024-03-28T13:08:57.235 INFO:tasks.workunit.client.0.smithi076.stdout:9/784: rename d9/dd/c52 to d9/d74/d7d/cf0 0 2024-03-28T13:08:57.235 INFO:tasks.workunit.client.0.smithi076.stdout:9/785: stat d9/da/f68 0 2024-03-28T13:08:57.235 INFO:tasks.workunit.client.0.smithi076.stdout:2/779: truncate d2/d5/d7/fa 1150558 0 2024-03-28T13:08:57.244 INFO:tasks.workunit.client.0.smithi076.stdout:4/801: dread d0/d3b/d40/d42/f24 [0,4194304] 0 2024-03-28T13:08:57.272 INFO:tasks.workunit.client.0.smithi076.stdout:4/802: dwrite d0/d3b/d40/d42/d47/d69/da9/fe9 [0,4194304] 0 2024-03-28T13:08:57.746 INFO:tasks.workunit.client.0.smithi076.stdout:7/721: read d1/f5 [554591,64978] 0 2024-03-28T13:08:57.746 INFO:tasks.workunit.client.0.smithi076.stdout:7/722: dread - d1/d18/d3c/d7b/d7d/fca zero size 2024-03-28T13:08:57.746 INFO:tasks.workunit.client.0.smithi076.stdout:0/783: creat db/dc/df/d71/d4a/d7e/f119 x:0 0 0 2024-03-28T13:08:57.746 INFO:tasks.workunit.client.0.smithi076.stdout:1/646: creat d14/d19/d85/d2e/d31/d51/d92/da4/db7/fe6 x:0 0 0 2024-03-28T13:08:57.896 INFO:tasks.workunit.client.0.smithi076.stdout:3/656: truncate d1/d7/d30/d38/f35 1388726 0 2024-03-28T13:08:57.897 INFO:tasks.workunit.client.0.smithi076.stdout:5/782: rename d5/d9/d1c/d25/dbd/d7a/de2/cf2 to d5/d9/d35/d3b/c126 0 2024-03-28T13:08:57.897 INFO:tasks.workunit.client.0.smithi076.stdout:5/783: dread - d5/d9/d1c/d25/d60/fc5 zero size 2024-03-28T13:08:57.897 INFO:tasks.workunit.client.0.smithi076.stdout:9/786: creat d9/d74/d7d/ff1 x:0 0 0 2024-03-28T13:08:57.897 INFO:tasks.workunit.client.0.smithi076.stdout:2/780: creat d2/d5/d7/d8/d21/ff1 x:0 0 0 2024-03-28T13:08:57.905 INFO:tasks.workunit.client.0.smithi076.stdout:4/803: mknod d0/d3b/d40/d42/d31/d5e/dc3/c10d 0 2024-03-28T13:08:57.926 INFO:tasks.workunit.client.0.smithi076.stdout:8/776: read de/d23/d2b/d51/d60/f73 [385104,6100] 0 2024-03-28T13:08:57.927 INFO:tasks.workunit.client.0.smithi076.stdout:5/784: write d5/d9/d35/fea [951649,99417] 0 2024-03-28T13:08:57.950 INFO:tasks.workunit.client.0.smithi076.stdout:4/804: dread d0/d20/d7f/dda/f18 [0,4194304] 0 2024-03-28T13:08:57.952 INFO:tasks.workunit.client.0.smithi076.stdout:2/781: dwrite d2/d5/d7/f23 [0,4194304] 0 2024-03-28T13:08:58.265 INFO:tasks.workunit.client.0.smithi076.stdout:0/784: mknod db/dc/df/d18/d1d/d75/d51/d97/c11a 0 2024-03-28T13:08:58.265 INFO:tasks.workunit.client.0.smithi076.stdout:7/723: symlink d1/d8/d37/l101 0 2024-03-28T13:08:58.265 INFO:tasks.workunit.client.0.smithi076.stdout:7/724: stat d1/d8/f35 0 2024-03-28T13:08:58.265 INFO:tasks.workunit.client.0.smithi076.stdout:0/785: dread - db/dc/df/d18/d1d/f10c zero size 2024-03-28T13:08:58.413 INFO:tasks.workunit.client.0.smithi076.stdout:1/647: creat d14/d6c/fe7 x:0 0 0 2024-03-28T13:08:58.413 INFO:tasks.workunit.client.0.smithi076.stdout:8/777: rename de/d23/d2b/d5d/d76/d18/d3c/ffb to de/d23/d2b/d51/d60/f10f 0 2024-03-28T13:08:58.425 INFO:tasks.workunit.client.0.smithi076.stdout:8/778: dread de/f10 [0,4194304] 0 2024-03-28T13:08:58.425 INFO:tasks.workunit.client.0.smithi076.stdout:8/779: read de/d23/d2b/d51/d60/f73 [558094,42518] 0 2024-03-28T13:08:58.429 INFO:tasks.workunit.client.0.smithi076.stdout:5/785: symlink d5/d9/d35/d3b/l127 0 2024-03-28T13:08:58.768 INFO:tasks.workunit.client.0.smithi076.stdout:6/799: sync 2024-03-28T13:08:59.056 INFO:tasks.workunit.client.0.smithi076.stdout:4/805: chown d0/d3b/d40/d42/d47/d7c/ld9 2500025 1 2024-03-28T13:08:59.056 INFO:tasks.workunit.client.0.smithi076.stdout:4/806: chown d0/c1a 17 1 2024-03-28T13:08:59.056 INFO:tasks.workunit.client.0.smithi076.stdout:2/782: creat d2/d5/d4b/d39/d57/de9/ff2 x:0 0 0 2024-03-28T13:08:59.056 INFO:tasks.workunit.client.0.smithi076.stdout:2/783: truncate d2/d5/db/d3b/d5a/d8d/fd2 1031726 0 2024-03-28T13:08:59.057 INFO:tasks.workunit.client.0.smithi076.stdout:1/648: unlink d14/d19/d85/cbc 0 2024-03-28T13:08:59.111 INFO:tasks.workunit.client.0.smithi076.stdout:2/784: dwrite d2/d75/fdc [0,4194304] 0 2024-03-28T13:08:59.167 INFO:tasks.workunit.client.0.smithi076.stdout:8/780: dread de/d23/d2b/d5d/d76/d18/d3c/f9a [0,4194304] 0 2024-03-28T13:08:59.199 INFO:tasks.workunit.client.0.smithi076.stdout:8/781: dwrite de/d13/ff6 [0,4194304] 0 2024-03-28T13:08:59.200 INFO:tasks.workunit.client.0.smithi076.stdout:8/782: dread de/d23/d2b/d5d/d76/d18/d3c/f9a [0,4194304] 0 2024-03-28T13:08:59.212 INFO:tasks.workunit.client.0.smithi076.stdout:5/786: mkdir d5/db/d19/d34/d128 0 2024-03-28T13:08:59.212 INFO:tasks.workunit.client.0.smithi076.stdout:5/787: fdatasync d5/d9/d35/fea 0 2024-03-28T13:08:59.212 INFO:tasks.workunit.client.0.smithi076.stdout:5/788: write d5/d9/d1c/d1d/fa6 [368476,8082] 0 2024-03-28T13:08:59.216 INFO:tasks.workunit.client.0.smithi076.stdout:8/783: write de/d23/d2b/d5d/d76/d6e/d7a/f92 [2971100,71786] 0 2024-03-28T13:08:59.219 INFO:tasks.workunit.client.0.smithi076.stdout:5/789: read d5/db/d3f/d42/f83 [10218233,41940] 0 2024-03-28T13:08:59.345 INFO:tasks.workunit.client.0.smithi076.stdout:4/807: link d0/d20/d7f/dda/d2d/d75/la4 d0/d3b/d50/da8/l10e 0 2024-03-28T13:08:59.362 INFO:tasks.workunit.client.0.smithi076.stdout:4/808: dread d0/d20/d7f/dda/fa7 [4194304,4194304] 0 2024-03-28T13:08:59.396 INFO:tasks.workunit.client.0.smithi076.stdout:4/809: dwrite d0/d20/d7f/dda/d2d/f35 [4194304,4194304] 0 2024-03-28T13:08:59.397 INFO:tasks.workunit.client.0.smithi076.stdout:4/810: write d0/d20/d7f/dda/db7/ff0 [261001,98328] 0 2024-03-28T13:08:59.397 INFO:tasks.workunit.client.0.smithi076.stdout:4/811: chown d0/d3b/de8 3 1 2024-03-28T13:08:59.470 INFO:tasks.workunit.client.0.smithi076.stdout:1/649: creat d14/d19/d85/d2e/d31/d49/fe8 x:0 0 0 2024-03-28T13:08:59.471 INFO:tasks.workunit.client.0.smithi076.stdout:1/650: write d14/d6c/fa7 [645820,76754] 0 2024-03-28T13:08:59.471 INFO:tasks.workunit.client.0.smithi076.stdout:1/651: stat d14/d19/d85/d2e/d91/fa0 0 2024-03-28T13:08:59.471 INFO:tasks.workunit.client.0.smithi076.stdout:1/652: chown d14/d19/d85/d2e/d31/d49 1699757040 1 2024-03-28T13:08:59.561 INFO:tasks.workunit.client.0.smithi076.stdout:2/785: creat d2/d5/d7/d3e/ff3 x:0 0 0 2024-03-28T13:08:59.787 INFO:tasks.workunit.client.0.smithi076.stdout:7/725: getdents d1/d8/d37 0 2024-03-28T13:08:59.842 INFO:tasks.workunit.client.0.smithi076.stdout:8/784: unlink de/d23/d2b/d51/d60/d89/lf1 0 2024-03-28T13:08:59.980 INFO:tasks.workunit.client.0.smithi076.stdout:6/800: mknod d6/da/d5f/d7e/dc8/c102 0 2024-03-28T13:08:59.980 INFO:tasks.workunit.client.0.smithi076.stdout:6/801: chown d6/da/d23/f45 0 1 2024-03-28T13:09:00.090 INFO:tasks.workunit.client.0.smithi076.stdout:1/653: mknod d14/d19/d85/d2e/d31/d49/ce9 0 2024-03-28T13:09:00.129 INFO:tasks.workunit.client.0.smithi076.stdout:2/786: dwrite d2/d5/db/d3b/d3f/d99/fd9 [0,4194304] 0 2024-03-28T13:09:00.144 INFO:tasks.workunit.client.0.smithi076.stdout:1/654: dwrite f8 [0,4194304] 0 2024-03-28T13:09:00.153 INFO:tasks.workunit.client.0.smithi076.stdout:2/787: write d2/d5/d7/d8/d21/fe3 [965652,116667] 0 2024-03-28T13:09:00.185 INFO:tasks.workunit.client.0.smithi076.stdout:7/726: creat d1/d81/dd7/f102 x:0 0 0 2024-03-28T13:09:00.186 INFO:tasks.workunit.client.0.smithi076.stdout:7/727: read - d1/dc/ff0 zero size 2024-03-28T13:09:00.186 INFO:tasks.workunit.client.0.smithi076.stdout:7/728: chown d1/d8/d37/d53/lff 627 1 2024-03-28T13:09:00.186 INFO:tasks.workunit.client.0.smithi076.stdout:7/729: truncate d1/d8/d37/d53/dae/fd1 4198146 0 2024-03-28T13:09:00.217 INFO:tasks.workunit.client.0.smithi076.stdout:7/730: dwrite d1/d8/d37/f43 [4194304,4194304] 0 2024-03-28T13:09:00.341 INFO:tasks.workunit.client.0.smithi076.stdout:6/802: rmdir d6/da/d39 39 2024-03-28T13:09:00.341 INFO:tasks.workunit.client.0.smithi076.stdout:8/785: creat de/f110 x:0 0 0 2024-03-28T13:09:00.369 INFO:tasks.workunit.client.0.smithi076.stdout:4/812: symlink d0/d3b/d40/d42/d47/l10f 0 2024-03-28T13:09:00.759 INFO:tasks.workunit.client.0.smithi076.stdout:2/788: symlink d2/lf4 0 2024-03-28T13:09:00.759 INFO:tasks.workunit.client.0.smithi076.stdout:1/655: link d14/d19/d85/d3f/c76 d14/d19/d20/cea 0 2024-03-28T13:09:00.760 INFO:tasks.workunit.client.0.smithi076.stdout:1/656: chown d14/d19/d85/d2e/f5a 143522054 1 2024-03-28T13:09:00.799 INFO:tasks.workunit.client.0.smithi076.stdout:1/657: dwrite f5 [4194304,4194304] 0 2024-03-28T13:09:00.799 INFO:tasks.workunit.client.0.smithi076.stdout:1/658: dread - d14/d19/d85/d2e/fce zero size 2024-03-28T13:09:00.799 INFO:tasks.workunit.client.0.smithi076.stdout:1/659: chown d14/d19/d85/d2e/d31 1850936 1 2024-03-28T13:09:00.966 INFO:tasks.workunit.client.0.smithi076.stdout:6/803: unlink d6/da/d40/d56/dd2/ff0 0 2024-03-28T13:09:01.061 INFO:tasks.workunit.client.0.smithi076.stdout:8/786: mknod de/d23/d2b/d51/d62/c111 0 2024-03-28T13:09:01.184 INFO:tasks.workunit.client.0.smithi076.stdout:4/813: truncate d0/d3b/d40/d42/d31/fde 6157186 0 2024-03-28T13:09:01.184 INFO:tasks.workunit.client.0.smithi076.stdout:4/814: dread - d0/d20/d7f/dda/fee zero size 2024-03-28T13:09:01.399 INFO:tasks.workunit.client.0.smithi076.stdout:0/786: sync 2024-03-28T13:09:01.399 INFO:tasks.workunit.client.0.smithi076.stdout:3/657: sync 2024-03-28T13:09:01.399 INFO:tasks.workunit.client.0.smithi076.stdout:9/787: sync 2024-03-28T13:09:01.436 INFO:tasks.workunit.client.0.smithi076.stdout:3/658: dwrite d1/d7/d30/d38/d14/d4a/f5a [0,4194304] 0 2024-03-28T13:09:01.437 INFO:tasks.workunit.client.0.smithi076.stdout:3/659: write d1/d7/d30/d5f/f9d [4341170,90689] 0 2024-03-28T13:09:01.443 INFO:tasks.workunit.client.0.smithi076.stdout:9/788: dwrite d9/da/fc3 [0,4194304] 0 2024-03-28T13:09:01.461 INFO:tasks.workunit.client.0.smithi076.stdout:9/789: dread d9/d3c/f5a [0,4194304] 0 2024-03-28T13:09:01.795 INFO:tasks.workunit.client.0.smithi076.stdout:7/731: rename d1/d18/d3c/fb7 to d1/d18/d3c/d48/f103 0 2024-03-28T13:09:01.795 INFO:tasks.workunit.client.0.smithi076.stdout:7/732: fdatasync d1/d8/dc2/d100/fa2 0 2024-03-28T13:09:01.834 INFO:tasks.workunit.client.0.smithi076.stdout:6/804: symlink d6/da/d23/ddf/l103 0 2024-03-28T13:09:01.834 INFO:tasks.workunit.client.0.smithi076.stdout:6/805: chown d6/f3c 341360 1 2024-03-28T13:09:01.852 INFO:tasks.workunit.client.0.smithi076.stdout:6/806: dread d6/da/d23/ddf/fe9 [4194304,4194304] 0 2024-03-28T13:09:01.852 INFO:tasks.workunit.client.0.smithi076.stdout:8/787: creat de/d13/da2/f112 x:0 0 0 2024-03-28T13:09:01.916 INFO:tasks.workunit.client.0.smithi076.stdout:4/815: symlink d0/d20/d7b/d94/l110 0 2024-03-28T13:09:02.308 INFO:tasks.workunit.client.0.smithi076.stdout:0/787: rename db/d16/l5a to db/dc/df/d18/d1d/d75/l11b 0 2024-03-28T13:09:02.308 INFO:tasks.workunit.client.0.smithi076.stdout:0/788: chown db/dc/df/d71/d4a/d7e 90644 1 2024-03-28T13:09:02.556 INFO:tasks.workunit.client.0.smithi076.stdout:7/733: rmdir d1/d81/dc3/dfc 0 2024-03-28T13:09:02.660 INFO:tasks.workunit.client.0.smithi076.stdout:6/807: creat d6/da/d1e/dce/f104 x:0 0 0 2024-03-28T13:09:03.131 INFO:tasks.workunit.client.0.smithi076.stdout:3/660: rename d1/d7/ccf to d1/d7/d30/d38/d14/d4a/ddc/ce6 0 2024-03-28T13:09:03.132 INFO:tasks.workunit.client.0.smithi076.stdout:7/734: mkdir d1/d8/dc2/dc4/d104 0 2024-03-28T13:09:03.132 INFO:tasks.workunit.client.0.smithi076.stdout:3/661: fdatasync d1/f63 0 2024-03-28T13:09:03.132 INFO:tasks.workunit.client.0.smithi076.stdout:5/790: unlink d5/d9/l55 0 2024-03-28T13:09:03.164 INFO:tasks.workunit.client.0.smithi076.stdout:3/662: dwrite d1/d7/d30/d38/d14/d97/fcc [0,4194304] 0 2024-03-28T13:09:03.177 INFO:tasks.workunit.client.0.smithi076.stdout:7/735: dwrite d1/d18/d3c/d7b/fd2 [0,4194304] 0 2024-03-28T13:09:03.508 INFO:tasks.workunit.client.0.smithi076.stdout:4/816: rename d0/d3b/d50/de6/cfa to d0/d3b/d40/d42/d31/d5e/c111 0 2024-03-28T13:09:03.508 INFO:tasks.workunit.client.0.smithi076.stdout:4/817: truncate d0/d3b/d40/d42/d28/f7e 8510212 0 2024-03-28T13:09:03.717 INFO:tasks.workunit.client.0.smithi076.stdout:7/736: truncate d1/d81/fcd 1841808 0 2024-03-28T13:09:03.717 INFO:tasks.workunit.client.0.smithi076.stdout:7/737: fdatasync d1/d18/d2d/f34 0 2024-03-28T13:09:03.781 INFO:tasks.workunit.client.0.smithi076.stdout:1/660: dwrite d14/d19/f34 [0,4194304] 0 2024-03-28T13:09:03.781 INFO:tasks.workunit.client.0.smithi076.stdout:1/661: read fd [893485,125772] 0 2024-03-28T13:09:03.845 INFO:tasks.workunit.client.0.smithi076.stdout:0/789: rename db/dc/df/d18/d1d/d75/d51/cda to db/da6/c11c 0 2024-03-28T13:09:04.132 INFO:tasks.workunit.client.0.smithi076.stdout:7/738: rmdir d1/dc/dba 0 2024-03-28T13:09:04.388 INFO:tasks.workunit.client.0.smithi076.stdout:0/790: symlink db/dc/df/d18/d9f/l11d 0 2024-03-28T13:09:04.389 INFO:tasks.workunit.client.0.smithi076.stdout:0/791: chown db/d16/c45 0 1 2024-03-28T13:09:04.473 INFO:tasks.workunit.client.0.smithi076.stdout:9/790: dwrite d9/dd/d48/fc1 [0,4194304] 0 2024-03-28T13:09:04.473 INFO:tasks.workunit.client.0.smithi076.stdout:9/791: chown d9/l77 0 1 2024-03-28T13:09:04.473 INFO:tasks.workunit.client.0.smithi076.stdout:9/792: chown d9/dd/df/d11/d14/d58/d6e/d2a/c72 32729 1 2024-03-28T13:09:04.516 INFO:tasks.workunit.client.0.smithi076.stdout:9/793: dwrite d9/dd/df/fde [0,4194304] 0 2024-03-28T13:09:04.517 INFO:tasks.workunit.client.0.smithi076.stdout:9/794: write d9/dd/df/d11/fac [268238,47495] 0 2024-03-28T13:09:04.529 INFO:tasks.workunit.client.0.smithi076.stdout:9/795: dread d9/dd/df/d11/d14/f4e [0,4194304] 0 2024-03-28T13:09:04.529 INFO:tasks.workunit.client.0.smithi076.stdout:9/796: stat d9/l19 0 2024-03-28T13:09:04.648 INFO:tasks.workunit.client.0.smithi076.stdout:0/792: mkdir db/dc/df/d71/d11e 0 2024-03-28T13:09:04.893 INFO:tasks.workunit.client.0.smithi076.stdout:9/797: truncate d9/dd/df/d11/d14/d58/d6e/fd6 3477300 0 2024-03-28T13:09:04.897 INFO:tasks.workunit.client.0.smithi076.stdout:9/798: dread d9/dd/df/d11/db2/fe0 [4194304,4194304] 0 2024-03-28T13:09:04.897 INFO:tasks.workunit.client.0.smithi076.stdout:9/799: write d9/dd/df/d11/fe3 [862275,68625] 0 2024-03-28T13:09:05.141 INFO:tasks.workunit.client.0.smithi076.stdout:0/793: rename db/dc/df/d11/lc2 to db/dc/df/d18/d1d/d75/d51/d60/d89/l11f 0 2024-03-28T13:09:05.154 INFO:tasks.workunit.client.0.smithi076.stdout:9/800: mkdir d9/da/de6/df2 0 2024-03-28T13:09:05.172 INFO:tasks.workunit.client.0.smithi076.stdout:9/801: dread d9/d3c/f43 [0,4194304] 0 2024-03-28T13:09:05.477 INFO:tasks.workunit.client.0.smithi076.stdout:8/788: write de/f3f [1715765,632] 0 2024-03-28T13:09:05.477 INFO:tasks.workunit.client.0.smithi076.stdout:8/789: write de/d23/d2b/d51/d62/ffe [153212,122711] 0 2024-03-28T13:09:05.504 INFO:tasks.workunit.client.0.smithi076.stdout:2/789: sync 2024-03-28T13:09:05.784 INFO:tasks.workunit.client.0.smithi076.stdout:3/663: write d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d93/fd8 [3256331,41702] 0 2024-03-28T13:09:05.784 INFO:tasks.workunit.client.0.smithi076.stdout:3/664: readlink d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/l2a 0 2024-03-28T13:09:05.845 INFO:tasks.workunit.client.0.smithi076.stdout:8/790: mkdir de/d23/d2b/d5d/d76/d113 0 2024-03-28T13:09:05.936 INFO:tasks.workunit.client.0.smithi076.stdout:1/662: write d14/d19/d20/f27 [1525675,116126] 0 2024-03-28T13:09:06.059 INFO:tasks.workunit.client.0.smithi076.stdout:8/791: creat de/d13/da2/dee/f114 x:0 0 0 2024-03-28T13:09:06.070 INFO:tasks.workunit.client.0.smithi076.stdout:8/792: dread de/d23/d2b/d58/d78/f81 [0,4194304] 0 2024-03-28T13:09:06.070 INFO:tasks.workunit.client.0.smithi076.stdout:3/665: dread d1/d7/d30/d38/d14/d27/f80 [0,4194304] 0 2024-03-28T13:09:06.088 INFO:tasks.workunit.client.0.smithi076.stdout:3/666: dread d1/d7/f78 [0,4194304] 0 2024-03-28T13:09:06.088 INFO:tasks.workunit.client.0.smithi076.stdout:3/667: fdatasync d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/fce 0 2024-03-28T13:09:06.088 INFO:tasks.workunit.client.0.smithi076.stdout:3/668: read - d1/d2/fe0 zero size 2024-03-28T13:09:06.088 INFO:tasks.workunit.client.0.smithi076.stdout:3/669: chown d1/d7/d30/d38/d14/f8c 491689 1 2024-03-28T13:09:06.171 INFO:tasks.workunit.client.0.smithi076.stdout:1/663: dread d14/d19/f4b [0,4194304] 0 2024-03-28T13:09:06.171 INFO:tasks.workunit.client.0.smithi076.stdout:1/664: chown d14/d19/d85/d2e/f6a 19341646 1 2024-03-28T13:09:06.171 INFO:tasks.workunit.client.0.smithi076.stdout:1/665: read d14/d19/d85/d2e/f6a [135780,102073] 0 2024-03-28T13:09:06.223 INFO:tasks.workunit.client.0.smithi076.stdout:8/793: rename de/d23/d2b/d5d/d76/f15 to de/d23/d2b/d5d/f115 0 2024-03-28T13:09:06.520 INFO:tasks.workunit.client.0.smithi076.stdout:4/818: creat d0/d3b/f112 x:0 0 0 2024-03-28T13:09:06.570 INFO:tasks.workunit.client.0.smithi076.stdout:1/666: rename d14/d19/d85/d2e/d31/c5b to d14/d19/d20/ceb 0 2024-03-28T13:09:06.589 INFO:tasks.workunit.client.0.smithi076.stdout:1/667: dread d14/d19/d20/f27 [0,4194304] 0 2024-03-28T13:09:06.589 INFO:tasks.workunit.client.0.smithi076.stdout:1/668: write d14/f52 [5053955,51830] 0 2024-03-28T13:09:06.709 INFO:tasks.workunit.client.0.smithi076.stdout:8/794: getdents de/d23/d2b/d5d/d76/d18 0 2024-03-28T13:09:06.793 INFO:tasks.workunit.client.0.smithi076.stdout:4/819: creat d0/d20/d7f/dda/d2d/d75/f113 x:0 0 0 2024-03-28T13:09:06.868 INFO:tasks.workunit.client.0.smithi076.stdout:1/669: rename d14/d19/d85/l4d to d14/d6c/d74/lec 0 2024-03-28T13:09:06.904 INFO:tasks.workunit.client.0.smithi076.stdout:8/795: symlink de/d23/d2b/d5d/d76/d113/l116 0 2024-03-28T13:09:06.939 INFO:tasks.workunit.client.0.smithi076.stdout:8/796: dwrite de/f1d [0,4194304] 0 2024-03-28T13:09:06.966 INFO:tasks.workunit.client.0.smithi076.stdout:6/808: link d6/da/d5f/lfe d6/l105 0 2024-03-28T13:09:06.966 INFO:tasks.workunit.client.0.smithi076.stdout:6/809: read d6/da/d1e/f50 [5533923,84838] 0 2024-03-28T13:09:07.161 INFO:tasks.workunit.client.0.smithi076.stdout:4/820: symlink d0/d20/l114 0 2024-03-28T13:09:07.179 INFO:tasks.workunit.client.0.smithi076.stdout:1/670: creat d14/d19/d85/d2e/d91/fed x:0 0 0 2024-03-28T13:09:07.206 INFO:tasks.workunit.client.0.smithi076.stdout:2/790: write d2/d5/d7/d28/d64/fcd [1615682,19715] 0 2024-03-28T13:09:07.207 INFO:tasks.workunit.client.0.smithi076.stdout:9/802: dwrite d9/dd/df/d11/d37/f1d [4194304,4194304] 0 2024-03-28T13:09:07.233 INFO:tasks.workunit.client.0.smithi076.stdout:0/794: dwrite db/dc/df/f23 [0,4194304] 0 2024-03-28T13:09:07.233 INFO:tasks.workunit.client.0.smithi076.stdout:0/795: dread - db/dd8/ff5 zero size 2024-03-28T13:09:07.249 INFO:tasks.workunit.client.0.smithi076.stdout:2/791: dwrite d2/d5/db/d3b/f62 [0,4194304] 0 2024-03-28T13:09:07.266 INFO:tasks.workunit.client.0.smithi076.stdout:8/797: symlink de/d23/d2b/d51/d62/df9/l117 0 2024-03-28T13:09:07.266 INFO:tasks.workunit.client.0.smithi076.stdout:8/798: readlink de/d4e/d54/lca 0 2024-03-28T13:09:07.267 INFO:tasks.workunit.client.0.smithi076.stdout:2/792: dread d2/d5/d7/dd/f32 [4194304,4194304] 0 2024-03-28T13:09:07.316 INFO:tasks.workunit.client.0.smithi076.stdout:6/810: creat d6/da/d23/ddf/f106 x:0 0 0 2024-03-28T13:09:07.316 INFO:tasks.workunit.client.0.smithi076.stdout:6/811: dread - d6/da/d1e/dce/f104 zero size 2024-03-28T13:09:07.316 INFO:tasks.workunit.client.0.smithi076.stdout:6/812: fdatasync d6/da/d89/fa1 0 2024-03-28T13:09:07.317 INFO:tasks.workunit.client.0.smithi076.stdout:6/813: chown d6/da/d39/d63/lbe 66238 1 2024-03-28T13:09:07.370 INFO:tasks.workunit.client.0.smithi076.stdout:4/821: getdents d0/d3b/d40/d42/d31/d5e/d72/d78 0 2024-03-28T13:09:07.370 INFO:tasks.workunit.client.0.smithi076.stdout:4/822: chown d0/d3b/d50/ff7 172905350 1 2024-03-28T13:09:07.833 INFO:tasks.workunit.client.0.smithi076.stdout:9/803: symlink d9/dd/d48/dad/lf3 0 2024-03-28T13:09:07.843 INFO:tasks.workunit.client.0.smithi076.stdout:1/671: dread d14/d19/d85/d2e/d31/d3b/f55 [0,4194304] 0 2024-03-28T13:09:07.845 INFO:tasks.workunit.client.0.smithi076.stdout:3/670: link d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/l2a d1/d7/d30/le7 0 2024-03-28T13:09:07.845 INFO:tasks.workunit.client.0.smithi076.stdout:3/671: chown d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/fbf 6775283 1 2024-03-28T13:09:07.845 INFO:tasks.workunit.client.0.smithi076.stdout:3/672: dread - d1/d7/d30/d38/d14/d97/fa5 zero size 2024-03-28T13:09:07.845 INFO:tasks.workunit.client.0.smithi076.stdout:3/673: stat d1/d7/lbb 0 2024-03-28T13:09:07.876 INFO:tasks.workunit.client.0.smithi076.stdout:1/672: dwrite d14/d6c/fe7 [0,4194304] 0 2024-03-28T13:09:07.877 INFO:tasks.workunit.client.0.smithi076.stdout:1/673: truncate d14/d19/d85/d2e/d31/d49/f63 2322489 0 2024-03-28T13:09:07.879 INFO:tasks.workunit.client.0.smithi076.stdout:3/674: dwrite d1/d7/d30/d38/d14/d27/f4e [0,4194304] 0 2024-03-28T13:09:07.902 INFO:tasks.workunit.client.0.smithi076.stdout:1/674: dwrite d14/d19/d85/d2e/d31/d51/d92/da4/db7/fe6 [0,4194304] 0 2024-03-28T13:09:08.015 INFO:tasks.workunit.client.0.smithi076.stdout:0/796: creat db/dc/df/d71/d4a/d7e/d91/f120 x:0 0 0 2024-03-28T13:09:08.031 INFO:tasks.workunit.client.0.smithi076.stdout:0/797: read db/dd8/ff9 [2459286,73815] 0 2024-03-28T13:09:08.144 INFO:tasks.workunit.client.0.smithi076.stdout:8/799: symlink de/d23/d2b/d5d/d76/d6e/d87/l118 0 2024-03-28T13:09:08.145 INFO:tasks.workunit.client.0.smithi076.stdout:8/800: read - de/d23/d2b/d5d/fe7 zero size 2024-03-28T13:09:08.265 INFO:tasks.workunit.client.0.smithi076.stdout:2/793: unlink d2/d5/db/d3b/d5a/daa/ccf 0 2024-03-28T13:09:08.435 INFO:tasks.workunit.client.0.smithi076.stdout:6/814: unlink d6/da/d89/cc5 0 2024-03-28T13:09:08.612 INFO:tasks.workunit.client.0.smithi076.stdout:9/804: mkdir d9/dd/d48/dd7/dd9/df4 0 2024-03-28T13:09:08.616 INFO:tasks.workunit.client.0.smithi076.stdout:9/805: dread d9/fb1 [0,4194304] 0 2024-03-28T13:09:08.629 INFO:tasks.workunit.client.0.smithi076.stdout:9/806: dread d9/dd/df/d11/d14/d58/d6e/f60 [0,4194304] 0 2024-03-28T13:09:08.629 INFO:tasks.workunit.client.0.smithi076.stdout:9/807: truncate d9/d74/d7d/fa5 1674752 0 2024-03-28T13:09:08.629 INFO:tasks.workunit.client.0.smithi076.stdout:9/808: chown d9/dd/df/d11 232 1 2024-03-28T13:09:08.632 INFO:tasks.workunit.client.0.smithi076.stdout:9/809: read d9/dd/df/d11/d14/d58/d6e/d2a/f44 [251992,84696] 0 2024-03-28T13:09:08.707 INFO:tasks.workunit.client.0.smithi076.stdout:7/739: sync 2024-03-28T13:09:08.707 INFO:tasks.workunit.client.0.smithi076.stdout:5/791: sync 2024-03-28T13:09:08.803 INFO:tasks.workunit.client.0.smithi076.stdout:3/675: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/dcd/db9/fe8 x:0 0 0 2024-03-28T13:09:08.997 INFO:tasks.workunit.client.0.smithi076.stdout:1/675: creat d14/d19/d85/d2e/d31/d8f/dde/fee x:0 0 0 2024-03-28T13:09:09.083 INFO:tasks.workunit.client.0.smithi076.stdout:0/798: creat db/dc/df/d18/d1d/d75/d51/dd7/f121 x:0 0 0 2024-03-28T13:09:09.194 INFO:tasks.workunit.client.0.smithi076.stdout:8/801: mknod de/d23/d2b/d5d/d76/d6e/d7a/c119 0 2024-03-28T13:09:09.950 INFO:tasks.workunit.client.0.smithi076.stdout:6/815: mknod d6/da/d39/d63/df5/c107 0 2024-03-28T13:09:10.183 INFO:tasks.workunit.client.0.smithi076.stdout:7/740: rename d1/d8/d37/d53/dae/fd1 to d1/d8/dc2/dc4/f105 0 2024-03-28T13:09:10.183 INFO:tasks.workunit.client.0.smithi076.stdout:7/741: truncate d1/d8/dc2/d100/db5/fe3 444157 0 2024-03-28T13:09:10.256 INFO:tasks.workunit.client.0.smithi076.stdout:5/792: creat d5/d9/d1c/dcc/f129 x:0 0 0 2024-03-28T13:09:10.298 INFO:tasks.workunit.client.0.smithi076.stdout:5/793: dwrite d5/d9/d1c/d25/dbd/d7a/de2/f11c [0,4194304] 0 2024-03-28T13:09:10.397 INFO:tasks.workunit.client.0.smithi076.stdout:0/799: symlink db/dc/df/d18/d1d/d75/d51/dd7/de3/l122 0 2024-03-28T13:09:10.400 INFO:tasks.workunit.client.0.smithi076.stdout:0/800: dread db/dc/df/d18/d1d/d21/dd2/fde [0,4194304] 0 2024-03-28T13:09:10.470 INFO:tasks.workunit.client.0.smithi076.stdout:8/802: creat de/d23/d2b/d5d/d76/d6e/d8a/f11a x:0 0 0 2024-03-28T13:09:10.562 INFO:tasks.workunit.client.0.smithi076.stdout:6/816: creat d6/da/d40/d56/d8f/f108 x:0 0 0 2024-03-28T13:09:10.964 INFO:tasks.workunit.client.0.smithi076.stdout:0/801: creat db/dc/df/d11/d40/d77/f123 x:0 0 0 2024-03-28T13:09:10.964 INFO:tasks.workunit.client.0.smithi076.stdout:0/802: chown db/dc/df/d18/d1d/d75/l11b 9793596 1 2024-03-28T13:09:10.964 INFO:tasks.workunit.client.0.smithi076.stdout:1/676: truncate d14/d19/d85/d2e/f61 938270 0 2024-03-28T13:09:10.964 INFO:tasks.workunit.client.0.smithi076.stdout:0/803: stat db/dc/df/d11/d40/d77/da2/f95 0 2024-03-28T13:09:10.964 INFO:tasks.workunit.client.0.smithi076.stdout:1/677: chown d14/d19/d85/d2e/f7b 2050244 1 2024-03-28T13:09:10.965 INFO:tasks.workunit.client.0.smithi076.stdout:1/678: fsync d14/d19/d85/d2e/fbe 0 2024-03-28T13:09:10.965 INFO:tasks.workunit.client.0.smithi076.stdout:1/679: chown d14/d19/d85/d2e/d3c/c48 8405786 1 2024-03-28T13:09:11.067 INFO:tasks.workunit.client.0.smithi076.stdout:6/817: fsync d6/da/d5f/d6d/fb4 0 2024-03-28T13:09:11.067 INFO:tasks.workunit.client.0.smithi076.stdout:6/818: chown d6/d99/d46/ff4 3754232 1 2024-03-28T13:09:11.094 INFO:tasks.workunit.client.0.smithi076.stdout:6/819: dwrite d6/da/d1e/f50 [4194304,4194304] 0 2024-03-28T13:09:11.244 INFO:tasks.workunit.client.0.smithi076.stdout:5/794: link d5/db/d3f/d42/l88 d5/d9/d1c/d25/dbd/d7a/l12a 0 2024-03-28T13:09:11.244 INFO:tasks.workunit.client.0.smithi076.stdout:5/795: write d5/db/d3f/feb [396368,57717] 0 2024-03-28T13:09:11.264 INFO:tasks.workunit.client.0.smithi076.stdout:5/796: write d5/db/df/fd3 [2281620,31163] 0 2024-03-28T13:09:11.275 INFO:tasks.workunit.client.0.smithi076.stdout:0/804: symlink db/dc/df/d11/d40/d77/d87/d88/l124 0 2024-03-28T13:09:11.280 INFO:tasks.workunit.client.0.smithi076.stdout:5/797: write d5/d9/d1c/d25/dbd/d7a/fbb [326795,13081] 0 2024-03-28T13:09:11.301 INFO:tasks.workunit.client.0.smithi076.stdout:5/798: dread d5/d9/f59 [0,4194304] 0 2024-03-28T13:09:11.301 INFO:tasks.workunit.client.0.smithi076.stdout:5/799: fsync d5/d9/d1c/d25/dbd/f103 0 2024-03-28T13:09:11.305 INFO:tasks.workunit.client.0.smithi076.stdout:1/680: mkdir d14/def 0 2024-03-28T13:09:11.305 INFO:tasks.workunit.client.0.smithi076.stdout:1/681: chown d14/d19/d85/d2e/d31/d3b/f4e 501302038 1 2024-03-28T13:09:11.516 INFO:tasks.workunit.client.0.smithi076.stdout:6/820: symlink d6/da/d5f/d7e/dc8/l109 0 2024-03-28T13:09:11.519 INFO:tasks.workunit.client.0.smithi076.stdout:0/805: symlink db/dc/d3d/d57/l125 0 2024-03-28T13:09:11.560 INFO:tasks.workunit.client.0.smithi076.stdout:6/821: dwrite d6/da/ff9 [0,4194304] 0 2024-03-28T13:09:11.704 INFO:tasks.workunit.client.0.smithi076.stdout:1/682: rename d14/d19/d85/d2e/d3c/d5c to d14/def/df0 0 2024-03-28T13:09:11.704 INFO:tasks.workunit.client.0.smithi076.stdout:1/683: truncate d14/d6c/d74/f78 2295395 0 2024-03-28T13:09:11.774 INFO:tasks.workunit.client.0.smithi076.stdout:4/823: mkdir d0/d3b/d40/d42/d115 0 2024-03-28T13:09:11.774 INFO:tasks.workunit.client.0.smithi076.stdout:4/824: chown d0/d3b/d50/d64 180 1 2024-03-28T13:09:11.849 INFO:tasks.workunit.client.0.smithi076.stdout:0/806: mknod db/dc/df/d18/d1d/d21/dd2/df1/c126 0 2024-03-28T13:09:12.001 INFO:tasks.workunit.client.0.smithi076.stdout:6/822: symlink d6/da/d40/d56/dd2/l10a 0 2024-03-28T13:09:12.368 INFO:tasks.workunit.client.0.smithi076.stdout:4/825: mkdir d0/d20/d7f/dda/d2d/d75/d116 0 2024-03-28T13:09:12.368 INFO:tasks.workunit.client.0.smithi076.stdout:4/826: chown d0/d20/d7b 3245 1 2024-03-28T13:09:12.368 INFO:tasks.workunit.client.0.smithi076.stdout:4/827: write d0/d20/d7b/fd6 [747005,70204] 0 2024-03-28T13:09:12.580 INFO:tasks.workunit.client.0.smithi076.stdout:6/823: symlink d6/d99/d46/dff/l10b 0 2024-03-28T13:09:12.624 INFO:tasks.workunit.client.0.smithi076.stdout:6/824: dwrite d6/f3c [0,4194304] 0 2024-03-28T13:09:12.706 INFO:tasks.workunit.client.0.smithi076.stdout:2/794: sync 2024-03-28T13:09:12.724 INFO:tasks.workunit.client.0.smithi076.stdout:2/795: dread d2/d5/d7/d8/d21/f27 [0,4194304] 0 2024-03-28T13:09:12.737 INFO:tasks.workunit.client.0.smithi076.stdout:6/825: symlink d6/da/d23/l10c 0 2024-03-28T13:09:12.786 INFO:tasks.workunit.client.0.smithi076.stdout:4/828: truncate d0/d3b/d40/d42/d47/d69/da9/fe9 2364562 0 2024-03-28T13:09:12.801 INFO:tasks.workunit.client.0.smithi076.stdout:9/810: write d9/d74/f83 [467496,52384] 0 2024-03-28T13:09:12.826 INFO:tasks.workunit.client.0.smithi076.stdout:2/796: mkdir d2/d5/db/d3b/df5 0 2024-03-28T13:09:12.826 INFO:tasks.workunit.client.0.smithi076.stdout:2/797: write d2/d5/d4b/d39/d57/f7d [797472,95054] 0 2024-03-28T13:09:12.870 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:09:12.873 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:09:13.050 INFO:tasks.workunit.client.0.smithi076.stdout:4/829: truncate d0/d20/d7f/dda/db7/ff3 174828 0 2024-03-28T13:09:13.050 INFO:tasks.workunit.client.0.smithi076.stdout:9/811: mknod d9/da/de6/cf5 0 2024-03-28T13:09:13.050 INFO:tasks.workunit.client.0.smithi076.stdout:9/812: truncate d9/dd/d48/dd7/fee 754309 0 2024-03-28T13:09:13.082 INFO:tasks.workunit.client.0.smithi076.stdout:3/676: dwrite d1/d7/d30/d38/d14/f1f [0,4194304] 0 2024-03-28T13:09:13.197 INFO:tasks.workunit.client.0.smithi076.stdout:3/677: dread d1/d7/d30/d38/d14/d27/f7e [0,4194304] 0 2024-03-28T13:09:13.197 INFO:tasks.workunit.client.0.smithi076.stdout:4/830: dwrite d0/d3b/d40/d42/d31/d5e/d72/d78/dcc/fd8 [0,4194304] 0 2024-03-28T13:09:13.197 INFO:tasks.workunit.client.0.smithi076.stdout:4/831: chown d0/l59 1379 1 2024-03-28T13:09:13.203 INFO:tasks.workunit.client.0.smithi076.stdout:4/832: dread d0/d3b/d40/f6e [0,4194304] 0 2024-03-28T13:09:13.203 INFO:tasks.workunit.client.0.smithi076.stdout:4/833: fsync d0/d20/d7b/fd6 0 2024-03-28T13:09:13.203 INFO:tasks.workunit.client.0.smithi076.stdout:4/834: dread - d0/d3b/de8/f104 zero size 2024-03-28T13:09:13.441 INFO:tasks.workunit.client.0.smithi076.stdout:2/798: truncate d2/d5/d7/f19 2110392 0 2024-03-28T13:09:13.441 INFO:tasks.workunit.client.0.smithi076.stdout:2/799: chown d2/d5/db/d3b/d3f/cc3 152 1 2024-03-28T13:09:13.831 INFO:tasks.workunit.client.0.smithi076.stdout:3/678: unlink d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d58/f6f 0 2024-03-28T13:09:13.929 INFO:tasks.workunit.client.0.smithi076.stdout:2/800: symlink d2/d5/db/d3b/d5a/lf6 0 2024-03-28T13:09:13.940 INFO:tasks.workunit.client.0.smithi076.stdout:8/803: dwrite de/d23/d2b/d51/d60/f10f [0,4194304] 0 2024-03-28T13:09:13.945 INFO:tasks.workunit.client.0.smithi076.stdout:8/804: dread de/d23/d2b/d5d/d76/d6e/d8a/fa5 [0,4194304] 0 2024-03-28T13:09:14.097 INFO:tasks.workunit.client.0.smithi076.stdout:2/801: symlink d2/d5/d7/dd/dc8/lf7 0 2024-03-28T13:09:14.181 INFO:tasks.workunit.client.0.smithi076.stdout:5/800: dwrite d5/d9/d1c/d25/dbd/d7a/db1/fc4 [0,4194304] 0 2024-03-28T13:09:14.206 INFO:tasks.workunit.client.0.smithi076.stdout:8/805: symlink de/d23/d2b/d51/d62/df9/l11b 0 2024-03-28T13:09:14.206 INFO:tasks.workunit.client.0.smithi076.stdout:8/806: dread - de/d23/fdc zero size 2024-03-28T13:09:14.206 INFO:tasks.workunit.client.0.smithi076.stdout:8/807: chown de/d23/d2b/d5d/d76/d18/d49/f10d 416970 1 2024-03-28T13:09:14.359 INFO:tasks.workunit.client.0.smithi076.stdout:5/801: stat d5/db/d3f/d42/l90 0 2024-03-28T13:09:14.411 INFO:tasks.workunit.client.0.smithi076.stdout:5/802: dwrite d5/d9/d1c/d25/dbd/d7a/d7c/f109 [0,4194304] 0 2024-03-28T13:09:14.438 INFO:tasks.workunit.client.0.smithi076.stdout:7/742: sync 2024-03-28T13:09:14.438 INFO:tasks.workunit.client.0.smithi076.stdout:7/743: fdatasync d1/d8/f35 0 2024-03-28T13:09:14.473 INFO:tasks.workunit.client.0.smithi076.stdout:8/808: mkdir de/d23/d2b/d51/d60/d11c 0 2024-03-28T13:09:14.672 INFO:tasks.workunit.client.0.smithi076.stdout:5/803: mknod d5/d9/d1c/d25/dbd/d7a/c12b 0 2024-03-28T13:09:14.673 INFO:tasks.workunit.client.0.smithi076.stdout:5/804: fdatasync d5/db/f46 0 2024-03-28T13:09:14.696 INFO:tasks.workunit.client.0.smithi076.stdout:8/809: dread de/d23/d2b/d58/d78/fa0 [0,4194304] 0 2024-03-28T13:09:14.741 INFO:tasks.workunit.client.0.smithi076.stdout:8/810: dwrite de/d13/da2/f112 [0,4194304] 0 2024-03-28T13:09:14.742 INFO:tasks.workunit.client.0.smithi076.stdout:8/811: chown de/d23/d2b/d5d/d76/d6e/d7a/c119 0 1 2024-03-28T13:09:14.891 INFO:tasks.workunit.client.0.smithi076.stdout:8/812: getdents de/d23/d2b/d5d/d76/d18/d49/dd0 0 2024-03-28T13:09:14.895 INFO:tasks.workunit.client.0.smithi076.stdout:8/813: read de/d13/d27/d8c/f99 [136027,78315] 0 2024-03-28T13:09:14.922 INFO:tasks.workunit.client.0.smithi076.stdout:1/684: sync 2024-03-28T13:09:15.009 INFO:tasks.workunit.client.0.smithi076.stdout:8/814: unlink fd 0 2024-03-28T13:09:15.010 INFO:tasks.workunit.client.0.smithi076.stdout:8/815: write de/d23/d2b/d5d/fe7 [375910,75896] 0 2024-03-28T13:09:15.081 INFO:tasks.workunit.client.0.smithi076.stdout:0/807: dwrite db/dc/df/d11/f1c [0,4194304] 0 2024-03-28T13:09:15.107 INFO:tasks.workunit.client.0.smithi076.stdout:1/685: truncate d14/d19/d85/d2e/d31/d51/d92/da4/db7/fe6 3783159 0 2024-03-28T13:09:15.211 INFO:tasks.workunit.client.0.smithi076.stdout:8/816: creat de/d23/d2b/d5d/d76/d18/d49/dbd/f11d x:0 0 0 2024-03-28T13:09:15.278 INFO:tasks.workunit.client.0.smithi076.stdout:0/808: symlink db/dc/df/d18/d1d/d75/d51/dd7/l127 0 2024-03-28T13:09:15.338 INFO:tasks.workunit.client.0.smithi076.stdout:0/809: dwrite db/dc/df/fe1 [0,4194304] 0 2024-03-28T13:09:15.402 INFO:tasks.workunit.client.0.smithi076.stdout:1/686: truncate d14/d19/d85/d2e/d91/fae 3443946 0 2024-03-28T13:09:15.402 INFO:tasks.workunit.client.0.smithi076.stdout:1/687: chown d14/d6c/fe7 52 1 2024-03-28T13:09:15.439 INFO:tasks.workunit.client.0.smithi076.stdout:8/817: symlink de/d13/da2/l11e 0 2024-03-28T13:09:15.627 INFO:tasks.workunit.client.0.smithi076.stdout:0/810: unlink db/dc/df/d18/d1d/d21/c116 0 2024-03-28T13:09:15.627 INFO:tasks.workunit.client.0.smithi076.stdout:0/811: readlink db/dc/df/d18/d1d/d75/d51/d60/d89/l11f 0 2024-03-28T13:09:15.718 INFO:tasks.workunit.client.0.smithi076.stdout:1/688: creat d14/d19/d20/dbf/ff1 x:0 0 0 2024-03-28T13:09:15.718 INFO:tasks.workunit.client.0.smithi076.stdout:8/818: creat de/d23/d2b/d5d/d76/d18/d49/f11f x:0 0 0 2024-03-28T13:09:15.718 INFO:tasks.workunit.client.0.smithi076.stdout:1/689: fdatasync d14/d19/d85/d3f/fd5 0 2024-03-28T13:09:15.743 INFO:tasks.workunit.client.0.smithi076.stdout:8/819: write de/f56 [1970878,129327] 0 2024-03-28T13:09:15.769 INFO:tasks.workunit.client.0.smithi076.stdout:8/820: read de/d23/d2b/d5d/d76/d18/d49/dd0/fe1 [1969266,24711] 0 2024-03-28T13:09:15.769 INFO:tasks.workunit.client.0.smithi076.stdout:8/821: chown de/d13/c52 357022 1 2024-03-28T13:09:15.769 INFO:tasks.workunit.client.0.smithi076.stdout:8/822: write de/d4e/f67 [4473352,3046] 0 2024-03-28T13:09:15.784 INFO:tasks.workunit.client.0.smithi076.stdout:8/823: dread de/f1d [4194304,4194304] 0 2024-03-28T13:09:15.784 INFO:tasks.workunit.client.0.smithi076.stdout:8/824: stat de/cf 0 2024-03-28T13:09:15.916 INFO:tasks.workunit.client.0.smithi076.stdout:0/812: rmdir db/dc/df/d11/d40/d77/da2/d6d 39 2024-03-28T13:09:16.184 INFO:tasks.workunit.client.0.smithi076.stdout:1/690: creat d14/d19/d85/d2e/d31/d3b/ff2 x:0 0 0 2024-03-28T13:09:16.344 INFO:tasks.workunit.client.0.smithi076.stdout:6/826: sync 2024-03-28T13:09:16.344 INFO:tasks.workunit.client.0.smithi076.stdout:6/827: fdatasync d6/da/d5f/d6d/fbb 0 2024-03-28T13:09:16.368 INFO:tasks.workunit.client.0.smithi076.stdout:9/813: sync 2024-03-28T13:09:16.368 INFO:tasks.workunit.client.0.smithi076.stdout:4/835: sync 2024-03-28T13:09:16.576 INFO:tasks.workunit.client.0.smithi076.stdout:2/802: write d2/d5/d4b/d39/d57/fbd [1077311,30644] 0 2024-03-28T13:09:16.688 INFO:tasks.workunit.client.0.smithi076.stdout:8/825: creat de/d13/f120 x:0 0 0 2024-03-28T13:09:16.701 INFO:tasks.workunit.client.0.smithi076.stdout:8/826: dread de/d23/d2b/d5d/d76/d18/d49/dd0/fe1 [0,4194304] 0 2024-03-28T13:09:16.745 INFO:tasks.workunit.client.0.smithi076.stdout:0/813: creat db/dc/df/d18/d1d/f128 x:0 0 0 2024-03-28T13:09:16.745 INFO:tasks.workunit.client.0.smithi076.stdout:0/814: dread - db/dc/df/d18/d1d/d75/d51/d60/d89/fd0 zero size 2024-03-28T13:09:16.745 INFO:tasks.workunit.client.0.smithi076.stdout:0/815: stat db/dc/df/d11/d40/d77/da2/d6d/db9/lbf 0 2024-03-28T13:09:16.883 INFO:tasks.workunit.client.0.smithi076.stdout:1/691: mkdir d14/d19/d85/d2e/d31/df3 0 2024-03-28T13:09:16.933 INFO:tasks.workunit.client.0.smithi076.stdout:6/828: creat d6/d99/f10d x:0 0 0 2024-03-28T13:09:16.999 INFO:tasks.workunit.client.0.smithi076.stdout:9/814: creat d9/dd/df/d11/d14/d58/d6e/ff6 x:0 0 0 2024-03-28T13:09:17.002 INFO:tasks.workunit.client.0.smithi076.stdout:9/815: dread d9/fb1 [0,4194304] 0 2024-03-28T13:09:17.047 INFO:tasks.workunit.client.0.smithi076.stdout:4/836: creat d0/d20/d7f/dda/f117 x:0 0 0 2024-03-28T13:09:17.082 INFO:tasks.workunit.client.0.smithi076.stdout:4/837: dwrite d0/d20/d7b/d94/fc8 [0,4194304] 0 2024-03-28T13:09:17.082 INFO:tasks.workunit.client.0.smithi076.stdout:4/838: fsync d0/d3b/d40/d42/d31/fde 0 2024-03-28T13:09:17.083 INFO:tasks.workunit.client.0.smithi076.stdout:4/839: chown d0/d3b/d40/d42/d31/d5e/d72/d78/dcc 0 1 2024-03-28T13:09:17.196 INFO:tasks.workunit.client.0.smithi076.stdout:2/803: getdents d2/d5/db/d3b/d9f/d9e/db1 0 2024-03-28T13:09:17.196 INFO:tasks.workunit.client.0.smithi076.stdout:2/804: chown d2/d5/d7/c29 1274 1 2024-03-28T13:09:17.216 INFO:tasks.workunit.client.0.smithi076.stdout:2/805: read d2/d5/d4b/d39/f97 [3467071,11071] 0 2024-03-28T13:09:17.249 INFO:tasks.workunit.client.0.smithi076.stdout:8/827: mkdir de/d4e/d121 0 2024-03-28T13:09:17.305 INFO:tasks.workunit.client.0.smithi076.stdout:5/805: dwrite d5/d9/d1c/d1d/d31/ded/d91/fd5 [0,4194304] 0 2024-03-28T13:09:17.305 INFO:tasks.workunit.client.0.smithi076.stdout:5/806: chown d5/d9/d35/l71 0 1 2024-03-28T13:09:17.414 INFO:tasks.workunit.client.0.smithi076.stdout:6/829: unlink d6/da/d40/d56/l77 0 2024-03-28T13:09:17.846 INFO:tasks.workunit.client.0.smithi076.stdout:4/840: symlink d0/d3b/d40/d42/d31/d5e/l118 0 2024-03-28T13:09:18.173 INFO:tasks.workunit.client.0.smithi076.stdout:2/806: creat d2/d5/db/d3b/d9f/ff8 x:0 0 0 2024-03-28T13:09:18.173 INFO:tasks.workunit.client.0.smithi076.stdout:8/828: mknod de/d23/d2b/d5d/d76/d18/d49/dd0/c122 0 2024-03-28T13:09:18.221 INFO:tasks.workunit.client.0.smithi076.stdout:8/829: dwrite de/d13/d27/d8c/f99 [0,4194304] 0 2024-03-28T13:09:18.294 INFO:tasks.workunit.client.0.smithi076.stdout:5/807: truncate d5/d9/d1c/d1d/d31/fe4 2680882 0 2024-03-28T13:09:18.294 INFO:tasks.workunit.client.0.smithi076.stdout:5/808: readlink d5/d9/d1c/d1d/d31/ded/lad 0 2024-03-28T13:09:18.349 INFO:tasks.workunit.client.0.smithi076.stdout:6/830: creat d6/dc1/f10e x:0 0 0 2024-03-28T13:09:18.349 INFO:tasks.workunit.client.0.smithi076.stdout:6/831: write d6/fe8 [139921,109381] 0 2024-03-28T13:09:18.411 INFO:tasks.workunit.client.0.smithi076.stdout:3/679: link d1/d7/d30/d38/d14/d36/l50 d1/le9 0 2024-03-28T13:09:18.411 INFO:tasks.workunit.client.0.smithi076.stdout:3/680: readlink d1/d7/d30/d38/d14/d36/d56/d5b/d6d/ld0 0 2024-03-28T13:09:18.799 INFO:tasks.workunit.client.0.smithi076.stdout:7/744: rename d1/ff8 to d1/dc/d8b/dbf/f106 0 2024-03-28T13:09:18.887 INFO:tasks.workunit.client.0.smithi076.stdout:6/832: symlink d6/da/d40/d56/dc7/l10f 0 2024-03-28T13:09:19.052 INFO:tasks.workunit.client.0.smithi076.stdout:3/681: symlink d1/d7/d30/d38/d14/d51/lea 0 2024-03-28T13:09:19.053 INFO:tasks.workunit.client.0.smithi076.stdout:3/682: write d1/d7/d30/d38/d14/d27/f4e [4985542,116566] 0 2024-03-28T13:09:19.053 INFO:tasks.workunit.client.0.smithi076.stdout:3/683: write d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/fce [974566,34671] 0 2024-03-28T13:09:19.082 INFO:tasks.workunit.client.0.smithi076.stdout:0/816: rename db/dc/d3d/d57/f108 to db/dc/df/d11/d40/d77/d87/f129 0 2024-03-28T13:09:19.083 INFO:tasks.workunit.client.0.smithi076.stdout:7/745: creat d1/dc/d8b/dbf/f107 x:0 0 0 2024-03-28T13:09:19.083 INFO:tasks.workunit.client.0.smithi076.stdout:7/746: truncate d1/dc/d8b/fb6 492017 0 2024-03-28T13:09:19.125 INFO:tasks.workunit.client.0.smithi076.stdout:6/833: rmdir d6/d99/d46/dff 39 2024-03-28T13:09:19.188 INFO:tasks.workunit.client.0.smithi076.stdout:3/684: fdatasync d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d93/dd4/fdf 0 2024-03-28T13:09:19.310 INFO:tasks.workunit.client.0.smithi076.stdout:0/817: rename db/dc/df/d18/d1d/d75/d51/d60/d92/c111 to db/dc/df/d18/d1d/d75/d51/d60/d89/c12a 0 2024-03-28T13:09:19.311 INFO:tasks.workunit.client.0.smithi076.stdout:7/747: mknod d1/d18/c108 0 2024-03-28T13:09:19.358 INFO:tasks.workunit.client.0.smithi076.stdout:6/834: dread d6/da/d40/d56/da4/fb8 [0,4194304] 0 2024-03-28T13:09:19.404 INFO:tasks.workunit.client.0.smithi076.stdout:6/835: dwrite d6/da/d40/f82 [0,4194304] 0 2024-03-28T13:09:19.419 INFO:tasks.workunit.client.0.smithi076.stdout:6/836: dread d6/da/d40/d62/dfa/ff2 [0,4194304] 0 2024-03-28T13:09:19.419 INFO:tasks.workunit.client.0.smithi076.stdout:6/837: fdatasync d6/da/d23/ddf/fe9 0 2024-03-28T13:09:19.421 INFO:tasks.workunit.client.0.smithi076.stdout:6/838: readlink d6/da/d40/l51 0 2024-03-28T13:09:19.429 INFO:tasks.workunit.client.0.smithi076.stdout:3/685: creat d1/d7/d30/d38/d14/d4a/ddc/feb x:0 0 0 2024-03-28T13:09:19.438 INFO:tasks.workunit.client.0.smithi076.stdout:6/839: read d6/da/d1e/f86 [3257997,127082] 0 2024-03-28T13:09:19.586 INFO:tasks.workunit.client.0.smithi076.stdout:0/818: rmdir db/dc/df/d11/dfc 39 2024-03-28T13:09:19.586 INFO:tasks.workunit.client.0.smithi076.stdout:7/748: rename d1/d18/d3c/ffe to d1/dc/f109 0 2024-03-28T13:09:19.790 INFO:tasks.workunit.client.0.smithi076.stdout:6/840: creat d6/da/d5f/d6d/f110 x:0 0 0 2024-03-28T13:09:19.790 INFO:tasks.workunit.client.0.smithi076.stdout:0/819: chown db/dc/df/d11/d40/lf0 224 1 2024-03-28T13:09:19.797 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:28:36.985 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:09:19.806 INFO:tasks.workunit.client.0.smithi076.stdout:6/841: dread d6/da/d40/d56/d8f/fa0 [0,4194304] 0 2024-03-28T13:09:19.807 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:28:36.996 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:09:19.834 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:28:36.949 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:09:19.841 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:28:36.956 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:09:19.842 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:28:36.956 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:09:19.845 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:28:36.959 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:09:19.889 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:28:37.076 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:09:19.956 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:28:37.070 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:09:20.012 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:28:37.127 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:09:20.132 INFO:tasks.workunit.client.0.smithi076.stdout:0/820: mkdir db/dc/df/d18/d12b 0 2024-03-28T13:09:20.133 INFO:tasks.workunit.client.0.smithi076.stdout:0/821: truncate db/d16/fb6 82087 0 2024-03-28T13:09:20.133 INFO:tasks.workunit.client.0.smithi076.stdout:0/822: fsync db/dc/df/d11/d40/d77/f123 0 2024-03-28T13:09:20.133 INFO:tasks.workunit.client.0.smithi076.stdout:0/823: readlink db/dc/df/d11/d40/d77/d87/d88/l124 0 2024-03-28T13:09:20.133 INFO:tasks.workunit.client.0.smithi076.stdout:0/824: getdents db/dc/df/d71/d4a/d107 0 2024-03-28T13:09:20.153 INFO:tasks.workunit.client.0.smithi076.stdout:0/825: dread db/f12 [0,4194304] 0 2024-03-28T13:09:20.153 INFO:tasks.workunit.client.0.smithi076.stdout:0/826: write db/dc/df/d18/d1d/d21/fac [70398,122751] 0 2024-03-28T13:09:20.178 INFO:tasks.workunit.client.0.smithi076.stdout:0/827: dwrite db/dc/df/d18/d1d/d21/dd2/fde [0,4194304] 0 2024-03-28T13:09:20.178 INFO:tasks.workunit.client.0.smithi076.stdout:0/828: fsync db/dc/df/d18/d1d/f29 0 2024-03-28T13:09:20.234 INFO:tasks.workunit.client.0.smithi076.stdout:6/842: mkdir d6/da/d5f/d7e/d111 0 2024-03-28T13:09:20.535 INFO:tasks.workunit.client.0.smithi076.stdout:1/692: write d14/d19/f47 [9098517,65163] 0 2024-03-28T13:09:20.695 INFO:tasks.workunit.client.0.smithi076.stdout:0/829: unlink db/dc/df/d18/d1d/d75/d51/d97/c11a 0 2024-03-28T13:09:20.737 INFO:tasks.workunit.client.0.smithi076.stdout:0/830: dwrite db/dc/df/d18/d1d/d75/d51/dd7/f121 [0,4194304] 0 2024-03-28T13:09:20.753 INFO:tasks.workunit.client.0.smithi076.stdout:0/831: dread db/dc/df/d11/d40/d77/da2/d6d/f8c [0,4194304] 0 2024-03-28T13:09:20.770 INFO:tasks.workunit.client.0.smithi076.stdout:0/832: dread db/dc/df/d18/d1d/d75/d51/fbc [0,4194304] 0 2024-03-28T13:09:20.770 INFO:tasks.workunit.client.0.smithi076.stdout:0/833: chown db/dc/d3d/l90 3906021 1 2024-03-28T13:09:20.770 INFO:tasks.workunit.client.0.smithi076.stdout:0/834: fdatasync db/da6/f112 0 2024-03-28T13:09:20.770 INFO:tasks.workunit.client.0.smithi076.stdout:0/835: chown db/dc/df/d71/d4a/d107 501359 1 2024-03-28T13:09:20.777 INFO:tasks.workunit.client.0.smithi076.stdout:6/843: getdents d6/da/d40/d56/d8f 0 2024-03-28T13:09:20.804 INFO:tasks.workunit.client.0.smithi076.stdout:6/844: write d6/da/d40/d62/f7b [1234037,65765] 0 2024-03-28T13:09:20.873 INFO:tasks.workunit.client.0.smithi076.stdout:6/845: dwrite d6/da/d23/f43 [4194304,4194304] 0 2024-03-28T13:09:20.899 INFO:tasks.workunit.client.0.smithi076.stdout:1/693: creat d14/d19/d85/d2e/d31/d46/ff4 x:0 0 0 2024-03-28T13:09:20.923 INFO:tasks.workunit.client.0.smithi076.stdout:1/694: dwrite d14/d6c/fe7 [0,4194304] 0 2024-03-28T13:09:21.085 INFO:tasks.workunit.client.0.smithi076.stdout:0/836: creat db/dc/df/d18/d1d/f12c x:0 0 0 2024-03-28T13:09:21.143 INFO:tasks.workunit.client.0.smithi076.stdout:6/846: creat d6/da/d89/f112 x:0 0 0 2024-03-28T13:09:21.294 INFO:tasks.workunit.client.0.smithi076.stdout:1/695: symlink d14/d19/d85/d2e/d3c/d7e/lf5 0 2024-03-28T13:09:21.321 INFO:tasks.workunit.client.0.smithi076.stdout:1/696: dwrite d14/d19/d85/dd6/fe1 [0,4194304] 0 2024-03-28T13:09:21.521 INFO:tasks.workunit.client.0.smithi076.stdout:0/837: mkdir db/d16/d12d 0 2024-03-28T13:09:21.706 INFO:tasks.workunit.client.0.smithi076.stdout:1/697: getdents d14/def 0 2024-03-28T13:09:22.127 INFO:tasks.workunit.client.0.smithi076.stdout:5/809: write d5/db/d3f/d42/f58 [485519,60745] 0 2024-03-28T13:09:22.128 INFO:tasks.workunit.client.0.smithi076.stdout:8/830: write de/d23/d2b/d5d/d76/d18/d3c/f9a [388618,18118] 0 2024-03-28T13:09:22.167 INFO:tasks.workunit.client.0.smithi076.stdout:2/807: dwrite d2/d5/db/d3b/d5a/d8d/fc4 [0,4194304] 0 2024-03-28T13:09:22.167 INFO:tasks.workunit.client.0.smithi076.stdout:2/808: fdatasync d2/d5/d4b/d39/d57/fd1 0 2024-03-28T13:09:22.167 INFO:tasks.workunit.client.0.smithi076.stdout:2/809: dread - d2/d5/db/d3b/d3f/d99/fd7 zero size 2024-03-28T13:09:22.176 INFO:tasks.workunit.client.0.smithi076.stdout:2/810: dread d2/d5/d7/d8/d21/f5e [4194304,4194304] 0 2024-03-28T13:09:22.217 INFO:tasks.workunit.client.0.smithi076.stdout:4/841: sync 2024-03-28T13:09:22.217 INFO:tasks.workunit.client.0.smithi076.stdout:9/816: sync 2024-03-28T13:09:22.217 INFO:tasks.workunit.client.0.smithi076.stdout:9/817: getdents d9/dd/df/d11/d14 0 2024-03-28T13:09:22.249 INFO:tasks.workunit.client.0.smithi076.stdout:4/842: dwrite d0/d3b/d40/d42/d28/f32 [0,4194304] 0 2024-03-28T13:09:22.655 INFO:tasks.workunit.client.0.smithi076.stdout:5/810: creat d5/db/d19/f12c x:0 0 0 2024-03-28T13:09:22.655 INFO:tasks.workunit.client.0.smithi076.stdout:8/831: creat de/d13/d27/f123 x:0 0 0 2024-03-28T13:09:22.655 INFO:tasks.workunit.client.0.smithi076.stdout:8/832: fsync de/d13/f120 0 2024-03-28T13:09:22.655 INFO:tasks.workunit.client.0.smithi076.stdout:8/833: readlink de/l6c 0 2024-03-28T13:09:22.703 INFO:tasks.workunit.client.0.smithi076.stdout:8/834: dwrite de/d23/d2b/d5d/d76/d18/f5c [0,4194304] 0 2024-03-28T13:09:22.704 INFO:tasks.workunit.client.0.smithi076.stdout:8/835: write de/d23/d2b/d5d/d76/d18/d49/f11f [723956,32567] 0 2024-03-28T13:09:22.736 INFO:tasks.workunit.client.0.smithi076.stdout:4/843: mknod d0/d20/d7b/c119 0 2024-03-28T13:09:22.736 INFO:tasks.workunit.client.0.smithi076.stdout:4/844: chown d0/d3b/d40/d42/f24 14 1 2024-03-28T13:09:22.737 INFO:tasks.workunit.client.0.smithi076.stdout:9/818: truncate d9/dd/df/f25 7753956 0 2024-03-28T13:09:22.737 INFO:tasks.workunit.client.0.smithi076.stdout:9/819: chown d9/dd/df/fbf 36543419 1 2024-03-28T13:09:23.108 INFO:tasks.workunit.client.0.smithi076.stdout:6/847: rename d6/da/d5f/d7e to d6/da/d39/d63/d113 0 2024-03-28T13:09:23.125 INFO:tasks.workunit.client.0.smithi076.stdout:6/848: write d6/da/d1e/f50 [4283685,112778] 0 2024-03-28T13:09:23.269 INFO:tasks.workunit.client.0.smithi076.stdout:8/836: symlink de/d23/d2b/d58/d8e/l124 0 2024-03-28T13:09:23.299 INFO:tasks.workunit.client.0.smithi076.stdout:8/837: dwrite de/d23/d2b/d5d/d76/d18/d3c/f44 [0,4194304] 0 2024-03-28T13:09:23.330 INFO:tasks.workunit.client.0.smithi076.stdout:4/845: mknod d0/d3b/d40/d42/d31/d5e/d72/d78/dcc/c11a 0 2024-03-28T13:09:23.468 INFO:tasks.workunit.client.0.smithi076.stdout:6/849: symlink d6/da/d39/d63/d113/d111/l114 0 2024-03-28T13:09:23.521 INFO:tasks.workunit.client.0.smithi076.stdout:8/838: mkdir de/d4e/db6/dde/d125 0 2024-03-28T13:09:23.522 INFO:tasks.workunit.client.0.smithi076.stdout:8/839: write de/d23/d2b/d58/d78/fbe [269344,126343] 0 2024-03-28T13:09:23.522 INFO:tasks.workunit.client.0.smithi076.stdout:8/840: truncate de/d13/f120 890799 0 2024-03-28T13:09:23.942 INFO:tasks.workunit.client.0.smithi076.stdout:5/811: symlink d5/d9/d1c/l12d 0 2024-03-28T13:09:23.942 INFO:tasks.workunit.client.0.smithi076.stdout:5/812: chown d5/d9/d35/fe6 30261 1 2024-03-28T13:09:24.051 INFO:tasks.workunit.client.0.smithi076.stdout:5/813: link d5/d9/d35/d3b/db6/df7/l10e d5/d9/d35/d3b/d115/l12e 0 2024-03-28T13:09:24.260 INFO:tasks.workunit.client.0.smithi076.stdout:3/686: mknod d1/d7/d30/cec 0 2024-03-28T13:09:24.599 INFO:tasks.workunit.client.0.smithi076.stdout:5/814: truncate d5/d9/d1c/d25/d60/fce 146930 0 2024-03-28T13:09:24.689 INFO:tasks.workunit.client.0.smithi076.stdout:3/687: mkdir d1/d7/d30/d38/d14/d4a/ddc/ded 0 2024-03-28T13:09:24.871 INFO:tasks.workunit.client.0.smithi076.stdout:5/815: rename d5/db/f12 to d5/d9/d4c/f12f 0 2024-03-28T13:09:24.871 INFO:tasks.workunit.client.0.smithi076.stdout:5/816: write d5/db/d19/ff0 [52950,67185] 0 2024-03-28T13:09:25.055 INFO:tasks.workunit.client.0.smithi076.stdout:3/688: dread - d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/dcd/f9c zero size 2024-03-28T13:09:25.071 INFO:tasks.workunit.client.0.smithi076.stdout:3/689: write d1/d7/d30/f43 [852254,90842] 0 2024-03-28T13:09:25.101 INFO:tasks.workunit.client.0.smithi076.stdout:2/811: dwrite d2/d5/db/d3b/d5a/d8d/fd2 [0,4194304] 0 2024-03-28T13:09:25.333 INFO:tasks.workunit.client.0.smithi076.stdout:5/817: mkdir d5/db/d19/d34/d128/d130 0 2024-03-28T13:09:25.333 INFO:tasks.workunit.client.0.smithi076.stdout:3/690: creat d1/d2/fee x:0 0 0 2024-03-28T13:09:25.333 INFO:tasks.workunit.client.0.smithi076.stdout:5/818: readlink d5/d9/d1c/d1d/d31/ded/lad 0 2024-03-28T13:09:25.333 INFO:tasks.workunit.client.0.smithi076.stdout:5/819: fsync d5/f6 0 2024-03-28T13:09:25.345 INFO:tasks.workunit.client.0.smithi076.stdout:3/691: dread d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/f40 [0,4194304] 0 2024-03-28T13:09:25.380 INFO:tasks.workunit.client.0.smithi076.stdout:3/692: dwrite d1/d7/d30/d38/d14/d36/d56/d5b/d6d/fda [0,4194304] 0 2024-03-28T13:09:25.734 INFO:tasks.workunit.client.0.smithi076.stdout:2/812: rename d2/d92/la1 to d2/d92/lf9 0 2024-03-28T13:09:25.846 INFO:tasks.workunit.client.0.smithi076.stdout:3/693: unlink d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/f24 0 2024-03-28T13:09:25.846 INFO:tasks.workunit.client.0.smithi076.stdout:3/694: write d1/d2/fba [339742,29363] 0 2024-03-28T13:09:25.846 INFO:tasks.workunit.client.0.smithi076.stdout:3/695: chown d1/d7/d30/d38/ld6 63 1 2024-03-28T13:09:25.883 INFO:tasks.workunit.client.0.smithi076.stdout:2/813: creat d2/d5/db/d3b/d5a/daa/ffa x:0 0 0 2024-03-28T13:09:26.164 INFO:tasks.workunit.client.0.smithi076.stdout:5/820: symlink d5/d9/l131 0 2024-03-28T13:09:26.165 INFO:tasks.workunit.client.0.smithi076.stdout:5/821: dread - d5/d9/d1c/d1d/d22/d9d/dcb/fff zero size 2024-03-28T13:09:26.215 INFO:tasks.workunit.client.0.smithi076.stdout:6/850: dwrite d6/da/d39/d63/d113/dc8/fd8 [0,4194304] 0 2024-03-28T13:09:26.234 INFO:tasks.workunit.client.0.smithi076.stdout:1/698: sync 2024-03-28T13:09:26.234 INFO:tasks.workunit.client.0.smithi076.stdout:0/838: sync 2024-03-28T13:09:26.234 INFO:tasks.workunit.client.0.smithi076.stdout:7/749: sync 2024-03-28T13:09:26.234 INFO:tasks.workunit.client.0.smithi076.stdout:1/699: stat d14/d6c/fa7 0 2024-03-28T13:09:26.234 INFO:tasks.workunit.client.0.smithi076.stdout:0/839: dread - db/dd1/f114 zero size 2024-03-28T13:09:26.264 INFO:tasks.workunit.client.0.smithi076.stdout:2/814: mkdir d2/d5/db/d3b/d60/dfb 0 2024-03-28T13:09:26.805 INFO:tasks.workunit.client.0.smithi076.stdout:6/851: symlink d6/da/d40/l115 0 2024-03-28T13:09:26.830 INFO:tasks.workunit.client.0.smithi076.stdout:6/852: dwrite d6/da/d23/f97 [0,4194304] 0 2024-03-28T13:09:26.877 INFO:tasks.workunit.client.0.smithi076.stdout:7/750: creat d1/dc/f10a x:0 0 0 2024-03-28T13:09:26.936 INFO:tasks.workunit.client.0.smithi076.stdout:0/840: getdents db/dc/df/d11 0 2024-03-28T13:09:26.936 INFO:tasks.workunit.client.0.smithi076.stdout:0/841: write db/dc/df/d11/d40/d77/da2/d6d/f8c [3631732,41233] 0 2024-03-28T13:09:27.109 INFO:tasks.workunit.client.0.smithi076.stdout:2/815: mknod d2/cfc 0 2024-03-28T13:09:27.109 INFO:tasks.workunit.client.0.smithi076.stdout:2/816: dread - d2/d5/d7/d8/d21/fe5 zero size 2024-03-28T13:09:27.337 INFO:tasks.workunit.client.0.smithi076.stdout:6/853: unlink d6/da/d1e/f86 0 2024-03-28T13:09:27.337 INFO:tasks.workunit.client.0.smithi076.stdout:7/751: creat d1/d18/d3c/d48/d69/d79/f10b x:0 0 0 2024-03-28T13:09:27.337 INFO:tasks.workunit.client.0.smithi076.stdout:7/752: chown d1/f7e 419676722 1 2024-03-28T13:09:27.349 INFO:tasks.workunit.client.0.smithi076.stdout:6/854: dread d6/da/d23/fa7 [0,4194304] 0 2024-03-28T13:09:27.567 INFO:tasks.workunit.client.0.smithi076.stdout:2/817: getdents d2/d5/db/d3b 0 2024-03-28T13:09:27.614 INFO:tasks.workunit.client.0.smithi076.stdout:7/753: creat d1/d18/d3c/d7b/d7d/f10c x:0 0 0 2024-03-28T13:09:27.614 INFO:tasks.workunit.client.0.smithi076.stdout:7/754: stat d1/d18/d3c/f44 0 2024-03-28T13:09:27.645 INFO:tasks.workunit.client.0.smithi076.stdout:7/755: dwrite d1/d18/d3c/f24 [4194304,4194304] 0 2024-03-28T13:09:27.645 INFO:tasks.workunit.client.0.smithi076.stdout:7/756: fsync d1/f5 0 2024-03-28T13:09:27.679 INFO:tasks.workunit.client.0.smithi076.stdout:7/757: dwrite d1/d18/d3c/d7b/d7d/fca [0,4194304] 0 2024-03-28T13:09:27.740 INFO:tasks.workunit.client.0.smithi076.stdout:5/822: rename d5/f76 to d5/d9/d1c/d1d/d22/d110/f132 0 2024-03-28T13:09:27.740 INFO:tasks.workunit.client.0.smithi076.stdout:6/855: creat d6/da/d89/f116 x:0 0 0 2024-03-28T13:09:27.740 INFO:tasks.workunit.client.0.smithi076.stdout:5/823: write d5/d9/d4c/f12f [37089,16190] 0 2024-03-28T13:09:27.766 INFO:tasks.workunit.client.0.smithi076.stdout:6/856: write d6/da/d40/d62/db0/fbc [1423775,92481] 0 2024-03-28T13:09:27.766 INFO:tasks.workunit.client.0.smithi076.stdout:6/857: chown d6/da/d5f/d6d/d95/fb2 54 1 2024-03-28T13:09:27.766 INFO:tasks.workunit.client.0.smithi076.stdout:6/858: fdatasync d6/da/d40/f82 0 2024-03-28T13:09:27.794 INFO:tasks.workunit.client.0.smithi076.stdout:2/818: rename d2/d5/d7/d3e/cce to d2/d5/d7/d3e/cfd 0 2024-03-28T13:09:28.273 INFO:tasks.workunit.client.0.smithi076.stdout:7/758: rmdir d1/d18/d3c/d7b/d7d 39 2024-03-28T13:09:28.273 INFO:tasks.workunit.client.0.smithi076.stdout:7/759: chown d1/d8/c41 517617 1 2024-03-28T13:09:28.296 INFO:tasks.workunit.client.0.smithi076.stdout:3/696: write d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/f40 [1072638,25838] 0 2024-03-28T13:09:28.296 INFO:tasks.workunit.client.0.smithi076.stdout:3/697: chown d1/d7/d30/d71/fa6 265930694 1 2024-03-28T13:09:28.371 INFO:tasks.workunit.client.0.smithi076.stdout:5/824: mkdir d5/d9/d1c/dec/d133 0 2024-03-28T13:09:28.399 INFO:tasks.workunit.client.0.smithi076.stdout:5/825: dwrite d5/db/df/fa2 [8388608,4194304] 0 2024-03-28T13:09:28.486 INFO:tasks.workunit.client.0.smithi076.stdout:6/859: truncate d6/da/d1e/f5a 888259 0 2024-03-28T13:09:28.486 INFO:tasks.workunit.client.0.smithi076.stdout:6/860: fsync d6/f7a 0 2024-03-28T13:09:28.486 INFO:tasks.workunit.client.0.smithi076.stdout:6/861: fsync d6/da/d40/d56/d58/fbd 0 2024-03-28T13:09:28.542 INFO:tasks.workunit.client.0.smithi076.stdout:2/819: creat d2/d5/d4b/d39/ffe x:0 0 0 2024-03-28T13:09:28.592 INFO:tasks.workunit.client.0.smithi076.stdout:9/820: unlink d9/dd/df/l2c 0 2024-03-28T13:09:28.592 INFO:tasks.workunit.client.0.smithi076.stdout:9/821: fsync d9/dd/df/d11/d14/d58/da1/fba 0 2024-03-28T13:09:28.712 INFO:tasks.workunit.client.0.smithi076.stdout:7/760: rename d1/d18/d3c/cce to d1/d8/dc2/dc4/d104/c10d 0 2024-03-28T13:09:28.771 INFO:tasks.workunit.client.0.smithi076.stdout:3/698: unlink d1/d7/d30/d38/l49 0 2024-03-28T13:09:28.861 INFO:tasks.workunit.client.0.smithi076.stdout:5/826: link d5/d9/d1c/d25/dbd/d7a/l12a d5/d9/d1c/d1d/d31/ded/d91/d105/l134 0 2024-03-28T13:09:28.861 INFO:tasks.workunit.client.0.smithi076.stdout:5/827: chown d5/f6 284349617 1 2024-03-28T13:09:29.028 INFO:tasks.workunit.client.0.smithi076.stdout:2/820: truncate d2/d5/d4b/d39/d57/fbd 218140 0 2024-03-28T13:09:29.028 INFO:tasks.workunit.client.0.smithi076.stdout:9/822: mkdir d9/dd/df7 0 2024-03-28T13:09:29.056 INFO:tasks.workunit.client.0.smithi076.stdout:7/761: mkdir d1/dc/d8b/dbf/d10e 0 2024-03-28T13:09:29.057 INFO:tasks.workunit.client.0.smithi076.stdout:7/762: truncate d1/dc/f10a 266964 0 2024-03-28T13:09:29.150 INFO:tasks.workunit.client.0.smithi076.stdout:5/828: mkdir d5/d9/d1c/d1d/d31/ded/d91/d105/d135 0 2024-03-28T13:09:29.291 INFO:tasks.workunit.client.0.smithi076.stdout:2/821: creat d2/fff x:0 0 0 2024-03-28T13:09:29.326 INFO:tasks.workunit.client.0.smithi076.stdout:9/823: mkdir d9/dd/df/d11/d14/d58/d6e/df8 0 2024-03-28T13:09:29.400 INFO:tasks.workunit.client.0.smithi076.stdout:7/763: rename d1/d8/dc2/dc4/fcc to d1/dc/d8b/dbf/f10f 0 2024-03-28T13:09:29.548 INFO:tasks.workunit.client.0.smithi076.stdout:2/822: creat d2/d5/db/d3b/d3f/f100 x:0 0 0 2024-03-28T13:09:29.788 INFO:tasks.workunit.client.0.smithi076.stdout:9/824: stat d9/dd/df/d11/d14/d58/f6c 0 2024-03-28T13:09:30.042 INFO:tasks.workunit.client.0.smithi076.stdout:9/825: mkdir d9/dd/df/d11/d37/dc4/df9 0 2024-03-28T13:09:30.046 INFO:tasks.workunit.client.0.smithi076.stdout:9/826: write d9/dd/df/d11/d14/f16 [491127,60417] 0 2024-03-28T13:09:30.306 INFO:tasks.workunit.client.0.smithi076.stdout:9/827: creat d9/dd/d48/dd7/ffa x:0 0 0 2024-03-28T13:09:30.306 INFO:tasks.workunit.client.0.smithi076.stdout:9/828: chown d9/d74/db3/db5/fbc 13261 1 2024-03-28T13:09:30.351 INFO:tasks.workunit.client.0.smithi076.stdout:9/829: dwrite d9/dd/df/d11/d14/d58/d6e/d2a/fdc [0,4194304] 0 2024-03-28T13:09:30.752 INFO:tasks.workunit.client.0.smithi076.stdout:4/846: sync 2024-03-28T13:09:30.753 INFO:tasks.workunit.client.0.smithi076.stdout:1/700: sync 2024-03-28T13:09:30.753 INFO:tasks.workunit.client.0.smithi076.stdout:8/841: sync 2024-03-28T13:09:30.753 INFO:tasks.workunit.client.0.smithi076.stdout:0/842: sync 2024-03-28T13:09:30.753 INFO:tasks.workunit.client.0.smithi076.stdout:1/701: write d14/d19/d20/f27 [947293,20569] 0 2024-03-28T13:09:30.753 INFO:tasks.workunit.client.0.smithi076.stdout:0/843: chown db/dc/df/d18/d1d/d75/d51/d60/d89/c12a 178537 1 2024-03-28T13:09:30.753 INFO:tasks.workunit.client.0.smithi076.stdout:0/844: fdatasync db/dc/f66 0 2024-03-28T13:09:30.753 INFO:tasks.workunit.client.0.smithi076.stdout:1/702: fdatasync d14/d6c/d74/f78 0 2024-03-28T13:09:30.753 INFO:tasks.workunit.client.0.smithi076.stdout:0/845: dread - db/dc/df/d18/d1d/d21/dd2/ffb zero size 2024-03-28T13:09:30.753 INFO:tasks.workunit.client.0.smithi076.stdout:4/847: write d0/f73 [4324337,10763] 0 2024-03-28T13:09:30.799 INFO:tasks.workunit.client.0.smithi076.stdout:0/846: dwrite db/dc/df/d18/d1d/d75/d51/fbc [0,4194304] 0 2024-03-28T13:09:30.847 INFO:tasks.workunit.client.0.smithi076.stdout:0/847: dwrite db/dc/df/d11/d40/d77/da2/f6b [0,4194304] 0 2024-03-28T13:09:30.847 INFO:tasks.workunit.client.0.smithi076.stdout:0/848: fdatasync db/ff8 0 2024-03-28T13:09:30.849 INFO:tasks.workunit.client.0.smithi076.stdout:9/830: creat d9/d74/db3/db5/ffb x:0 0 0 2024-03-28T13:09:30.849 INFO:tasks.workunit.client.0.smithi076.stdout:9/831: chown d9/dd/df/d11/d37/fd0 12 1 2024-03-28T13:09:30.849 INFO:tasks.workunit.client.0.smithi076.stdout:9/832: getdents d9/dd/df/d11/d14/d58/da1 0 2024-03-28T13:09:30.860 INFO:tasks.workunit.client.0.smithi076.stdout:9/833: dread d9/dd/df/d11/d14/d58/f6c [0,4194304] 0 2024-03-28T13:09:30.966 INFO:tasks.workunit.client.0.smithi076.stdout:6/862: dwrite d6/da/d1e/f47 [0,4194304] 0 2024-03-28T13:09:31.004 INFO:tasks.workunit.client.0.smithi076.stdout:8/842: creat de/d13/dc9/f126 x:0 0 0 2024-03-28T13:09:31.018 INFO:tasks.workunit.client.0.smithi076.stdout:8/843: dread de/d25/f5b [0,4194304] 0 2024-03-28T13:09:31.132 INFO:tasks.workunit.client.0.smithi076.stdout:1/703: mknod d14/cf6 0 2024-03-28T13:09:31.193 INFO:tasks.workunit.client.0.smithi076.stdout:4/848: creat d0/d20/d7f/dda/d2d/f11b x:0 0 0 2024-03-28T13:09:31.526 INFO:tasks.workunit.client.0.smithi076.stdout:0/849: rmdir db/dc/df/d18/d1d/d21 39 2024-03-28T13:09:31.666 INFO:tasks.workunit.client.0.smithi076.stdout:5/829: write d5/f9a [280062,116758] 0 2024-03-28T13:09:31.666 INFO:tasks.workunit.client.0.smithi076.stdout:5/830: readlink d5/d9/d4c/l96 0 2024-03-28T13:09:31.971 INFO:tasks.workunit.client.0.smithi076.stdout:2/823: write d2/d5/d7/d3e/f81 [4043958,127729] 0 2024-03-28T13:09:31.971 INFO:tasks.workunit.client.0.smithi076.stdout:2/824: fsync d2/d5/db/d3b/d5a/fea 0 2024-03-28T13:09:31.993 INFO:tasks.workunit.client.0.smithi076.stdout:2/825: write d2/d5/db/d3b/d5a/d8d/dc1/fc6 [2297240,36442] 0 2024-03-28T13:09:31.994 INFO:tasks.workunit.client.0.smithi076.stdout:7/764: dwrite d1/dc/f55 [0,4194304] 0 2024-03-28T13:09:32.024 INFO:tasks.workunit.client.0.smithi076.stdout:7/765: dwrite d1/d81/dd7/f102 [0,4194304] 0 2024-03-28T13:09:32.086 INFO:tasks.workunit.client.0.smithi076.stdout:6/863: mknod d6/da/d23/c117 0 2024-03-28T13:09:32.311 INFO:tasks.workunit.client.0.smithi076.stdout:8/844: creat de/d23/d2b/d51/d71/f127 x:0 0 0 2024-03-28T13:09:32.312 INFO:tasks.workunit.client.0.smithi076.stdout:1/704: creat d14/d19/d85/d2e/d31/d51/d92/da4/db5/ff7 x:0 0 0 2024-03-28T13:09:32.312 INFO:tasks.workunit.client.0.smithi076.stdout:1/705: chown d14/d19/d85/d2e/d31/d3b/ce5 12487 1 2024-03-28T13:09:32.348 INFO:tasks.workunit.client.0.smithi076.stdout:8/845: dwrite de/d13/da2/dee/f114 [0,4194304] 0 2024-03-28T13:09:32.421 INFO:tasks.workunit.client.0.smithi076.stdout:0/850: rename db/dc/df/d18/d1d/d75/d51/d60/f70 to db/d16/f12e 0 2024-03-28T13:09:32.550 INFO:tasks.workunit.client.0.smithi076.stdout:2/826: mknod d2/d5/db/d3b/d5a/c101 0 2024-03-28T13:09:32.550 INFO:tasks.workunit.client.0.smithi076.stdout:2/827: fdatasync d2/d5/d7/d28/f43 0 2024-03-28T13:09:32.735 INFO:tasks.workunit.client.0.smithi076.stdout:6/864: truncate d6/da/d23/f43 6045928 0 2024-03-28T13:09:32.735 INFO:tasks.workunit.client.0.smithi076.stdout:6/865: fdatasync d6/da/f15 0 2024-03-28T13:09:32.735 INFO:tasks.workunit.client.0.smithi076.stdout:6/866: truncate d6/da/d40/d56/dd1/ff6 898628 0 2024-03-28T13:09:32.786 INFO:tasks.workunit.client.0.smithi076.stdout:1/706: link d14/d19/d85/d62/c9b d14/d19/d85/d2e/d3c/d7e/cf8 0 2024-03-28T13:09:33.355 INFO:tasks.workunit.client.0.smithi076.stdout:9/834: dwrite d9/dd/d48/f66 [4194304,4194304] 0 2024-03-28T13:09:33.355 INFO:tasks.workunit.client.0.smithi076.stdout:9/835: write d9/dd/df/d11/fd1 [555274,65220] 0 2024-03-28T13:09:33.459 INFO:tasks.workunit.client.0.smithi076.stdout:8/846: dread de/d13/f80 [0,4194304] 0 2024-03-28T13:09:33.616 INFO:tasks.workunit.client.0.smithi076.stdout:5/831: rename d5/d9/d1c/d1d/d31/ded/d91 to d5/d9/d1c/d25/d136 0 2024-03-28T13:09:33.616 INFO:tasks.workunit.client.0.smithi076.stdout:7/766: creat d1/dc/f110 x:0 0 0 2024-03-28T13:09:33.616 INFO:tasks.workunit.client.0.smithi076.stdout:7/767: readlink d1/d8/dc2/d100/ld9 0 2024-03-28T13:09:33.651 INFO:tasks.workunit.client.0.smithi076.stdout:5/832: dwrite d5/db/d19/f12c [0,4194304] 0 2024-03-28T13:09:33.671 INFO:tasks.workunit.client.0.smithi076.stdout:3/699: link d1/d7/d30/d38/d14/d36/d56/d5b/f76 d1/d7/fef 0 2024-03-28T13:09:33.673 INFO:tasks.workunit.client.0.smithi076.stdout:5/833: dread d5/d9/d1c/d1d/d31/f104 [0,4194304] 0 2024-03-28T13:09:33.691 INFO:tasks.workunit.client.0.smithi076.stdout:0/851: chown db/dc/df/d11/d40/feb 9090 1 2024-03-28T13:09:33.733 INFO:tasks.workunit.client.0.smithi076.stdout:0/852: dwrite db/f4b [4194304,4194304] 0 2024-03-28T13:09:33.733 INFO:tasks.workunit.client.0.smithi076.stdout:0/853: chown db/dc/df/d18/d1d/fb8 952 1 2024-03-28T13:09:33.772 INFO:tasks.workunit.client.0.smithi076.stdout:2/828: rmdir d2/d5/db/d3b/d94 39 2024-03-28T13:09:33.773 INFO:tasks.workunit.client.0.smithi076.stdout:0/854: dwrite db/dc/df/d18/d1d/fb8 [4194304,4194304] 0 2024-03-28T13:09:34.105 INFO:tasks.workunit.client.0.smithi076.stdout:6/867: creat d6/da/d5f/d6d/daf/f118 x:0 0 0 2024-03-28T13:09:34.215 INFO:tasks.workunit.client.0.smithi076.stdout:1/707: link d14/d6c/d74/f95 d14/d19/d85/d2e/d31/d8f/ff9 0 2024-03-28T13:09:34.215 INFO:tasks.workunit.client.0.smithi076.stdout:1/708: readlink d14/d19/d85/d3f/ld8 0 2024-03-28T13:09:34.217 INFO:tasks.workunit.client.0.smithi076.stdout:4/849: write d0/d20/d7f/dda/fa7 [8665442,110089] 0 2024-03-28T13:09:34.799 INFO:tasks.workunit.client.0.smithi076.stdout:9/836: symlink d9/d74/d7d/lfc 0 2024-03-28T13:09:34.872 INFO:tasks.workunit.client.0.smithi076.stdout:8/847: mknod de/d4e/d121/c128 0 2024-03-28T13:09:34.946 INFO:tasks.workunit.client.0.smithi076.stdout:7/768: truncate d1/d18/f5c 2952291 0 2024-03-28T13:09:35.069 INFO:tasks.workunit.client.0.smithi076.stdout:3/700: stat d1/d7/d30/d38/d14/c90 0 2024-03-28T13:09:35.171 INFO:tasks.workunit.client.0.smithi076.stdout:5/834: creat d5/db/d3f/d97/f137 x:0 0 0 2024-03-28T13:09:35.171 INFO:tasks.workunit.client.0.smithi076.stdout:2/829: mknod d2/d5/db/d3b/d94/c102 0 2024-03-28T13:09:35.171 INFO:tasks.workunit.client.0.smithi076.stdout:2/830: write d2/d5/d7/d8/d21/f27 [5205749,77384] 0 2024-03-28T13:09:35.171 INFO:tasks.workunit.client.0.smithi076.stdout:2/831: dread - d2/d5/db/d3b/fd3 zero size 2024-03-28T13:09:35.217 INFO:tasks.workunit.client.0.smithi076.stdout:2/832: dwrite d2/fff [0,4194304] 0 2024-03-28T13:09:35.218 INFO:tasks.workunit.client.0.smithi076.stdout:2/833: write d2/d5/d7/f40 [1980098,70423] 0 2024-03-28T13:09:35.392 INFO:tasks.workunit.client.0.smithi076.stdout:1/709: mknod d14/d19/d85/d2e/d31/d49/cfa 0 2024-03-28T13:09:35.417 INFO:tasks.workunit.client.0.smithi076.stdout:1/710: dwrite d14/d19/d85/d2e/d31/d8f/f9c [0,4194304] 0 2024-03-28T13:09:35.417 INFO:tasks.workunit.client.0.smithi076.stdout:1/711: getdents d14/d19/d85/d2e/d31/df3 0 2024-03-28T13:09:35.451 INFO:tasks.workunit.client.0.smithi076.stdout:4/850: symlink d0/d3b/d50/de6/l11c 0 2024-03-28T13:09:35.458 INFO:tasks.workunit.client.0.smithi076.stdout:1/712: dwrite d14/d19/d85/d2e/d31/d49/fcf [0,4194304] 0 2024-03-28T13:09:36.019 INFO:tasks.workunit.client.0.smithi076.stdout:9/837: creat d9/dd/df/d11/ffd x:0 0 0 2024-03-28T13:09:36.020 INFO:tasks.workunit.client.0.smithi076.stdout:8/848: creat de/d25/f129 x:0 0 0 2024-03-28T13:09:36.056 INFO:tasks.workunit.client.0.smithi076.stdout:8/849: dwrite de/d23/d2b/d5d/d76/f3e [0,4194304] 0 2024-03-28T13:09:36.096 INFO:tasks.workunit.client.0.smithi076.stdout:7/769: truncate d1/f56 2870956 0 2024-03-28T13:09:36.204 INFO:tasks.workunit.client.0.smithi076.stdout:5/835: mkdir d5/d9/d1c/d25/d73/d138 0 2024-03-28T13:09:36.365 INFO:tasks.workunit.client.0.smithi076.stdout:2/834: truncate d2/d5/db/d3b/f62 2726133 0 2024-03-28T13:09:36.366 INFO:tasks.workunit.client.0.smithi076.stdout:2/835: readlink d2/d5/db/d3b/d94/lbe 0 2024-03-28T13:09:36.392 INFO:tasks.workunit.client.0.smithi076.stdout:2/836: dwrite d2/d5/db/d3b/d5a/d8d/fd2 [0,4194304] 0 2024-03-28T13:09:36.699 INFO:tasks.workunit.client.0.smithi076.stdout:4/851: link d0/d20/d7f/dda/db7/ff3 d0/d20/d7f/dda/d2d/d75/f11d 0 2024-03-28T13:09:36.737 INFO:tasks.workunit.client.0.smithi076.stdout:1/713: mkdir d14/d19/d85/d2e/d31/d51/d92/da4/dfb 0 2024-03-28T13:09:36.737 INFO:tasks.workunit.client.0.smithi076.stdout:9/838: mknod d9/dd/df/d11/d14/d58/d6e/d2a/cfe 0 2024-03-28T13:09:36.934 INFO:tasks.workunit.client.0.smithi076.stdout:8/850: stat de/d25/d7f 0 2024-03-28T13:09:36.961 INFO:tasks.workunit.client.0.smithi076.stdout:7/770: truncate d1/f3d 3921782 0 2024-03-28T13:09:36.961 INFO:tasks.workunit.client.0.smithi076.stdout:7/771: fsync d1/d81/dc3/f88 0 2024-03-28T13:09:36.961 INFO:tasks.workunit.client.0.smithi076.stdout:7/772: write d1/dc/d8b/dbf/f10f [1784998,60588] 0 2024-03-28T13:09:37.003 INFO:tasks.workunit.client.0.smithi076.stdout:3/701: creat d1/d7/d30/d38/d14/d27/ff0 x:0 0 0 2024-03-28T13:09:37.033 INFO:tasks.workunit.client.0.smithi076.stdout:5/836: mknod d5/d9/d1c/d25/dbd/c139 0 2024-03-28T13:09:37.048 INFO:tasks.workunit.client.0.smithi076.stdout:5/837: dread d5/d9/d4c/d98/fc6 [0,4194304] 0 2024-03-28T13:09:37.158 INFO:tasks.workunit.client.0.smithi076.stdout:2/837: creat d2/d5/d7/dd/f103 x:0 0 0 2024-03-28T13:09:37.241 INFO:tasks.workunit.client.0.smithi076.stdout:9/839: rmdir d9/d74/db3 39 2024-03-28T13:09:37.264 INFO:tasks.workunit.client.0.smithi076.stdout:9/840: dwrite d9/d3c/f43 [0,4194304] 0 2024-03-28T13:09:37.311 INFO:tasks.workunit.client.0.smithi076.stdout:8/851: creat de/d23/d2b/d5d/d76/f12a x:0 0 0 2024-03-28T13:09:37.328 INFO:tasks.workunit.client.0.smithi076.stdout:8/852: dread de/d4e/d54/d98/f9d [0,4194304] 0 2024-03-28T13:09:37.399 INFO:tasks.workunit.client.0.smithi076.stdout:7/773: readlink d1/d18/d3c/d48/l96 0 2024-03-28T13:09:37.481 INFO:tasks.workunit.client.0.smithi076.stdout:5/838: getdents d5/db/df 0 2024-03-28T13:09:37.565 INFO:tasks.workunit.client.0.smithi076.stdout:2/838: mknod d2/d5/db/d3b/d9f/d9e/c104 0 2024-03-28T13:09:37.730 INFO:tasks.workunit.client.0.smithi076.stdout:7/774: mknod d1/d18/d3c/d7b/c111 0 2024-03-28T13:09:37.754 INFO:tasks.workunit.client.0.smithi076.stdout:3/702: dread - d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/faa zero size 2024-03-28T13:09:37.802 INFO:tasks.workunit.client.0.smithi076.stdout:5/839: rmdir d5/d9/d1c/d25/d73 39 2024-03-28T13:09:38.028 INFO:tasks.workunit.client.0.smithi076.stdout:2/839: dread d2/d5/d7/d28/f8b [0,4194304] 0 2024-03-28T13:09:38.053 INFO:tasks.workunit.client.0.smithi076.stdout:2/840: dwrite d2/d5/d7/dd/dc8/fcc [0,4194304] 0 2024-03-28T13:09:38.053 INFO:tasks.workunit.client.0.smithi076.stdout:2/841: write d2/d5/f84 [106465,24739] 0 2024-03-28T13:09:38.056 INFO:tasks.workunit.client.0.smithi076.stdout:2/842: write d2/d5/db/d3b/f9a [416123,98256] 0 2024-03-28T13:09:38.092 INFO:tasks.workunit.client.0.smithi076.stdout:7/775: link d1/d8/dc2/dc4/ld8 d1/d81/dd7/l112 0 2024-03-28T13:09:38.093 INFO:tasks.workunit.client.0.smithi076.stdout:0/855: write db/dc/df/d71/d4a/f72 [3024590,106353] 0 2024-03-28T13:09:38.178 INFO:tasks.workunit.client.0.smithi076.stdout:9/841: rename d9/l19 to d9/dd/df/d11/d14/d58/d6e/df8/lff 0 2024-03-28T13:09:38.203 INFO:tasks.workunit.client.0.smithi076.stdout:9/842: dwrite d9/dd/df/d11/d14/f16 [0,4194304] 0 2024-03-28T13:09:38.203 INFO:tasks.workunit.client.0.smithi076.stdout:9/843: fdatasync d9/dd/f2e 0 2024-03-28T13:09:38.204 INFO:tasks.workunit.client.0.smithi076.stdout:9/844: fdatasync d9/d74/f83 0 2024-03-28T13:09:38.204 INFO:tasks.workunit.client.0.smithi076.stdout:9/845: write d9/dd/df/d11/d14/d58/d6e/f60 [3568970,11794] 0 2024-03-28T13:09:38.204 INFO:tasks.workunit.client.0.smithi076.stdout:9/846: dread - d9/dd/df/d11/db2/fcc zero size 2024-03-28T13:09:38.320 INFO:tasks.workunit.client.0.smithi076.stdout:5/840: unlink d5/d9/d35/d3b/d115/l121 0 2024-03-28T13:09:38.331 INFO:tasks.workunit.client.0.smithi076.stdout:5/841: dread d5/db/d19/f12c [0,4194304] 0 2024-03-28T13:09:38.581 INFO:tasks.workunit.client.0.smithi076.stdout:0/856: symlink db/dc/d3d/d57/l12f 0 2024-03-28T13:09:38.715 INFO:tasks.workunit.client.0.smithi076.stdout:5/842: truncate d5/d9/f111 1011800 0 2024-03-28T13:09:38.789 INFO:tasks.workunit.client.0.smithi076.stdout:9/847: symlink d9/dd/df/d11/d37/l100 0 2024-03-28T13:09:38.789 INFO:tasks.workunit.client.0.smithi076.stdout:9/848: chown d9/dd/df/d11/d37/dc4 473141321 1 2024-03-28T13:09:38.872 INFO:tasks.workunit.client.0.smithi076.stdout:5/843: rename d5/d9/d1c/d25/f3a to d5/db/f13a 0 2024-03-28T13:09:38.872 INFO:tasks.workunit.client.0.smithi076.stdout:5/844: readlink d5/d9/lca 0 2024-03-28T13:09:38.989 INFO:tasks.workunit.client.0.smithi076.stdout:0/857: link db/dc/df/d18/d1d/d75/d51/d60/d89/fd0 db/dc/df/d11/dfc/dfd/f130 0 2024-03-28T13:09:38.989 INFO:tasks.workunit.client.0.smithi076.stdout:0/858: chown db/dc/df/d11/d40/d77/da2/d6d/f8c 1 1 2024-03-28T13:09:39.028 INFO:tasks.workunit.client.0.smithi076.stdout:6/868: sync 2024-03-28T13:09:39.028 INFO:tasks.workunit.client.0.smithi076.stdout:9/849: mkdir d9/dd/d48/dd7/dd9/d101 0 2024-03-28T13:09:39.028 INFO:tasks.workunit.client.0.smithi076.stdout:9/850: fsync d9/dd/df/d11/d37/fc0 0 2024-03-28T13:09:39.028 INFO:tasks.workunit.client.0.smithi076.stdout:9/851: write d9/dd/df/d11/d14/f8c [3336897,51644] 0 2024-03-28T13:09:39.055 INFO:tasks.workunit.client.0.smithi076.stdout:9/852: dwrite d9/dd/df/d11/d14/f16 [0,4194304] 0 2024-03-28T13:09:39.055 INFO:tasks.workunit.client.0.smithi076.stdout:9/853: chown d9/l38 3 1 2024-03-28T13:09:39.409 INFO:tasks.workunit.client.0.smithi076.stdout:0/859: creat db/dc/df/d71/d4a/d7e/f131 x:0 0 0 2024-03-28T13:09:39.410 INFO:tasks.workunit.client.0.smithi076.stdout:0/860: write db/dc/df/d18/d1d/d21/dd2/df1/f118 [155211,18841] 0 2024-03-28T13:09:39.458 INFO:tasks.workunit.client.0.smithi076.stdout:0/861: dwrite db/dc/df/d18/d1d/d75/d51/d60/d89/fd0 [0,4194304] 0 2024-03-28T13:09:39.513 INFO:tasks.workunit.client.0.smithi076.stdout:6/869: rename d6/fc9 to d6/da/d89/f119 0 2024-03-28T13:09:39.554 INFO:tasks.workunit.client.0.smithi076.stdout:6/870: dwrite d6/da/d1e/f1f [4194304,4194304] 0 2024-03-28T13:09:39.577 INFO:tasks.workunit.client.0.smithi076.stdout:6/871: write d6/da/d39/f3b [6449209,62256] 0 2024-03-28T13:09:39.605 INFO:tasks.workunit.client.0.smithi076.stdout:6/872: dwrite d6/da/d39/d63/d113/dc8/fd8 [0,4194304] 0 2024-03-28T13:09:39.605 INFO:tasks.workunit.client.0.smithi076.stdout:6/873: read d6/da/d5f/d6d/fbb [2827583,69899] 0 2024-03-28T13:09:39.605 INFO:tasks.workunit.client.0.smithi076.stdout:6/874: write d6/da/d89/f112 [909674,122194] 0 2024-03-28T13:09:39.711 INFO:tasks.workunit.client.0.smithi076.stdout:9/854: creat d9/d74/db3/f102 x:0 0 0 2024-03-28T13:09:39.998 INFO:tasks.workunit.client.0.smithi076.stdout:0/862: link db/dc/d3d/c7c db/dd1/c132 0 2024-03-28T13:09:40.479 INFO:tasks.workunit.client.0.smithi076.stdout:0/863: creat db/dc/df/d18/d1d/d75/d51/d97/f133 x:0 0 0 2024-03-28T13:09:40.551 INFO:tasks.workunit.client.0.smithi076.stdout:6/875: mkdir d6/da/d40/d56/da4/d11a 0 2024-03-28T13:09:40.551 INFO:tasks.workunit.client.0.smithi076.stdout:6/876: chown d6/da/d40/d62/dca/ddd 130 1 2024-03-28T13:09:40.564 INFO:tasks.workunit.client.0.smithi076.stdout:6/877: write d6/da/d39/f61 [3016402,115365] 0 2024-03-28T13:09:40.618 INFO:tasks.workunit.client.0.smithi076.stdout:1/714: write d14/d19/d85/d2e/d31/d49/f63 [938066,4685] 0 2024-03-28T13:09:40.827 INFO:tasks.workunit.client.0.smithi076.stdout:0/864: mkdir db/dc/d3d/d134 0 2024-03-28T13:09:40.977 INFO:tasks.workunit.client.0.smithi076.stdout:8/853: creat de/d23/f12b x:0 0 0 2024-03-28T13:09:40.977 INFO:tasks.workunit.client.0.smithi076.stdout:8/854: fsync de/d23/d2b/d51/d62/d8b/f91 0 2024-03-28T13:09:40.996 INFO:tasks.workunit.client.0.smithi076.stdout:4/852: dwrite d0/d3b/d50/ffd [0,4194304] 0 2024-03-28T13:09:40.997 INFO:tasks.workunit.client.0.smithi076.stdout:4/853: write d0/d3b/d40/d42/d31/f99 [273282,106544] 0 2024-03-28T13:09:41.173 INFO:tasks.workunit.client.0.smithi076.stdout:1/715: rename d14/d19/d20/cea to d14/d19/d85/d2e/d31/d51/cfc 0 2024-03-28T13:09:41.173 INFO:tasks.workunit.client.0.smithi076.stdout:1/716: dread - d14/d19/d20/dbf/ff1 zero size 2024-03-28T13:09:41.173 INFO:tasks.workunit.client.0.smithi076.stdout:1/717: fsync d14/f32 0 2024-03-28T13:09:41.173 INFO:tasks.workunit.client.0.smithi076.stdout:1/718: write d14/d6c/d74/f95 [1315884,38726] 0 2024-03-28T13:09:41.173 INFO:tasks.workunit.client.0.smithi076.stdout:1/719: stat d14/d19/d20/dbf/ff1 0 2024-03-28T13:09:41.193 INFO:tasks.workunit.client.0.smithi076.stdout:1/720: dread fd [0,4194304] 0 2024-03-28T13:09:41.193 INFO:tasks.workunit.client.0.smithi076.stdout:1/721: write d14/d6c/d74/f95 [2132071,13659] 0 2024-03-28T13:09:41.209 INFO:tasks.workunit.client.0.smithi076.stdout:1/722: read d14/d6c/fe7 [1155971,57196] 0 2024-03-28T13:09:41.209 INFO:tasks.workunit.client.0.smithi076.stdout:1/723: chown d14/d19/d85/d2e/d31/d51/cfc 241173718 1 2024-03-28T13:09:41.209 INFO:tasks.workunit.client.0.smithi076.stdout:3/703: dwrite d1/d7/d30/d38/d14/d36/fc6 [0,4194304] 0 2024-03-28T13:09:41.222 INFO:tasks.workunit.client.0.smithi076.stdout:2/843: write d2/d5/d7/f19 [2326326,44911] 0 2024-03-28T13:09:41.223 INFO:tasks.workunit.client.0.smithi076.stdout:3/704: write d1/d7/d30/d38/d14/d27/d42/f68 [2802474,110891] 0 2024-03-28T13:09:41.223 INFO:tasks.workunit.client.0.smithi076.stdout:3/705: stat d1/d2/fee 0 2024-03-28T13:09:41.281 INFO:tasks.workunit.client.0.smithi076.stdout:0/865: dread db/d16/fb6 [0,4194304] 0 2024-03-28T13:09:41.471 INFO:tasks.workunit.client.0.smithi076.stdout:4/854: mknod d0/d3b/d50/d64/c11e 0 2024-03-28T13:09:41.573 INFO:tasks.workunit.client.0.smithi076.stdout:1/724: rename d14/d19/d85/d2e/d31/d49/fe8 to d14/d19/d85/d2e/d31/d8f/ffd 0 2024-03-28T13:09:41.675 INFO:tasks.workunit.client.0.smithi076.stdout:2/844: symlink d2/d5/d7/l105 0 2024-03-28T13:09:41.706 INFO:tasks.workunit.client.0.smithi076.stdout:3/706: readlink d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d58/la0 0 2024-03-28T13:09:41.767 INFO:tasks.workunit.client.0.smithi076.stdout:0/866: symlink db/dc/df/d71/d4a/d7e/d91/l135 0 2024-03-28T13:09:41.911 INFO:tasks.workunit.client.0.smithi076.stdout:4/855: link d0/d3b/d40/d42/d47/d69/la3 d0/d3b/d40/d8d/l11f 0 2024-03-28T13:09:41.968 INFO:tasks.workunit.client.0.smithi076.stdout:1/725: creat d14/d19/d85/d2e/d31/d51/d92/da4/db7/ffe x:0 0 0 2024-03-28T13:09:42.043 INFO:tasks.workunit.client.0.smithi076.stdout:2/845: mknod d2/d5/d4b/d39/d57/de9/c106 0 2024-03-28T13:09:42.106 INFO:tasks.workunit.client.0.smithi076.stdout:3/707: creat d1/d7/d30/d71/ff1 x:0 0 0 2024-03-28T13:09:42.333 INFO:tasks.workunit.client.0.smithi076.stdout:4/856: creat d0/d3b/d50/da8/f120 x:0 0 0 2024-03-28T13:09:42.385 INFO:tasks.workunit.client.0.smithi076.stdout:1/726: getdents d14/d19/d85/d2e/d3c/d7e 0 2024-03-28T13:09:42.414 INFO:tasks.workunit.client.0.smithi076.stdout:1/727: dwrite d14/f32 [0,4194304] 0 2024-03-28T13:09:42.414 INFO:tasks.workunit.client.0.smithi076.stdout:1/728: chown d14/d19/d85/d2e/d31/d51/d92/da4/db5 85771166 1 2024-03-28T13:09:42.414 INFO:tasks.workunit.client.0.smithi076.stdout:1/729: truncate d14/d19/d85/d2e/fbe 965623 0 2024-03-28T13:09:42.436 INFO:tasks.workunit.client.0.smithi076.stdout:1/730: write d14/def/df0/f65 [3219457,38827] 0 2024-03-28T13:09:42.437 INFO:tasks.workunit.client.0.smithi076.stdout:1/731: readlink d14/d19/d85/d2e/d31/d51/l59 0 2024-03-28T13:09:42.453 INFO:tasks.workunit.client.0.smithi076.stdout:2/846: creat d2/d5/db/d3b/d9f/f107 x:0 0 0 2024-03-28T13:09:42.533 INFO:tasks.workunit.client.0.smithi076.stdout:0/867: mknod db/dc/d3d/c136 0 2024-03-28T13:09:42.616 INFO:tasks.workunit.client.0.smithi076.stdout:4/857: mkdir d0/d20/d7b/d81/d121 0 2024-03-28T13:09:42.617 INFO:tasks.workunit.client.0.smithi076.stdout:4/858: write d0/d20/d7f/dda/db7/fe2 [28119,78303] 0 2024-03-28T13:09:42.768 INFO:tasks.workunit.client.0.smithi076.stdout:1/732: mknod d14/d19/d20/dbf/cff 0 2024-03-28T13:09:42.826 INFO:tasks.workunit.client.0.smithi076.stdout:2/847: getdents d2/d5/db/d3b/d3f/d99 0 2024-03-28T13:09:42.826 INFO:tasks.workunit.client.0.smithi076.stdout:2/848: write d2/d5/d4b/d39/d57/fd1 [781602,36467] 0 2024-03-28T13:09:42.845 INFO:tasks.workunit.client.0.smithi076.stdout:2/849: write d2/d5/db/d3b/d5a/d8d/fae [516373,118659] 0 2024-03-28T13:09:42.926 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:09:42.929 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:09:43.780 INFO:tasks.workunit.client.0.smithi076.stdout:1/733: truncate d14/d6c/d74/fe4 1292634 0 2024-03-28T13:09:44.012 INFO:tasks.workunit.client.0.smithi076.stdout:2/850: mknod d2/d5/d7/d8/d21/da0/c108 0 2024-03-28T13:09:44.012 INFO:tasks.workunit.client.0.smithi076.stdout:3/708: link d1/d7/d30/d38/d14/d4a/ddc/ce6 d1/d7/d30/d38/d14/d97/cf2 0 2024-03-28T13:09:44.012 INFO:tasks.workunit.client.0.smithi076.stdout:3/709: chown d1/d7/d30 18 1 2024-03-28T13:09:44.012 INFO:tasks.workunit.client.0.smithi076.stdout:3/710: chown d1/d7/d30/d38/d14/d97/cf2 254809 1 2024-03-28T13:09:44.013 INFO:tasks.workunit.client.0.smithi076.stdout:2/851: fdatasync d2/d5/db/d3b/f62 0 2024-03-28T13:09:44.097 INFO:tasks.workunit.client.0.smithi076.stdout:4/859: mknod d0/d3b/d40/d42/d47/c122 0 2024-03-28T13:09:44.117 INFO:tasks.workunit.client.0.smithi076.stdout:4/860: dwrite d0/d3b/d40/d42/d31/f56 [4194304,4194304] 0 2024-03-28T13:09:44.148 INFO:tasks.workunit.client.0.smithi076.stdout:4/861: dwrite d0/d3b/d40/d42/f24 [0,4194304] 0 2024-03-28T13:09:44.175 INFO:tasks.workunit.client.0.smithi076.stdout:1/734: creat d14/d19/d85/d2e/d31/d51/d92/da4/dfb/f100 x:0 0 0 2024-03-28T13:09:44.177 INFO:tasks.workunit.client.0.smithi076.stdout:1/735: dread d14/d6c/d74/fb4 [0,4194304] 0 2024-03-28T13:09:44.231 INFO:tasks.workunit.client.0.smithi076.stdout:7/776: mkdir d1/d8/dc2/d113 0 2024-03-28T13:09:44.289 INFO:tasks.workunit.client.0.smithi076.stdout:7/777: dwrite d1/d18/d3c/d7b/d7d/f82 [4194304,4194304] 0 2024-03-28T13:09:44.298 INFO:tasks.workunit.client.0.smithi076.stdout:3/711: stat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/ld0 0 2024-03-28T13:09:44.337 INFO:tasks.workunit.client.0.smithi076.stdout:2/852: mknod d2/d5/d7/d28/c109 0 2024-03-28T13:09:44.348 INFO:tasks.workunit.client.0.smithi076.stdout:2/853: write d2/d5/db/d3b/d9f/f8e [53826,110314] 0 2024-03-28T13:09:44.389 INFO:tasks.workunit.client.0.smithi076.stdout:4/862: mkdir d0/d3b/d50/de6/d123 0 2024-03-28T13:09:44.521 INFO:tasks.workunit.client.0.smithi076.stdout:3/712: dread d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/fbf [0,4194304] 0 2024-03-28T13:09:44.753 INFO:tasks.workunit.client.0.smithi076.stdout:4/863: mkdir d0/d3b/d40/d42/d31/d5e/d124 0 2024-03-28T13:09:44.770 INFO:tasks.workunit.client.0.smithi076.stdout:4/864: dread d0/d20/f48 [0,4194304] 0 2024-03-28T13:09:44.872 INFO:tasks.workunit.client.0.smithi076.stdout:4/865: symlink d0/d20/d7b/d81/l125 0 2024-03-28T13:09:44.872 INFO:tasks.workunit.client.0.smithi076.stdout:4/866: chown d0/d3b/d40/d42/d31/d4d/d63/de4/f105 10 1 2024-03-28T13:09:45.646 INFO:tasks.workunit.client.0.smithi076.stdout:2/854: fsync d2/d5/db/d3b/d9f/f107 0 2024-03-28T13:09:45.646 INFO:tasks.workunit.client.0.smithi076.stdout:2/855: fsync d2/d5/db/d3b/d9f/fde 0 2024-03-28T13:09:45.646 INFO:tasks.workunit.client.0.smithi076.stdout:4/867: creat d0/d20/d7b/d81/d121/f126 x:0 0 0 2024-03-28T13:09:45.709 INFO:tasks.workunit.client.0.smithi076.stdout:8/855: dwrite de/d25/f85 [0,4194304] 0 2024-03-28T13:09:45.730 INFO:tasks.workunit.client.0.smithi076.stdout:4/868: creat d0/d3b/d50/da8/f127 x:0 0 0 2024-03-28T13:09:45.730 INFO:tasks.workunit.client.0.smithi076.stdout:4/869: fsync d0/d3b/d40/d42/d31/f56 0 2024-03-28T13:09:45.954 INFO:tasks.workunit.client.0.smithi076.stdout:8/856: dwrite de/d25/f36 [0,4194304] 0 2024-03-28T13:09:46.342 INFO:tasks.workunit.client.0.smithi076.stdout:6/878: sync 2024-03-28T13:09:46.342 INFO:tasks.workunit.client.0.smithi076.stdout:9/855: sync 2024-03-28T13:09:46.342 INFO:tasks.workunit.client.0.smithi076.stdout:0/868: sync 2024-03-28T13:09:46.343 INFO:tasks.workunit.client.0.smithi076.stdout:5/845: sync 2024-03-28T13:09:46.343 INFO:tasks.workunit.client.0.smithi076.stdout:9/856: fsync d9/dd/df/d11/d14/d58/d6e/ff6 0 2024-03-28T13:09:46.343 INFO:tasks.workunit.client.0.smithi076.stdout:6/879: read d6/d99/d46/f74 [1554577,83865] 0 2024-03-28T13:09:46.343 INFO:tasks.workunit.client.0.smithi076.stdout:5/846: write d5/d9/d1c/d25/d136/fd5 [4415117,66706] 0 2024-03-28T13:09:46.343 INFO:tasks.workunit.client.0.smithi076.stdout:5/847: write d5/d9/f40 [4297481,37152] 0 2024-03-28T13:09:46.343 INFO:tasks.workunit.client.0.smithi076.stdout:5/848: fdatasync d5/db/d19/f12c 0 2024-03-28T13:09:46.361 INFO:tasks.workunit.client.0.smithi076.stdout:6/880: write d6/da/d23/f45 [580370,50994] 0 2024-03-28T13:09:46.942 INFO:tasks.workunit.client.0.smithi076.stdout:0/869: symlink db/dd1/l137 0 2024-03-28T13:09:46.943 INFO:tasks.workunit.client.0.smithi076.stdout:0/870: write db/dc/df/d18/d1d/d75/d51/fbc [4666486,76778] 0 2024-03-28T13:09:46.943 INFO:tasks.workunit.client.0.smithi076.stdout:0/871: chown db/dc/df/d11/d40/d77/f86 104570314 1 2024-03-28T13:09:46.977 INFO:tasks.workunit.client.0.smithi076.stdout:9/857: symlink d9/da/de6/df2/l103 0 2024-03-28T13:09:47.175 INFO:tasks.workunit.client.0.smithi076.stdout:4/870: symlink d0/d20/d7f/dda/l128 0 2024-03-28T13:09:47.176 INFO:tasks.workunit.client.0.smithi076.stdout:4/871: chown d0/d3b/f9a 4850284 1 2024-03-28T13:09:47.192 INFO:tasks.workunit.client.0.smithi076.stdout:4/872: dread d0/d3b/d40/d42/d31/d5e/d72/d78/dcc/fd8 [0,4194304] 0 2024-03-28T13:09:47.193 INFO:tasks.workunit.client.0.smithi076.stdout:4/873: write d0/d3b/d40/d42/d31/d4d/d63/de4/f105 [580584,119625] 0 2024-03-28T13:09:47.193 INFO:tasks.workunit.client.0.smithi076.stdout:4/874: fdatasync d0/d20/d7b/fbd 0 2024-03-28T13:09:47.193 INFO:tasks.workunit.client.0.smithi076.stdout:4/875: readlink d0/d20/l107 0 2024-03-28T13:09:47.196 INFO:tasks.workunit.client.0.smithi076.stdout:4/876: read d0/d3b/d40/d42/d31/d5e/f10b [774406,65855] 0 2024-03-28T13:09:47.196 INFO:tasks.workunit.client.0.smithi076.stdout:4/877: truncate d0/d3b/d40/d42/f98 1226819 0 2024-03-28T13:09:47.224 INFO:tasks.workunit.client.0.smithi076.stdout:1/736: rename d14/d19/d85/d2e/d31/c8e to d14/d19/d85/d2e/d31/d46/c101 0 2024-03-28T13:09:47.224 INFO:tasks.workunit.client.0.smithi076.stdout:1/737: fdatasync d14/d19/d85/d2e/fce 0 2024-03-28T13:09:47.229 INFO:tasks.workunit.client.0.smithi076.stdout:5/849: truncate d5/d9/d1c/f6d 655750 0 2024-03-28T13:09:47.247 INFO:tasks.workunit.client.0.smithi076.stdout:5/850: dread d5/d9/d1c/d25/dbd/d7a/fbb [0,4194304] 0 2024-03-28T13:09:47.247 INFO:tasks.workunit.client.0.smithi076.stdout:5/851: chown d5/db/d3f/d42/fd1 91124665 1 2024-03-28T13:09:47.247 INFO:tasks.workunit.client.0.smithi076.stdout:5/852: truncate d5/d9/d1c/d1d/d22/f65 1092918 0 2024-03-28T13:09:47.252 INFO:tasks.workunit.client.0.smithi076.stdout:1/738: dwrite d14/d6c/fe7 [0,4194304] 0 2024-03-28T13:09:47.288 INFO:tasks.workunit.client.0.smithi076.stdout:5/853: dwrite d5/d9/f28 [0,4194304] 0 2024-03-28T13:09:47.300 INFO:tasks.workunit.client.0.smithi076.stdout:0/872: symlink db/dc/df/d71/l138 0 2024-03-28T13:09:47.301 INFO:tasks.workunit.client.0.smithi076.stdout:0/873: read db/d16/f54 [3213801,80448] 0 2024-03-28T13:09:47.704 INFO:tasks.workunit.client.0.smithi076.stdout:8/857: mkdir de/d12c 0 2024-03-28T13:09:47.704 INFO:tasks.workunit.client.0.smithi076.stdout:8/858: stat de/d4e/d54/f64 0 2024-03-28T13:09:47.740 INFO:tasks.workunit.client.0.smithi076.stdout:2/856: sync 2024-03-28T13:09:47.740 INFO:tasks.workunit.client.0.smithi076.stdout:7/778: sync 2024-03-28T13:09:47.740 INFO:tasks.workunit.client.0.smithi076.stdout:2/857: truncate d2/d5/db/d3b/fd3 580818 0 2024-03-28T13:09:47.745 INFO:tasks.workunit.client.0.smithi076.stdout:2/858: dread d2/d5/d4b/d39/d57/fd1 [0,4194304] 0 2024-03-28T13:09:47.778 INFO:tasks.workunit.client.0.smithi076.stdout:2/859: dwrite d2/d5/d7/d28/d64/fb3 [0,4194304] 0 2024-03-28T13:09:47.976 INFO:tasks.workunit.client.0.smithi076.stdout:1/739: mkdir d14/d19/d85/d2e/d31/d8f/d102 0 2024-03-28T13:09:47.976 INFO:tasks.workunit.client.0.smithi076.stdout:5/854: creat d5/d9/f13b x:0 0 0 2024-03-28T13:09:48.017 INFO:tasks.workunit.client.0.smithi076.stdout:0/874: creat db/dc/df/d11/d40/dd5/ded/f139 x:0 0 0 2024-03-28T13:09:48.369 INFO:tasks.workunit.client.0.smithi076.stdout:8/859: creat de/d23/d2b/d51/d60/d11c/f12d x:0 0 0 2024-03-28T13:09:48.423 INFO:tasks.workunit.client.0.smithi076.stdout:7/779: chown d1/d18/d3c/d48/f8d 14347702 1 2024-03-28T13:09:48.423 INFO:tasks.workunit.client.0.smithi076.stdout:7/780: readlink d1/d8/d37/d53/l80 0 2024-03-28T13:09:48.424 INFO:tasks.workunit.client.0.smithi076.stdout:7/781: write d1/f16 [1488818,22431] 0 2024-03-28T13:09:48.424 INFO:tasks.workunit.client.0.smithi076.stdout:7/782: chown d1/d8/fdc 733 1 2024-03-28T13:09:48.424 INFO:tasks.workunit.client.0.smithi076.stdout:7/783: dread - d1/d8/dc2/dc4/ff5 zero size 2024-03-28T13:09:48.511 INFO:tasks.workunit.client.0.smithi076.stdout:2/860: link d2/d5/db/d3b/d5a/l74 d2/d5/db/d3b/d9f/l10a 0 2024-03-28T13:09:48.563 INFO:tasks.workunit.client.0.smithi076.stdout:2/861: dwrite d2/d5/db/d3b/d5a/fea [0,4194304] 0 2024-03-28T13:09:48.574 INFO:tasks.workunit.client.0.smithi076.stdout:9/858: sync 2024-03-28T13:09:48.574 INFO:tasks.workunit.client.0.smithi076.stdout:9/859: chown d9/dd/df/d11/d14/d58/d6e/d2a/l69 7789 1 2024-03-28T13:09:48.574 INFO:tasks.workunit.client.0.smithi076.stdout:9/860: fsync d9/d74/f8e 0 2024-03-28T13:09:48.574 INFO:tasks.workunit.client.0.smithi076.stdout:9/861: write d9/d74/f8e [4462582,115286] 0 2024-03-28T13:09:48.574 INFO:tasks.workunit.client.0.smithi076.stdout:4/878: symlink d0/d3b/d40/d42/l129 0 2024-03-28T13:09:48.669 INFO:tasks.workunit.client.0.smithi076.stdout:3/713: rename d1/d7/d30/d38/d14/d51 to d1/d7/d30/d38/d14/d4a/ddc/ded/df3 0 2024-03-28T13:09:48.733 INFO:tasks.workunit.client.0.smithi076.stdout:1/740: getdents d14/d19/d85/d2e/d3c 0 2024-03-28T13:09:48.980 INFO:tasks.workunit.client.0.smithi076.stdout:8/860: mkdir de/d23/d2b/d5d/d76/d6e/dcd/d12e 0 2024-03-28T13:09:49.007 INFO:tasks.workunit.client.0.smithi076.stdout:8/861: dwrite de/d23/d2b/d51/fe5 [0,4194304] 0 2024-03-28T13:09:49.033 INFO:tasks.workunit.client.0.smithi076.stdout:7/784: rmdir d1/dc/d8b/dbf/d10e 0 2024-03-28T13:09:49.047 INFO:tasks.workunit.client.0.smithi076.stdout:7/785: dread d1/f4f [0,4194304] 0 2024-03-28T13:09:49.322 INFO:tasks.workunit.client.0.smithi076.stdout:2/862: creat d2/d5/db/d3b/df5/f10b x:0 0 0 2024-03-28T13:09:49.323 INFO:tasks.workunit.client.0.smithi076.stdout:9/862: creat d9/da/de6/df2/f104 x:0 0 0 2024-03-28T13:09:49.405 INFO:tasks.workunit.client.0.smithi076.stdout:4/879: symlink d0/d20/d7f/dda/d2d/d75/d116/l12a 0 2024-03-28T13:09:49.454 INFO:tasks.workunit.client.0.smithi076.stdout:4/880: dwrite d0/d3b/d40/d42/d47/d69/fe0 [0,4194304] 0 2024-03-28T13:09:49.474 INFO:tasks.workunit.client.0.smithi076.stdout:4/881: dread d0/d3b/d40/d42/d28/f32 [0,4194304] 0 2024-03-28T13:09:49.503 INFO:tasks.workunit.client.0.smithi076.stdout:6/881: rename d6/da/d40/d56/dd2/cd6 to d6/da/d40/c11b 0 2024-03-28T13:09:49.526 INFO:tasks.workunit.client.0.smithi076.stdout:6/882: dwrite d6/da/d40/d56/d58/f66 [0,4194304] 0 2024-03-28T13:09:49.526 INFO:tasks.workunit.client.0.smithi076.stdout:6/883: read d6/da/d40/d56/dc7/ffd [63,60909] 0 2024-03-28T13:09:49.614 INFO:tasks.workunit.client.0.smithi076.stdout:3/714: creat d1/d2/ff4 x:0 0 0 2024-03-28T13:09:49.660 INFO:tasks.workunit.client.0.smithi076.stdout:1/741: rmdir d14/d19/d85/d3f 39 2024-03-28T13:09:49.709 INFO:tasks.workunit.client.0.smithi076.stdout:0/875: symlink db/dc/df/d11/d40/l13a 0 2024-03-28T13:09:49.709 INFO:tasks.workunit.client.0.smithi076.stdout:0/876: write db/da6/fe6 [989317,34952] 0 2024-03-28T13:09:49.813 INFO:tasks.workunit.client.0.smithi076.stdout:8/862: getdents de/d23/d2b/d51/d71 0 2024-03-28T13:09:50.214 INFO:tasks.workunit.client.0.smithi076.stdout:2/863: symlink d2/d5/db/d3b/d9f/d9e/db1/l10c 0 2024-03-28T13:09:50.214 INFO:tasks.workunit.client.0.smithi076.stdout:2/864: dread - d2/d5/d4b/d39/ffe zero size 2024-03-28T13:09:50.283 INFO:tasks.workunit.client.0.smithi076.stdout:9/863: mkdir d9/dd/d105 0 2024-03-28T13:09:50.492 INFO:tasks.workunit.client.0.smithi076.stdout:5/855: rename d5/d9/d1c/d25/d136/d105/l134 to d5/d9/d1c/d1d/d22/d9d/dcb/l13c 0 2024-03-28T13:09:50.574 INFO:tasks.workunit.client.0.smithi076.stdout:6/884: unlink d6/da/d23/l5c 0 2024-03-28T13:09:50.753 INFO:tasks.workunit.client.0.smithi076.stdout:1/742: creat d14/d19/d85/d2e/d91/f103 x:0 0 0 2024-03-28T13:09:50.754 INFO:tasks.workunit.client.0.smithi076.stdout:1/743: dread d14/d6c/d74/fb4 [0,4194304] 0 2024-03-28T13:09:50.861 INFO:tasks.workunit.client.0.smithi076.stdout:8/863: unlink de/f3f 0 2024-03-28T13:09:50.861 INFO:tasks.workunit.client.0.smithi076.stdout:0/877: creat db/dc/df/d18/d1d/d75/f13b x:0 0 0 2024-03-28T13:09:50.861 INFO:tasks.workunit.client.0.smithi076.stdout:0/878: chown db/dc/c10 48 1 2024-03-28T13:09:50.868 INFO:tasks.workunit.client.0.smithi076.stdout:0/879: dread db/da6/fe6 [0,4194304] 0 2024-03-28T13:09:50.955 INFO:tasks.workunit.client.0.smithi076.stdout:2/865: mknod d2/d5/d7/d8/d21/c10d 0 2024-03-28T13:09:51.110 INFO:tasks.workunit.client.0.smithi076.stdout:4/882: rename d0/d3b/c46 to d0/d3b/d40/d42/d31/d5e/df4/c12b 0 2024-03-28T13:09:51.111 INFO:tasks.workunit.client.0.smithi076.stdout:4/883: write d0/d3b/d40/d42/d31/d4d/d63/ffe [477722,42930] 0 2024-03-28T13:09:51.137 INFO:tasks.workunit.client.0.smithi076.stdout:6/885: stat d6/d99/cfb 0 2024-03-28T13:09:51.220 INFO:tasks.workunit.client.0.smithi076.stdout:3/715: truncate d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/fdb 349606 0 2024-03-28T13:09:51.312 INFO:tasks.workunit.client.0.smithi076.stdout:1/744: creat d14/d19/d85/d2e/d31/d3b/f104 x:0 0 0 2024-03-28T13:09:51.312 INFO:tasks.workunit.client.0.smithi076.stdout:1/745: read - d14/d19/d85/d2e/d31/d51/d92/fbb zero size 2024-03-28T13:09:51.313 INFO:tasks.workunit.client.0.smithi076.stdout:8/864: getdents de/d23/d2b/d5d/d76/d18/d49/dd0 0 2024-03-28T13:09:51.368 INFO:tasks.workunit.client.0.smithi076.stdout:0/880: getdents db/dc/d3d 0 2024-03-28T13:09:51.368 INFO:tasks.workunit.client.0.smithi076.stdout:0/881: write db/d16/f6f [644804,118327] 0 2024-03-28T13:09:51.408 INFO:tasks.workunit.client.0.smithi076.stdout:2/866: symlink d2/d5/d7/d8/l10e 0 2024-03-28T13:09:51.517 INFO:tasks.workunit.client.0.smithi076.stdout:5/856: rename d5/db/f13a to d5/d9/d35/f13d 0 2024-03-28T13:09:51.533 INFO:tasks.workunit.client.0.smithi076.stdout:4/884: symlink d0/d3b/d40/d42/d31/d5e/d72/d78/l12c 0 2024-03-28T13:09:51.533 INFO:tasks.workunit.client.0.smithi076.stdout:4/885: readlink d0/d3b/d40/d42/d47/d69/lf1 0 2024-03-28T13:09:51.533 INFO:tasks.workunit.client.0.smithi076.stdout:4/886: dread - d0/d20/d7f/dda/f117 zero size 2024-03-28T13:09:51.533 INFO:tasks.workunit.client.0.smithi076.stdout:4/887: write d0/d3b/d40/d42/d31/d4d/f9f [394415,121199] 0 2024-03-28T13:09:51.640 INFO:tasks.workunit.client.0.smithi076.stdout:6/886: creat d6/da/d39/d63/d113/dc8/f11c x:0 0 0 2024-03-28T13:09:51.727 INFO:tasks.workunit.client.0.smithi076.stdout:3/716: mknod d1/d7/d30/d38/d14/d97/cf5 0 2024-03-28T13:09:51.727 INFO:tasks.workunit.client.0.smithi076.stdout:3/717: readlink d1/d7/d30/d81/lc0 0 2024-03-28T13:09:51.727 INFO:tasks.workunit.client.0.smithi076.stdout:3/718: readlink d1/d7/d30/d38/d14/d36/l50 0 2024-03-28T13:09:51.753 INFO:tasks.workunit.client.0.smithi076.stdout:1/746: stat d14/d19/d85/d2e/d31/l67 0 2024-03-28T13:09:51.753 INFO:tasks.workunit.client.0.smithi076.stdout:1/747: getdents d14/d19/d85/d2e/d3c/ddd 0 2024-03-28T13:09:51.820 INFO:tasks.workunit.client.0.smithi076.stdout:8/865: creat de/d4e/db6/dae/f12f x:0 0 0 2024-03-28T13:09:51.820 INFO:tasks.workunit.client.0.smithi076.stdout:8/866: fdatasync de/d23/d2b/d51/d62/d8b/fed 0 2024-03-28T13:09:51.825 INFO:tasks.workunit.client.0.smithi076.stdout:8/867: read de/d23/d2b/d5d/d76/d18/d49/f11f [162489,55917] 0 2024-03-28T13:09:51.856 INFO:tasks.workunit.client.0.smithi076.stdout:0/882: mknod db/dc/df/d11/d40/d77/c13c 0 2024-03-28T13:09:51.856 INFO:tasks.workunit.client.0.smithi076.stdout:8/868: dwrite de/d4e/db6/dae/f5f [0,4194304] 0 2024-03-28T13:09:51.882 INFO:tasks.workunit.client.0.smithi076.stdout:0/883: write db/dc/df/d11/d40/d77/da2/f6b [1591225,50171] 0 2024-03-28T13:09:51.924 INFO:tasks.workunit.client.0.smithi076.stdout:2/867: link d2/d5/db/d3b/d5a/fa5 d2/d5/db/d3b/d5a/d8d/f10f 0 2024-03-28T13:09:51.944 INFO:tasks.workunit.client.0.smithi076.stdout:7/786: sync 2024-03-28T13:09:52.282 INFO:tasks.workunit.client.0.smithi076.stdout:4/888: unlink d0/d20/c70 0 2024-03-28T13:09:52.282 INFO:tasks.workunit.client.0.smithi076.stdout:6/887: mkdir d6/da/d5f/d6d/daf/d11d 0 2024-03-28T13:09:52.282 INFO:tasks.workunit.client.0.smithi076.stdout:4/889: readlink d0/d3b/d50/d64/lae 0 2024-03-28T13:09:52.292 INFO:tasks.workunit.client.0.smithi076.stdout:1/748: creat d14/d19/d85/d3f/f105 x:0 0 0 2024-03-28T13:09:52.322 INFO:tasks.workunit.client.0.smithi076.stdout:1/749: dwrite d14/d19/d85/d2e/d31/d8f/f9c [0,4194304] 0 2024-03-28T13:09:52.327 INFO:tasks.workunit.client.0.smithi076.stdout:1/750: write d14/d6c/d74/f95 [967127,126396] 0 2024-03-28T13:09:52.618 INFO:tasks.workunit.client.0.smithi076.stdout:8/869: unlink de/d13/d27/f34 0 2024-03-28T13:09:52.619 INFO:tasks.workunit.client.0.smithi076.stdout:2/868: unlink d2/lf4 0 2024-03-28T13:09:52.619 INFO:tasks.workunit.client.0.smithi076.stdout:0/884: mkdir db/dd8/d13d 0 2024-03-28T13:09:52.624 INFO:tasks.workunit.client.0.smithi076.stdout:8/870: dread de/d23/d2b/d58/d78/fa0 [0,4194304] 0 2024-03-28T13:09:52.631 INFO:tasks.workunit.client.0.smithi076.stdout:0/885: dread db/dc/df/d71/f58 [0,4194304] 0 2024-03-28T13:09:52.664 INFO:tasks.workunit.client.0.smithi076.stdout:7/787: rename d1/d8/f19 to d1/d8/d37/d53/dae/f114 0 2024-03-28T13:09:52.714 INFO:tasks.workunit.client.0.smithi076.stdout:4/890: creat d0/d3b/d50/de6/f12d x:0 0 0 2024-03-28T13:09:52.883 INFO:tasks.workunit.client.0.smithi076.stdout:6/888: mkdir d6/da/d40/d62/dca/ddd/d11e 0 2024-03-28T13:09:52.904 INFO:tasks.workunit.client.0.smithi076.stdout:6/889: dwrite d6/da/d89/f116 [0,4194304] 0 2024-03-28T13:09:53.235 INFO:tasks.workunit.client.0.smithi076.stdout:2/869: creat d2/d5/db/d3b/d94/f110 x:0 0 0 2024-03-28T13:09:53.235 INFO:tasks.workunit.client.0.smithi076.stdout:8/871: mknod de/d4e/d54/d98/c130 0 2024-03-28T13:09:53.244 INFO:tasks.workunit.client.0.smithi076.stdout:0/886: creat db/dc/df/d18/d1d/d75/d51/dd7/f13e x:0 0 0 2024-03-28T13:09:53.253 INFO:tasks.workunit.client.0.smithi076.stdout:2/870: write d2/d5/d7/dd/dc8/fcc [1462795,58368] 0 2024-03-28T13:09:53.253 INFO:tasks.workunit.client.0.smithi076.stdout:2/871: truncate d2/d5/d7/d8/d21/fe5 109308 0 2024-03-28T13:09:53.262 INFO:tasks.workunit.client.0.smithi076.stdout:0/887: dread db/dc/df/d71/d4a/f5c [0,4194304] 0 2024-03-28T13:09:53.307 INFO:tasks.workunit.client.0.smithi076.stdout:0/888: dwrite f5 [0,4194304] 0 2024-03-28T13:09:53.492 INFO:tasks.workunit.client.0.smithi076.stdout:7/788: creat d1/d18/d2d/f115 x:0 0 0 2024-03-28T13:09:53.528 INFO:tasks.workunit.client.0.smithi076.stdout:9/864: sync 2024-03-28T13:09:53.528 INFO:tasks.workunit.client.0.smithi076.stdout:9/865: fsync d9/dd/fa0 0 2024-03-28T13:09:53.528 INFO:tasks.workunit.client.0.smithi076.stdout:9/866: write d9/dd/df/d11/d14/d58/d6e/ff6 [85608,42949] 0 2024-03-28T13:09:53.982 INFO:tasks.workunit.client.0.smithi076.stdout:4/891: getdents d0/d3b/d40/d42/d31/d5e/d72/d78 0 2024-03-28T13:09:54.021 INFO:tasks.workunit.client.0.smithi076.stdout:6/890: rmdir d6/da/d39/d63/df5 39 2024-03-28T13:09:54.121 INFO:tasks.workunit.client.0.smithi076.stdout:1/751: symlink d14/d19/d85/d3f/l106 0 2024-03-28T13:09:54.152 INFO:tasks.workunit.client.0.smithi076.stdout:8/872: mkdir de/d23/d2b/d58/d131 0 2024-03-28T13:09:54.379 INFO:tasks.workunit.client.0.smithi076.stdout:2/872: symlink d2/d5/d7/d8/l111 0 2024-03-28T13:09:54.409 INFO:tasks.workunit.client.0.smithi076.stdout:5/857: sync 2024-03-28T13:09:54.409 INFO:tasks.workunit.client.0.smithi076.stdout:3/719: sync 2024-03-28T13:09:54.409 INFO:tasks.workunit.client.0.smithi076.stdout:5/858: dread - d5/db/d3f/f120 zero size 2024-03-28T13:09:54.409 INFO:tasks.workunit.client.0.smithi076.stdout:3/720: fdatasync d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/dcd/db9/fe8 0 2024-03-28T13:09:54.409 INFO:tasks.workunit.client.0.smithi076.stdout:5/859: write d5/f9a [1734346,95463] 0 2024-03-28T13:09:54.421 INFO:tasks.workunit.client.0.smithi076.stdout:3/721: write d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/f5e [4654313,104493] 0 2024-03-28T13:09:54.426 INFO:tasks.workunit.client.0.smithi076.stdout:0/889: dread db/dc/d3d/d57/f5b [4194304,4194304] 0 2024-03-28T13:09:54.426 INFO:tasks.workunit.client.0.smithi076.stdout:0/890: write db/dc/df/d18/d9f/fa5 [3502536,127452] 0 2024-03-28T13:09:54.448 INFO:tasks.workunit.client.0.smithi076.stdout:9/867: readlink d9/d74/db3/lb9 0 2024-03-28T13:09:54.448 INFO:tasks.workunit.client.0.smithi076.stdout:9/868: chown d9/dd/df/d11/fac 4532 1 2024-03-28T13:09:54.448 INFO:tasks.workunit.client.0.smithi076.stdout:9/869: fsync d9/f54 0 2024-03-28T13:09:54.456 INFO:tasks.workunit.client.0.smithi076.stdout:0/891: dwrite db/dc/df/d11/d40/d77/da2/d6d/db9/fcb [0,4194304] 0 2024-03-28T13:09:54.547 INFO:tasks.workunit.client.0.smithi076.stdout:4/892: creat d0/d3b/d40/d42/d47/d69/f12e x:0 0 0 2024-03-28T13:09:54.561 INFO:tasks.workunit.client.0.smithi076.stdout:4/893: dread d0/d3b/d40/d42/f65 [0,4194304] 0 2024-03-28T13:09:54.561 INFO:tasks.workunit.client.0.smithi076.stdout:4/894: fdatasync d0/d3b/d40/d42/fec 0 2024-03-28T13:09:54.613 INFO:tasks.workunit.client.0.smithi076.stdout:6/891: creat d6/da/d5f/d6d/d95/f11f x:0 0 0 2024-03-28T13:09:54.639 INFO:tasks.workunit.client.0.smithi076.stdout:1/752: symlink d14/d19/d85/d2e/d3c/l107 0 2024-03-28T13:09:54.639 INFO:tasks.workunit.client.0.smithi076.stdout:1/753: chown d14/d19/d85/d2e/d31/d51/l98 9564276 1 2024-03-28T13:09:54.655 INFO:tasks.workunit.client.0.smithi076.stdout:6/892: dwrite d6/da/f15 [0,4194304] 0 2024-03-28T13:09:54.763 INFO:tasks.workunit.client.0.smithi076.stdout:8/873: rename de/d23/d2b/d5d/d76/d18/d49/dd0/fe1 to de/d13/da2/dee/f132 0 2024-03-28T13:09:54.799 INFO:tasks.workunit.client.0.smithi076.stdout:8/874: dwrite de/d23/d2b/d5d/f115 [0,4194304] 0 2024-03-28T13:09:55.100 INFO:tasks.workunit.client.0.smithi076.stdout:2/873: truncate d2/d5/d7/d8/d21/f69 7756909 0 2024-03-28T13:09:55.110 INFO:tasks.workunit.client.0.smithi076.stdout:9/870: mknod d9/dd/d48/dd7/dd9/df4/c106 0 2024-03-28T13:09:55.110 INFO:tasks.workunit.client.0.smithi076.stdout:9/871: write d9/dd/df/d11/d37/f1c [1336031,127330] 0 2024-03-28T13:09:55.768 INFO:tasks.workunit.client.0.smithi076.stdout:7/789: creat d1/d18/d3c/d7b/f116 x:0 0 0 2024-03-28T13:09:55.768 INFO:tasks.workunit.client.0.smithi076.stdout:7/790: stat d1/d8/d37/f45 0 2024-03-28T13:09:55.980 INFO:tasks.workunit.client.0.smithi076.stdout:6/893: rename d6/da/d1e/dce/f104 to d6/da/d1e/dce/f120 0 2024-03-28T13:09:56.002 INFO:tasks.workunit.client.0.smithi076.stdout:6/894: write d6/da/d1e/f50 [3785765,86999] 0 2024-03-28T13:09:56.223 INFO:tasks.workunit.client.0.smithi076.stdout:0/892: rename db/dc/df/d71/l55 to db/dc/df/d11/d40/d77/da2/d6d/db9/l13f 0 2024-03-28T13:09:56.224 INFO:tasks.workunit.client.0.smithi076.stdout:8/875: symlink de/d23/d2b/d5d/d76/d18/l133 0 2024-03-28T13:09:56.285 INFO:tasks.workunit.client.0.smithi076.stdout:8/876: dwrite de/d23/d2b/d51/d60/f10f [0,4194304] 0 2024-03-28T13:09:56.285 INFO:tasks.workunit.client.0.smithi076.stdout:8/877: read - de/d23/d2b/d51/d60/d89/fe8 zero size 2024-03-28T13:09:56.285 INFO:tasks.workunit.client.0.smithi076.stdout:8/878: dread - de/d23/d2b/d5d/d76/d6e/d8a/d93/fcf zero size 2024-03-28T13:09:56.285 INFO:tasks.workunit.client.0.smithi076.stdout:8/879: truncate de/d23/d2b/d58/d78/fbe 583775 0 2024-03-28T13:09:56.285 INFO:tasks.workunit.client.0.smithi076.stdout:8/880: chown de/d23/d2b/d51/d71 5497830 1 2024-03-28T13:09:56.285 INFO:tasks.workunit.client.0.smithi076.stdout:8/881: write de/d23/d2b/d51/d62/d8b/fed [906191,102599] 0 2024-03-28T13:09:56.285 INFO:tasks.workunit.client.0.smithi076.stdout:8/882: chown de/d23/d2b/d51/d62/fc4 31115353 1 2024-03-28T13:09:56.349 INFO:tasks.workunit.client.0.smithi076.stdout:3/722: mkdir d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/df6 0 2024-03-28T13:09:56.349 INFO:tasks.workunit.client.0.smithi076.stdout:3/723: fsync d1/d7/d30/d38/d14/d36/f16 0 2024-03-28T13:09:56.385 INFO:tasks.workunit.client.0.smithi076.stdout:3/724: dwrite d1/d7/d30/d38/f29 [0,4194304] 0 2024-03-28T13:09:56.388 INFO:tasks.workunit.client.0.smithi076.stdout:2/874: creat d2/d75/f112 x:0 0 0 2024-03-28T13:09:56.417 INFO:tasks.workunit.client.0.smithi076.stdout:2/875: dwrite d2/d5/db/d3b/d5a/fa5 [0,4194304] 0 2024-03-28T13:09:56.563 INFO:tasks.workunit.client.0.smithi076.stdout:9/872: mkdir d9/dd/d48/dd7/dd9/df4/d107 0 2024-03-28T13:09:56.563 INFO:tasks.workunit.client.0.smithi076.stdout:1/754: link d14/d19/d85/d3f/ld8 d14/d6c/l108 0 2024-03-28T13:09:56.563 INFO:tasks.workunit.client.0.smithi076.stdout:9/873: fsync d9/dd/df/d11/d14/d58/d6e/d2a/f44 0 2024-03-28T13:09:56.616 INFO:tasks.workunit.client.0.smithi076.stdout:7/791: read d1/d8/dc2/d100/db5/ff9 [949831,22719] 0 2024-03-28T13:09:56.641 INFO:tasks.workunit.client.0.smithi076.stdout:6/895: chown d6/da/d40/d56/d84/f90 1198680 1 2024-03-28T13:09:56.641 INFO:tasks.workunit.client.0.smithi076.stdout:6/896: chown d6/d99/d46/f74 6618 1 2024-03-28T13:09:56.641 INFO:tasks.workunit.client.0.smithi076.stdout:6/897: fsync d6/da/d23/f43 0 2024-03-28T13:09:56.667 INFO:tasks.workunit.client.0.smithi076.stdout:0/893: stat db/dc/df/d11/d40/dc7 0 2024-03-28T13:09:56.745 INFO:tasks.workunit.client.0.smithi076.stdout:0/894: dwrite db/dc/df/d18/d1d/d75/d51/dd7/ffa [4194304,4194304] 0 2024-03-28T13:09:56.751 INFO:tasks.workunit.client.0.smithi076.stdout:8/883: creat de/d4e/db6/dde/f134 x:0 0 0 2024-03-28T13:09:56.752 INFO:tasks.workunit.client.0.smithi076.stdout:8/884: write de/d4e/d54/d98/f9d [4599563,49155] 0 2024-03-28T13:09:56.768 INFO:tasks.workunit.client.0.smithi076.stdout:0/895: dread db/dc/df/d11/d40/f64 [0,4194304] 0 2024-03-28T13:09:56.768 INFO:tasks.workunit.client.0.smithi076.stdout:0/896: write db/dc/df/d18/d1d/f10c [775331,43495] 0 2024-03-28T13:09:56.861 INFO:tasks.workunit.client.0.smithi076.stdout:3/725: rename d1/d7/d30/d71/fa6 to d1/d7/d30/d38/d14/d4a/ddc/ff7 0 2024-03-28T13:09:57.143 INFO:tasks.workunit.client.0.smithi076.stdout:2/876: mkdir d2/d5/db/d3b/d5a/d8d/dc1/d113 0 2024-03-28T13:09:57.143 INFO:tasks.workunit.client.0.smithi076.stdout:2/877: truncate d2/d5/db/d3b/f4e 4422167 0 2024-03-28T13:09:57.169 INFO:tasks.workunit.client.0.smithi076.stdout:1/755: symlink d14/d19/d85/d2e/d31/d51/d92/da4/db5/l109 0 2024-03-28T13:09:57.169 INFO:tasks.workunit.client.0.smithi076.stdout:9/874: truncate d9/d3c/f2f 2213566 0 2024-03-28T13:09:57.169 INFO:tasks.workunit.client.0.smithi076.stdout:1/756: dread - d14/d19/d85/d2e/fce zero size 2024-03-28T13:09:57.173 INFO:tasks.workunit.client.0.smithi076.stdout:1/757: write d14/d6c/fa7 [416598,69608] 0 2024-03-28T13:09:57.173 INFO:tasks.workunit.client.0.smithi076.stdout:1/758: readlink d14/d19/d85/d2e/d31/d51/d92/lb0 0 2024-03-28T13:09:57.173 INFO:tasks.workunit.client.0.smithi076.stdout:1/759: write d14/d6c/d74/fd3 [943008,127946] 0 2024-03-28T13:09:57.184 INFO:tasks.workunit.client.0.smithi076.stdout:2/878: dwrite d2/d75/fdf [0,4194304] 0 2024-03-28T13:09:57.259 INFO:tasks.workunit.client.0.smithi076.stdout:7/792: truncate d1/d8/dc2/d100/db5/fe3 471207 0 2024-03-28T13:09:57.390 INFO:tasks.workunit.client.0.smithi076.stdout:6/898: creat d6/da/d40/d62/db0/f121 x:0 0 0 2024-03-28T13:09:57.390 INFO:tasks.workunit.client.0.smithi076.stdout:6/899: write d6/f98 [164533,39913] 0 2024-03-28T13:09:57.466 INFO:tasks.workunit.client.0.smithi076.stdout:8/885: mknod de/d4e/d54/c135 0 2024-03-28T13:09:57.523 INFO:tasks.workunit.client.0.smithi076.stdout:0/897: creat db/dc/df/d18/d1d/d75/d51/d97/f140 x:0 0 0 2024-03-28T13:09:57.622 INFO:tasks.workunit.client.0.smithi076.stdout:3/726: dread - d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d93/dd4/fdf zero size 2024-03-28T13:09:57.623 INFO:tasks.workunit.client.0.smithi076.stdout:9/875: creat d9/d74/f108 x:0 0 0 2024-03-28T13:09:57.646 INFO:tasks.workunit.client.0.smithi076.stdout:3/727: write d1/d7/d30/d38/f29 [3956216,103432] 0 2024-03-28T13:09:57.814 INFO:tasks.workunit.client.0.smithi076.stdout:2/879: mknod d2/d5/db/d3b/ddd/c114 0 2024-03-28T13:09:57.921 INFO:tasks.workunit.client.0.smithi076.stdout:7/793: symlink d1/d18/d3c/d48/de5/l117 0 2024-03-28T13:09:57.965 INFO:tasks.workunit.client.0.smithi076.stdout:6/900: creat d6/da/d39/d63/d113/f122 x:0 0 0 2024-03-28T13:09:58.005 INFO:tasks.workunit.client.0.smithi076.stdout:8/886: mkdir de/d23/db3/d136 0 2024-03-28T13:09:58.681 INFO:tasks.workunit.client.0.smithi076.stdout:9/876: creat d9/dd/df/d11/d14/f109 x:0 0 0 2024-03-28T13:09:58.916 INFO:tasks.workunit.client.0.smithi076.stdout:3/728: mknod d1/d7/d30/d38/d14/d97/cf8 0 2024-03-28T13:09:58.917 INFO:tasks.workunit.client.0.smithi076.stdout:1/760: symlink d14/d19/d85/d3f/l10a 0 2024-03-28T13:09:58.917 INFO:tasks.workunit.client.0.smithi076.stdout:1/761: chown d14/def/df0 25604 1 2024-03-28T13:09:58.978 INFO:tasks.workunit.client.0.smithi076.stdout:2/880: mkdir d2/d5/db/d3b/d3f/d115 0 2024-03-28T13:09:58.984 INFO:tasks.workunit.client.0.smithi076.stdout:5/860: sync 2024-03-28T13:09:58.984 INFO:tasks.workunit.client.0.smithi076.stdout:4/895: sync 2024-03-28T13:09:58.984 INFO:tasks.workunit.client.0.smithi076.stdout:5/861: write d5/db/ff1 [3736905,35872] 0 2024-03-28T13:09:58.984 INFO:tasks.workunit.client.0.smithi076.stdout:4/896: write d0/d3b/d50/da8/f120 [437395,76399] 0 2024-03-28T13:09:58.984 INFO:tasks.workunit.client.0.smithi076.stdout:7/794: mknod d1/d8/dc2/dc4/d104/c118 0 2024-03-28T13:09:59.002 INFO:tasks.workunit.client.0.smithi076.stdout:4/897: write d0/d3b/d40/d42/f24 [1162159,99704] 0 2024-03-28T13:09:59.002 INFO:tasks.workunit.client.0.smithi076.stdout:4/898: fsync d0/f1e 0 2024-03-28T13:09:59.096 INFO:tasks.workunit.client.0.smithi076.stdout:6/901: rename d6/da/d40/d56/d8f to d6/da/d40/d62/db0/d123 0 2024-03-28T13:09:59.163 INFO:tasks.workunit.client.0.smithi076.stdout:8/887: symlink de/d4e/d121/l137 0 2024-03-28T13:09:59.164 INFO:tasks.workunit.client.0.smithi076.stdout:8/888: read de/d23/d2b/d58/d78/f81 [91987,46524] 0 2024-03-28T13:09:59.186 INFO:tasks.workunit.client.0.smithi076.stdout:8/889: dwrite de/d23/d2b/d5d/d76/d18/d3c/f44 [0,4194304] 0 2024-03-28T13:09:59.309 INFO:tasks.workunit.client.0.smithi076.stdout:9/877: chown d9/dd/d48/c4c 493 1 2024-03-28T13:09:59.396 INFO:tasks.workunit.client.0.smithi076.stdout:3/729: unlink d1/d7/d30/d38/d14/d36/d56/f7f 0 2024-03-28T13:09:59.445 INFO:tasks.workunit.client.0.smithi076.stdout:3/730: dwrite d1/d7/d30/d38/d14/d97/fcc [0,4194304] 0 2024-03-28T13:09:59.458 INFO:tasks.workunit.client.0.smithi076.stdout:1/762: mknod d14/d19/d85/d2e/d91/c10b 0 2024-03-28T13:09:59.484 INFO:tasks.workunit.client.0.smithi076.stdout:2/881: getdents d2/d5 0 2024-03-28T13:09:59.484 INFO:tasks.workunit.client.0.smithi076.stdout:2/882: chown d2/d75/f91 5823187 1 2024-03-28T13:09:59.485 INFO:tasks.workunit.client.0.smithi076.stdout:3/731: dwrite d1/d7/d30/d38/d14/d4a/d66/fb3 [0,4194304] 0 2024-03-28T13:09:59.537 INFO:tasks.workunit.client.0.smithi076.stdout:5/862: getdents d5/d9/d1c/d25/d60/d82 0 2024-03-28T13:09:59.537 INFO:tasks.workunit.client.0.smithi076.stdout:5/863: write d5/db/df/f5a [2253810,24499] 0 2024-03-28T13:09:59.590 INFO:tasks.workunit.client.0.smithi076.stdout:7/795: creat d1/d18/d3c/f119 x:0 0 0 2024-03-28T13:09:59.656 INFO:tasks.workunit.client.0.smithi076.stdout:4/899: rename d0/d3b/d40/d42/d28/f7e to d0/d3b/d40/d42/d31/f12f 0 2024-03-28T13:09:59.656 INFO:tasks.workunit.client.0.smithi076.stdout:4/900: readlink d0/d20/d7f/dda/db7/lf8 0 2024-03-28T13:09:59.800 INFO:tasks.workunit.client.0.smithi076.stdout:8/890: mknod de/d23/d2b/d5d/d76/d6e/dcd/c138 0 2024-03-28T13:09:59.958 INFO:tasks.workunit.client.0.smithi076.stdout:1/763: creat d14/d6c/d74/d9e/f10c x:0 0 0 2024-03-28T13:10:00.096 INFO:tasks.workunit.client.0.smithi076.stdout:2/883: link d2/d5/db/l49 d2/d5/db/d3b/d60/dfb/l116 0 2024-03-28T13:10:00.096 INFO:tasks.workunit.client.0.smithi076.stdout:2/884: readlink d2/d5/db/d3b/d42/l93 0 2024-03-28T13:10:00.115 INFO:tasks.workunit.client.0.smithi076.stdout:2/885: dread d2/d5/fac [0,4194304] 0 2024-03-28T13:10:00.115 INFO:tasks.workunit.client.0.smithi076.stdout:2/886: fdatasync d2/d5/db/d3b/d5a/d8d/dc1/fc6 0 2024-03-28T13:10:00.204 INFO:tasks.workunit.client.0.smithi076.stdout:3/732: mkdir d1/d7/d30/d5f/df9 0 2024-03-28T13:10:00.238 INFO:tasks.workunit.client.0.smithi076.stdout:5/864: symlink d5/d9/d1c/d25/dbd/d117/l13e 0 2024-03-28T13:10:00.274 INFO:tasks.workunit.client.0.smithi076.stdout:7/796: creat d1/d18/d3c/d7b/f11a x:0 0 0 2024-03-28T13:10:00.275 INFO:tasks.workunit.client.0.smithi076.stdout:7/797: chown d1/d18/d2d/caa 3088838 1 2024-03-28T13:10:00.358 INFO:tasks.workunit.client.0.smithi076.stdout:4/901: unlink d0/d20/d7f/dda/d2d/f101 0 2024-03-28T13:10:00.492 INFO:tasks.workunit.client.0.smithi076.stdout:2/887: dread d2/d5/d7/d8/f6a [0,4194304] 0 2024-03-28T13:10:00.512 INFO:tasks.workunit.client.0.smithi076.stdout:3/733: creat d1/d7/d30/d38/d9b/ffa x:0 0 0 2024-03-28T13:10:00.613 INFO:tasks.workunit.client.0.smithi076.stdout:9/878: rename d9/d3c/f2f to d9/dd/d48/dd7/dd9/d101/f10a 0 2024-03-28T13:10:00.613 INFO:tasks.workunit.client.0.smithi076.stdout:7/798: mknod d1/d81/dd7/c11b 0 2024-03-28T13:10:00.783 INFO:tasks.workunit.client.0.smithi076.stdout:4/902: unlink d0/f1f 0 2024-03-28T13:10:00.783 INFO:tasks.workunit.client.0.smithi076.stdout:8/891: mkdir de/d23/d2b/d58/d78/d139 0 2024-03-28T13:10:00.846 INFO:tasks.workunit.client.0.smithi076.stdout:2/888: rmdir d2/d5/db/d3b/d60/dfb 39 2024-03-28T13:10:00.895 INFO:tasks.workunit.client.0.smithi076.stdout:3/734: link d1/d7/d30/d38/d14/d4a/ddc/ff7 d1/d7/d30/ffb 0 2024-03-28T13:10:00.998 INFO:tasks.workunit.client.0.smithi076.stdout:1/764: rename d14/def/df0/ldb to d14/d19/d85/d2e/d31/d8f/d102/l10d 0 2024-03-28T13:10:01.046 INFO:tasks.workunit.client.0.smithi076.stdout:9/879: getdents d9/da/de6/df2 0 2024-03-28T13:10:01.087 INFO:tasks.workunit.client.0.smithi076.stdout:7/799: getdents d1/d8 0 2024-03-28T13:10:01.217 INFO:tasks.workunit.client.0.smithi076.stdout:8/892: dread de/d25/f5b [0,4194304] 0 2024-03-28T13:10:01.303 INFO:tasks.workunit.client.0.smithi076.stdout:6/902: rmdir d6/da/d40 39 2024-03-28T13:10:01.303 INFO:tasks.workunit.client.0.smithi076.stdout:4/903: creat d0/d20/d7b/f130 x:0 0 0 2024-03-28T13:10:01.303 INFO:tasks.workunit.client.0.smithi076.stdout:4/904: dread - d0/d3b/d40/d42/d47/d69/f12e zero size 2024-03-28T13:10:01.320 INFO:tasks.workunit.client.0.smithi076.stdout:2/889: dread d2/d5/d7/d8/f44 [0,4194304] 0 2024-03-28T13:10:01.360 INFO:tasks.workunit.client.0.smithi076.stdout:3/735: truncate d1/d7/d30/d38/d14/d36/d56/fd7 599445 0 2024-03-28T13:10:01.772 INFO:tasks.workunit.client.0.smithi076.stdout:5/865: rename d5/d9/c86 to d5/db/d19/d34/c13f 0 2024-03-28T13:10:01.772 INFO:tasks.workunit.client.0.smithi076.stdout:1/765: creat d14/d19/d85/d2e/d31/d51/d92/da4/db7/dc8/f10e x:0 0 0 2024-03-28T13:10:01.772 INFO:tasks.workunit.client.0.smithi076.stdout:1/766: chown d14/d6c/fe7 86 1 2024-03-28T13:10:01.772 INFO:tasks.workunit.client.0.smithi076.stdout:1/767: fdatasync f12 0 2024-03-28T13:10:01.778 INFO:tasks.workunit.client.0.smithi076.stdout:5/866: dread d5/db/d3f/fa0 [0,4194304] 0 2024-03-28T13:10:01.778 INFO:tasks.workunit.client.0.smithi076.stdout:7/800: symlink d1/d81/dd7/l11c 0 2024-03-28T13:10:01.778 INFO:tasks.workunit.client.0.smithi076.stdout:8/893: symlink de/d13/dc9/def/l13a 0 2024-03-28T13:10:01.781 INFO:tasks.workunit.client.0.smithi076.stdout:1/768: dread d14/d19/d85/d2e/d31/d6f/f81 [0,4194304] 0 2024-03-28T13:10:01.794 INFO:tasks.workunit.client.0.smithi076.stdout:6/903: getdents d6/da/d39 0 2024-03-28T13:10:01.794 INFO:tasks.workunit.client.0.smithi076.stdout:6/904: readlink d6/da/d40/d56/lb1 0 2024-03-28T13:10:01.794 INFO:tasks.workunit.client.0.smithi076.stdout:6/905: chown d6/da/d40/d56/dc7/l10f 107 1 2024-03-28T13:10:01.816 INFO:tasks.workunit.client.0.smithi076.stdout:1/769: dwrite f5 [4194304,4194304] 0 2024-03-28T13:10:01.831 INFO:tasks.workunit.client.0.smithi076.stdout:2/890: getdents d2/d5/db/d3b/df5 0 2024-03-28T13:10:01.831 INFO:tasks.workunit.client.0.smithi076.stdout:2/891: readlink d2/d5/db/l49 0 2024-03-28T13:10:01.832 INFO:tasks.workunit.client.0.smithi076.stdout:3/736: mkdir d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/db5/dfc 0 2024-03-28T13:10:01.832 INFO:tasks.workunit.client.0.smithi076.stdout:2/892: write d2/d5/db/d3b/d5a/daa/ffa [503790,54978] 0 2024-03-28T13:10:01.832 INFO:tasks.workunit.client.0.smithi076.stdout:2/893: write d2/d5/d7/d3e/f81 [3295697,113969] 0 2024-03-28T13:10:01.832 INFO:tasks.workunit.client.0.smithi076.stdout:2/894: fsync d2/d5/db/d3b/f9a 0 2024-03-28T13:10:02.011 INFO:tasks.workunit.client.0.smithi076.stdout:5/867: mknod d5/db/d19/d34/c140 0 2024-03-28T13:10:02.011 INFO:tasks.workunit.client.0.smithi076.stdout:5/868: read - d5/d9/d1c/d1d/d22/fae zero size 2024-03-28T13:10:02.140 INFO:tasks.workunit.client.0.smithi076.stdout:8/894: symlink de/d23/d2b/d5d/d76/d113/l13b 0 2024-03-28T13:10:02.158 INFO:tasks.workunit.client.0.smithi076.stdout:8/895: read de/d23/d2b/d5d/d76/f21 [4007387,42710] 0 2024-03-28T13:10:02.198 INFO:tasks.workunit.client.0.smithi076.stdout:6/906: creat d6/da/d23/f124 x:0 0 0 2024-03-28T13:10:02.198 INFO:tasks.workunit.client.0.smithi076.stdout:6/907: read - d6/dc1/f10e zero size 2024-03-28T13:10:02.332 INFO:tasks.workunit.client.0.smithi076.stdout:1/770: rename d14/d19/d20/f27 to d14/d19/d85/d2e/d3c/f10f 0 2024-03-28T13:10:02.353 INFO:tasks.workunit.client.0.smithi076.stdout:1/771: dread f12 [4194304,4194304] 0 2024-03-28T13:10:02.433 INFO:tasks.workunit.client.0.smithi076.stdout:3/737: link d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d58/cd5 d1/d7/d30/d38/d14/d27/d69/cfd 0 2024-03-28T13:10:02.478 INFO:tasks.workunit.client.0.smithi076.stdout:2/895: truncate d2/fff 3621375 0 2024-03-28T13:10:02.519 INFO:tasks.workunit.client.0.smithi076.stdout:7/801: mkdir d1/d18/d3c/d11d 0 2024-03-28T13:10:02.519 INFO:tasks.workunit.client.0.smithi076.stdout:7/802: write d1/d8/dc2/dc4/fec [702060,71153] 0 2024-03-28T13:10:02.719 INFO:tasks.workunit.client.0.smithi076.stdout:6/908: creat d6/da/d40/d56/d58/f125 x:0 0 0 2024-03-28T13:10:02.818 INFO:tasks.workunit.client.0.smithi076.stdout:5/869: rename d5/db/df/fa2 to d5/d9/d1c/dcc/f141 0 2024-03-28T13:10:02.905 INFO:tasks.workunit.client.0.smithi076.stdout:1/772: creat d14/d6c/d74/d9e/f110 x:0 0 0 2024-03-28T13:10:02.906 INFO:tasks.workunit.client.0.smithi076.stdout:1/773: write d14/d19/d85/d2e/d31/d51/d92/fb3 [1900276,46556] 0 2024-03-28T13:10:02.914 INFO:tasks.workunit.client.0.smithi076.stdout:1/774: dread fd [0,4194304] 0 2024-03-28T13:10:02.996 INFO:tasks.workunit.client.0.smithi076.stdout:2/896: creat d2/d5/d7/d8/d21/f117 x:0 0 0 2024-03-28T13:10:02.996 INFO:tasks.workunit.client.0.smithi076.stdout:2/897: chown d2/d92/lf9 2453 1 2024-03-28T13:10:03.065 INFO:tasks.workunit.client.0.smithi076.stdout:7/803: dread d1/d8/dc2/dc4/f105 [0,4194304] 0 2024-03-28T13:10:03.083 INFO:tasks.workunit.client.0.smithi076.stdout:7/804: write d1/d18/d3c/d48/d69/d79/f89 [3518890,69387] 0 2024-03-28T13:10:03.083 INFO:tasks.workunit.client.0.smithi076.stdout:7/805: chown d1/d18/l71 1591489 1 2024-03-28T13:10:03.083 INFO:tasks.workunit.client.0.smithi076.stdout:7/806: write d1/d18/fe2 [2506598,118864] 0 2024-03-28T13:10:03.152 INFO:tasks.workunit.client.0.smithi076.stdout:6/909: creat d6/da/d40/d56/da4/d11a/f126 x:0 0 0 2024-03-28T13:10:03.152 INFO:tasks.workunit.client.0.smithi076.stdout:6/910: dread - d6/d99/fed zero size 2024-03-28T13:10:03.204 INFO:tasks.workunit.client.0.smithi076.stdout:5/870: rename d5/d9/f111 to d5/d9/d4c/f142 0 2024-03-28T13:10:03.235 INFO:tasks.workunit.client.0.smithi076.stdout:5/871: dwrite d5/d9/d1c/d25/d136/fd5 [0,4194304] 0 2024-03-28T13:10:03.257 INFO:tasks.workunit.client.0.smithi076.stdout:1/775: creat d14/d19/d85/d2e/d31/d3b/f111 x:0 0 0 2024-03-28T13:10:03.257 INFO:tasks.workunit.client.0.smithi076.stdout:1/776: dread - d14/d19/d85/d2e/d31/d51/d92/fbb zero size 2024-03-28T13:10:03.277 INFO:tasks.workunit.client.0.smithi076.stdout:1/777: write f8 [224123,114419] 0 2024-03-28T13:10:03.299 INFO:tasks.workunit.client.0.smithi076.stdout:1/778: dwrite d14/d19/d85/d2e/d3c/d7e/fcc [0,4194304] 0 2024-03-28T13:10:03.352 INFO:tasks.workunit.client.0.smithi076.stdout:7/807: getdents d1/d18 0 2024-03-28T13:10:03.402 INFO:tasks.workunit.client.0.smithi076.stdout:7/808: dwrite d1/f16 [0,4194304] 0 2024-03-28T13:10:03.403 INFO:tasks.workunit.client.0.smithi076.stdout:7/809: chown d1/d18/d3c/d7b/f116 112627 1 2024-03-28T13:10:03.413 INFO:tasks.workunit.client.0.smithi076.stdout:6/911: mknod d6/da/d5f/d6d/d95/c127 0 2024-03-28T13:10:03.422 INFO:tasks.workunit.client.0.smithi076.stdout:7/810: write d1/d8/d37/d53/dae/f114 [1878112,9045] 0 2024-03-28T13:10:03.445 INFO:tasks.workunit.client.0.smithi076.stdout:6/912: write d6/da/d1e/f4a [9722121,46772] 0 2024-03-28T13:10:03.445 INFO:tasks.workunit.client.0.smithi076.stdout:6/913: chown d6/c4c 1267448 1 2024-03-28T13:10:03.455 INFO:tasks.workunit.client.0.smithi076.stdout:7/811: dwrite d1/d18/feb [0,4194304] 0 2024-03-28T13:10:03.455 INFO:tasks.workunit.client.0.smithi076.stdout:7/812: chown d1/dc/d8b/fd4 3 1 2024-03-28T13:10:03.642 INFO:tasks.workunit.client.0.smithi076.stdout:5/872: getdents d5/d9/d1c 0 2024-03-28T13:10:03.679 INFO:tasks.workunit.client.0.smithi076.stdout:0/898: sync 2024-03-28T13:10:03.679 INFO:tasks.workunit.client.0.smithi076.stdout:0/899: read - db/dc/df/d11/d40/feb zero size 2024-03-28T13:10:04.093 INFO:tasks.workunit.client.0.smithi076.stdout:2/898: truncate d2/d5/db/d3b/d9f/f77 2399661 0 2024-03-28T13:10:04.164 INFO:tasks.workunit.client.0.smithi076.stdout:1/779: symlink d14/d19/d20/l112 0 2024-03-28T13:10:04.296 INFO:tasks.workunit.client.0.smithi076.stdout:6/914: creat d6/da/d40/f128 x:0 0 0 2024-03-28T13:10:04.477 INFO:tasks.workunit.client.0.smithi076.stdout:7/813: link d1/f7 d1/d8/dc2/d100/f11e 0 2024-03-28T13:10:04.552 INFO:tasks.workunit.client.0.smithi076.stdout:0/900: creat db/dc/df/d18/d1d/d75/d51/d60/f141 x:0 0 0 2024-03-28T13:10:04.623 INFO:tasks.workunit.client.0.smithi076.stdout:2/899: mknod d2/d5/db/d3b/d94/c118 0 2024-03-28T13:10:04.640 INFO:tasks.workunit.client.0.smithi076.stdout:2/900: dread d2/d5/db/d3b/d5a/d8d/dc1/fc6 [0,4194304] 0 2024-03-28T13:10:04.681 INFO:tasks.workunit.client.0.smithi076.stdout:1/780: mkdir d14/d19/d85/d2e/d31/d49/d113 0 2024-03-28T13:10:04.736 INFO:tasks.workunit.client.0.smithi076.stdout:6/915: mknod d6/da/d39/d63/d113/c129 0 2024-03-28T13:10:04.736 INFO:tasks.workunit.client.0.smithi076.stdout:6/916: chown d6/da/d23/f43 435 1 2024-03-28T13:10:04.736 INFO:tasks.workunit.client.0.smithi076.stdout:6/917: truncate d6/d99/d46/f74 5120298 0 2024-03-28T13:10:04.736 INFO:tasks.workunit.client.0.smithi076.stdout:6/918: dread - d6/da/d23/ddf/f106 zero size 2024-03-28T13:10:04.800 INFO:tasks.workunit.client.0.smithi076.stdout:7/814: link d1/d18/d2d/l94 d1/d8/dc2/dc4/d104/l11f 0 2024-03-28T13:10:04.844 INFO:tasks.workunit.client.0.smithi076.stdout:0/901: mkdir db/dc/d3d/d57/d142 0 2024-03-28T13:10:04.940 INFO:tasks.workunit.client.0.smithi076.stdout:1/781: creat d14/d19/d85/d2e/d31/d51/f114 x:0 0 0 2024-03-28T13:10:04.941 INFO:tasks.workunit.client.0.smithi076.stdout:1/782: read - d14/d19/d85/d2e/d91/fed zero size 2024-03-28T13:10:04.941 INFO:tasks.workunit.client.0.smithi076.stdout:1/783: fdatasync d14/d19/d85/d2e/d31/d3b/f104 0 2024-03-28T13:10:05.192 INFO:tasks.workunit.client.0.smithi076.stdout:6/919: creat d6/da/d89/f12a x:0 0 0 2024-03-28T13:10:05.193 INFO:tasks.workunit.client.0.smithi076.stdout:6/920: read d6/da/d1e/f70 [91600,81808] 0 2024-03-28T13:10:05.197 INFO:tasks.workunit.client.0.smithi076.stdout:0/902: symlink db/dc/df/d18/d1d/d75/d51/d60/l143 0 2024-03-28T13:10:05.197 INFO:tasks.workunit.client.0.smithi076.stdout:0/903: truncate db/dd8/ff9 4846811 0 2024-03-28T13:10:05.508 INFO:tasks.workunit.client.0.smithi076.stdout:1/784: unlink d14/d19/d85/d2e/d31/d46/l94 0 2024-03-28T13:10:05.508 INFO:tasks.workunit.client.0.smithi076.stdout:1/785: truncate d14/d19/f34 4214537 0 2024-03-28T13:10:05.661 INFO:tasks.workunit.client.0.smithi076.stdout:6/921: mknod d6/da/d5f/c12b 0 2024-03-28T13:10:05.819 INFO:tasks.workunit.client.0.smithi076.stdout:1/786: mkdir d14/d19/d85/d2e/d31/d3b/d115 0 2024-03-28T13:10:05.819 INFO:tasks.workunit.client.0.smithi076.stdout:1/787: readlink d14/d19/d85/d2e/d31/d51/d92/da4/db7/dc8/le2 0 2024-03-28T13:10:05.833 INFO:tasks.workunit.client.0.smithi076.stdout:4/905: sync 2024-03-28T13:10:05.838 INFO:tasks.workunit.client.0.smithi076.stdout:4/906: read d0/d3b/d40/d42/d31/f99 [127510,90569] 0 2024-03-28T13:10:05.841 INFO:tasks.workunit.client.0.smithi076.stdout:1/788: dread d14/d19/f34 [0,4194304] 0 2024-03-28T13:10:05.841 INFO:tasks.workunit.client.0.smithi076.stdout:1/789: dread - d14/def/df0/fd0 zero size 2024-03-28T13:10:05.841 INFO:tasks.workunit.client.0.smithi076.stdout:1/790: write f8 [1780720,56711] 0 2024-03-28T13:10:06.172 INFO:tasks.workunit.client.0.smithi076.stdout:6/922: rmdir d6/da/d40/d62/db0/d123 39 2024-03-28T13:10:06.190 INFO:tasks.workunit.client.0.smithi076.stdout:9/880: dwrite d9/dd/df/d11/d37/f8a [0,4194304] 0 2024-03-28T13:10:06.464 INFO:tasks.workunit.client.0.smithi076.stdout:6/923: mknod d6/da/d40/d56/c12c 0 2024-03-28T13:10:06.575 INFO:tasks.workunit.client.0.smithi076.stdout:8/896: sync 2024-03-28T13:10:06.575 INFO:tasks.workunit.client.0.smithi076.stdout:8/897: stat de/d23/d2b/d51/d62/df9 0 2024-03-28T13:10:06.575 INFO:tasks.workunit.client.0.smithi076.stdout:8/898: read - de/d13/dc9/f126 zero size 2024-03-28T13:10:06.597 INFO:tasks.workunit.client.0.smithi076.stdout:8/899: write de/d23/d2b/d5d/f115 [1354807,78551] 0 2024-03-28T13:10:06.602 INFO:tasks.workunit.client.0.smithi076.stdout:9/881: symlink d9/dd/df/d11/d37/dc4/df9/l10b 0 2024-03-28T13:10:06.636 INFO:tasks.workunit.client.0.smithi076.stdout:5/873: rmdir d5/d9/d1c/dcc 39 2024-03-28T13:10:06.636 INFO:tasks.workunit.client.0.smithi076.stdout:5/874: stat d5/db/d3f/d97 0 2024-03-28T13:10:06.636 INFO:tasks.workunit.client.0.smithi076.stdout:5/875: stat d5/db/d3f/d97/l11e 0 2024-03-28T13:10:06.652 INFO:tasks.workunit.client.0.smithi076.stdout:9/882: dwrite d9/dd/d48/dad/fcf [0,4194304] 0 2024-03-28T13:10:06.657 INFO:tasks.workunit.client.0.smithi076.stdout:9/883: dread d9/fb1 [0,4194304] 0 2024-03-28T13:10:06.898 INFO:tasks.workunit.client.0.smithi076.stdout:8/900: symlink de/d23/d2b/d5d/d76/d6e/d7a/d106/l13c 0 2024-03-28T13:10:06.984 INFO:tasks.workunit.client.0.smithi076.stdout:3/738: sync 2024-03-28T13:10:07.084 INFO:tasks.workunit.client.0.smithi076.stdout:9/884: creat d9/d74/db3/f10c x:0 0 0 2024-03-28T13:10:07.444 INFO:tasks.workunit.client.0.smithi076.stdout:5/876: mknod d5/d9/d1c/d1d/d22/c143 0 2024-03-28T13:10:07.444 INFO:tasks.workunit.client.0.smithi076.stdout:5/877: chown d5/d9/d35/d3b/l127 124694 1 2024-03-28T13:10:07.501 INFO:tasks.workunit.client.0.smithi076.stdout:9/885: mknod d9/dd/df/d11/d14/d58/da1/c10d 0 2024-03-28T13:10:07.919 INFO:tasks.workunit.client.0.smithi076.stdout:5/878: chown d5/d9/d1c/d25/d73/d138 237879 1 2024-03-28T13:10:08.023 INFO:tasks.workunit.client.0.smithi076.stdout:9/886: mknod d9/dd/d48/dd7/dd9/c10e 0 2024-03-28T13:10:08.160 INFO:tasks.workunit.client.0.smithi076.stdout:7/815: write d1/d8/f68 [2738065,110018] 0 2024-03-28T13:10:08.161 INFO:tasks.workunit.client.0.smithi076.stdout:7/816: chown d1/d18/d3c/f5f 326 1 2024-03-28T13:10:08.297 INFO:tasks.workunit.client.0.smithi076.stdout:3/739: link d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/f82 d1/d7/d30/d38/d14/d27/d42/ffe 0 2024-03-28T13:10:08.324 INFO:tasks.workunit.client.0.smithi076.stdout:0/904: dwrite db/dc/df/d71/f6a [0,4194304] 0 2024-03-28T13:10:08.370 INFO:tasks.workunit.client.0.smithi076.stdout:5/879: mknod d5/d9/d35/d3b/db6/df7/c144 0 2024-03-28T13:10:08.370 INFO:tasks.workunit.client.0.smithi076.stdout:5/880: write d5/db/d19/ff0 [557534,78130] 0 2024-03-28T13:10:08.391 INFO:tasks.workunit.client.0.smithi076.stdout:5/881: dwrite d5/d9/d35/fac [4194304,4194304] 0 2024-03-28T13:10:08.392 INFO:tasks.workunit.client.0.smithi076.stdout:5/882: dread - d5/d9/d1c/d25/d60/fc5 zero size 2024-03-28T13:10:08.435 INFO:tasks.workunit.client.0.smithi076.stdout:5/883: dwrite d5/d9/d1c/d25/d73/f10c [0,4194304] 0 2024-03-28T13:10:08.467 INFO:tasks.workunit.client.0.smithi076.stdout:7/817: creat d1/d8/f120 x:0 0 0 2024-03-28T13:10:08.744 INFO:tasks.workunit.client.0.smithi076.stdout:3/740: mknod d1/d7/d30/d38/d14/d27/dc7/cff 0 2024-03-28T13:10:08.782 INFO:tasks.workunit.client.0.smithi076.stdout:3/741: dwrite d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/f5e [0,4194304] 0 2024-03-28T13:10:08.825 INFO:tasks.workunit.client.0.smithi076.stdout:3/742: dwrite d1/d7/d30/d38/d14/d27/f4e [0,4194304] 0 2024-03-28T13:10:08.825 INFO:tasks.workunit.client.0.smithi076.stdout:3/743: readlink d1/d2/l5 0 2024-03-28T13:10:09.017 INFO:tasks.workunit.client.0.smithi076.stdout:7/818: read d1/d8/dc2/d100/f11e [2293195,126019] 0 2024-03-28T13:10:09.027 INFO:tasks.workunit.client.0.smithi076.stdout:7/819: dread d1/d8/d37/f43 [0,4194304] 0 2024-03-28T13:10:09.295 INFO:tasks.workunit.client.0.smithi076.stdout:0/905: rename db/dc/df/d71/l138 to db/dc/df/l144 0 2024-03-28T13:10:09.295 INFO:tasks.workunit.client.0.smithi076.stdout:3/744: symlink d1/d7/d30/d38/d14/d4a/ddc/ded/df3/l100 0 2024-03-28T13:10:09.296 INFO:tasks.workunit.client.0.smithi076.stdout:0/906: dread - db/dc/df/d18/d1d/d75/d51/d97/f140 zero size 2024-03-28T13:10:09.296 INFO:tasks.workunit.client.0.smithi076.stdout:7/820: symlink d1/d8/dc2/dc4/l121 0 2024-03-28T13:10:09.296 INFO:tasks.workunit.client.0.smithi076.stdout:7/821: chown d1/d8/d37/d53/dae/f114 3 1 2024-03-28T13:10:09.297 INFO:tasks.workunit.client.0.smithi076.stdout:7/822: chown d1/dc/f32 7389053 1 2024-03-28T13:10:09.315 INFO:tasks.workunit.client.0.smithi076.stdout:0/907: write db/dc/df/d18/d9f/fb2 [2522293,98799] 0 2024-03-28T13:10:09.321 INFO:tasks.workunit.client.0.smithi076.stdout:3/745: dwrite d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d93/fd8 [0,4194304] 0 2024-03-28T13:10:09.713 INFO:tasks.workunit.client.0.smithi076.stdout:4/907: write d0/d20/d7f/dda/db7/ff3 [289322,41126] 0 2024-03-28T13:10:09.714 INFO:tasks.workunit.client.0.smithi076.stdout:4/908: truncate d0/d20/d7f/dda/d2d/f35 8940803 0 2024-03-28T13:10:09.775 INFO:tasks.workunit.client.0.smithi076.stdout:7/823: rename d1/d81/dc3/cb3 to d1/d81/dd7/c122 0 2024-03-28T13:10:09.896 INFO:tasks.workunit.client.0.smithi076.stdout:0/908: chown db/dc/df/d11/d40/ce2 24 1 2024-03-28T13:10:09.896 INFO:tasks.workunit.client.0.smithi076.stdout:0/909: fsync db/dc/df/d71/f6a 0 2024-03-28T13:10:10.144 INFO:tasks.workunit.client.0.smithi076.stdout:7/824: creat d1/d8/d37/d53/dae/f123 x:0 0 0 2024-03-28T13:10:10.157 INFO:tasks.workunit.client.0.smithi076.stdout:8/901: dwrite de/d13/fec [0,4194304] 0 2024-03-28T13:10:10.158 INFO:tasks.workunit.client.0.smithi076.stdout:8/902: getdents de/d23/d2b/d5d/d76/d6e/dcd/d12e 0 2024-03-28T13:10:10.158 INFO:tasks.workunit.client.0.smithi076.stdout:8/903: write de/d23/d2b/d5d/d76/d18/d3c/f9a [1286938,55408] 0 2024-03-28T13:10:10.158 INFO:tasks.workunit.client.0.smithi076.stdout:8/904: fsync de/d23/d2b/d5d/d76/d6e/d8a/fa5 0 2024-03-28T13:10:10.389 INFO:tasks.workunit.client.0.smithi076.stdout:4/909: mkdir d0/d3b/d40/d42/d47/d7c/d131 0 2024-03-28T13:10:10.392 INFO:tasks.workunit.client.0.smithi076.stdout:0/910: dread db/dc/df/d11/d40/f65 [0,4194304] 0 2024-03-28T13:10:10.396 INFO:tasks.workunit.client.0.smithi076.stdout:7/825: truncate d1/d8/d37/d53/f73 3124134 0 2024-03-28T13:10:10.396 INFO:tasks.workunit.client.0.smithi076.stdout:7/826: dread - d1/dc/d8b/dbf/f107 zero size 2024-03-28T13:10:10.409 INFO:tasks.workunit.client.0.smithi076.stdout:7/827: dread d1/dc/f6e [0,4194304] 0 2024-03-28T13:10:10.409 INFO:tasks.workunit.client.0.smithi076.stdout:7/828: fdatasync d1/d8/d37/fc0 0 2024-03-28T13:10:10.566 INFO:tasks.workunit.client.0.smithi076.stdout:8/905: link de/d23/d2b/d5d/d76/d18/d3c/l46 de/d23/d2b/d5d/d76/d18/d49/l13d 0 2024-03-28T13:10:10.566 INFO:tasks.workunit.client.0.smithi076.stdout:8/906: dread - de/d23/d2b/d5d/d76/d18/d49/dbd/f11d zero size 2024-03-28T13:10:10.686 INFO:tasks.workunit.client.0.smithi076.stdout:4/910: rename d0/d3b/d40/d42/d31/d4d/d63 to d0/d3b/d50/d64/d132 0 2024-03-28T13:10:10.741 INFO:tasks.workunit.client.0.smithi076.stdout:0/911: symlink db/dc/df/d11/d40/d77/da2/d6d/l145 0 2024-03-28T13:10:11.033 INFO:tasks.workunit.client.0.smithi076.stdout:8/907: mkdir de/d23/d2b/d5d/d76/d18/d13e 0 2024-03-28T13:10:11.245 INFO:tasks.workunit.client.0.smithi076.stdout:0/912: unlink db/dc/df/d18/d1d/d75/f13b 0 2024-03-28T13:10:11.245 INFO:tasks.workunit.client.0.smithi076.stdout:0/913: truncate db/dc/df/d11/d40/d77/d87/d88/fab 1238447 0 2024-03-28T13:10:11.245 INFO:tasks.workunit.client.0.smithi076.stdout:0/914: readlink db/dc/df/l144 0 2024-03-28T13:10:11.340 INFO:tasks.workunit.client.0.smithi076.stdout:3/746: dread d1/d7/d30/d38/d14/f8e [0,4194304] 0 2024-03-28T13:10:11.341 INFO:tasks.workunit.client.0.smithi076.stdout:3/747: rename d1/d7 to d1/d7/d30/d38/d14/d27/d101 22 2024-03-28T13:10:11.551 INFO:tasks.workunit.client.0.smithi076.stdout:1/791: symlink d14/d19/d85/l116 0 2024-03-28T13:10:11.551 INFO:tasks.workunit.client.0.smithi076.stdout:9/887: mkdir d9/dd/d10f 0 2024-03-28T13:10:11.551 INFO:tasks.workunit.client.0.smithi076.stdout:1/792: read - d14/d19/d85/d2e/d31/d51/d92/da4/dfb/f100 zero size 2024-03-28T13:10:11.551 INFO:tasks.workunit.client.0.smithi076.stdout:9/888: dread - d9/da/f9d zero size 2024-03-28T13:10:11.588 INFO:tasks.workunit.client.0.smithi076.stdout:9/889: dwrite d9/dd/df/d11/d14/d58/d6e/f21 [0,4194304] 0 2024-03-28T13:10:11.841 INFO:tasks.workunit.client.0.smithi076.stdout:2/901: symlink d2/d5/l119 0 2024-03-28T13:10:11.841 INFO:tasks.workunit.client.0.smithi076.stdout:2/902: fsync d2/d5/db/d3b/d60/f87 0 2024-03-28T13:10:11.841 INFO:tasks.workunit.client.0.smithi076.stdout:2/903: dread - d2/d5/db/d3b/d3f/d99/fd7 zero size 2024-03-28T13:10:11.879 INFO:tasks.workunit.client.0.smithi076.stdout:2/904: dwrite d2/d5/db/d3b/f9a [0,4194304] 0 2024-03-28T13:10:11.879 INFO:tasks.workunit.client.0.smithi076.stdout:2/905: stat d2/d5/d7/d28/c109 0 2024-03-28T13:10:11.919 INFO:tasks.workunit.client.0.smithi076.stdout:8/908: symlink de/d23/d2b/d51/l13f 0 2024-03-28T13:10:11.945 INFO:tasks.workunit.client.0.smithi076.stdout:8/909: read de/d23/d2b/d51/d60/f10f [647403,99270] 0 2024-03-28T13:10:11.996 INFO:tasks.workunit.client.0.smithi076.stdout:0/915: rmdir db/dc/df/d11/d40/dc7 39 2024-03-28T13:10:11.996 INFO:tasks.workunit.client.0.smithi076.stdout:0/916: write db/dc/df/d18/d1d/d75/d51/d97/f133 [366176,59001] 0 2024-03-28T13:10:11.996 INFO:tasks.workunit.client.0.smithi076.stdout:0/917: fsync db/dc/df/f44 0 2024-03-28T13:10:12.005 INFO:tasks.workunit.client.0.smithi076.stdout:0/918: dread db/dc/df/f22 [0,4194304] 0 2024-03-28T13:10:12.005 INFO:tasks.workunit.client.0.smithi076.stdout:0/919: write db/dc/df/d71/d4a/d7e/f131 [950140,106185] 0 2024-03-28T13:10:12.127 INFO:tasks.workunit.client.0.smithi076.stdout:3/748: link d1/d7/d30/d38/fb7 d1/d7/d30/d38/d14/d36/d56/d5b/f102 0 2024-03-28T13:10:12.256 INFO:tasks.workunit.client.0.smithi076.stdout:1/793: mknod d14/d19/d85/d2e/d3c/c117 0 2024-03-28T13:10:12.256 INFO:tasks.workunit.client.0.smithi076.stdout:6/924: mknod d6/c12d 0 2024-03-28T13:10:12.256 INFO:tasks.workunit.client.0.smithi076.stdout:1/794: chown d14/d6c/d74/c9a 5020514 1 2024-03-28T13:10:12.256 INFO:tasks.workunit.client.0.smithi076.stdout:6/925: write d6/da/d5f/d6d/fbb [3741949,113629] 0 2024-03-28T13:10:12.256 INFO:tasks.workunit.client.0.smithi076.stdout:6/926: chown d6/da/d23/fa7 3976152 1 2024-03-28T13:10:12.614 INFO:tasks.workunit.client.0.smithi076.stdout:8/910: readlink l5 0 2024-03-28T13:10:12.615 INFO:tasks.workunit.client.0.smithi076.stdout:8/911: read de/d23/d2b/d5d/d76/d18/d3c/f9a [676296,112764] 0 2024-03-28T13:10:12.669 INFO:tasks.workunit.client.0.smithi076.stdout:0/920: getdents db/dc/df/d18/d1d/d21/dd2 0 2024-03-28T13:10:12.669 INFO:tasks.workunit.client.0.smithi076.stdout:0/921: truncate db/dc/df/d11/d40/dd5/ded/f139 692151 0 2024-03-28T13:10:12.830 INFO:tasks.workunit.client.0.smithi076.stdout:3/749: symlink d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/dcd/l103 0 2024-03-28T13:10:12.836 INFO:tasks.workunit.client.0.smithi076.stdout:1/795: mkdir d14/d19/d85/d2e/d31/d51/d92/da4/db7/dc8/d118 0 2024-03-28T13:10:12.868 INFO:tasks.workunit.client.0.smithi076.stdout:6/927: creat d6/da/d40/d56/d58/f12e x:0 0 0 2024-03-28T13:10:12.894 INFO:tasks.workunit.client.0.smithi076.stdout:6/928: dwrite d6/da/d5f/d6d/fe3 [0,4194304] 0 2024-03-28T13:10:12.924 INFO:tasks.workunit.client.0.smithi076.stdout:6/929: dwrite d6/f2f [4194304,4194304] 0 2024-03-28T13:10:12.951 INFO:tasks.workunit.client.0.smithi076.stdout:6/930: dwrite d6/da/d39/faa [0,4194304] 0 2024-03-28T13:10:13.032 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:10:13.036 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:10:13.210 INFO:tasks.workunit.client.0.smithi076.stdout:8/912: symlink de/d23/d2b/d5d/d76/d6e/l140 0 2024-03-28T13:10:13.232 INFO:tasks.workunit.client.0.smithi076.stdout:7/829: write d1/d8/dc2/dc4/f105 [1598822,101119] 0 2024-03-28T13:10:13.237 INFO:tasks.workunit.client.0.smithi076.stdout:8/913: dwrite de/d23/d2b/d51/d60/d11c/f12d [0,4194304] 0 2024-03-28T13:10:13.248 INFO:tasks.workunit.client.0.smithi076.stdout:0/922: mkdir db/dc/df/d11/dfc/dfd/d146 0 2024-03-28T13:10:13.264 INFO:tasks.workunit.client.0.smithi076.stdout:0/923: dread db/dc/f9a [0,4194304] 0 2024-03-28T13:10:13.386 INFO:tasks.workunit.client.0.smithi076.stdout:3/750: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/db5/dfc/f104 x:0 0 0 2024-03-28T13:10:13.387 INFO:tasks.workunit.client.0.smithi076.stdout:1/796: symlink d14/d19/d85/d2e/d31/d49/d113/l119 0 2024-03-28T13:10:13.420 INFO:tasks.workunit.client.0.smithi076.stdout:1/797: dwrite d14/d19/d85/d2e/d91/f9f [0,4194304] 0 2024-03-28T13:10:13.420 INFO:tasks.workunit.client.0.smithi076.stdout:1/798: fsync d14/d19/d85/d2e/d31/d3b/f43 0 2024-03-28T13:10:13.420 INFO:tasks.workunit.client.0.smithi076.stdout:1/799: readlink d14/d19/d85/d2e/d31/d51/d92/da4/db7/dc8/le2 0 2024-03-28T13:10:13.420 INFO:tasks.workunit.client.0.smithi076.stdout:1/800: write d14/d19/d85/d2e/d31/d51/d92/da4/dfb/f100 [497434,44664] 0 2024-03-28T13:10:13.420 INFO:tasks.workunit.client.0.smithi076.stdout:1/801: dread - d14/d19/d85/d2e/d31/d8f/dde/fee zero size 2024-03-28T13:10:13.421 INFO:tasks.workunit.client.0.smithi076.stdout:1/802: chown d14/d19/d85/d2e/d31/d51/c8d 16 1 2024-03-28T13:10:13.430 INFO:tasks.workunit.client.0.smithi076.stdout:1/803: dread d14/d6c/d74/f95 [0,4194304] 0 2024-03-28T13:10:13.430 INFO:tasks.workunit.client.0.smithi076.stdout:1/804: chown d14/d19/f4b 0 1 2024-03-28T13:10:13.637 INFO:tasks.workunit.client.0.smithi076.stdout:6/931: creat d6/d99/d46/f12f x:0 0 0 2024-03-28T13:10:13.637 INFO:tasks.workunit.client.0.smithi076.stdout:6/932: truncate d6/da/d89/f119 797472 0 2024-03-28T13:10:13.666 INFO:tasks.workunit.client.0.smithi076.stdout:6/933: dwrite d6/da/d1e/f50 [4194304,4194304] 0 2024-03-28T13:10:13.852 INFO:tasks.workunit.client.0.smithi076.stdout:7/830: symlink d1/dc/l124 0 2024-03-28T13:10:13.882 INFO:tasks.workunit.client.0.smithi076.stdout:7/831: dwrite d1/d8/fdc [0,4194304] 0 2024-03-28T13:10:14.180 INFO:tasks.workunit.client.0.smithi076.stdout:8/914: truncate de/d23/d2b/d51/fe5 3005598 0 2024-03-28T13:10:14.180 INFO:tasks.workunit.client.0.smithi076.stdout:8/915: stat de/d23/d2b/d5d/d76/d6e/dcd/c138 0 2024-03-28T13:10:14.180 INFO:tasks.workunit.client.0.smithi076.stdout:0/924: creat db/dc/df/d11/d40/d77/f147 x:0 0 0 2024-03-28T13:10:14.222 INFO:tasks.workunit.client.0.smithi076.stdout:4/911: dwrite d0/d3b/d40/d42/d31/d5e/f83 [0,4194304] 0 2024-03-28T13:10:14.222 INFO:tasks.workunit.client.0.smithi076.stdout:4/912: fsync d0/d20/d7b/fd6 0 2024-03-28T13:10:14.331 INFO:tasks.workunit.client.0.smithi076.stdout:5/884: rmdir d5/d9/d1c/d1d 39 2024-03-28T13:10:14.518 INFO:tasks.workunit.client.0.smithi076.stdout:5/885: fsync d5/d9/d1c/d25/dbd/f103 0 2024-03-28T13:10:14.518 INFO:tasks.workunit.client.0.smithi076.stdout:5/886: chown d5/d9/d1c/d25/d136/f6f 0 1 2024-03-28T13:10:14.862 INFO:tasks.workunit.client.0.smithi076.stdout:2/906: write d2/d5/d7/d8/d21/fe5 [1086473,17934] 0 2024-03-28T13:10:15.196 INFO:tasks.workunit.client.0.smithi076.stdout:6/934: creat d6/da/d39/d63/d113/f130 x:0 0 0 2024-03-28T13:10:15.243 INFO:tasks.workunit.client.0.smithi076.stdout:9/890: dwrite d9/d74/db3/db5/fbc [0,4194304] 0 2024-03-28T13:10:15.246 INFO:tasks.workunit.client.0.smithi076.stdout:6/935: dwrite d6/da/d39/d63/f8a [0,4194304] 0 2024-03-28T13:10:15.246 INFO:tasks.workunit.client.0.smithi076.stdout:6/936: read - d6/da/d40/d56/da4/d11a/f126 zero size 2024-03-28T13:10:15.246 INFO:tasks.workunit.client.0.smithi076.stdout:6/937: write d6/da/d5f/d6d/fb4 [1039097,126618] 0 2024-03-28T13:10:15.246 INFO:tasks.workunit.client.0.smithi076.stdout:6/938: chown d6/d99 3 1 2024-03-28T13:10:15.262 INFO:tasks.workunit.client.0.smithi076.stdout:9/891: dread d9/dd/df/d11/d14/d58/d6e/d2a/fdc [0,4194304] 0 2024-03-28T13:10:15.356 INFO:tasks.workunit.client.0.smithi076.stdout:7/832: truncate d1/d18/d3c/d7b/d7d/f9d 929681 0 2024-03-28T13:10:15.484 INFO:tasks.workunit.client.0.smithi076.stdout:8/916: creat de/d23/d2b/d5d/d76/d18/f141 x:0 0 0 2024-03-28T13:10:15.603 INFO:tasks.workunit.client.0.smithi076.stdout:0/925: rename db/dc/df/d18/d1d/d75/d51/d60/f141 to db/dc/df/d18/d1d/d75/d51/d60/f148 0 2024-03-28T13:10:15.604 INFO:tasks.workunit.client.0.smithi076.stdout:0/926: truncate db/dc/f9a 4986619 0 2024-03-28T13:10:15.638 INFO:tasks.workunit.client.0.smithi076.stdout:4/913: mknod d0/d3b/d40/df5/c133 0 2024-03-28T13:10:15.639 INFO:tasks.workunit.client.0.smithi076.stdout:4/914: fsync d0/d3b/de8/f104 0 2024-03-28T13:10:15.672 INFO:tasks.workunit.client.0.smithi076.stdout:5/887: write d5/d9/d1c/fe1 [1406381,69216] 0 2024-03-28T13:10:15.672 INFO:tasks.workunit.client.0.smithi076.stdout:5/888: chown d5/d9/d1c 2 1 2024-03-28T13:10:15.672 INFO:tasks.workunit.client.0.smithi076.stdout:5/889: fsync d5/d9/d1c/d25/f5d 0 2024-03-28T13:10:15.672 INFO:tasks.workunit.client.0.smithi076.stdout:5/890: write d5/d9/d1c/d25/d60/d82/f84 [4596014,71394] 0 2024-03-28T13:10:15.689 INFO:tasks.workunit.client.0.smithi076.stdout:5/891: write d5/db/f2a [871596,69865] 0 2024-03-28T13:10:15.748 INFO:tasks.workunit.client.0.smithi076.stdout:2/907: mknod d2/d5/db/d3b/d60/c11a 0 2024-03-28T13:10:15.769 INFO:tasks.workunit.client.0.smithi076.stdout:2/908: dread d2/d75/fdc [0,4194304] 0 2024-03-28T13:10:15.959 INFO:tasks.workunit.client.0.smithi076.stdout:6/939: creat d6/da/d40/d56/dd2/f131 x:0 0 0 2024-03-28T13:10:15.980 INFO:tasks.workunit.client.0.smithi076.stdout:9/892: mknod d9/da/de6/c110 0 2024-03-28T13:10:15.981 INFO:tasks.workunit.client.0.smithi076.stdout:7/833: dread d1/dc/f10a [0,4194304] 0 2024-03-28T13:10:15.986 INFO:tasks.workunit.client.0.smithi076.stdout:7/834: dread d1/d8/d37/d53/f6a [0,4194304] 0 2024-03-28T13:10:16.027 INFO:tasks.workunit.client.0.smithi076.stdout:9/893: dwrite d9/dd/df/d11/d14/d58/faf [0,4194304] 0 2024-03-28T13:10:16.213 INFO:tasks.workunit.client.0.smithi076.stdout:0/927: creat db/dd1/f149 x:0 0 0 2024-03-28T13:10:16.213 INFO:tasks.workunit.client.0.smithi076.stdout:0/928: stat db/dc/df/d11/d40/ce2 0 2024-03-28T13:10:16.295 INFO:tasks.workunit.client.0.smithi076.stdout:4/915: creat d0/d3b/d50/d64/d132/de4/f134 x:0 0 0 2024-03-28T13:10:16.296 INFO:tasks.workunit.client.0.smithi076.stdout:4/916: chown d0/d3b/d40/d42/d31/d5e/d72/d78/dcc/c11a 138183 1 2024-03-28T13:10:16.296 INFO:tasks.workunit.client.0.smithi076.stdout:4/917: chown d0/d3b/d40/d8d/l11f 112 1 2024-03-28T13:10:16.400 INFO:tasks.workunit.client.0.smithi076.stdout:5/892: mknod d5/d9/d1c/d25/d73/c145 0 2024-03-28T13:10:16.468 INFO:tasks.workunit.client.0.smithi076.stdout:2/909: rename d2/d5/d7/d3e/ff3 to d2/d67/f11b 0 2024-03-28T13:10:16.502 INFO:tasks.workunit.client.0.smithi076.stdout:2/910: dwrite d2/d75/fda [0,4194304] 0 2024-03-28T13:10:16.509 INFO:tasks.workunit.client.0.smithi076.stdout:2/911: fdatasync d2/d5/d7/d8/d21/fe5 0 2024-03-28T13:10:16.600 INFO:tasks.workunit.client.0.smithi076.stdout:6/940: mknod d6/c132 0 2024-03-28T13:10:16.600 INFO:tasks.workunit.client.0.smithi076.stdout:6/941: readlink d6/da/d40/d62/db0/d123/l93 0 2024-03-28T13:10:16.600 INFO:tasks.workunit.client.0.smithi076.stdout:7/835: mknod d1/d81/dd7/c125 0 2024-03-28T13:10:16.795 INFO:tasks.workunit.client.0.smithi076.stdout:0/929: unlink db/dc/df/d18/d1d/d21/dd2/df1/f118 0 2024-03-28T13:10:16.848 INFO:tasks.workunit.client.0.smithi076.stdout:4/918: mknod d0/d3b/d40/df5/c135 0 2024-03-28T13:10:17.178 INFO:tasks.workunit.client.0.smithi076.stdout:2/912: mknod d2/d5/db/d3b/d60/c11c 0 2024-03-28T13:10:17.178 INFO:tasks.workunit.client.0.smithi076.stdout:6/942: getdents d6/da/d40/d56/da4 0 2024-03-28T13:10:17.205 INFO:tasks.workunit.client.0.smithi076.stdout:6/943: dwrite d6/fe6 [0,4194304] 0 2024-03-28T13:10:17.244 INFO:tasks.workunit.client.0.smithi076.stdout:7/836: creat d1/dc/d8b/f126 x:0 0 0 2024-03-28T13:10:17.335 INFO:tasks.workunit.client.0.smithi076.stdout:9/894: unlink d9/d74/db3/cda 0 2024-03-28T13:10:17.424 INFO:tasks.workunit.client.0.smithi076.stdout:0/930: rename db/dc/df/d11/dfc/dfd/d146 to db/dc/df/d18/d1d/d21/d14a 0 2024-03-28T13:10:17.552 INFO:tasks.workunit.client.0.smithi076.stdout:4/919: truncate d0/d3b/d40/d42/d31/d5e/d72/d78/dcc/fd8 3505352 0 2024-03-28T13:10:17.552 INFO:tasks.workunit.client.0.smithi076.stdout:4/920: dread - d0/d20/d7b/f130 zero size 2024-03-28T13:10:17.625 INFO:tasks.workunit.client.0.smithi076.stdout:2/913: creat d2/d5/d4b/d39/d57/de9/f11d x:0 0 0 2024-03-28T13:10:17.774 INFO:tasks.workunit.client.0.smithi076.stdout:6/944: mkdir d6/da/d39/d63/d113/d133 0 2024-03-28T13:10:17.840 INFO:tasks.workunit.client.0.smithi076.stdout:1/805: dwrite f7 [0,4194304] 0 2024-03-28T13:10:17.841 INFO:tasks.workunit.client.0.smithi076.stdout:1/806: dread - d14/d19/d85/d2e/d31/d8f/dde/fee zero size 2024-03-28T13:10:17.879 INFO:tasks.workunit.client.0.smithi076.stdout:9/895: creat d9/dd/d48/dd7/dd9/f111 x:0 0 0 2024-03-28T13:10:17.880 INFO:tasks.workunit.client.0.smithi076.stdout:9/896: chown d9/dd/d48/dd7/dd9/fed 7137380 1 2024-03-28T13:10:17.880 INFO:tasks.workunit.client.0.smithi076.stdout:9/897: chown d9/da/ca4 1897177 1 2024-03-28T13:10:17.884 INFO:tasks.workunit.client.0.smithi076.stdout:1/807: dwrite d14/d19/d85/d2e/d31/d51/d92/da4/db7/ffe [0,4194304] 0 2024-03-28T13:10:17.899 INFO:tasks.workunit.client.0.smithi076.stdout:1/808: dread d14/d19/f34 [0,4194304] 0 2024-03-28T13:10:18.021 INFO:tasks.workunit.client.0.smithi076.stdout:5/893: rename d5/d9/d35/d3b/c48 to d5/d9/d1c/dcc/c146 0 2024-03-28T13:10:18.179 INFO:tasks.workunit.client.0.smithi076.stdout:4/921: creat d0/d3b/d40/d42/d31/d5e/df9/f136 x:0 0 0 2024-03-28T13:10:18.179 INFO:tasks.workunit.client.0.smithi076.stdout:4/922: chown d0/d3b/d50/d64/d132/fed 0 1 2024-03-28T13:10:18.396 INFO:tasks.workunit.client.0.smithi076.stdout:2/914: creat d2/d5/db/d3b/d3f/f11e x:0 0 0 2024-03-28T13:10:18.573 INFO:tasks.workunit.client.0.smithi076.stdout:9/898: symlink d9/d3c/l112 0 2024-03-28T13:10:18.712 INFO:tasks.workunit.client.0.smithi076.stdout:3/751: sync 2024-03-28T13:10:18.921 INFO:tasks.workunit.client.0.smithi076.stdout:1/809: truncate d14/d19/d85/d2e/f58 3825539 0 2024-03-28T13:10:18.921 INFO:tasks.workunit.client.0.smithi076.stdout:1/810: write d14/d6c/d74/fd3 [1831624,49877] 0 2024-03-28T13:10:18.938 INFO:tasks.workunit.client.0.smithi076.stdout:5/894: creat d5/d9/d1c/d1d/d22/d110/f147 x:0 0 0 2024-03-28T13:10:18.944 INFO:tasks.workunit.client.0.smithi076.stdout:5/895: dread d5/d9/d35/f7f [0,4194304] 0 2024-03-28T13:10:19.171 INFO:tasks.workunit.client.0.smithi076.stdout:4/923: symlink d0/d20/d7b/d81/l137 0 2024-03-28T13:10:19.186 INFO:tasks.workunit.client.0.smithi076.stdout:2/915: symlink d2/d5/db/d3b/df5/l11f 0 2024-03-28T13:10:19.216 INFO:tasks.workunit.client.0.smithi076.stdout:4/924: dwrite d0/d3b/d50/da8/f71 [0,4194304] 0 2024-03-28T13:10:19.233 INFO:tasks.workunit.client.0.smithi076.stdout:4/925: write d0/d3b/d40/d42/d28/f32 [6515666,105120] 0 2024-03-28T13:10:19.244 INFO:tasks.workunit.client.0.smithi076.stdout:9/899: creat d9/da/de6/f113 x:0 0 0 2024-03-28T13:10:19.256 INFO:tasks.workunit.client.0.smithi076.stdout:4/926: dwrite d0/d3b/d40/d42/d47/d7c/f91 [0,4194304] 0 2024-03-28T13:10:19.311 INFO:tasks.workunit.client.0.smithi076.stdout:3/752: truncate d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/fbf 546745 0 2024-03-28T13:10:19.721 INFO:tasks.workunit.client.0.smithi076.stdout:1/811: symlink d14/d19/d20/dd7/l11a 0 2024-03-28T13:10:19.750 INFO:tasks.workunit.client.0.smithi076.stdout:5/896: fsync d5/d9/d1c/f6d 0 2024-03-28T13:10:19.793 INFO:tasks.workunit.client.0.smithi076.stdout:2/916: rmdir d2/d5/db/d3b/d9f/d9e 39 2024-03-28T13:10:19.903 INFO:tasks.workunit.client.0.smithi076.stdout:9/900: rmdir d9/d74 39 2024-03-28T13:10:19.953 INFO:tasks.workunit.client.0.smithi076.stdout:4/927: getdents d0/d3b/d40/d42/d47 0 2024-03-28T13:10:19.974 INFO:tasks.workunit.client.0.smithi076.stdout:4/928: dread d0/d20/d7f/dda/f23 [0,4194304] 0 2024-03-28T13:10:19.979 INFO:tasks.workunit.client.0.smithi076.stdout:4/929: dread d0/d3b/d40/d42/d31/d4d/f9f [0,4194304] 0 2024-03-28T13:10:20.404 INFO:tasks.workunit.client.0.smithi076.stdout:5/897: link d5/d9/d1c/d25/d60/d82/fc0 d5/d9/d1c/d1d/d22/d9d/f148 0 2024-03-28T13:10:20.404 INFO:tasks.workunit.client.0.smithi076.stdout:5/898: chown d5/d9/f40 2 1 2024-03-28T13:10:20.422 INFO:tasks.workunit.client.0.smithi076.stdout:2/917: truncate d2/d5/db/d3b/d9f/f8e 428512 0 2024-03-28T13:10:20.423 INFO:tasks.workunit.client.0.smithi076.stdout:2/918: stat d2/d5/cee 0 2024-03-28T13:10:20.462 INFO:tasks.workunit.client.0.smithi076.stdout:4/930: creat d0/d3b/d40/d42/d31/d5e/f138 x:0 0 0 2024-03-28T13:10:20.462 INFO:tasks.workunit.client.0.smithi076.stdout:4/931: dread - d0/d3b/d50/da8/f127 zero size 2024-03-28T13:10:20.516 INFO:tasks.workunit.client.0.smithi076.stdout:4/932: dwrite d0/d3b/d40/d42/d31/f56 [8388608,4194304] 0 2024-03-28T13:10:20.562 INFO:tasks.workunit.client.0.smithi076.stdout:4/933: dwrite d0/f73 [4194304,4194304] 0 2024-03-28T13:10:20.586 INFO:tasks.workunit.client.0.smithi076.stdout:8/917: unlink de/d23/d2b/fff 0 2024-03-28T13:10:21.091 INFO:tasks.workunit.client.0.smithi076.stdout:2/919: mknod d2/d5/d7/d28/d64/c120 0 2024-03-28T13:10:21.091 INFO:tasks.workunit.client.0.smithi076.stdout:2/920: truncate d2/d5/db/d3b/d9f/d9e/fc5 836536 0 2024-03-28T13:10:21.091 INFO:tasks.workunit.client.0.smithi076.stdout:8/918: getdents de/d13/da2 0 2024-03-28T13:10:21.331 INFO:tasks.workunit.client.0.smithi076.stdout:7/837: write d1/d8/dc2/dc4/fec [165945,111269] 0 2024-03-28T13:10:21.331 INFO:tasks.workunit.client.0.smithi076.stdout:7/838: write d1/d8/dc2/d100/fbb [1037275,70482] 0 2024-03-28T13:10:22.703 INFO:tasks.workunit.client.0.smithi076.stdout:9/901: creat d9/dd/df/d11/d14/d58/f114 x:0 0 0 2024-03-28T13:10:22.925 INFO:tasks.workunit.client.0.smithi076.stdout:2/921: mkdir d2/d5/db/d3b/d42/d121 0 2024-03-28T13:10:22.926 INFO:tasks.workunit.client.0.smithi076.stdout:8/919: truncate de/d13/f120 338135 0 2024-03-28T13:10:22.937 INFO:tasks.workunit.client.0.smithi076.stdout:7/839: mkdir d1/dc/d8b/dbf/d127 0 2024-03-28T13:10:22.938 INFO:tasks.workunit.client.0.smithi076.stdout:6/945: sync 2024-03-28T13:10:22.938 INFO:tasks.workunit.client.0.smithi076.stdout:0/931: sync 2024-03-28T13:10:22.938 INFO:tasks.workunit.client.0.smithi076.stdout:3/753: sync 2024-03-28T13:10:22.964 INFO:tasks.workunit.client.0.smithi076.stdout:5/899: write d5/d9/d35/fac [425161,120935] 0 2024-03-28T13:10:22.964 INFO:tasks.workunit.client.0.smithi076.stdout:5/900: dread - d5/db/d3f/d97/f137 zero size 2024-03-28T13:10:23.557 INFO:tasks.workunit.client.0.smithi076.stdout:9/902: rmdir d9/dd/dbb 39 2024-03-28T13:10:23.557 INFO:tasks.workunit.client.0.smithi076.stdout:2/922: mknod d2/d92/c122 0 2024-03-28T13:10:23.557 INFO:tasks.workunit.client.0.smithi076.stdout:8/920: creat de/d23/d2b/d5d/d76/d6e/d7a/f142 x:0 0 0 2024-03-28T13:10:23.589 INFO:tasks.workunit.client.0.smithi076.stdout:8/921: dwrite de/d23/d2b/d5d/d76/d6e/d7a/f4c [0,4194304] 0 2024-03-28T13:10:23.589 INFO:tasks.workunit.client.0.smithi076.stdout:8/922: dread - de/f110 zero size 2024-03-28T13:10:23.667 INFO:tasks.workunit.client.0.smithi076.stdout:6/946: stat d6/da/d40/d62/cab 0 2024-03-28T13:10:23.667 INFO:tasks.workunit.client.0.smithi076.stdout:0/932: creat db/dc/df/d11/d40/d77/f14b x:0 0 0 2024-03-28T13:10:23.667 INFO:tasks.workunit.client.0.smithi076.stdout:6/947: write d6/da/d5f/d6d/d95/f11f [192352,72986] 0 2024-03-28T13:10:23.673 INFO:tasks.workunit.client.0.smithi076.stdout:0/933: dread db/dc/df/d18/d1d/f10c [0,4194304] 0 2024-03-28T13:10:23.689 INFO:tasks.workunit.client.0.smithi076.stdout:0/934: write db/f94 [2030160,11043] 0 2024-03-28T13:10:23.946 INFO:tasks.workunit.client.0.smithi076.stdout:1/812: rename d14/f52 to d14/d19/d85/d2e/d31/d8f/f11b 0 2024-03-28T13:10:23.946 INFO:tasks.workunit.client.0.smithi076.stdout:1/813: fsync d14/d19/f34 0 2024-03-28T13:10:24.372 INFO:tasks.workunit.client.0.smithi076.stdout:9/903: mkdir d9/dd/df/d11/d14/d58/d6e/d2a/d115 0 2024-03-28T13:10:24.390 INFO:tasks.workunit.client.0.smithi076.stdout:2/923: dread d2/d5/d7/d28/d64/fb3 [4194304,4194304] 0 2024-03-28T13:10:24.390 INFO:tasks.workunit.client.0.smithi076.stdout:2/924: chown d2/d5/d7/l105 1395 1 2024-03-28T13:10:24.393 INFO:tasks.workunit.client.0.smithi076.stdout:2/925: write d2/d5/db/d3b/d9f/d9e/fc5 [191841,60540] 0 2024-03-28T13:10:24.420 INFO:tasks.workunit.client.0.smithi076.stdout:8/923: mknod de/d13/da2/c143 0 2024-03-28T13:10:24.472 INFO:tasks.workunit.client.0.smithi076.stdout:5/901: write d5/d9/d1c/d25/d60/fce [940538,61474] 0 2024-03-28T13:10:24.586 INFO:tasks.workunit.client.0.smithi076.stdout:6/948: creat d6/da/d40/d62/f134 x:0 0 0 2024-03-28T13:10:24.696 INFO:tasks.workunit.client.0.smithi076.stdout:0/935: getdents db/dc/df/d18/d1d/d75/d51/d60/d92 0 2024-03-28T13:10:25.008 INFO:tasks.workunit.client.0.smithi076.stdout:4/934: rename d0/d20/d7f/dda/d2d/d75/fe7 to d0/d3b/d50/de6/d123/f139 0 2024-03-28T13:10:25.010 INFO:tasks.workunit.client.0.smithi076.stdout:1/814: truncate d14/d6c/d74/f95 54534 0 2024-03-28T13:10:25.010 INFO:tasks.workunit.client.0.smithi076.stdout:1/815: dread - d14/d19/d85/d2e/d31/d51/d92/da4/db7/dc8/f10e zero size 2024-03-28T13:10:25.010 INFO:tasks.workunit.client.0.smithi076.stdout:1/816: write d14/d19/d85/d2e/d31/d8f/fc1 [934526,48463] 0 2024-03-28T13:10:25.010 INFO:tasks.workunit.client.0.smithi076.stdout:1/817: chown d14/d19/d20/c25 7355 1 2024-03-28T13:10:25.038 INFO:tasks.workunit.client.0.smithi076.stdout:1/818: dwrite d14/d19/d85/d2e/d31/d51/d92/da4/db5/ff7 [0,4194304] 0 2024-03-28T13:10:25.915 INFO:tasks.workunit.client.0.smithi076.stdout:7/840: dwrite d1/d8/d37/f6c [0,4194304] 0 2024-03-28T13:10:26.055 INFO:tasks.workunit.client.0.smithi076.stdout:5/902: symlink d5/d9/d1c/d25/d136/d105/d135/l149 0 2024-03-28T13:10:26.063 INFO:tasks.workunit.client.0.smithi076.stdout:6/949: creat d6/da/d39/d63/f135 x:0 0 0 2024-03-28T13:10:26.063 INFO:tasks.workunit.client.0.smithi076.stdout:6/950: fdatasync d6/fc2 0 2024-03-28T13:10:26.064 INFO:tasks.workunit.client.0.smithi076.stdout:6/951: chown d6/da/d1e/f70 77902582 1 2024-03-28T13:10:26.088 INFO:tasks.workunit.client.0.smithi076.stdout:2/926: dwrite d2/d5/d4b/d39/d57/fbd [0,4194304] 0 2024-03-28T13:10:26.109 INFO:tasks.workunit.client.0.smithi076.stdout:2/927: dread d2/d5/d7/d28/d64/fb3 [0,4194304] 0 2024-03-28T13:10:26.109 INFO:tasks.workunit.client.0.smithi076.stdout:2/928: write d2/d5/d7/d8/d21/f117 [141149,54952] 0 2024-03-28T13:10:26.338 INFO:tasks.workunit.client.0.smithi076.stdout:3/754: rename d1/d7/d30/d38/d14/d4a/ddc/ded/df3/l100 to d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/df6/l105 0 2024-03-28T13:10:26.339 INFO:tasks.workunit.client.0.smithi076.stdout:0/936: creat db/dc/df/d18/d1d/f14c x:0 0 0 2024-03-28T13:10:26.417 INFO:tasks.workunit.client.0.smithi076.stdout:4/935: creat d0/d20/d7f/dda/d2d/d75/f13a x:0 0 0 2024-03-28T13:10:26.433 INFO:tasks.workunit.client.0.smithi076.stdout:4/936: dread d0/d3b/d40/d42/d47/d69/fe0 [0,4194304] 0 2024-03-28T13:10:26.603 INFO:tasks.workunit.client.0.smithi076.stdout:1/819: symlink d14/d19/d20/dd7/l11c 0 2024-03-28T13:10:26.611 INFO:tasks.workunit.client.0.smithi076.stdout:1/820: dread d14/d19/d85/d2e/d31/d49/f63 [0,4194304] 0 2024-03-28T13:10:26.625 INFO:tasks.workunit.client.0.smithi076.stdout:8/924: dwrite de/d23/d2b/d58/d78/fa0 [0,4194304] 0 2024-03-28T13:10:26.679 INFO:tasks.workunit.client.0.smithi076.stdout:7/841: dread d1/f56 [0,4194304] 0 2024-03-28T13:10:26.734 INFO:tasks.workunit.client.0.smithi076.stdout:5/903: mknod d5/d9/d4c/c14a 0 2024-03-28T13:10:26.734 INFO:tasks.workunit.client.0.smithi076.stdout:5/904: fsync d5/db/d3f/d42/f58 0 2024-03-28T13:10:26.751 INFO:tasks.workunit.client.0.smithi076.stdout:5/905: write d5/d9/d1c/d25/d136/f6f [873467,99576] 0 2024-03-28T13:10:26.751 INFO:tasks.workunit.client.0.smithi076.stdout:5/906: chown d5/d9/d1c/d25/d73/d138 1126225 1 2024-03-28T13:10:26.815 INFO:tasks.workunit.client.0.smithi076.stdout:6/952: creat d6/da/d39/d63/d113/f136 x:0 0 0 2024-03-28T13:10:26.833 INFO:tasks.workunit.client.0.smithi076.stdout:6/953: dread d6/da/d39/d63/f8a [0,4194304] 0 2024-03-28T13:10:26.961 INFO:tasks.workunit.client.0.smithi076.stdout:2/929: creat d2/d5/d7/d8/f123 x:0 0 0 2024-03-28T13:10:26.961 INFO:tasks.workunit.client.0.smithi076.stdout:2/930: fdatasync d2/d5/d7/dd/f32 0 2024-03-28T13:10:26.964 INFO:tasks.workunit.client.0.smithi076.stdout:2/931: dread d2/d5/db/d3b/d60/f87 [0,4194304] 0 2024-03-28T13:10:26.964 INFO:tasks.workunit.client.0.smithi076.stdout:2/932: write d2/d5/db/d3b/df5/f10b [187030,91078] 0 2024-03-28T13:10:27.583 INFO:tasks.workunit.client.0.smithi076.stdout:9/904: sync 2024-03-28T13:10:27.589 INFO:tasks.workunit.client.0.smithi076.stdout:9/905: dread d9/dd/df/f5e [0,4194304] 0 2024-03-28T13:10:27.633 INFO:tasks.workunit.client.0.smithi076.stdout:3/755: truncate d1/d7/d30/d38/d14/d36/fc6 1449033 0 2024-03-28T13:10:27.641 INFO:tasks.workunit.client.0.smithi076.stdout:0/937: mkdir db/dc/d3d/d57/d14d 0 2024-03-28T13:10:27.710 INFO:tasks.workunit.client.0.smithi076.stdout:1/821: truncate d14/d19/d85/d2e/d31/d51/d92/fb3 872046 0 2024-03-28T13:10:27.710 INFO:tasks.workunit.client.0.smithi076.stdout:8/925: rename de/d23/d2b/d5d/d76/d18/d3c/f9a to de/d13/d27/f144 0 2024-03-28T13:10:27.710 INFO:tasks.workunit.client.0.smithi076.stdout:1/822: dread - d14/f97 zero size 2024-03-28T13:10:27.710 INFO:tasks.workunit.client.0.smithi076.stdout:1/823: stat d14/d19/d85/d2e/d31/d51/d92/da4/db5/l109 0 2024-03-28T13:10:27.717 INFO:tasks.workunit.client.0.smithi076.stdout:7/842: chown d1/d18/d3c/d48/l4a 624 1 2024-03-28T13:10:27.717 INFO:tasks.workunit.client.0.smithi076.stdout:7/843: fsync d1/d8/d37/d53/f8f 0 2024-03-28T13:10:27.717 INFO:tasks.workunit.client.0.smithi076.stdout:7/844: fdatasync d1/d18/d3c/f30 0 2024-03-28T13:10:27.717 INFO:tasks.workunit.client.0.smithi076.stdout:7/845: write d1/d8/dc2/dc4/f105 [1154263,74838] 0 2024-03-28T13:10:27.739 INFO:tasks.workunit.client.0.smithi076.stdout:7/846: write d1/d8/dc2/d100/fa9 [3862936,26916] 0 2024-03-28T13:10:27.739 INFO:tasks.workunit.client.0.smithi076.stdout:7/847: write d1/fb9 [386145,89050] 0 2024-03-28T13:10:27.753 INFO:tasks.workunit.client.0.smithi076.stdout:7/848: dread d1/d18/d3c/d48/d69/f6d [0,4194304] 0 2024-03-28T13:10:27.753 INFO:tasks.workunit.client.0.smithi076.stdout:7/849: truncate d1/d8/d37/fc0 707427 0 2024-03-28T13:10:27.753 INFO:tasks.workunit.client.0.smithi076.stdout:7/850: readlink d1/l9e 0 2024-03-28T13:10:27.753 INFO:tasks.workunit.client.0.smithi076.stdout:7/851: write d1/dc/d8b/f126 [120235,38172] 0 2024-03-28T13:10:27.857 INFO:tasks.workunit.client.0.smithi076.stdout:5/907: mknod d5/d9/d35/d10b/c14b 0 2024-03-28T13:10:27.858 INFO:tasks.workunit.client.0.smithi076.stdout:6/954: mkdir d6/da/d40/d137 0 2024-03-28T13:10:27.886 INFO:tasks.workunit.client.0.smithi076.stdout:5/908: dwrite d5/db/d19/f77 [0,4194304] 0 2024-03-28T13:10:27.886 INFO:tasks.workunit.client.0.smithi076.stdout:5/909: write d5/db/d3f/d42/fd1 [1966253,98526] 0 2024-03-28T13:10:28.019 INFO:tasks.workunit.client.0.smithi076.stdout:9/906: mkdir d9/dd/df/d11/d14/d58/d116 0 2024-03-28T13:10:28.021 INFO:tasks.workunit.client.0.smithi076.stdout:9/907: dread d9/f6b [0,4194304] 0 2024-03-28T13:10:28.021 INFO:tasks.workunit.client.0.smithi076.stdout:9/908: write d9/dd/df/d11/fac [528689,35900] 0 2024-03-28T13:10:28.107 INFO:tasks.workunit.client.0.smithi076.stdout:2/933: rename d2/c9d to d2/d5/d7/d28/c124 0 2024-03-28T13:10:28.180 INFO:tasks.workunit.client.0.smithi076.stdout:8/926: creat de/d23/d2b/d5d/d76/d18/d49/dd0/f145 x:0 0 0 2024-03-28T13:10:28.246 INFO:tasks.workunit.client.0.smithi076.stdout:1/824: rmdir d14/d19/d20/dbf 39 2024-03-28T13:10:28.409 INFO:tasks.workunit.client.0.smithi076.stdout:7/852: mkdir d1/d8/d37/d128 0 2024-03-28T13:10:28.450 INFO:tasks.workunit.client.0.smithi076.stdout:4/937: dwrite d0/d20/d7b/d94/fc8 [0,4194304] 0 2024-03-28T13:10:28.678 INFO:tasks.workunit.client.0.smithi076.stdout:6/955: mknod d6/da/d40/d62/db0/d123/c138 0 2024-03-28T13:10:28.760 INFO:tasks.workunit.client.0.smithi076.stdout:0/938: mkdir db/d14e 0 2024-03-28T13:10:28.783 INFO:tasks.workunit.client.0.smithi076.stdout:0/939: dwrite db/dc/df/d18/d1d/d75/d51/d60/d89/fd0 [4194304,4194304] 0 2024-03-28T13:10:28.783 INFO:tasks.workunit.client.0.smithi076.stdout:0/940: truncate db/dc/df/d71/d4a/d7e/f119 495365 0 2024-03-28T13:10:28.873 INFO:tasks.workunit.client.0.smithi076.stdout:9/909: link d9/d3c/fa8 d9/dd/d48/dd7/dd9/d101/f117 0 2024-03-28T13:10:29.176 INFO:tasks.workunit.client.0.smithi076.stdout:5/910: rename d5/d9/d1c/d25/dbd/d7a/c12b to d5/d9/d35/d3b/db6/c14c 0 2024-03-28T13:10:29.270 INFO:tasks.workunit.client.0.smithi076.stdout:2/934: creat d2/d5/db/d3b/d5a/d8d/dc1/d113/f125 x:0 0 0 2024-03-28T13:10:29.389 INFO:tasks.workunit.client.0.smithi076.stdout:8/927: dread de/d23/fcc [0,4194304] 0 2024-03-28T13:10:29.771 INFO:tasks.workunit.client.0.smithi076.stdout:7/853: symlink d1/d8/dc2/d113/l129 0 2024-03-28T13:10:29.772 INFO:tasks.workunit.client.0.smithi076.stdout:7/854: fdatasync d1/d18/d3c/f30 0 2024-03-28T13:10:29.772 INFO:tasks.workunit.client.0.smithi076.stdout:7/855: chown d1/d18/d3c/c85 3 1 2024-03-28T13:10:29.779 INFO:tasks.workunit.client.0.smithi076.stdout:4/938: mknod d0/d3b/d40/d42/d47/d69/da9/dce/c13b 0 2024-03-28T13:10:29.780 INFO:tasks.workunit.client.0.smithi076.stdout:6/956: creat d6/da/d40/d56/d58/f139 x:0 0 0 2024-03-28T13:10:29.805 INFO:tasks.workunit.client.0.smithi076.stdout:6/957: dwrite d6/d99/d46/ffc [0,4194304] 0 2024-03-28T13:10:29.993 INFO:tasks.workunit.client.0.smithi076.stdout:9/910: creat d9/dd/df/d11/d14/d58/d6e/f118 x:0 0 0 2024-03-28T13:10:30.061 INFO:tasks.workunit.client.0.smithi076.stdout:0/941: rename db/dd1/c132 to db/d14e/c14f 0 2024-03-28T13:10:30.360 INFO:tasks.workunit.client.0.smithi076.stdout:5/911: creat d5/d9/d1c/d1d/d31/ded/f14d x:0 0 0 2024-03-28T13:10:30.360 INFO:tasks.workunit.client.0.smithi076.stdout:5/912: read - d5/d9/d35/d3b/db6/fc7 zero size 2024-03-28T13:10:30.362 INFO:tasks.workunit.client.0.smithi076.stdout:3/756: sync 2024-03-28T13:10:30.387 INFO:tasks.workunit.client.0.smithi076.stdout:2/935: getdents d2/d5/db/d3b/d9f 0 2024-03-28T13:10:30.388 INFO:tasks.workunit.client.0.smithi076.stdout:2/936: chown d2/d5/db/d3b/d9f/d9e/fc5 1 1 2024-03-28T13:10:30.618 INFO:tasks.workunit.client.0.smithi076.stdout:8/928: mknod de/d23/d2b/d51/d60/d11c/c146 0 2024-03-28T13:10:30.903 INFO:tasks.workunit.client.0.smithi076.stdout:6/958: symlink d6/da/d5f/d6d/d95/l13a 0 2024-03-28T13:10:30.904 INFO:tasks.workunit.client.0.smithi076.stdout:9/911: creat d9/da/de6/f119 x:0 0 0 2024-03-28T13:10:30.927 INFO:tasks.workunit.client.0.smithi076.stdout:9/912: dwrite d9/fef [0,4194304] 0 2024-03-28T13:10:30.927 INFO:tasks.workunit.client.0.smithi076.stdout:9/913: truncate d9/d74/db3/f102 614331 0 2024-03-28T13:10:30.927 INFO:tasks.workunit.client.0.smithi076.stdout:9/914: write d9/dd/df/d11/d37/f78 [1717963,116232] 0 2024-03-28T13:10:30.973 INFO:tasks.workunit.client.0.smithi076.stdout:9/915: dwrite d9/d74/f83 [0,4194304] 0 2024-03-28T13:10:31.007 INFO:tasks.workunit.client.0.smithi076.stdout:0/942: creat db/dc/d3d/d57/d14d/f150 x:0 0 0 2024-03-28T13:10:31.045 INFO:tasks.workunit.client.0.smithi076.stdout:5/913: mknod d5/d9/d1c/d25/d73/d138/c14e 0 2024-03-28T13:10:31.049 INFO:tasks.workunit.client.0.smithi076.stdout:5/914: dread d5/db/d3f/feb [0,4194304] 0 2024-03-28T13:10:31.087 INFO:tasks.workunit.client.0.smithi076.stdout:3/757: truncate d1/d7/d30/d38/d14/d4a/fae 4433133 0 2024-03-28T13:10:31.087 INFO:tasks.workunit.client.0.smithi076.stdout:3/758: readlink d1/d7/d30/le7 0 2024-03-28T13:10:31.182 INFO:tasks.workunit.client.0.smithi076.stdout:1/825: rmdir d14/d19/d85/d2e/d3c/ddd 0 2024-03-28T13:10:31.217 INFO:tasks.workunit.client.0.smithi076.stdout:8/929: truncate de/d23/d2b/d58/d78/f81 1025177 0 2024-03-28T13:10:31.272 INFO:tasks.workunit.client.0.smithi076.stdout:4/939: symlink d0/d3b/d40/d42/l13c 0 2024-03-28T13:10:31.272 INFO:tasks.workunit.client.0.smithi076.stdout:4/940: write d0/d20/d7f/dda/d2d/f11b [708777,58517] 0 2024-03-28T13:10:31.368 INFO:tasks.workunit.client.0.smithi076.stdout:6/959: rename d6/da/d39/cae to d6/da/d1e/dce/d101/c13b 0 2024-03-28T13:10:31.570 INFO:tasks.workunit.client.0.smithi076.stdout:9/916: creat d9/dd/df/d11/d14/d58/d6e/f11a x:0 0 0 2024-03-28T13:10:31.659 INFO:tasks.workunit.client.0.smithi076.stdout:0/943: rename db/dc/df/d11/f63 to db/dc/df/d11/f151 0 2024-03-28T13:10:31.679 INFO:tasks.workunit.client.0.smithi076.stdout:0/944: write db/dc/f66 [908517,37046] 0 2024-03-28T13:10:31.762 INFO:tasks.workunit.client.0.smithi076.stdout:5/915: symlink d5/d9/l14f 0 2024-03-28T13:10:32.010 INFO:tasks.workunit.client.0.smithi076.stdout:8/930: unlink de/d23/d2b/d5d/d76/d6e/d8a/fa5 0 2024-03-28T13:10:32.031 INFO:tasks.workunit.client.0.smithi076.stdout:8/931: write de/d25/d7f/fc3 [2701376,119767] 0 2024-03-28T13:10:32.031 INFO:tasks.workunit.client.0.smithi076.stdout:8/932: dread - de/d23/d2b/d58/d8e/ff3 zero size 2024-03-28T13:10:32.067 INFO:tasks.workunit.client.0.smithi076.stdout:4/941: getdents d0/d20 0 2024-03-28T13:10:32.067 INFO:tasks.workunit.client.0.smithi076.stdout:4/942: read d0/d3b/d40/d42/d28/f32 [4312065,9889] 0 2024-03-28T13:10:32.253 INFO:tasks.workunit.client.0.smithi076.stdout:3/759: rename d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/dcd/f9c to d1/d7/d30/d38/d14/d97/f106 0 2024-03-28T13:10:32.257 INFO:tasks.workunit.client.0.smithi076.stdout:3/760: dread d1/d2/fba [0,4194304] 0 2024-03-28T13:10:32.334 INFO:tasks.workunit.client.0.smithi076.stdout:6/960: mknod d6/d99/c13c 0 2024-03-28T13:10:32.348 INFO:tasks.workunit.client.0.smithi076.stdout:6/961: dread d6/da/d5f/d6d/fbb [4194304,4194304] 0 2024-03-28T13:10:32.348 INFO:tasks.workunit.client.0.smithi076.stdout:6/962: truncate d6/da/d23/f124 113455 0 2024-03-28T13:10:32.531 INFO:tasks.workunit.client.0.smithi076.stdout:0/945: creat db/dc/df/d18/d12b/f152 x:0 0 0 2024-03-28T13:10:32.547 INFO:tasks.workunit.client.0.smithi076.stdout:0/946: dread db/dc/df/d11/dfc/dfd/f130 [0,4194304] 0 2024-03-28T13:10:32.576 INFO:tasks.workunit.client.0.smithi076.stdout:5/916: creat d5/d9/d1c/d1d/d22/f150 x:0 0 0 2024-03-28T13:10:32.731 INFO:tasks.workunit.client.0.smithi076.stdout:8/933: mkdir de/d23/d2b/d5d/d76/d6e/d87/d147 0 2024-03-28T13:10:32.836 INFO:tasks.workunit.client.0.smithi076.stdout:4/943: rmdir d0/d3b/d40/d42/d31/d5e/df4 39 2024-03-28T13:10:32.836 INFO:tasks.workunit.client.0.smithi076.stdout:4/944: read - d0/d3b/d50/da8/f127 zero size 2024-03-28T13:10:32.865 INFO:tasks.workunit.client.0.smithi076.stdout:4/945: write d0/d20/d7f/dda/d2d/f3a [4728318,78420] 0 2024-03-28T13:10:32.950 INFO:tasks.workunit.client.0.smithi076.stdout:3/761: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/f107 x:0 0 0 2024-03-28T13:10:32.950 INFO:tasks.workunit.client.0.smithi076.stdout:3/762: chown d1/d7/d30/d38/d14/d27/dc7 944 1 2024-03-28T13:10:33.002 INFO:tasks.workunit.client.0.smithi076.stdout:7/856: write d1/dc/f2b [3039846,30428] 0 2024-03-28T13:10:33.030 INFO:tasks.workunit.client.0.smithi076.stdout:7/857: dwrite d1/d18/d3c/f44 [4194304,4194304] 0 2024-03-28T13:10:33.119 INFO:tasks.workunit.client.0.smithi076.stdout:0/947: unlink db/dc/df/d18/d1d/f29 0 2024-03-28T13:10:33.138 INFO:tasks.workunit.client.0.smithi076.stdout:0/948: read db/dc/df/d11/d40/d77/f86 [1411160,107156] 0 2024-03-28T13:10:33.209 INFO:tasks.workunit.client.0.smithi076.stdout:5/917: link d5/d9/d1c/d25/f5d d5/d9/d1c/d1d/f151 0 2024-03-28T13:10:33.209 INFO:tasks.workunit.client.0.smithi076.stdout:5/918: fsync d5/d9/d1c/dcc/f129 0 2024-03-28T13:10:33.312 INFO:tasks.workunit.client.0.smithi076.stdout:8/934: creat de/d23/d2b/d58/d8e/f148 x:0 0 0 2024-03-28T13:10:33.312 INFO:tasks.workunit.client.0.smithi076.stdout:8/935: fsync de/d4e/d54/f64 0 2024-03-28T13:10:33.540 INFO:tasks.workunit.client.0.smithi076.stdout:4/946: symlink d0/d3b/d50/de6/l13d 0 2024-03-28T13:10:33.559 INFO:tasks.workunit.client.0.smithi076.stdout:4/947: write d0/d20/d7f/dda/d2d/f35 [3231329,101773] 0 2024-03-28T13:10:33.559 INFO:tasks.workunit.client.0.smithi076.stdout:4/948: dread - d0/d3b/d40/d42/d31/f8f zero size 2024-03-28T13:10:33.660 INFO:tasks.workunit.client.0.smithi076.stdout:3/763: rename d1/d7/d30/d38/d14/d27/d42/de4 to d1/d7/d30/d38/d14/d27/d108 0 2024-03-28T13:10:33.773 INFO:tasks.workunit.client.0.smithi076.stdout:6/963: mknod d6/da/d40/d56/d84/c13d 0 2024-03-28T13:10:33.908 INFO:tasks.workunit.client.0.smithi076.stdout:7/858: symlink d1/dc/d8b/dbf/d127/l12a 0 2024-03-28T13:10:33.908 INFO:tasks.workunit.client.0.smithi076.stdout:7/859: fsync d1/d8/dc2/d100/fa2 0 2024-03-28T13:10:33.931 INFO:tasks.workunit.client.0.smithi076.stdout:7/860: write d1/d18/d3c/d7b/fd2 [687087,108043] 0 2024-03-28T13:10:34.200 INFO:tasks.workunit.client.0.smithi076.stdout:0/949: creat db/dc/df/d71/d4a/f153 x:0 0 0 2024-03-28T13:10:34.200 INFO:tasks.workunit.client.0.smithi076.stdout:0/950: fdatasync db/dc/df/f44 0 2024-03-28T13:10:34.227 INFO:tasks.workunit.client.0.smithi076.stdout:2/937: dwrite d2/d5/d7/d8/f44 [0,4194304] 0 2024-03-28T13:10:34.227 INFO:tasks.workunit.client.0.smithi076.stdout:2/938: chown d2/d5/db/d3b/d60/f87 4 1 2024-03-28T13:10:34.404 INFO:tasks.workunit.client.0.smithi076.stdout:5/919: creat d5/d9/d1c/d25/d73/f152 x:0 0 0 2024-03-28T13:10:34.505 INFO:tasks.workunit.client.0.smithi076.stdout:8/936: creat de/d23/d2b/d5d/d76/d6e/d7a/d106/f149 x:0 0 0 2024-03-28T13:10:34.596 INFO:tasks.workunit.client.0.smithi076.stdout:4/949: truncate d0/d3b/d40/d42/d31/d4d/f54 6895492 0 2024-03-28T13:10:34.657 INFO:tasks.workunit.client.0.smithi076.stdout:1/826: symlink d14/d19/d85/l11d 0 2024-03-28T13:10:34.657 INFO:tasks.workunit.client.0.smithi076.stdout:1/827: truncate d14/d19/d85/d2e/d31/d3b/ff2 338358 0 2024-03-28T13:10:34.679 INFO:tasks.workunit.client.0.smithi076.stdout:3/764: creat d1/d7/d30/d38/d14/d97/f109 x:0 0 0 2024-03-28T13:10:34.679 INFO:tasks.workunit.client.0.smithi076.stdout:3/765: fsync d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/f40 0 2024-03-28T13:10:34.709 INFO:tasks.workunit.client.0.smithi076.stdout:6/964: dread - d6/da/d39/d63/d113/ff3 zero size 2024-03-28T13:10:34.709 INFO:tasks.workunit.client.0.smithi076.stdout:6/965: chown d6/dc1 105150979 1 2024-03-28T13:10:34.783 INFO:tasks.workunit.client.0.smithi076.stdout:7/861: mkdir d1/d8/dc2/dc4/d12b 0 2024-03-28T13:10:34.849 INFO:tasks.workunit.client.0.smithi076.stdout:0/951: unlink db/dc/df/d11/fa0 0 2024-03-28T13:10:35.004 INFO:tasks.workunit.client.0.smithi076.stdout:2/939: truncate d2/d5/db/d3b/d9f/f77 1912094 0 2024-03-28T13:10:35.059 INFO:tasks.workunit.client.0.smithi076.stdout:5/920: readlink d5/d9/d1c/lf3 0 2024-03-28T13:10:35.130 INFO:tasks.workunit.client.0.smithi076.stdout:8/937: read de/d23/d2b/d51/fe5 [519118,3626] 0 2024-03-28T13:10:35.295 INFO:tasks.workunit.client.0.smithi076.stdout:4/950: rename d0/d3b/d40/d42/d47/d69/f12e to d0/d20/d7f/f13e 0 2024-03-28T13:10:35.295 INFO:tasks.workunit.client.0.smithi076.stdout:4/951: chown d0/d3b/d50/d64/d132/fcb 619698 1 2024-03-28T13:10:35.339 INFO:tasks.workunit.client.0.smithi076.stdout:1/828: mknod d14/d19/d85/d2e/d91/c11e 0 2024-03-28T13:10:35.437 INFO:tasks.workunit.client.0.smithi076.stdout:3/766: link d1/d7/d30/d38/d14/d4a/d66/f6a d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/db5/f10a 0 2024-03-28T13:10:35.437 INFO:tasks.workunit.client.0.smithi076.stdout:3/767: readlink d1/d7/d30/d38/d14/d27/d69/lbc 0 2024-03-28T13:10:35.437 INFO:tasks.workunit.client.0.smithi076.stdout:3/768: chown d1/d7/d30/d38/d9b/ffa 216203 1 2024-03-28T13:10:35.437 INFO:tasks.workunit.client.0.smithi076.stdout:3/769: truncate d1/d7/d30/d38/d14/d36/d56/d5b/f102 4810862 0 2024-03-28T13:10:35.464 INFO:tasks.workunit.client.0.smithi076.stdout:3/770: dwrite d1/d7/d30/d38/d14/d4a/ddc/feb [0,4194304] 0 2024-03-28T13:10:35.497 INFO:tasks.workunit.client.0.smithi076.stdout:6/966: truncate d6/da/d23/f43 4273086 0 2024-03-28T13:10:35.563 INFO:tasks.workunit.client.0.smithi076.stdout:9/917: dwrite d9/dd/df/d11/d14/d58/d6e/d2a/f8b [0,4194304] 0 2024-03-28T13:10:35.576 INFO:tasks.workunit.client.0.smithi076.stdout:2/940: symlink d2/d5/db/d3b/d60/dfb/l126 0 2024-03-28T13:10:35.591 INFO:tasks.workunit.client.0.smithi076.stdout:9/918: read d9/dd/d48/dad/fcf [3669912,68913] 0 2024-03-28T13:10:35.591 INFO:tasks.workunit.client.0.smithi076.stdout:9/919: stat d9/dd/d48/c4c 0 2024-03-28T13:10:35.592 INFO:tasks.workunit.client.0.smithi076.stdout:9/920: chown d9/dd/d48/dad/ca7 24735069 1 2024-03-28T13:10:35.610 INFO:tasks.workunit.client.0.smithi076.stdout:2/941: dwrite d2/d5/d7/f19 [0,4194304] 0 2024-03-28T13:10:36.384 INFO:tasks.workunit.client.0.smithi076.stdout:4/952: unlink d0/d3b/d40/d42/d47/d7c/lf6 0 2024-03-28T13:10:36.495 INFO:tasks.workunit.client.0.smithi076.stdout:1/829: dread d14/d19/d85/d2e/d31/d51/d92/da4/db7/fe6 [0,4194304] 0 2024-03-28T13:10:36.576 INFO:tasks.workunit.client.0.smithi076.stdout:1/830: dwrite d14/d19/d85/d2e/d31/d49/f63 [0,4194304] 0 2024-03-28T13:10:36.577 INFO:tasks.workunit.client.0.smithi076.stdout:1/831: chown d14/d19/d20/ceb 168245093 1 2024-03-28T13:10:36.877 INFO:tasks.workunit.client.0.smithi076.stdout:3/771: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/f10b x:0 0 0 2024-03-28T13:10:36.919 INFO:tasks.workunit.client.0.smithi076.stdout:6/967: mkdir d6/da/d40/d137/d13e 0 2024-03-28T13:10:37.346 INFO:tasks.workunit.client.0.smithi076.stdout:9/921: unlink d9/d74/d7d/fa5 0 2024-03-28T13:10:37.346 INFO:tasks.workunit.client.0.smithi076.stdout:2/942: getdents d2/d5/d7/dd/dc8 0 2024-03-28T13:10:37.370 INFO:tasks.workunit.client.0.smithi076.stdout:9/922: dwrite d9/dd/df/d11/d14/f31 [0,4194304] 0 2024-03-28T13:10:37.395 INFO:tasks.workunit.client.0.smithi076.stdout:9/923: write d9/dd/df/fde [3391449,130330] 0 2024-03-28T13:10:37.431 INFO:tasks.workunit.client.0.smithi076.stdout:4/953: getdents d0/d3b/d40/d8d 0 2024-03-28T13:10:37.623 INFO:tasks.workunit.client.0.smithi076.stdout:1/832: rmdir d14/d19/d85/d2e/d31/d51/d92/da4/db7 39 2024-03-28T13:10:37.629 INFO:tasks.workunit.client.0.smithi076.stdout:1/833: dread d14/d6c/fa7 [0,4194304] 0 2024-03-28T13:10:37.698 INFO:tasks.workunit.client.0.smithi076.stdout:6/968: creat d6/da/d40/d62/dca/ddd/f13f x:0 0 0 2024-03-28T13:10:37.746 INFO:tasks.workunit.client.0.smithi076.stdout:2/943: symlink d2/d67/l127 0 2024-03-28T13:10:37.746 INFO:tasks.workunit.client.0.smithi076.stdout:2/944: dread - d2/d5/db/d3b/d3f/f11e zero size 2024-03-28T13:10:37.746 INFO:tasks.workunit.client.0.smithi076.stdout:2/945: stat d2/d5/d7/d3e/lb4 0 2024-03-28T13:10:37.746 INFO:tasks.workunit.client.0.smithi076.stdout:2/946: dread - d2/d5/db/d3b/d3f/f11e zero size 2024-03-28T13:10:37.985 INFO:tasks.workunit.client.0.smithi076.stdout:9/924: truncate d9/d3c/f5a 484805 0 2024-03-28T13:10:37.985 INFO:tasks.workunit.client.0.smithi076.stdout:4/954: creat d0/d3b/d40/d42/d31/d5e/dc3/f13f x:0 0 0 2024-03-28T13:10:37.985 INFO:tasks.workunit.client.0.smithi076.stdout:4/955: readlink d0/d3b/d50/de6/l13d 0 2024-03-28T13:10:37.985 INFO:tasks.workunit.client.0.smithi076.stdout:9/925: write d9/dd/df/d11/d14/d58/d6e/d2a/f76 [261099,48821] 0 2024-03-28T13:10:37.985 INFO:tasks.workunit.client.0.smithi076.stdout:9/926: stat d9/dd/df/l88 0 2024-03-28T13:10:38.044 INFO:tasks.workunit.client.0.smithi076.stdout:3/772: mknod d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/dd3/c10c 0 2024-03-28T13:10:38.092 INFO:tasks.workunit.client.0.smithi076.stdout:3/773: dwrite d1/d7/d30/d38/d14/d36/f16 [0,4194304] 0 2024-03-28T13:10:38.108 INFO:tasks.workunit.client.0.smithi076.stdout:6/969: creat d6/da/d39/d63/d113/d111/f140 x:0 0 0 2024-03-28T13:10:38.189 INFO:tasks.workunit.client.0.smithi076.stdout:2/947: symlink d2/d5/d7/d8/d21/l128 0 2024-03-28T13:10:38.431 INFO:tasks.workunit.client.0.smithi076.stdout:1/834: truncate d14/d19/d85/d3f/f73 1702013 0 2024-03-28T13:10:38.466 INFO:tasks.workunit.client.0.smithi076.stdout:3/774: mkdir d1/d7/d30/d38/d14/d36/d56/d5b/d10d 0 2024-03-28T13:10:38.961 INFO:tasks.workunit.client.0.smithi076.stdout:2/948: creat d2/d5/db/f129 x:0 0 0 2024-03-28T13:10:38.990 INFO:tasks.workunit.client.0.smithi076.stdout:8/938: dwrite de/d13/f120 [0,4194304] 0 2024-03-28T13:10:38.997 INFO:tasks.workunit.client.0.smithi076.stdout:1/835: creat d14/d19/d85/d2e/d31/d8f/f11f x:0 0 0 2024-03-28T13:10:39.017 INFO:tasks.workunit.client.0.smithi076.stdout:3/775: mkdir d1/d7/d30/d38/d14/d4a/ddc/d10e 0 2024-03-28T13:10:39.017 INFO:tasks.workunit.client.0.smithi076.stdout:6/970: mkdir d6/da/d39/d141 0 2024-03-28T13:10:39.017 INFO:tasks.workunit.client.0.smithi076.stdout:6/971: chown d6/da/d23/fa7 1138 1 2024-03-28T13:10:39.287 INFO:tasks.workunit.client.0.smithi076.stdout:2/949: mknod d2/d5/db/d3b/d60/dfb/c12a 0 2024-03-28T13:10:39.345 INFO:tasks.workunit.client.0.smithi076.stdout:2/950: dwrite d2/d5/d7/d8/d21/f27 [0,4194304] 0 2024-03-28T13:10:39.433 INFO:tasks.workunit.client.0.smithi076.stdout:3/776: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/dcd/db9/f10f x:0 0 0 2024-03-28T13:10:39.433 INFO:tasks.workunit.client.0.smithi076.stdout:6/972: creat d6/da/d5f/d6d/daf/d11d/f142 x:0 0 0 2024-03-28T13:10:39.819 INFO:tasks.workunit.client.0.smithi076.stdout:3/777: symlink d1/d7/d30/d81/l110 0 2024-03-28T13:10:39.825 INFO:tasks.workunit.client.0.smithi076.stdout:6/973: creat d6/da/d1e/dce/d101/f143 x:0 0 0 2024-03-28T13:10:39.871 INFO:tasks.workunit.client.0.smithi076.stdout:3/778: symlink d1/d7/d30/d38/d14/d4a/ddc/d10e/l111 0 2024-03-28T13:10:39.970 INFO:tasks.workunit.client.0.smithi076.stdout:6/974: getdents d6/da 0 2024-03-28T13:10:40.215 INFO:tasks.workunit.client.0.smithi076.stdout:3/779: creat d1/d7/d30/d38/d14/d4a/ddc/f112 x:0 0 0 2024-03-28T13:10:40.226 INFO:tasks.workunit.client.0.smithi076.stdout:6/975: symlink d6/da/d40/d62/dca/ddd/d11e/l144 0 2024-03-28T13:10:40.307 INFO:tasks.workunit.client.0.smithi076.stdout:3/780: creat d1/d2/f113 x:0 0 0 2024-03-28T13:10:40.330 INFO:tasks.workunit.client.0.smithi076.stdout:6/976: rmdir d6/da/d1e/dde 39 2024-03-28T13:10:40.371 INFO:tasks.workunit.client.0.smithi076.stdout:6/977: dwrite d6/da/d1e/f70 [0,4194304] 0 2024-03-28T13:10:40.400 INFO:tasks.workunit.client.0.smithi076.stdout:6/978: dwrite d6/da/d89/f112 [0,4194304] 0 2024-03-28T13:10:40.400 INFO:tasks.workunit.client.0.smithi076.stdout:6/979: dread - d6/d99/d46/ff4 zero size 2024-03-28T13:10:40.510 INFO:tasks.workunit.client.0.smithi076.stdout:0/952: mkdir db/d154 0 2024-03-28T13:10:40.510 INFO:tasks.workunit.client.0.smithi076.stdout:3/781: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/db5/f114 x:0 0 0 2024-03-28T13:10:40.816 INFO:tasks.workunit.client.0.smithi076.stdout:6/980: symlink d6/da/d39/d63/d113/d111/l145 0 2024-03-28T13:10:40.841 INFO:tasks.workunit.client.0.smithi076.stdout:6/981: read d6/da/d40/d56/d58/f88 [3567897,64703] 0 2024-03-28T13:10:40.841 INFO:tasks.workunit.client.0.smithi076.stdout:6/982: readlink d6/l105 0 2024-03-28T13:10:40.918 INFO:tasks.workunit.client.0.smithi076.stdout:0/953: link db/dc/df/fe1 db/dc/df/d11/d40/d77/f155 0 2024-03-28T13:10:40.987 INFO:tasks.workunit.client.0.smithi076.stdout:6/983: creat d6/da/d40/d56/dc7/f146 x:0 0 0 2024-03-28T13:10:41.058 INFO:tasks.workunit.client.0.smithi076.stdout:0/954: mkdir db/dc/d3d/d156 0 2024-03-28T13:10:41.058 INFO:tasks.workunit.client.0.smithi076.stdout:0/955: dread - db/dc/df/d11/d40/d77/f14b zero size 2024-03-28T13:10:41.313 INFO:tasks.workunit.client.0.smithi076.stdout:3/782: truncate d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/fdb 155106 0 2024-03-28T13:10:41.442 INFO:tasks.workunit.client.0.smithi076.stdout:6/984: dread d6/da/d23/f80 [0,4194304] 0 2024-03-28T13:10:41.460 INFO:tasks.workunit.client.0.smithi076.stdout:6/985: dread d6/da/d40/d56/d58/f88 [0,4194304] 0 2024-03-28T13:10:41.945 INFO:tasks.workunit.client.0.smithi076.stdout:7/862: rename d1/d8/f25 to d1/dc/f12c 0 2024-03-28T13:10:42.123 INFO:tasks.workunit.client.0.smithi076.stdout:0/956: symlink db/dc/df/d71/d4a/l157 0 2024-03-28T13:10:42.307 INFO:tasks.workunit.client.0.smithi076.stdout:2/951: rename d2/d5/db/d3b/d9f/fde to d2/d5/db/d3b/d5a/d8d/dc1/f12b 0 2024-03-28T13:10:42.350 INFO:tasks.workunit.client.0.smithi076.stdout:7/863: chown d1/d18/d3c/d48/c75 94572 1 2024-03-28T13:10:42.394 INFO:tasks.workunit.client.0.smithi076.stdout:0/957: creat db/dc/df/d18/d1d/d73/f158 x:0 0 0 2024-03-28T13:10:42.523 INFO:tasks.workunit.client.0.smithi076.stdout:6/986: mkdir d6/da/d40/d147 0 2024-03-28T13:10:42.523 INFO:tasks.workunit.client.0.smithi076.stdout:2/952: rename d2/d5/db/d3b/d9f/d9e/c104 to d2/d67/c12c 0 2024-03-28T13:10:42.523 INFO:tasks.workunit.client.0.smithi076.stdout:6/987: write d6/da/d40/d56/dc7/f146 [269965,101008] 0 2024-03-28T13:10:42.543 INFO:tasks.workunit.client.0.smithi076.stdout:2/953: dread d2/d5/db/d3b/d3f/fbf [0,4194304] 0 2024-03-28T13:10:42.584 INFO:tasks.workunit.client.0.smithi076.stdout:7/864: creat d1/d8/f12d x:0 0 0 2024-03-28T13:10:42.624 INFO:tasks.workunit.client.0.smithi076.stdout:7/865: dwrite d1/d8/d37/f9a [0,4194304] 0 2024-03-28T13:10:42.820 INFO:tasks.workunit.client.0.smithi076.stdout:2/954: mkdir d2/d5/db/d3b/d60/d12d 0 2024-03-28T13:10:42.820 INFO:tasks.workunit.client.0.smithi076.stdout:7/866: link d1/d18/d3c/d48/d69/fd0 d1/dc/f12e 0 2024-03-28T13:10:42.840 INFO:tasks.workunit.client.0.smithi076.stdout:0/958: dread - db/dc/df/d11/d40/dc7/fe5 zero size 2024-03-28T13:10:43.154 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:10:43.158 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:10:43.206 INFO:tasks.workunit.client.0.smithi076.stdout:0/959: symlink db/dc/df/d18/d1d/d21/l159 0 2024-03-28T13:10:43.206 INFO:tasks.workunit.client.0.smithi076.stdout:0/960: dread - db/dc/df/d18/d1d/d75/d51/d60/f148 zero size 2024-03-28T13:10:43.523 INFO:tasks.workunit.client.0.smithi076.stdout:0/961: truncate db/dc/df/d11/d40/d77/f86 1876128 0 2024-03-28T13:10:44.382 INFO:tasks.workunit.client.0.smithi076.stdout:9/927: sync 2024-03-28T13:10:44.382 INFO:tasks.workunit.client.0.smithi076.stdout:5/921: sync 2024-03-28T13:10:44.382 INFO:tasks.workunit.client.0.smithi076.stdout:1/836: sync 2024-03-28T13:10:44.382 INFO:tasks.workunit.client.0.smithi076.stdout:5/922: fdatasync d5/db/d3f/d97/fa8 0 2024-03-28T13:10:44.382 INFO:tasks.workunit.client.0.smithi076.stdout:9/928: write d9/dd/fd2 [188030,20585] 0 2024-03-28T13:10:44.383 INFO:tasks.workunit.client.0.smithi076.stdout:4/956: sync 2024-03-28T13:10:44.383 INFO:tasks.workunit.client.0.smithi076.stdout:8/939: sync 2024-03-28T13:10:44.383 INFO:tasks.workunit.client.0.smithi076.stdout:8/940: readlink de/d23/d2b/d5d/d76/d18/l48 0 2024-03-28T13:10:44.397 INFO:tasks.workunit.client.0.smithi076.stdout:5/923: dread d5/db/d3f/d42/f58 [0,4194304] 0 2024-03-28T13:10:44.404 INFO:tasks.workunit.client.0.smithi076.stdout:3/783: write d1/d7/fef [5146116,83305] 0 2024-03-28T13:10:44.404 INFO:tasks.workunit.client.0.smithi076.stdout:3/784: chown d1/d7/d30/d38/d14/d97/fcc 398153 1 2024-03-28T13:10:44.421 INFO:tasks.workunit.client.0.smithi076.stdout:4/957: dwrite d0/d20/d7f/fad [0,4194304] 0 2024-03-28T13:10:44.421 INFO:tasks.workunit.client.0.smithi076.stdout:4/958: dread - d0/d3b/d40/d42/fec zero size 2024-03-28T13:10:44.421 INFO:tasks.workunit.client.0.smithi076.stdout:4/959: chown d0/f73 1434767298 1 2024-03-28T13:10:44.485 INFO:tasks.workunit.client.0.smithi076.stdout:6/988: write d6/f12 [5051591,12417] 0 2024-03-28T13:10:44.523 INFO:tasks.workunit.client.0.smithi076.stdout:7/867: dwrite d1/d18/d3c/d7b/d7d/f9d [0,4194304] 0 2024-03-28T13:10:44.735 INFO:tasks.workunit.client.0.smithi076.stdout:1/837: link d14/d19/d85/d2e/d91/fed d14/d19/d85/dd6/f120 0 2024-03-28T13:10:44.765 INFO:tasks.workunit.client.0.smithi076.stdout:8/941: mknod de/d23/d2b/d5d/d76/d6e/d7a/d106/c14a 0 2024-03-28T13:10:44.768 INFO:tasks.workunit.client.0.smithi076.stdout:1/838: dwrite f8 [4194304,4194304] 0 2024-03-28T13:10:44.768 INFO:tasks.workunit.client.0.smithi076.stdout:1/839: fdatasync d14/d6c/d74/f78 0 2024-03-28T13:10:44.912 INFO:tasks.workunit.client.0.smithi076.stdout:4/960: unlink d0/d3b/d40/d42/d31/d5e/d72/d78/dcc/fd8 0 2024-03-28T13:10:44.913 INFO:tasks.workunit.client.0.smithi076.stdout:4/961: chown d0/d20/d7f/dda/d2d/d75/d116 61 1 2024-03-28T13:10:44.933 INFO:tasks.workunit.client.0.smithi076.stdout:4/962: dread d0/d20/d7f/dda/d2d/f35 [4194304,4194304] 0 2024-03-28T13:10:45.173 INFO:tasks.workunit.client.0.smithi076.stdout:6/989: unlink d6/d99/cc0 0 2024-03-28T13:10:45.173 INFO:tasks.workunit.client.0.smithi076.stdout:7/868: symlink d1/d18/d3c/d48/de5/l12f 0 2024-03-28T13:10:45.174 INFO:tasks.workunit.client.0.smithi076.stdout:7/869: write d1/dc/f2b [4094805,102433] 0 2024-03-28T13:10:45.226 INFO:tasks.workunit.client.0.smithi076.stdout:2/955: sync 2024-03-28T13:10:45.226 INFO:tasks.workunit.client.0.smithi076.stdout:0/962: sync 2024-03-28T13:10:45.266 INFO:tasks.workunit.client.0.smithi076.stdout:9/929: rmdir d9/dd/df/d11/d14 39 2024-03-28T13:10:45.266 INFO:tasks.workunit.client.0.smithi076.stdout:8/942: creat de/d23/d2b/d5d/d76/d18/d49/dd0/f14b x:0 0 0 2024-03-28T13:10:45.369 INFO:tasks.workunit.client.0.smithi076.stdout:1/840: link d14/d19/d85/l116 d14/d19/d85/d2e/d31/d8f/d102/l121 0 2024-03-28T13:10:45.410 INFO:tasks.workunit.client.0.smithi076.stdout:1/841: dwrite d14/d19/d85/d2e/d3c/f10f [0,4194304] 0 2024-03-28T13:10:45.458 INFO:tasks.workunit.client.0.smithi076.stdout:6/990: truncate d6/da/d89/fa1 3187407 0 2024-03-28T13:10:45.490 INFO:tasks.workunit.client.0.smithi076.stdout:7/870: truncate d1/f13 3743647 0 2024-03-28T13:10:45.852 INFO:tasks.workunit.client.0.smithi076.stdout:0/963: symlink db/dc/df/d71/d4a/d107/l15a 0 2024-03-28T13:10:45.853 INFO:tasks.workunit.client.0.smithi076.stdout:0/964: fsync db/ff8 0 2024-03-28T13:10:45.883 INFO:tasks.workunit.client.0.smithi076.stdout:9/930: mknod d9/d3c/c11b 0 2024-03-28T13:10:45.884 INFO:tasks.workunit.client.0.smithi076.stdout:8/943: rmdir de 39 2024-03-28T13:10:45.908 INFO:tasks.workunit.client.0.smithi076.stdout:8/944: write de/d23/d2b/d51/d60/d11c/f12d [2745611,65005] 0 2024-03-28T13:10:46.300 INFO:tasks.workunit.client.0.smithi076.stdout:7/871: mknod d1/d18/d3c/d48/de5/c130 0 2024-03-28T13:10:46.300 INFO:tasks.workunit.client.0.smithi076.stdout:7/872: fdatasync d1/d8/dc2/d100/db5/fe3 0 2024-03-28T13:10:46.330 INFO:tasks.workunit.client.0.smithi076.stdout:0/965: creat db/dd1/f15b x:0 0 0 2024-03-28T13:10:46.399 INFO:tasks.workunit.client.0.smithi076.stdout:9/931: dwrite d9/dd/df/d11/ffd [0,4194304] 0 2024-03-28T13:10:46.452 INFO:tasks.workunit.client.0.smithi076.stdout:8/945: stat de/d4e/l6b 0 2024-03-28T13:10:46.452 INFO:tasks.workunit.client.0.smithi076.stdout:8/946: readlink de/d13/l38 0 2024-03-28T13:10:46.579 INFO:tasks.workunit.client.0.smithi076.stdout:7/873: creat d1/d8/dc2/d113/f131 x:0 0 0 2024-03-28T13:10:46.579 INFO:tasks.workunit.client.0.smithi076.stdout:7/874: chown d1/d18/d3c/d48/de5/l12f 98 1 2024-03-28T13:10:46.588 INFO:tasks.workunit.client.0.smithi076.stdout:5/924: write d5/d9/d35/f13d [4795208,79606] 0 2024-03-28T13:10:46.823 INFO:tasks.workunit.client.0.smithi076.stdout:3/785: sync 2024-03-28T13:10:46.845 INFO:tasks.workunit.client.0.smithi076.stdout:3/786: read d1/d7/d30/d38/d14/d97/fcc [2454354,27678] 0 2024-03-28T13:10:46.845 INFO:tasks.workunit.client.0.smithi076.stdout:3/787: dread - d1/d2/fe0 zero size 2024-03-28T13:10:46.845 INFO:tasks.workunit.client.0.smithi076.stdout:3/788: dread - d1/d7/d30/d38/d14/d4a/ddc/ded/df3/fb8 zero size 2024-03-28T13:10:46.845 INFO:tasks.workunit.client.0.smithi076.stdout:3/789: chown d1/d7/d30/d38/d14/d4a 13 1 2024-03-28T13:10:46.845 INFO:tasks.workunit.client.0.smithi076.stdout:3/790: write d1/d2/f4f [5694370,106840] 0 2024-03-28T13:10:46.879 INFO:tasks.workunit.client.0.smithi076.stdout:0/966: truncate db/dc/df/d11/f151 2998102 0 2024-03-28T13:10:46.879 INFO:tasks.workunit.client.0.smithi076.stdout:0/967: write db/dc/df/d18/d1d/fb8 [3882430,80977] 0 2024-03-28T13:10:47.001 INFO:tasks.workunit.client.0.smithi076.stdout:9/932: getdents d9/da/de6 0 2024-03-28T13:10:47.052 INFO:tasks.workunit.client.0.smithi076.stdout:8/947: getdents de/d23/d2b/d58/d8e 0 2024-03-28T13:10:47.093 INFO:tasks.workunit.client.0.smithi076.stdout:7/875: creat d1/d18/d2d/f132 x:0 0 0 2024-03-28T13:10:47.110 INFO:tasks.workunit.client.0.smithi076.stdout:8/948: dwrite de/d23/d2b/d51/d71/f127 [0,4194304] 0 2024-03-28T13:10:47.110 INFO:tasks.workunit.client.0.smithi076.stdout:8/949: chown de/d23/d2b/d5d/d76/d6e/l95 29224 1 2024-03-28T13:10:47.110 INFO:tasks.workunit.client.0.smithi076.stdout:8/950: chown de/d23/d2b/d5d/d76/d6e/f9c 278745921 1 2024-03-28T13:10:47.165 INFO:tasks.workunit.client.0.smithi076.stdout:5/925: mkdir d5/d9/d4c/d153 0 2024-03-28T13:10:47.385 INFO:tasks.workunit.client.0.smithi076.stdout:3/791: unlink d1/d7/d30/d38/d14/d4a/d66/c98 0 2024-03-28T13:10:47.385 INFO:tasks.workunit.client.0.smithi076.stdout:3/792: chown d1/la 78690378 1 2024-03-28T13:10:47.404 INFO:tasks.workunit.client.0.smithi076.stdout:2/956: dwrite d2/d5/d7/fa [0,4194304] 0 2024-03-28T13:10:47.405 INFO:tasks.workunit.client.0.smithi076.stdout:2/957: write d2/d5/d4b/d39/d57/f66 [92743,32143] 0 2024-03-28T13:10:47.405 INFO:tasks.workunit.client.0.smithi076.stdout:2/958: readlink d2/d5/db/d3b/d9f/l10a 0 2024-03-28T13:10:47.409 INFO:tasks.workunit.client.0.smithi076.stdout:0/968: symlink db/dc/df/d71/d4a/d107/l15c 0 2024-03-28T13:10:47.409 INFO:tasks.workunit.client.0.smithi076.stdout:0/969: chown db/dc/df/d11/d40/d77/da2 11 1 2024-03-28T13:10:47.973 INFO:tasks.workunit.client.0.smithi076.stdout:1/842: mknod d14/d19/d85/d2e/d31/c122 0 2024-03-28T13:10:47.983 INFO:tasks.workunit.client.0.smithi076.stdout:4/963: rename d0/d3b/d40/d42/d31/f8f to d0/d20/d7f/f140 0 2024-03-28T13:10:48.172 INFO:tasks.workunit.client.0.smithi076.stdout:5/926: truncate d5/db/df/fd3 4228204 0 2024-03-28T13:10:48.810 INFO:tasks.workunit.client.0.smithi076.stdout:2/959: mkdir d2/d5/d4b/d39/d57/d12e 0 2024-03-28T13:10:48.977 INFO:tasks.workunit.client.0.smithi076.stdout:0/970: rmdir db/da6 39 2024-03-28T13:10:48.977 INFO:tasks.workunit.client.0.smithi076.stdout:0/971: fdatasync db/dc/df/f44 0 2024-03-28T13:10:48.977 INFO:tasks.workunit.client.0.smithi076.stdout:9/933: link d9/dd/df/d11/d14/d58/d6e/l46 d9/d74/db3/l11c 0 2024-03-28T13:10:48.986 INFO:tasks.workunit.client.0.smithi076.stdout:1/843: mkdir d14/d19/d85/d2e/d31/d51/d92/da4/db5/d123 0 2024-03-28T13:10:48.987 INFO:tasks.workunit.client.0.smithi076.stdout:1/844: chown d14/d19/d85/d2e/d31/d51/f77 24097660 1 2024-03-28T13:10:48.987 INFO:tasks.workunit.client.0.smithi076.stdout:1/845: stat d14/d19/d85/d2e/d31/d3b/l8a 0 2024-03-28T13:10:49.001 INFO:tasks.workunit.client.0.smithi076.stdout:0/972: dread db/d16/f12e [0,4194304] 0 2024-03-28T13:10:49.008 INFO:tasks.workunit.client.0.smithi076.stdout:9/934: dwrite d9/dd/d48/dd7/ffa [0,4194304] 0 2024-03-28T13:10:49.057 INFO:tasks.workunit.client.0.smithi076.stdout:6/991: rename d6/f7a to d6/da/d39/d63/f148 0 2024-03-28T13:10:49.168 INFO:tasks.workunit.client.0.smithi076.stdout:4/964: mkdir d0/d3b/d40/d42/d47/d141 0 2024-03-28T13:10:49.699 INFO:tasks.workunit.client.0.smithi076.stdout:8/951: write de/d23/d2b/d58/d78/f81 [1545070,35674] 0 2024-03-28T13:10:49.699 INFO:tasks.workunit.client.0.smithi076.stdout:8/952: readlink l5 0 2024-03-28T13:10:49.699 INFO:tasks.workunit.client.0.smithi076.stdout:2/960: truncate d2/d5/d4b/d39/d57/fbd 4010931 0 2024-03-28T13:10:49.724 INFO:tasks.workunit.client.0.smithi076.stdout:2/961: dwrite d2/d5/d7/f40 [4194304,4194304] 0 2024-03-28T13:10:49.779 INFO:tasks.workunit.client.0.smithi076.stdout:0/973: rmdir db/dc/df/d18/d1d/d21/d14a 0 2024-03-28T13:10:49.779 INFO:tasks.workunit.client.0.smithi076.stdout:0/974: write db/dc/df/d18/d1d/d75/d51/dd7/f13e [400705,87723] 0 2024-03-28T13:10:49.862 INFO:tasks.workunit.client.0.smithi076.stdout:7/876: sync 2024-03-28T13:10:49.862 INFO:tasks.workunit.client.0.smithi076.stdout:7/877: write d1/d18/d3c/d48/d69/d79/f89 [2249479,34444] 0 2024-03-28T13:10:49.952 INFO:tasks.workunit.client.0.smithi076.stdout:3/793: write d1/d7/d30/d38/f35 [2189427,93192] 0 2024-03-28T13:10:49.953 INFO:tasks.workunit.client.0.smithi076.stdout:3/794: truncate d1/d7/d30/f4c 766410 0 2024-03-28T13:10:49.958 INFO:tasks.workunit.client.0.smithi076.stdout:6/992: unlink d6/dc1/f10e 0 2024-03-28T13:10:49.982 INFO:tasks.workunit.client.0.smithi076.stdout:3/795: dwrite d1/d7/d30/d38/d14/d4a/d66/f6a [0,4194304] 0 2024-03-28T13:10:50.018 INFO:tasks.workunit.client.0.smithi076.stdout:3/796: dwrite d1/d7/d30/d38/d14/d97/fcc [0,4194304] 0 2024-03-28T13:10:50.043 INFO:tasks.workunit.client.0.smithi076.stdout:3/797: dwrite d1/d7/d30/d38/d14/d4a/ddc/ded/df3/fd1 [0,4194304] 0 2024-03-28T13:10:50.089 INFO:tasks.workunit.client.0.smithi076.stdout:5/927: creat d5/d9/d1c/dec/f154 x:0 0 0 2024-03-28T13:10:50.094 INFO:tasks.workunit.client.0.smithi076.stdout:5/928: dread d5/db/d3f/feb [0,4194304] 0 2024-03-28T13:10:50.110 INFO:tasks.workunit.client.0.smithi076.stdout:5/929: dread d5/db/d3f/d42/f58 [0,4194304] 0 2024-03-28T13:10:50.110 INFO:tasks.workunit.client.0.smithi076.stdout:5/930: readlink d5/d9/d1c/d25/dbd/d117/l13e 0 2024-03-28T13:10:50.397 INFO:tasks.workunit.client.0.smithi076.stdout:8/953: link de/d23/c20 de/d13/dc9/c14c 0 2024-03-28T13:10:50.423 INFO:tasks.workunit.client.0.smithi076.stdout:8/954: dwrite de/d23/d2b/d5d/f115 [0,4194304] 0 2024-03-28T13:10:50.423 INFO:tasks.workunit.client.0.smithi076.stdout:8/955: chown de/d4e/d54 26 1 2024-03-28T13:10:50.496 INFO:tasks.workunit.client.0.smithi076.stdout:2/962: symlink d2/d5/db/d3b/d5a/d8d/l12f 0 2024-03-28T13:10:50.532 INFO:tasks.workunit.client.0.smithi076.stdout:2/963: dwrite d2/d5/db/d3b/f9a [0,4194304] 0 2024-03-28T13:10:50.533 INFO:tasks.workunit.client.0.smithi076.stdout:2/964: write d2/d5/db/d3b/d3f/f100 [734090,28005] 0 2024-03-28T13:10:50.536 INFO:tasks.workunit.client.0.smithi076.stdout:2/965: dread d2/d5/f84 [0,4194304] 0 2024-03-28T13:10:50.536 INFO:tasks.workunit.client.0.smithi076.stdout:2/966: readlink d2/l56 0 2024-03-28T13:10:50.583 INFO:tasks.workunit.client.0.smithi076.stdout:2/967: dwrite d2/d5/d4b/d39/d57/de9/ff2 [0,4194304] 0 2024-03-28T13:10:50.930 INFO:tasks.workunit.client.0.smithi076.stdout:7/878: symlink d1/d81/dc3/l133 0 2024-03-28T13:10:51.459 INFO:tasks.workunit.client.0.smithi076.stdout:1/846: write d14/d19/d85/d2e/d31/d51/d92/da4/db7/fe6 [1028076,119406] 0 2024-03-28T13:10:51.459 INFO:tasks.workunit.client.0.smithi076.stdout:1/847: dread - d14/d19/d85/d2e/d31/d3b/f111 zero size 2024-03-28T13:10:51.508 INFO:tasks.workunit.client.0.smithi076.stdout:8/956: mkdir de/d23/d2b/d51/d60/dc1/d14d 0 2024-03-28T13:10:51.656 INFO:tasks.workunit.client.0.smithi076.stdout:2/968: mkdir d2/d5/db/d3b/d60/d130 0 2024-03-28T13:10:51.737 INFO:tasks.workunit.client.0.smithi076.stdout:7/879: rmdir d1/d18/d3c/d11d 0 2024-03-28T13:10:51.758 INFO:tasks.workunit.client.0.smithi076.stdout:7/880: dread d1/d8/d37/f9a [0,4194304] 0 2024-03-28T13:10:51.758 INFO:tasks.workunit.client.0.smithi076.stdout:7/881: write d1/d8/dc2/d100/ff4 [5152449,1513] 0 2024-03-28T13:10:51.759 INFO:tasks.workunit.client.0.smithi076.stdout:7/882: chown d1/d8/d37/d53/f6a 887 1 2024-03-28T13:10:51.964 INFO:tasks.workunit.client.0.smithi076.stdout:9/935: rename d9/dd/df/d11/d37/f1d to d9/dd/d48/f11d 0 2024-03-28T13:10:51.964 INFO:tasks.workunit.client.0.smithi076.stdout:9/936: fsync d9/dd/df/fb0 0 2024-03-28T13:10:51.964 INFO:tasks.workunit.client.0.smithi076.stdout:9/937: chown d9/l34 14 1 2024-03-28T13:10:51.972 INFO:tasks.workunit.client.0.smithi076.stdout:4/965: sync 2024-03-28T13:10:52.003 INFO:tasks.workunit.client.0.smithi076.stdout:9/938: dwrite d9/f54 [0,4194304] 0 2024-03-28T13:10:52.003 INFO:tasks.workunit.client.0.smithi076.stdout:9/939: fdatasync d9/dd/d48/dd7/dd9/fed 0 2024-03-28T13:10:52.222 INFO:tasks.workunit.client.0.smithi076.stdout:0/975: sync 2024-03-28T13:10:52.400 INFO:tasks.workunit.client.0.smithi076.stdout:5/931: mknod d5/d9/d1c/d1d/d22/d110/c155 0 2024-03-28T13:10:52.400 INFO:tasks.workunit.client.0.smithi076.stdout:5/932: chown d5/d9/d1c/d25/d136/de9 33815 1 2024-03-28T13:10:52.455 INFO:tasks.workunit.client.0.smithi076.stdout:1/848: link d14/d19/d85/d2e/d31/cc7 d14/d19/d20/dd7/c124 0 2024-03-28T13:10:52.455 INFO:tasks.workunit.client.0.smithi076.stdout:1/849: write d14/d19/d85/d2e/fce [98576,25229] 0 2024-03-28T13:10:52.470 INFO:tasks.workunit.client.0.smithi076.stdout:1/850: dread f5 [4194304,4194304] 0 2024-03-28T13:10:52.621 INFO:tasks.workunit.client.0.smithi076.stdout:8/957: mkdir de/d13/d27/d8c/d14e 0 2024-03-28T13:10:52.621 INFO:tasks.workunit.client.0.smithi076.stdout:2/969: mkdir d2/d5/db/d3b/d5a/d8d/d131 0 2024-03-28T13:10:52.657 INFO:tasks.workunit.client.0.smithi076.stdout:4/966: creat d0/d3b/d40/d8d/f142 x:0 0 0 2024-03-28T13:10:52.669 INFO:tasks.workunit.client.0.smithi076.stdout:8/958: dwrite de/d13/d27/d8c/f97 [0,4194304] 0 2024-03-28T13:10:52.737 INFO:tasks.workunit.client.0.smithi076.stdout:9/940: creat d9/dd/df/d11/d14/d58/d116/f11e x:0 0 0 2024-03-28T13:10:52.737 INFO:tasks.workunit.client.0.smithi076.stdout:9/941: chown d9/dd/df/d11/d37/dc4/fcd 293822339 1 2024-03-28T13:10:52.772 INFO:tasks.workunit.client.0.smithi076.stdout:5/933: dread d5/d9/d1c/dcc/f141 [4194304,4194304] 0 2024-03-28T13:10:52.793 INFO:tasks.workunit.client.0.smithi076.stdout:5/934: dread d5/db/df/fd3 [0,4194304] 0 2024-03-28T13:10:52.793 INFO:tasks.workunit.client.0.smithi076.stdout:5/935: fsync d5/d9/d1c/d25/d136/d105/f118 0 2024-03-28T13:10:52.851 INFO:tasks.workunit.client.0.smithi076.stdout:1/851: unlink d14/d19/d85/d2e/d31/d51/f77 0 2024-03-28T13:10:52.892 INFO:tasks.workunit.client.0.smithi076.stdout:2/970: rmdir d2/d5/d7 39 2024-03-28T13:10:53.012 INFO:tasks.workunit.client.0.smithi076.stdout:6/993: rename d6/da/d5f/d6d/daf/d11d/f142 to d6/da/d1e/dde/f149 0 2024-03-28T13:10:53.074 INFO:tasks.workunit.client.0.smithi076.stdout:4/967: creat d0/d20/d7f/dda/d2d/d75/f143 x:0 0 0 2024-03-28T13:10:53.074 INFO:tasks.workunit.client.0.smithi076.stdout:4/968: write d0/d3b/d40/d42/d31/f12f [4911392,94773] 0 2024-03-28T13:10:53.201 INFO:tasks.workunit.client.0.smithi076.stdout:8/959: mkdir de/d23/d2b/d51/d14f 0 2024-03-28T13:10:53.202 INFO:tasks.workunit.client.0.smithi076.stdout:9/942: creat d9/da/de6/f11f x:0 0 0 2024-03-28T13:10:53.223 INFO:tasks.workunit.client.0.smithi076.stdout:5/936: dread - d5/d9/d1c/d1d/d31/ded/f102 zero size 2024-03-28T13:10:53.223 INFO:tasks.workunit.client.0.smithi076.stdout:5/937: getdents d5/db/d3f/d97/dd7 0 2024-03-28T13:10:53.224 INFO:tasks.workunit.client.0.smithi076.stdout:5/938: write d5/d9/d1c/d1d/d31/ded/f66 [983970,95248] 0 2024-03-28T13:10:53.224 INFO:tasks.workunit.client.0.smithi076.stdout:5/939: stat d5/db/d3f/d42 0 2024-03-28T13:10:53.224 INFO:tasks.workunit.client.0.smithi076.stdout:5/940: read d5/db/d3f/d42/f58 [2694827,72809] 0 2024-03-28T13:10:53.252 INFO:tasks.workunit.client.0.smithi076.stdout:3/798: dwrite d1/d7/d30/d38/d14/f8c [0,4194304] 0 2024-03-28T13:10:53.252 INFO:tasks.workunit.client.0.smithi076.stdout:3/799: dread - d1/d7/d30/d38/d9b/ffa zero size 2024-03-28T13:10:53.383 INFO:tasks.workunit.client.0.smithi076.stdout:2/971: unlink d2/d5/d7/c29 0 2024-03-28T13:10:53.400 INFO:tasks.workunit.client.0.smithi076.stdout:2/972: dread d2/d5/fac [0,4194304] 0 2024-03-28T13:10:53.401 INFO:tasks.workunit.client.0.smithi076.stdout:2/973: dread - d2/d5/d4b/d39/ffe zero size 2024-03-28T13:10:53.573 INFO:tasks.workunit.client.0.smithi076.stdout:7/883: rename d1/d18/d3c/d7b/d7d/fca to d1/d18/d3c/d7b/f134 0 2024-03-28T13:10:53.592 INFO:tasks.workunit.client.0.smithi076.stdout:6/994: mknod d6/da/d40/d62/dca/ddd/c14a 0 2024-03-28T13:10:53.592 INFO:tasks.workunit.client.0.smithi076.stdout:6/995: chown d6/da/d40/l115 3930 1 2024-03-28T13:10:53.597 INFO:tasks.workunit.client.0.smithi076.stdout:6/996: dread d6/f98 [0,4194304] 0 2024-03-28T13:10:53.597 INFO:tasks.workunit.client.0.smithi076.stdout:6/997: write d6/fb [8916019,58912] 0 2024-03-28T13:10:53.783 INFO:tasks.workunit.client.0.smithi076.stdout:8/960: rmdir de/d23/d2b 39 2024-03-28T13:10:53.823 INFO:tasks.workunit.client.0.smithi076.stdout:8/961: dwrite de/d23/d2b/d5d/f115 [4194304,4194304] 0 2024-03-28T13:10:53.827 INFO:tasks.workunit.client.0.smithi076.stdout:5/941: mknod d5/d9/d35/d3b/c156 0 2024-03-28T13:10:53.839 INFO:tasks.workunit.client.0.smithi076.stdout:8/962: dread de/d23/d2b/d5d/d76/d6e/f9c [0,4194304] 0 2024-03-28T13:10:53.862 INFO:tasks.workunit.client.0.smithi076.stdout:8/963: write de/d23/d2b/d5d/d76/d18/f5c [1238480,75253] 0 2024-03-28T13:10:53.910 INFO:tasks.workunit.client.0.smithi076.stdout:8/964: dwrite de/d13/d27/f29 [0,4194304] 0 2024-03-28T13:10:53.938 INFO:tasks.workunit.client.0.smithi076.stdout:3/800: unlink d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d93/fd8 0 2024-03-28T13:10:53.939 INFO:tasks.workunit.client.0.smithi076.stdout:3/801: chown d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/db5 15569 1 2024-03-28T13:10:54.079 INFO:tasks.workunit.client.0.smithi076.stdout:0/976: rename db/dc/df/d18/d12b/f152 to db/dc/d3d/d134/f15d 0 2024-03-28T13:10:54.534 INFO:tasks.workunit.client.0.smithi076.stdout:6/998: mkdir d6/d99/d14b 0 2024-03-28T13:10:55.089 INFO:tasks.workunit.client.0.smithi076.stdout:9/943: getdents d9/dd/dbb 0 2024-03-28T13:10:55.089 INFO:tasks.workunit.client.0.smithi076.stdout:5/942: mknod d5/d9/d4c/d98/c157 0 2024-03-28T13:10:55.142 INFO:tasks.workunit.client.0.smithi076.stdout:9/944: dwrite d9/d74/db3/db5/ffb [0,4194304] 0 2024-03-28T13:10:55.280 INFO:tasks.workunit.client.0.smithi076.stdout:8/965: symlink de/d13/da2/l150 0 2024-03-28T13:10:55.280 INFO:tasks.workunit.client.0.smithi076.stdout:8/966: chown de/d23/d2b/d5d/d76/f12a 40839693 1 2024-03-28T13:10:55.280 INFO:tasks.workunit.client.0.smithi076.stdout:8/967: chown de/d23/d2b/d5d/d76/cfc 92 1 2024-03-28T13:10:55.358 INFO:tasks.workunit.client.0.smithi076.stdout:3/802: creat d1/d7/d30/f115 x:0 0 0 2024-03-28T13:10:55.358 INFO:tasks.workunit.client.0.smithi076.stdout:3/803: fsync d1/d7/d30/d38/d14/d4a/ddc/ded/df3/fac 0 2024-03-28T13:10:55.358 INFO:tasks.workunit.client.0.smithi076.stdout:3/804: fdatasync d1/d2/fba 0 2024-03-28T13:10:55.412 INFO:tasks.workunit.client.0.smithi076.stdout:2/974: creat d2/d5/d7/d8/f132 x:0 0 0 2024-03-28T13:10:55.449 INFO:tasks.workunit.client.0.smithi076.stdout:1/852: dwrite d14/d19/d85/d2e/f61 [0,4194304] 0 2024-03-28T13:10:55.449 INFO:tasks.workunit.client.0.smithi076.stdout:1/853: chown d14/l15 12 1 2024-03-28T13:10:55.449 INFO:tasks.workunit.client.0.smithi076.stdout:1/854: fdatasync d14/d19/d85/d2e/d31/d51/d92/da4/dfb/f100 0 2024-03-28T13:10:55.601 INFO:tasks.workunit.client.0.smithi076.stdout:0/977: mknod db/dc/df/d18/d1d/d21/dd2/c15e 0 2024-03-28T13:10:55.685 INFO:tasks.workunit.client.0.smithi076.stdout:6/999: mknod d6/da/d40/d137/c14c 0 2024-03-28T13:10:55.756 INFO:tasks.workunit.client.0.smithi076.stdout:5/943: symlink d5/d9/d1c/d25/d136/de9/l158 0 2024-03-28T13:10:56.052 INFO:tasks.workunit.client.0.smithi076.stdout:9/945: link d9/l38 d9/dd/df/d11/d14/d58/d116/l120 0 2024-03-28T13:10:56.052 INFO:tasks.workunit.client.0.smithi076.stdout:9/946: read - d9/da/de6/f113 zero size 2024-03-28T13:10:56.133 INFO:tasks.workunit.client.0.smithi076.stdout:8/968: symlink de/d23/d2b/l151 0 2024-03-28T13:10:56.133 INFO:tasks.workunit.client.0.smithi076.stdout:8/969: readlink de/d23/d2b/d51/d71/l8d 0 2024-03-28T13:10:56.133 INFO:tasks.workunit.client.0.smithi076.stdout:8/970: readlink de/d4e/db6/dde/lf0 0 2024-03-28T13:10:56.216 INFO:tasks.workunit.client.0.smithi076.stdout:3/805: rmdir d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d58 39 2024-03-28T13:10:56.234 INFO:tasks.workunit.client.0.smithi076.stdout:2/975: getdents d2/d5/d4b/d39 0 2024-03-28T13:10:56.557 INFO:tasks.workunit.client.0.smithi076.stdout:1/855: truncate d14/d19/d85/d2e/d3c/d7e/fcc 3661472 0 2024-03-28T13:10:56.627 INFO:tasks.workunit.client.0.smithi076.stdout:0/978: unlink db/dc/df/d71/d4a/f72 0 2024-03-28T13:10:56.627 INFO:tasks.workunit.client.0.smithi076.stdout:5/944: mknod d5/d9/d1c/d25/d136/c159 0 2024-03-28T13:10:56.628 INFO:tasks.workunit.client.0.smithi076.stdout:5/945: truncate d5/d9/d4c/fde 24063 0 2024-03-28T13:10:56.660 INFO:tasks.workunit.client.0.smithi076.stdout:0/979: dwrite db/dc/df/d18/d1d/d75/d51/d60/f148 [0,4194304] 0 2024-03-28T13:10:56.660 INFO:tasks.workunit.client.0.smithi076.stdout:0/980: write db/dc/df/d11/d40/d77/d87/d88/fdb [677917,31918] 0 2024-03-28T13:10:56.668 INFO:tasks.workunit.client.0.smithi076.stdout:5/946: dwrite d5/d9/d1c/d1d/d22/d9d/dcb/f125 [0,4194304] 0 2024-03-28T13:10:56.702 INFO:tasks.workunit.client.0.smithi076.stdout:0/981: dwrite db/dc/f66 [0,4194304] 0 2024-03-28T13:10:56.702 INFO:tasks.workunit.client.0.smithi076.stdout:0/982: chown db/dc/df/d18/d1d/d21/dd2/df1/c126 7914 1 2024-03-28T13:10:56.702 INFO:tasks.workunit.client.0.smithi076.stdout:0/983: dread - db/dc/d3d/f113 zero size 2024-03-28T13:10:56.702 INFO:tasks.workunit.client.0.smithi076.stdout:0/984: readlink l7 0 2024-03-28T13:10:56.702 INFO:tasks.workunit.client.0.smithi076.stdout:0/985: fdatasync db/dc/df/d11/d40/dc7/fe5 0 2024-03-28T13:10:56.778 INFO:tasks.workunit.client.0.smithi076.stdout:9/947: rename d9/ca2 to d9/dd/d10f/c121 0 2024-03-28T13:10:56.808 INFO:tasks.workunit.client.0.smithi076.stdout:8/971: creat de/d13/f152 x:0 0 0 2024-03-28T13:10:56.808 INFO:tasks.workunit.client.0.smithi076.stdout:8/972: chown de/d4e/db6/dae/f5f 8 1 2024-03-28T13:10:56.809 INFO:tasks.workunit.client.0.smithi076.stdout:4/969: truncate d0/d3b/d40/d42/d31/d5e/d72/fc6 1303437 0 2024-03-28T13:10:56.870 INFO:tasks.workunit.client.0.smithi076.stdout:3/806: symlink d1/d7/d30/d38/d14/d27/dc7/l116 0 2024-03-28T13:10:56.918 INFO:tasks.workunit.client.0.smithi076.stdout:2/976: mknod d2/d5/db/d3b/d5a/d8d/c133 0 2024-03-28T13:10:56.918 INFO:tasks.workunit.client.0.smithi076.stdout:2/977: dread - d2/d5/d4b/d39/d57/db9/fc2 zero size 2024-03-28T13:10:56.971 INFO:tasks.workunit.client.0.smithi076.stdout:1/856: mknod d14/d19/d85/d2e/d3c/d7e/c125 0 2024-03-28T13:10:56.971 INFO:tasks.workunit.client.0.smithi076.stdout:1/857: write d14/d19/d85/d2e/d31/d51/d92/da4/db7/dc8/f10e [1019018,6795] 0 2024-03-28T13:10:57.236 INFO:tasks.workunit.client.0.smithi076.stdout:5/947: creat d5/d9/d35/d3b/db6/f15a x:0 0 0 2024-03-28T13:10:57.418 INFO:tasks.workunit.client.0.smithi076.stdout:8/973: mknod de/d23/d2b/d5d/d76/d6e/d87/d147/c153 0 2024-03-28T13:10:57.648 INFO:tasks.workunit.client.0.smithi076.stdout:1/858: unlink d14/d6c/d74/c96 0 2024-03-28T13:10:57.672 INFO:tasks.workunit.client.0.smithi076.stdout:1/859: write d14/d19/d85/d2e/d31/d51/d92/da4/db5/ff7 [626396,49780] 0 2024-03-28T13:10:57.880 INFO:tasks.workunit.client.0.smithi076.stdout:5/948: mkdir d5/db/d3f/d97/d15b 0 2024-03-28T13:10:57.880 INFO:tasks.workunit.client.0.smithi076.stdout:5/949: write d5/fa [3833338,23952] 0 2024-03-28T13:10:58.178 INFO:tasks.workunit.client.0.smithi076.stdout:3/807: mkdir d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/d117 0 2024-03-28T13:10:58.179 INFO:tasks.workunit.client.0.smithi076.stdout:4/970: mknod d0/d3b/d40/d42/c144 0 2024-03-28T13:10:58.179 INFO:tasks.workunit.client.0.smithi076.stdout:4/971: dread - d0/d3b/d40/d42/d31/d5e/d72/d78/dcc/f100 zero size 2024-03-28T13:10:58.179 INFO:tasks.workunit.client.0.smithi076.stdout:4/972: write d0/d20/d7f/fad [4647237,80420] 0 2024-03-28T13:10:58.284 INFO:tasks.workunit.client.0.smithi076.stdout:1/860: rename d14/d19/d85/d2e/d31/l67 to d14/d19/d85/d2e/d31/d51/d92/da4/dfb/l126 0 2024-03-28T13:10:58.462 INFO:tasks.workunit.client.0.smithi076.stdout:5/950: mkdir d5/d9/d4c/d153/d15c 0 2024-03-28T13:10:58.540 INFO:tasks.workunit.client.0.smithi076.stdout:3/808: creat d1/d7/d30/d38/d14/d4a/ddc/ded/df3/f118 x:0 0 0 2024-03-28T13:10:58.576 INFO:tasks.workunit.client.0.smithi076.stdout:3/809: dwrite d1/d7/d30/d38/d14/d36/f16 [0,4194304] 0 2024-03-28T13:10:58.576 INFO:tasks.workunit.client.0.smithi076.stdout:3/810: read - d1/d7/d30/d38/d14/d27/ff0 zero size 2024-03-28T13:10:58.673 INFO:tasks.workunit.client.0.smithi076.stdout:4/973: unlink d0/d3b/d40/d42/d47/d69/la3 0 2024-03-28T13:10:58.886 INFO:tasks.workunit.client.0.smithi076.stdout:3/811: mkdir d1/d7/d30/d38/d14/d4a/ddc/ded/d119 0 2024-03-28T13:10:58.886 INFO:tasks.workunit.client.0.smithi076.stdout:5/951: rmdir d5/d9/d1c/dcc 39 2024-03-28T13:10:58.886 INFO:tasks.workunit.client.0.smithi076.stdout:5/952: dread - d5/d9/d1c/d25/d60/fc5 zero size 2024-03-28T13:10:58.887 INFO:tasks.workunit.client.0.smithi076.stdout:5/953: chown d5/db/ff1 554952 1 2024-03-28T13:10:58.887 INFO:tasks.workunit.client.0.smithi076.stdout:5/954: chown d5/db/d3f/d97/f137 1142 1 2024-03-28T13:10:58.938 INFO:tasks.workunit.client.0.smithi076.stdout:4/974: creat d0/d3b/d40/d42/d31/d5e/d72/f145 x:0 0 0 2024-03-28T13:10:58.996 INFO:tasks.workunit.client.0.smithi076.stdout:4/975: dwrite d0/d3b/d50/de6/d123/f139 [4194304,4194304] 0 2024-03-28T13:10:59.165 INFO:tasks.workunit.client.0.smithi076.stdout:3/812: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/db5/dfc/f11a x:0 0 0 2024-03-28T13:10:59.165 INFO:tasks.workunit.client.0.smithi076.stdout:3/813: readlink d1/d7/d30/d38/d14/d36/d56/d5b/la1 0 2024-03-28T13:10:59.165 INFO:tasks.workunit.client.0.smithi076.stdout:3/814: write d1/d7/d30/d38/d14/d97/fa5 [518206,23335] 0 2024-03-28T13:10:59.165 INFO:tasks.workunit.client.0.smithi076.stdout:3/815: truncate d1/d7/d30/d38/d14/d97/f106 738475 0 2024-03-28T13:10:59.165 INFO:tasks.workunit.client.0.smithi076.stdout:3/816: readlink d1/d7/d30/d38/d14/d27/dc7/l116 0 2024-03-28T13:10:59.221 INFO:tasks.workunit.client.0.smithi076.stdout:5/955: creat d5/d9/d35/d3b/f15d x:0 0 0 2024-03-28T13:10:59.221 INFO:tasks.workunit.client.0.smithi076.stdout:5/956: chown d5/d9/d35/d3b/db6/ff4 232 1 2024-03-28T13:10:59.221 INFO:tasks.workunit.client.0.smithi076.stdout:5/957: truncate d5/d9/d35/fb0 215138 0 2024-03-28T13:10:59.255 INFO:tasks.workunit.client.0.smithi076.stdout:5/958: dwrite d5/db/d3f/d97/f114 [0,4194304] 0 2024-03-28T13:10:59.255 INFO:tasks.workunit.client.0.smithi076.stdout:5/959: truncate d5/d9/d1c/d1d/d22/d110/f147 777245 0 2024-03-28T13:10:59.587 INFO:tasks.workunit.client.0.smithi076.stdout:4/976: mknod d0/d3b/d40/d42/d115/c146 0 2024-03-28T13:10:59.587 INFO:tasks.workunit.client.0.smithi076.stdout:3/817: mkdir d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d11b 0 2024-03-28T13:10:59.659 INFO:tasks.workunit.client.0.smithi076.stdout:5/960: symlink d5/d9/d35/d3b/d115/l15e 0 2024-03-28T13:10:59.751 INFO:tasks.workunit.client.0.smithi076.stdout:4/977: mkdir d0/d3b/d40/d42/d47/d7c/d131/d147 0 2024-03-28T13:10:59.885 INFO:tasks.workunit.client.0.smithi076.stdout:7/884: sync 2024-03-28T13:10:59.954 INFO:tasks.workunit.client.0.smithi076.stdout:4/978: dread d0/d3b/d40/d42/d28/f49 [0,4194304] 0 2024-03-28T13:10:59.999 INFO:tasks.workunit.client.0.smithi076.stdout:4/979: dwrite d0/d20/d7b/f130 [0,4194304] 0 2024-03-28T13:10:59.999 INFO:tasks.workunit.client.0.smithi076.stdout:4/980: read d0/d20/d7f/dda/fa7 [5176177,49072] 0 2024-03-28T13:10:59.999 INFO:tasks.workunit.client.0.smithi076.stdout:4/981: write d0/d3b/d40/d42/d31/d5e/f10b [1350528,43416] 0 2024-03-28T13:11:00.017 INFO:tasks.workunit.client.0.smithi076.stdout:4/982: dread d0/d3b/d40/d42/f3f [0,4194304] 0 2024-03-28T13:11:00.202 INFO:tasks.workunit.client.0.smithi076.stdout:0/986: write db/d16/fb6 [44963,32320] 0 2024-03-28T13:11:00.203 INFO:tasks.workunit.client.0.smithi076.stdout:9/948: write d9/dd/df/f25 [6450411,64800] 0 2024-03-28T13:11:00.566 INFO:tasks.workunit.client.0.smithi076.stdout:4/983: mknod d0/d3b/d40/d42/d47/d7c/c148 0 2024-03-28T13:11:00.687 INFO:tasks.workunit.client.0.smithi076.stdout:2/978: sync 2024-03-28T13:11:00.719 INFO:tasks.workunit.client.0.smithi076.stdout:8/974: dwrite f2 [0,4194304] 0 2024-03-28T13:11:00.721 INFO:tasks.workunit.client.0.smithi076.stdout:8/975: write de/d23/f1e [1610903,37011] 0 2024-03-28T13:11:00.933 INFO:tasks.workunit.client.0.smithi076.stdout:5/961: rename d5/d9/lca to d5/d9/d1c/d25/dbd/d7a/d7c/l15f 0 2024-03-28T13:11:00.933 INFO:tasks.workunit.client.0.smithi076.stdout:5/962: chown d5/d9/d35/f85 0 1 2024-03-28T13:11:00.958 INFO:tasks.workunit.client.0.smithi076.stdout:9/949: mkdir d9/da/de6/df2/d122 0 2024-03-28T13:11:01.381 INFO:tasks.workunit.client.0.smithi076.stdout:1/861: symlink d14/l127 0 2024-03-28T13:11:01.963 INFO:tasks.workunit.client.0.smithi076.stdout:0/987: rename db/dd8/ff5 to db/d154/f15f 0 2024-03-28T13:11:01.966 INFO:tasks.workunit.client.0.smithi076.stdout:9/950: unlink d9/dd/d48/dad/lf3 0 2024-03-28T13:11:01.984 INFO:tasks.workunit.client.0.smithi076.stdout:9/951: dread d9/dd/d48/f66 [4194304,4194304] 0 2024-03-28T13:11:02.235 INFO:tasks.workunit.client.0.smithi076.stdout:8/976: creat de/d23/d2b/f154 x:0 0 0 2024-03-28T13:11:02.245 INFO:tasks.workunit.client.0.smithi076.stdout:7/885: write d1/d18/d3c/d48/f8d [2798204,16233] 0 2024-03-28T13:11:02.622 INFO:tasks.workunit.client.0.smithi076.stdout:0/988: stat db/dc/df/d11/d40/d77/da2/d6d/db9/cc4 0 2024-03-28T13:11:02.622 INFO:tasks.workunit.client.0.smithi076.stdout:0/989: fsync db/dc/df/d11/d40/f65 0 2024-03-28T13:11:02.770 INFO:tasks.workunit.client.0.smithi076.stdout:9/952: symlink d9/dd/df/d11/d14/d58/d6e/l123 0 2024-03-28T13:11:02.883 INFO:tasks.workunit.client.0.smithi076.stdout:3/818: creat d1/d7/d30/d38/d14/d4a/ddc/ded/f11c x:0 0 0 2024-03-28T13:11:03.018 INFO:tasks.workunit.client.0.smithi076.stdout:0/990: getdents db/dc/df/d18/d1d 0 2024-03-28T13:11:03.041 INFO:tasks.workunit.client.0.smithi076.stdout:9/953: chown d9/d74/db3/ccb 5739616 1 2024-03-28T13:11:03.043 INFO:tasks.workunit.client.0.smithi076.stdout:9/954: truncate d9/fb1 1755534 0 2024-03-28T13:11:03.043 INFO:tasks.workunit.client.0.smithi076.stdout:9/955: chown d9/da/f79 307100 1 2024-03-28T13:11:03.067 INFO:tasks.workunit.client.0.smithi076.stdout:0/991: dwrite db/f4b [0,4194304] 0 2024-03-28T13:11:03.208 INFO:tasks.workunit.client.0.smithi076.stdout:3/819: creat d1/d7/d30/d81/f11d x:0 0 0 2024-03-28T13:11:03.234 INFO:tasks.workunit.client.0.smithi076.stdout:9/956: fdatasync d9/dd/df/d11/fd1 0 2024-03-28T13:11:03.250 INFO:tasks.workunit.client.0.smithi076.stdout:3/820: dwrite d1/d7/f78 [4194304,4194304] 0 2024-03-28T13:11:03.280 INFO:tasks.workunit.client.0.smithi076.stdout:9/957: dwrite d9/dd/df/d11/d14/d58/d6e/d2a/f6d [0,4194304] 0 2024-03-28T13:11:03.299 INFO:tasks.workunit.client.0.smithi076.stdout:9/958: write d9/dd/f2e [1119392,110543] 0 2024-03-28T13:11:03.335 INFO:tasks.workunit.client.0.smithi076.stdout:0/992: mknod db/dc/df/d71/d4a/c160 0 2024-03-28T13:11:03.597 INFO:tasks.workunit.client.0.smithi076.stdout:9/959: creat d9/dd/df7/f124 x:0 0 0 2024-03-28T13:11:03.668 INFO:tasks.workunit.client.0.smithi076.stdout:0/993: unlink db/dc/df/d18/d1d/d21/c27 0 2024-03-28T13:11:03.669 INFO:tasks.workunit.client.0.smithi076.stdout:0/994: fsync db/dc/df/d18/d1d/d75/d51/d97/f140 0 2024-03-28T13:11:03.669 INFO:tasks.workunit.client.0.smithi076.stdout:0/995: fdatasync db/dc/df/d18/d1d/d75/d51/dd7/de3/ff2 0 2024-03-28T13:11:03.675 INFO:tasks.workunit.client.0.smithi076.stdout:0/996: write db/dc/faa [53435,101160] 0 2024-03-28T13:11:03.792 INFO:tasks.workunit.client.0.smithi076.stdout:3/821: mkdir d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d8f/d11e 0 2024-03-28T13:11:03.880 INFO:tasks.workunit.client.0.smithi076.stdout:4/984: rename d0/d3b/d40/d42/d31/d4d/f9f to d0/d3b/d40/d8d/f149 0 2024-03-28T13:11:03.936 INFO:tasks.workunit.client.0.smithi076.stdout:0/997: mknod db/dc/d3d/d57/d142/c161 0 2024-03-28T13:11:04.010 INFO:tasks.workunit.client.0.smithi076.stdout:0/998: dwrite db/dc/df/d11/f10d [0,4194304] 0 2024-03-28T13:11:04.011 INFO:tasks.workunit.client.0.smithi076.stdout:0/999: read db/dc/df/d11/d40/d77/d87/f129 [1149732,22428] 0 2024-03-28T13:11:04.117 INFO:tasks.workunit.client.0.smithi076.stdout:3/822: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/df6/f11f x:0 0 0 2024-03-28T13:11:04.117 INFO:tasks.workunit.client.0.smithi076.stdout:8/977: creat de/d23/f155 x:0 0 0 2024-03-28T13:11:04.117 INFO:tasks.workunit.client.0.smithi076.stdout:3/823: write d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/db5/dfc/f104 [210416,104890] 0 2024-03-28T13:11:04.356 INFO:tasks.workunit.client.0.smithi076.stdout:7/886: rmdir d1/d81 39 2024-03-28T13:11:04.356 INFO:tasks.workunit.client.0.smithi076.stdout:4/985: creat d0/d3b/d40/d42/d31/f14a x:0 0 0 2024-03-28T13:11:04.382 INFO:tasks.workunit.client.0.smithi076.stdout:1/862: unlink d14/d19/l69 0 2024-03-28T13:11:04.384 INFO:tasks.workunit.client.0.smithi076.stdout:5/963: sync 2024-03-28T13:11:04.384 INFO:tasks.workunit.client.0.smithi076.stdout:2/979: sync 2024-03-28T13:11:04.384 INFO:tasks.workunit.client.0.smithi076.stdout:2/980: fsync d2/d5/db/d3b/d94/f110 0 2024-03-28T13:11:04.384 INFO:tasks.workunit.client.0.smithi076.stdout:5/964: truncate d5/d9/d1c/d1d/d31/ded/f66 2066273 0 2024-03-28T13:11:04.385 INFO:tasks.workunit.client.0.smithi076.stdout:7/887: dwrite d1/d18/f93 [4194304,4194304] 0 2024-03-28T13:11:05.005 INFO:tasks.workunit.client.0.smithi076.stdout:8/978: creat de/d23/d2b/d58/d131/f156 x:0 0 0 2024-03-28T13:11:05.005 INFO:tasks.workunit.client.0.smithi076.stdout:8/979: fsync de/d4e/d54/d68/fb8 0 2024-03-28T13:11:05.006 INFO:tasks.workunit.client.0.smithi076.stdout:3/824: mkdir d1/d7/d30/d38/d9b/d120 0 2024-03-28T13:11:05.006 INFO:tasks.workunit.client.0.smithi076.stdout:3/825: dread - d1/d7/d30/d38/d14/d97/f109 zero size 2024-03-28T13:11:05.055 INFO:tasks.workunit.client.0.smithi076.stdout:4/986: dread d0/d20/d7f/dda/d2d/f4f [0,4194304] 0 2024-03-28T13:11:05.059 INFO:tasks.workunit.client.0.smithi076.stdout:1/863: getdents d14 0 2024-03-28T13:11:05.096 INFO:tasks.workunit.client.0.smithi076.stdout:2/981: creat d2/d5/db/d3b/d5a/f134 x:0 0 0 2024-03-28T13:11:05.096 INFO:tasks.workunit.client.0.smithi076.stdout:5/965: rmdir d5/d9/d1c/d25/dbd/d7a/db1 39 2024-03-28T13:11:05.096 INFO:tasks.workunit.client.0.smithi076.stdout:2/982: chown d2/d5/d7/d8/d21/l7a 30063594 1 2024-03-28T13:11:05.212 INFO:tasks.workunit.client.0.smithi076.stdout:7/888: link d1/d8/d37/l101 d1/d8/dc2/l135 0 2024-03-28T13:11:05.241 INFO:tasks.workunit.client.0.smithi076.stdout:7/889: dwrite d1/d18/d3c/d7b/f134 [0,4194304] 0 2024-03-28T13:11:05.301 INFO:tasks.workunit.client.0.smithi076.stdout:8/980: symlink de/d13/d27/l157 0 2024-03-28T13:11:05.301 INFO:tasks.workunit.client.0.smithi076.stdout:8/981: fdatasync de/f1d 0 2024-03-28T13:11:05.499 INFO:tasks.workunit.client.0.smithi076.stdout:3/826: mkdir d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/db5/d121 0 2024-03-28T13:11:05.503 INFO:tasks.workunit.client.0.smithi076.stdout:3/827: dread d1/d7/d30/d38/d14/d4a/fbe [0,4194304] 0 2024-03-28T13:11:05.510 INFO:tasks.workunit.client.0.smithi076.stdout:4/987: link d0/d20/d7f/dda/f117 d0/d20/d7f/dda/db7/f14b 0 2024-03-28T13:11:05.550 INFO:tasks.workunit.client.0.smithi076.stdout:3/828: dwrite d1/d7/d30/d38/d14/d4a/d66/f6a [0,4194304] 0 2024-03-28T13:11:05.579 INFO:tasks.workunit.client.0.smithi076.stdout:3/829: dwrite d1/d7/d30/d38/d14/d4a/d66/fa8 [4194304,4194304] 0 2024-03-28T13:11:05.618 INFO:tasks.workunit.client.0.smithi076.stdout:5/966: truncate d5/d9/d1c/d25/dbd/d7a/de2/f11c 5253643 0 2024-03-28T13:11:05.629 INFO:tasks.workunit.client.0.smithi076.stdout:3/830: dwrite d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/db5/dfc/f11a [0,4194304] 0 2024-03-28T13:11:05.709 INFO:tasks.workunit.client.0.smithi076.stdout:7/890: link d1/dc/d8b/fd4 d1/d81/dd7/f136 0 2024-03-28T13:11:05.730 INFO:tasks.workunit.client.0.smithi076.stdout:7/891: dread d1/d18/d3c/d7b/f134 [0,4194304] 0 2024-03-28T13:11:05.730 INFO:tasks.workunit.client.0.smithi076.stdout:7/892: readlink d1/d18/d3c/d48/de5/l12f 0 2024-03-28T13:11:05.759 INFO:tasks.workunit.client.0.smithi076.stdout:8/982: link de/d23/d2b/l151 de/d4e/d54/d68/l158 0 2024-03-28T13:11:05.759 INFO:tasks.workunit.client.0.smithi076.stdout:8/983: dread - de/d23/d2b/d5d/d76/d18/f141 zero size 2024-03-28T13:11:05.759 INFO:tasks.workunit.client.0.smithi076.stdout:8/984: fsync de/d13/fec 0 2024-03-28T13:11:05.884 INFO:tasks.workunit.client.0.smithi076.stdout:4/988: link d0/d20/d7f/dda/db7/ff3 d0/d3b/d40/d42/d31/d5e/dc3/f14c 0 2024-03-28T13:11:06.031 INFO:tasks.workunit.client.0.smithi076.stdout:9/960: dwrite d9/dd/df/d11/d14/d58/f6c [0,4194304] 0 2024-03-28T13:11:06.050 INFO:tasks.workunit.client.0.smithi076.stdout:9/961: dread d9/fef [0,4194304] 0 2024-03-28T13:11:06.379 INFO:tasks.workunit.client.0.smithi076.stdout:5/967: unlink d5/c75 0 2024-03-28T13:11:06.464 INFO:tasks.workunit.client.0.smithi076.stdout:7/893: creat d1/d81/dd7/f137 x:0 0 0 2024-03-28T13:11:06.480 INFO:tasks.workunit.client.0.smithi076.stdout:7/894: write d1/f65 [318070,91513] 0 2024-03-28T13:11:06.559 INFO:tasks.workunit.client.0.smithi076.stdout:8/985: creat de/d23/d2b/d51/d60/dc1/d14d/f159 x:0 0 0 2024-03-28T13:11:06.559 INFO:tasks.workunit.client.0.smithi076.stdout:8/986: getdents de/d4e/db6/dde/d125 0 2024-03-28T13:11:06.646 INFO:tasks.workunit.client.0.smithi076.stdout:4/989: mknod d0/d3b/d40/d42/d31/d5e/dc3/c14d 0 2024-03-28T13:11:06.716 INFO:tasks.workunit.client.0.smithi076.stdout:4/990: dwrite d0/d20/d7f/dda/db7/ff0 [0,4194304] 0 2024-03-28T13:11:06.720 INFO:tasks.workunit.client.0.smithi076.stdout:4/991: dread d0/d20/d7f/dda/d2d/d75/f11d [0,4194304] 0 2024-03-28T13:11:06.811 INFO:tasks.workunit.client.0.smithi076.stdout:5/968: mknod d5/d9/d4c/da4/c160 0 2024-03-28T13:11:06.867 INFO:tasks.workunit.client.0.smithi076.stdout:3/831: mkdir d1/d7/d30/d38/d14/d27/d42/d122 0 2024-03-28T13:11:06.981 INFO:tasks.workunit.client.0.smithi076.stdout:7/895: unlink d1/c21 0 2024-03-28T13:11:06.981 INFO:tasks.workunit.client.0.smithi076.stdout:7/896: truncate d1/d18/fad 734388 0 2024-03-28T13:11:06.981 INFO:tasks.workunit.client.0.smithi076.stdout:8/987: creat de/d4e/d54/f15a x:0 0 0 2024-03-28T13:11:06.981 INFO:tasks.workunit.client.0.smithi076.stdout:7/897: write d1/dc/f12e [266774,108141] 0 2024-03-28T13:11:06.981 INFO:tasks.workunit.client.0.smithi076.stdout:7/898: fdatasync d1/d18/d3c/f24 0 2024-03-28T13:11:07.005 INFO:tasks.workunit.client.0.smithi076.stdout:8/988: write de/d13/da2/f112 [641836,11253] 0 2024-03-28T13:11:07.005 INFO:tasks.workunit.client.0.smithi076.stdout:8/989: readlink de/d4e/d54/lca 0 2024-03-28T13:11:07.005 INFO:tasks.workunit.client.0.smithi076.stdout:8/990: fsync de/d23/d2b/d51/d60/d89/fe8 0 2024-03-28T13:11:07.005 INFO:tasks.workunit.client.0.smithi076.stdout:8/991: chown de/d23/d2b/d5d/d76/d6e/d7a/f142 25 1 2024-03-28T13:11:07.023 INFO:tasks.workunit.client.0.smithi076.stdout:8/992: dread fa [4194304,4194304] 0 2024-03-28T13:11:07.181 INFO:tasks.workunit.client.0.smithi076.stdout:4/992: getdents d0/d3b/d40/d42/d31/d4d 0 2024-03-28T13:11:07.256 INFO:tasks.workunit.client.0.smithi076.stdout:3/832: creat d1/d7/d30/d38/d14/d4a/ddc/ded/df3/f123 x:0 0 0 2024-03-28T13:11:07.411 INFO:tasks.workunit.client.0.smithi076.stdout:7/899: getdents d1/d18/d3c/d48/de5 0 2024-03-28T13:11:07.573 INFO:tasks.workunit.client.0.smithi076.stdout:4/993: link d0/d3b/d40/d42/d31/d5e/c36 d0/d3b/d40/df5/c14e 0 2024-03-28T13:11:07.640 INFO:tasks.workunit.client.0.smithi076.stdout:5/969: dwrite d5/d9/d1c/d25/dbd/d7a/db1/fc4 [0,4194304] 0 2024-03-28T13:11:07.640 INFO:tasks.workunit.client.0.smithi076.stdout:5/970: stat d5/db/d3f/d42/l90 0 2024-03-28T13:11:07.641 INFO:tasks.workunit.client.0.smithi076.stdout:5/971: stat d5/d9/d1c/d25/d73/cc8 0 2024-03-28T13:11:07.675 INFO:tasks.workunit.client.0.smithi076.stdout:3/833: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d8f/d11e/f124 x:0 0 0 2024-03-28T13:11:08.102 INFO:tasks.workunit.client.0.smithi076.stdout:7/900: creat d1/d18/d3c/d48/d69/f138 x:0 0 0 2024-03-28T13:11:08.177 INFO:tasks.workunit.client.0.smithi076.stdout:4/994: symlink d0/d3b/d40/d42/d31/d5e/df9/l14f 0 2024-03-28T13:11:08.177 INFO:tasks.workunit.client.0.smithi076.stdout:4/995: chown d0/d20/d7f/f84 132149198 1 2024-03-28T13:11:08.183 INFO:tasks.workunit.client.0.smithi076.stdout:4/996: write d0/d3b/d40/fa1 [617091,98965] 0 2024-03-28T13:11:08.247 INFO:tasks.workunit.client.0.smithi076.stdout:5/972: mknod d5/d9/d35/d3b/db6/df7/c161 0 2024-03-28T13:11:08.348 INFO:tasks.workunit.client.0.smithi076.stdout:3/834: rmdir d1/d7/d30/d38/d14/d36/d56/d5b/d10d 0 2024-03-28T13:11:08.498 INFO:tasks.workunit.client.0.smithi076.stdout:7/901: symlink d1/d8/dc2/dc4/d104/l139 0 2024-03-28T13:11:08.554 INFO:tasks.workunit.client.0.smithi076.stdout:7/902: dwrite d1/d18/d3c/d48/d69/f6d [0,4194304] 0 2024-03-28T13:11:08.554 INFO:tasks.workunit.client.0.smithi076.stdout:2/983: write d2/d5/d7/d28/f8b [1319406,54043] 0 2024-03-28T13:11:08.570 INFO:tasks.workunit.client.0.smithi076.stdout:7/903: dread d1/d18/d3c/f20 [0,4194304] 0 2024-03-28T13:11:08.718 INFO:tasks.workunit.client.0.smithi076.stdout:4/997: creat d0/d3b/d40/d42/d47/d7c/f150 x:0 0 0 2024-03-28T13:11:08.718 INFO:tasks.workunit.client.0.smithi076.stdout:5/973: creat d5/d9/d1c/d1d/f162 x:0 0 0 2024-03-28T13:11:08.721 INFO:tasks.workunit.client.0.smithi076.stdout:4/998: dread d0/d3b/d40/d42/d31/d5e/dc3/f14c [0,4194304] 0 2024-03-28T13:11:08.721 INFO:tasks.workunit.client.0.smithi076.stdout:4/999: chown d0/d3b/d40/d42/d47/c122 438949566 1 2024-03-28T13:11:08.735 INFO:tasks.workunit.client.0.smithi076.stdout:5/974: read d5/d9/d1c/d1d/d31/f104 [562157,106001] 0 2024-03-28T13:11:08.750 INFO:tasks.workunit.client.0.smithi076.stdout:5/975: dread d5/d9/d1c/d1d/d31/f57 [0,4194304] 0 2024-03-28T13:11:08.773 INFO:tasks.workunit.client.0.smithi076.stdout:3/835: truncate d1/d7/d30/fc4 4088008 0 2024-03-28T13:11:08.863 INFO:tasks.workunit.client.0.smithi076.stdout:2/984: link d2/d5/d4b/d39/d57/db9/fc2 d2/d5/db/d3b/d42/d121/f135 0 2024-03-28T13:11:08.863 INFO:tasks.workunit.client.0.smithi076.stdout:2/985: write d2/d5/db/d3b/d5a/d8d/dc1/f12b [886628,42951] 0 2024-03-28T13:11:08.881 INFO:tasks.workunit.client.0.smithi076.stdout:2/986: dread d2/d5/d7/d8/d21/fe3 [0,4194304] 0 2024-03-28T13:11:08.928 INFO:tasks.workunit.client.0.smithi076.stdout:7/904: rmdir d1/d8/d37/d128 0 2024-03-28T13:11:08.928 INFO:tasks.workunit.client.0.smithi076.stdout:7/905: stat d1/d18/f95 0 2024-03-28T13:11:08.945 INFO:tasks.workunit.client.0.smithi076.stdout:7/906: read d1/f56 [1980645,13360] 0 2024-03-28T13:11:09.957 INFO:tasks.workunit.client.0.smithi076.stdout:8/993: creat de/f15b x:0 0 0 2024-03-28T13:11:09.957 INFO:tasks.workunit.client.0.smithi076.stdout:8/994: stat de/d23/d2b/d5d/d76/f72 0 2024-03-28T13:11:10.767 INFO:tasks.workunit.client.0.smithi076.stdout:1/864: rename d14/d19/d85/d3f to d14/d19/d85/d2e/d3c/d7e/d128 0 2024-03-28T13:11:10.938 INFO:tasks.workunit.client.0.smithi076.stdout:5/976: truncate d5/d9/d1c/d1d/fa6 656726 0 2024-03-28T13:11:10.938 INFO:tasks.workunit.client.0.smithi076.stdout:5/977: write d5/db/fdb [534007,128552] 0 2024-03-28T13:11:10.966 INFO:tasks.workunit.client.0.smithi076.stdout:5/978: dwrite d5/d9/d1c/d25/dbd/fbe [0,4194304] 0 2024-03-28T13:11:10.988 INFO:tasks.workunit.client.0.smithi076.stdout:8/995: symlink de/d23/d2b/d51/d62/df9/l15c 0 2024-03-28T13:11:10.989 INFO:tasks.workunit.client.0.smithi076.stdout:8/996: read de/d23/d2b/d51/fe5 [1306183,92475] 0 2024-03-28T13:11:11.091 INFO:tasks.workunit.client.0.smithi076.stdout:9/962: rename d9/da/de6/f11f to d9/dd/dbb/f125 0 2024-03-28T13:11:11.175 INFO:tasks.workunit.client.0.smithi076.stdout:1/865: link d14/c41 d14/d19/d85/d2e/d31/d51/d92/da4/db7/dc8/c129 0 2024-03-28T13:11:11.175 INFO:tasks.workunit.client.0.smithi076.stdout:1/866: dread - d14/d19/d20/dbf/ff1 zero size 2024-03-28T13:11:11.393 INFO:tasks.workunit.client.0.smithi076.stdout:8/997: creat de/d13/f15d x:0 0 0 2024-03-28T13:11:11.564 INFO:tasks.workunit.client.0.smithi076.stdout:9/963: symlink d9/dd/df/d11/d14/d58/l126 0 2024-03-28T13:11:11.905 INFO:tasks.workunit.client.0.smithi076.stdout:9/964: creat d9/dd/df/d11/d14/d58/d6e/d2a/f127 x:0 0 0 2024-03-28T13:11:12.770 INFO:tasks.workunit.client.0.smithi076.stdout:9/965: symlink d9/d3c/l128 0 2024-03-28T13:11:12.770 INFO:tasks.workunit.client.0.smithi076.stdout:9/966: dread - d9/dd/d48/dad/fc2 zero size 2024-03-28T13:11:12.771 INFO:tasks.workunit.client.0.smithi076.stdout:7/907: rename d1/d18/d3c/c60 to d1/d8/d37/d53/c13a 0 2024-03-28T13:11:12.771 INFO:tasks.workunit.client.0.smithi076.stdout:7/908: chown d1/d18/d3c/d7b 1337844 1 2024-03-28T13:11:12.819 INFO:tasks.workunit.client.0.smithi076.stdout:9/967: dwrite d9/d3c/fa8 [0,4194304] 0 2024-03-28T13:11:12.824 INFO:tasks.workunit.client.0.smithi076.stdout:8/998: dwrite de/d23/d2b/d51/fe5 [0,4194304] 0 2024-03-28T13:11:12.824 INFO:tasks.workunit.client.0.smithi076.stdout:8/999: fsync de/d23/d2b/d5d/fe7 0 2024-03-28T13:11:13.004 INFO:tasks.workunit.client.0.smithi076.stdout:3/836: symlink d1/d7/d30/d38/d14/d36/d56/d5b/l125 0 2024-03-28T13:11:13.165 INFO:tasks.workunit.client.0.smithi076.stdout:5/979: rename d5/db/d19/c4b to d5/d9/d1c/d25/dbd/d7a/d7c/c163 0 2024-03-28T13:11:13.165 INFO:tasks.workunit.client.0.smithi076.stdout:7/909: mkdir d1/d8/dc2/dc4/d12b/d13b 0 2024-03-28T13:11:13.201 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:11:13.202 INFO:tasks.workunit.client.0.smithi076.stdout:9/968: creat d9/da/de6/f129 x:0 0 0 2024-03-28T13:11:13.205 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:11:13.273 INFO:tasks.workunit.client.0.smithi076.stdout:3/837: rename d1/d7/d30/d38/d14/d36/d56/d5b/d6d/ld0 to d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/df6/l126 0 2024-03-28T13:11:13.346 INFO:tasks.workunit.client.0.smithi076.stdout:5/980: write d5/d9/d1c/d25/dbd/d7a/db1/ffd [915358,76851] 0 2024-03-28T13:11:13.411 INFO:tasks.workunit.client.0.smithi076.stdout:7/910: creat d1/d8/dc2/dc4/d12b/d13b/f13c x:0 0 0 2024-03-28T13:11:13.466 INFO:tasks.workunit.client.0.smithi076.stdout:9/969: creat d9/dd/d105/f12a x:0 0 0 2024-03-28T13:11:13.484 INFO:tasks.workunit.client.0.smithi076.stdout:9/970: dread d9/fef [0,4194304] 0 2024-03-28T13:11:13.558 INFO:tasks.workunit.client.0.smithi076.stdout:3/838: rename d1/d7/d30/d38/d14/d36/d56/l5d to d1/l127 0 2024-03-28T13:11:13.559 INFO:tasks.workunit.client.0.smithi076.stdout:3/839: write d1/d7/d30/d38/f35 [607429,67833] 0 2024-03-28T13:11:13.605 INFO:tasks.workunit.client.0.smithi076.stdout:5/981: mkdir d5/d9/d1c/dcc/d164 0 2024-03-28T13:11:13.733 INFO:tasks.workunit.client.0.smithi076.stdout:7/911: creat d1/d18/d3c/d48/d69/f13d x:0 0 0 2024-03-28T13:11:13.733 INFO:tasks.workunit.client.0.smithi076.stdout:9/971: mkdir d9/dd/d48/dad/d12b 0 2024-03-28T13:11:13.754 INFO:tasks.workunit.client.0.smithi076.stdout:3/840: creat d1/d7/d30/d38/d14/d27/d69/f128 x:0 0 0 2024-03-28T13:11:13.876 INFO:tasks.workunit.client.0.smithi076.stdout:5/982: truncate d5/db/d19/f8c 3562179 0 2024-03-28T13:11:13.877 INFO:tasks.workunit.client.0.smithi076.stdout:7/912: creat d1/d18/d2d/f13e x:0 0 0 2024-03-28T13:11:13.877 INFO:tasks.workunit.client.0.smithi076.stdout:3/841: mkdir d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d8f/d129 0 2024-03-28T13:11:13.877 INFO:tasks.workunit.client.0.smithi076.stdout:9/972: creat d9/da/de6/df2/d122/f12c x:0 0 0 2024-03-28T13:11:13.877 INFO:tasks.workunit.client.0.smithi076.stdout:9/973: stat d9/d74/d7d/ff1 0 2024-03-28T13:11:13.938 INFO:tasks.workunit.client.0.smithi076.stdout:5/983: creat d5/d9/d1c/d25/dbd/f165 x:0 0 0 2024-03-28T13:11:13.939 INFO:tasks.workunit.client.0.smithi076.stdout:5/984: readlink d5/d9/d4c/da4/lda 0 2024-03-28T13:11:14.112 INFO:tasks.workunit.client.0.smithi076.stdout:7/913: unlink d1/d8/dc2/d100/f11e 0 2024-03-28T13:11:14.112 INFO:tasks.workunit.client.0.smithi076.stdout:3/842: getdents d1/d7/d30/d38/d14/d4a 0 2024-03-28T13:11:14.153 INFO:tasks.workunit.client.0.smithi076.stdout:7/914: dwrite d1/d18/d3c/f44 [0,4194304] 0 2024-03-28T13:11:14.183 INFO:tasks.workunit.client.0.smithi076.stdout:7/915: dwrite d1/f1b [0,4194304] 0 2024-03-28T13:11:14.183 INFO:tasks.workunit.client.0.smithi076.stdout:7/916: chown d1/d8/ca8 2647419 1 2024-03-28T13:11:14.202 INFO:tasks.workunit.client.0.smithi076.stdout:5/985: getdents d5/db/df 0 2024-03-28T13:11:14.245 INFO:tasks.workunit.client.0.smithi076.stdout:3/843: getdents d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d 0 2024-03-28T13:11:14.245 INFO:tasks.workunit.client.0.smithi076.stdout:3/844: truncate d1/d7/d30/ffb 19087 0 2024-03-28T13:11:14.287 INFO:tasks.workunit.client.0.smithi076.stdout:7/917: getdents d1/d18/d3c/d7b/d7d 0 2024-03-28T13:11:14.317 INFO:tasks.workunit.client.0.smithi076.stdout:1/867: sync 2024-03-28T13:11:14.318 INFO:tasks.workunit.client.0.smithi076.stdout:2/987: sync 2024-03-28T13:11:14.318 INFO:tasks.workunit.client.0.smithi076.stdout:1/868: readlink d14/d19/d85/d2e/d31/d51/l98 0 2024-03-28T13:11:14.359 INFO:tasks.workunit.client.0.smithi076.stdout:5/986: mknod d5/d9/d1c/d25/d136/c166 0 2024-03-28T13:11:14.528 INFO:tasks.workunit.client.0.smithi076.stdout:7/918: mknod d1/d18/d3c/d48/d69/c13f 0 2024-03-28T13:11:14.945 INFO:tasks.workunit.client.0.smithi076.stdout:1/869: rmdir d14/d19/d85/d2e/d31/d51 39 2024-03-28T13:11:14.945 INFO:tasks.workunit.client.0.smithi076.stdout:1/870: fsync d14/d19/d85/d2e/d31/d8f/ffd 0 2024-03-28T13:11:14.963 INFO:tasks.workunit.client.0.smithi076.stdout:1/871: dread d14/d19/d85/d2e/d3c/d7e/f99 [0,4194304] 0 2024-03-28T13:11:15.050 INFO:tasks.workunit.client.0.smithi076.stdout:5/987: symlink d5/d9/d4c/d153/l167 0 2024-03-28T13:11:15.184 INFO:tasks.workunit.client.0.smithi076.stdout:7/919: dread d1/d18/d3c/d48/f8d [0,4194304] 0 2024-03-28T13:11:15.328 INFO:tasks.workunit.client.0.smithi076.stdout:1/872: mkdir d14/d19/d85/d2e/d31/d8f/d12a 0 2024-03-28T13:11:15.360 INFO:tasks.workunit.client.0.smithi076.stdout:5/988: truncate d5/db/d19/f20 1045004 0 2024-03-28T13:11:15.763 INFO:tasks.workunit.client.0.smithi076.stdout:9/974: sync 2024-03-28T13:11:15.763 INFO:tasks.workunit.client.0.smithi076.stdout:9/975: chown d9/d74/f8e 79483 1 2024-03-28T13:11:15.769 INFO:tasks.workunit.client.0.smithi076.stdout:1/873: mknod d14/d19/d85/d2e/d31/d3b/d115/c12b 0 2024-03-28T13:11:15.850 INFO:tasks.workunit.client.0.smithi076.stdout:3/845: dwrite d1/d7/d30/fc4 [0,4194304] 0 2024-03-28T13:11:16.041 INFO:tasks.workunit.client.0.smithi076.stdout:3/846: dread - d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/faa zero size 2024-03-28T13:11:16.042 INFO:tasks.workunit.client.0.smithi076.stdout:5/989: symlink d5/db/d19/d34/d128/l168 0 2024-03-28T13:11:16.221 INFO:tasks.workunit.client.0.smithi076.stdout:7/920: truncate d1/f7 140967 0 2024-03-28T13:11:16.279 INFO:tasks.workunit.client.0.smithi076.stdout:1/874: dread d14/d19/d85/d2e/f58 [0,4194304] 0 2024-03-28T13:11:16.291 INFO:tasks.workunit.client.0.smithi076.stdout:3/847: symlink d1/d7/da4/l12a 0 2024-03-28T13:11:16.291 INFO:tasks.workunit.client.0.smithi076.stdout:3/848: stat d1/d7/d30/d38/f35 0 2024-03-28T13:11:16.344 INFO:tasks.workunit.client.0.smithi076.stdout:5/990: mknod d5/d9/d1c/d25/d136/d105/d135/c169 0 2024-03-28T13:11:16.396 INFO:tasks.workunit.client.0.smithi076.stdout:2/988: write d2/d5/db/d3b/d9f/f8e [925502,36314] 0 2024-03-28T13:11:16.422 INFO:tasks.workunit.client.0.smithi076.stdout:7/921: dread d1/d8/dc2/dc4/f105 [0,4194304] 0 2024-03-28T13:11:16.494 INFO:tasks.workunit.client.0.smithi076.stdout:3/849: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d8f/d129/f12b x:0 0 0 2024-03-28T13:11:16.521 INFO:tasks.workunit.client.0.smithi076.stdout:3/850: write d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/f5e [3334930,51873] 0 2024-03-28T13:11:16.592 INFO:tasks.workunit.client.0.smithi076.stdout:5/991: creat d5/d9/d1c/d1d/d22/d110/f16a x:0 0 0 2024-03-28T13:11:16.592 INFO:tasks.workunit.client.0.smithi076.stdout:5/992: dread - d5/d9/d1c/d1d/d31/ded/f14d zero size 2024-03-28T13:11:16.641 INFO:tasks.workunit.client.0.smithi076.stdout:2/989: symlink d2/d5/db/d3b/d9f/l136 0 2024-03-28T13:11:16.672 INFO:tasks.workunit.client.0.smithi076.stdout:2/990: dwrite d2/d5/d4b/d39/d57/fd1 [0,4194304] 0 2024-03-28T13:11:16.703 INFO:tasks.workunit.client.0.smithi076.stdout:7/922: mkdir d1/d8/dc2/d100/d140 0 2024-03-28T13:11:16.703 INFO:tasks.workunit.client.0.smithi076.stdout:7/923: fdatasync d1/d8/dc2/d100/db5/ff9 0 2024-03-28T13:11:16.718 INFO:tasks.workunit.client.0.smithi076.stdout:2/991: dwrite d2/d5/d7/d28/f43 [0,4194304] 0 2024-03-28T13:11:16.719 INFO:tasks.workunit.client.0.smithi076.stdout:2/992: write d2/d5/db/d3b/d5a/d8d/dc1/d113/f125 [681655,2002] 0 2024-03-28T13:11:16.777 INFO:tasks.workunit.client.0.smithi076.stdout:1/875: mknod d14/d19/d85/d2e/d31/d46/c12c 0 2024-03-28T13:11:16.911 INFO:tasks.workunit.client.0.smithi076.stdout:3/851: mknod d1/d7/d30/d38/d14/d36/d56/c12c 0 2024-03-28T13:11:16.911 INFO:tasks.workunit.client.0.smithi076.stdout:3/852: write d1/d7/d30/d38/f29 [4943817,38754] 0 2024-03-28T13:11:16.911 INFO:tasks.workunit.client.0.smithi076.stdout:3/853: fsync d1/d7/d30/d38/d14/d4a/ddc/feb 0 2024-03-28T13:11:16.911 INFO:tasks.workunit.client.0.smithi076.stdout:3/854: readlink d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/l2a 0 2024-03-28T13:11:16.911 INFO:tasks.workunit.client.0.smithi076.stdout:3/855: chown d1/d7/d30/d38/d14/d4a/ddc/ded/df3/f123 1284598067 1 2024-03-28T13:11:16.911 INFO:tasks.workunit.client.0.smithi076.stdout:3/856: readlink d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/l2a 0 2024-03-28T13:11:16.911 INFO:tasks.workunit.client.0.smithi076.stdout:3/857: fsync d1/d7/d30/d38/d14/d27/f4e 0 2024-03-28T13:11:16.911 INFO:tasks.workunit.client.0.smithi076.stdout:3/858: dread - d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d8f/d129/f12b zero size 2024-03-28T13:11:16.930 INFO:tasks.workunit.client.0.smithi076.stdout:3/859: dread d1/d7/d30/d38/d14/d4a/fae [0,4194304] 0 2024-03-28T13:11:16.966 INFO:tasks.workunit.client.0.smithi076.stdout:5/993: rename d5/d9/d4c/d98 to d5/d9/d1c/d25/dbd/d7a/de2/d16b 0 2024-03-28T13:11:17.144 INFO:tasks.workunit.client.0.smithi076.stdout:7/924: creat d1/d8/f141 x:0 0 0 2024-03-28T13:11:17.213 INFO:tasks.workunit.client.0.smithi076.stdout:2/993: mknod d2/d5/db/d3b/d5a/daa/c137 0 2024-03-28T13:11:17.298 INFO:tasks.workunit.client.0.smithi076.stdout:3/860: unlink d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/f40 0 2024-03-28T13:11:17.513 INFO:tasks.workunit.client.0.smithi076.stdout:2/994: mkdir d2/d5/d4b/d39/d57/d12e/d138 0 2024-03-28T13:11:17.513 INFO:tasks.workunit.client.0.smithi076.stdout:2/995: write d2/d5/d7/d28/f8b [3040316,79152] 0 2024-03-28T13:11:17.680 INFO:tasks.workunit.client.0.smithi076.stdout:1/876: rename d14/d19/d85/d2e/d91/fed to d14/d6c/d74/d9e/f12d 0 2024-03-28T13:11:17.680 INFO:tasks.workunit.client.0.smithi076.stdout:1/877: fdatasync d14/d19/d85/d2e/d31/d3b/f55 0 2024-03-28T13:11:17.756 INFO:tasks.workunit.client.0.smithi076.stdout:2/996: creat d2/d92/f139 x:0 0 0 2024-03-28T13:11:17.979 INFO:tasks.workunit.client.0.smithi076.stdout:1/878: rmdir d14/d19/d20 39 2024-03-28T13:11:17.979 INFO:tasks.workunit.client.0.smithi076.stdout:2/997: mknod d2/c13a 0 2024-03-28T13:11:18.031 INFO:tasks.workunit.client.0.smithi076.stdout:9/976: dwrite d9/dd/df/d11/f22 [4194304,4194304] 0 2024-03-28T13:11:18.050 INFO:tasks.workunit.client.0.smithi076.stdout:9/977: write d9/dd/d48/dd7/ffa [2920144,55025] 0 2024-03-28T13:11:18.050 INFO:tasks.workunit.client.0.smithi076.stdout:9/978: write d9/dd/df/fbf [826969,117417] 0 2024-03-28T13:11:18.200 INFO:tasks.workunit.client.0.smithi076.stdout:3/861: rename d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/ca9 to d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d3a/df6/c12d 0 2024-03-28T13:11:18.201 INFO:tasks.workunit.client.0.smithi076.stdout:3/862: write d1/d2/fcb [579637,44531] 0 2024-03-28T13:11:18.201 INFO:tasks.workunit.client.0.smithi076.stdout:3/863: write d1/d7/d30/d71/ff1 [136310,70069] 0 2024-03-28T13:11:18.220 INFO:tasks.workunit.client.0.smithi076.stdout:7/925: link d1/d8/d37/fde d1/f142 0 2024-03-28T13:11:18.236 INFO:tasks.workunit.client.0.smithi076.stdout:7/926: dread d1/f1b [0,4194304] 0 2024-03-28T13:11:18.236 INFO:tasks.workunit.client.0.smithi076.stdout:7/927: truncate d1/d8/dc2/dc4/d12b/d13b/f13c 459412 0 2024-03-28T13:11:18.236 INFO:tasks.workunit.client.0.smithi076.stdout:7/928: write d1/d8/dc2/d100/fbb [1297228,6313] 0 2024-03-28T13:11:18.236 INFO:tasks.workunit.client.0.smithi076.stdout:7/929: write d1/d8/dc2/d100/db5/fe3 [1414237,37100] 0 2024-03-28T13:11:18.300 INFO:tasks.workunit.client.0.smithi076.stdout:5/994: mkdir d5/d9/d16c 0 2024-03-28T13:11:18.318 INFO:tasks.workunit.client.0.smithi076.stdout:2/998: fsync d2/d5/d7/dd/dc8/fcc 0 2024-03-28T13:11:18.337 INFO:tasks.workunit.client.0.smithi076.stdout:2/999: write d2/d5/db/d3b/d3f/fbf [247842,100778] 0 2024-03-28T13:11:18.497 INFO:tasks.workunit.client.0.smithi076.stdout:9/979: creat d9/dd/df/d11/d14/d58/d6e/d2a/f12d x:0 0 0 2024-03-28T13:11:18.550 INFO:tasks.workunit.client.0.smithi076.stdout:3/864: creat d1/d7/d30/d38/d14/d27/dc7/f12e x:0 0 0 2024-03-28T13:11:18.550 INFO:tasks.workunit.client.0.smithi076.stdout:3/865: write d1/d7/d30/d38/d14/d36/f16 [2585269,13455] 0 2024-03-28T13:11:18.550 INFO:tasks.workunit.client.0.smithi076.stdout:3/866: truncate d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/faa 706193 0 2024-03-28T13:11:18.626 INFO:tasks.workunit.client.0.smithi076.stdout:7/930: creat d1/d8/dc2/d100/f143 x:0 0 0 2024-03-28T13:11:18.627 INFO:tasks.workunit.client.0.smithi076.stdout:7/931: readlink d1/dc/l5d 0 2024-03-28T13:11:18.686 INFO:tasks.workunit.client.0.smithi076.stdout:1/879: truncate d14/d19/d85/d2e/d31/d8f/ff9 139435 0 2024-03-28T13:11:18.686 INFO:tasks.workunit.client.0.smithi076.stdout:1/880: write d14/f6b [1190258,74336] 0 2024-03-28T13:11:18.745 INFO:tasks.workunit.client.0.smithi076.stdout:5/995: unlink d5/c4f 0 2024-03-28T13:11:18.746 INFO:tasks.workunit.client.0.smithi076.stdout:5/996: write d5/d9/d1c/d25/d136/de9/f11d [356626,110908] 0 2024-03-28T13:11:18.746 INFO:tasks.workunit.client.0.smithi076.stdout:5/997: readlink d5/db/d3f/l92 0 2024-03-28T13:11:18.858 INFO:tasks.workunit.client.0.smithi076.stdout:9/980: dwrite d9/dd/df/d11/fd1 [0,4194304] 0 2024-03-28T13:11:18.938 INFO:tasks.workunit.client.0.smithi076.stdout:3/867: truncate d1/d7/d30/d38/d14/d27/f4e 4532369 0 2024-03-28T13:11:18.984 INFO:tasks.workunit.client.0.smithi076.stdout:1/881: rename d14/d19/d85/f57 to d14/d19/d85/dc3/f12e 0 2024-03-28T13:11:19.030 INFO:tasks.workunit.client.0.smithi076.stdout:1/882: dwrite d14/d19/d85/d2e/d31/d8f/f9c [0,4194304] 0 2024-03-28T13:11:19.030 INFO:tasks.workunit.client.0.smithi076.stdout:1/883: chown d14/c1e 8664216 1 2024-03-28T13:11:19.066 INFO:tasks.workunit.client.0.smithi076.stdout:1/884: dwrite d14/d19/d85/d2e/d31/d51/d92/da4/dfb/f100 [0,4194304] 0 2024-03-28T13:11:19.089 INFO:tasks.workunit.client.0.smithi076.stdout:5/998: symlink d5/db/d19/d34/l16d 0 2024-03-28T13:11:19.123 INFO:tasks.workunit.client.0.smithi076.stdout:5/999: dwrite d5/d9/d1c/d25/d73/fba [0,4194304] 0 2024-03-28T13:11:20.448 INFO:tasks.workunit.client.0.smithi076.stdout:1/885: dread d14/d19/d85/d2e/d31/d3b/f55 [0,4194304] 0 2024-03-28T13:11:20.526 INFO:tasks.workunit.client.0.smithi076.stdout:7/932: dwrite d1/d18/fad [0,4194304] 0 2024-03-28T13:11:20.764 INFO:tasks.workunit.client.0.smithi076.stdout:1/886: creat d14/d19/d85/d2e/d31/d8f/d102/f12f x:0 0 0 2024-03-28T13:11:20.764 INFO:tasks.workunit.client.0.smithi076.stdout:1/887: fdatasync d14/d19/d85/d2e/d31/d3b/f111 0 2024-03-28T13:11:20.898 INFO:tasks.workunit.client.0.smithi076.stdout:1/888: creat d14/d19/d85/dc3/f130 x:0 0 0 2024-03-28T13:11:21.626 INFO:tasks.workunit.client.0.smithi076.stdout:1/889: getdents d14/d19/d85/d2e/d31/d3b/d115 0 2024-03-28T13:11:21.626 INFO:tasks.workunit.client.0.smithi076.stdout:1/890: write d14/def/df0/fd0 [1017763,26411] 0 2024-03-28T13:11:21.626 INFO:tasks.workunit.client.0.smithi076.stdout:1/891: readlink lf 0 2024-03-28T13:11:21.783 INFO:tasks.workunit.client.0.smithi076.stdout:1/892: mkdir d14/d19/d85/d2e/d3c/d7e/d131 0 2024-03-28T13:11:21.803 INFO:tasks.workunit.client.0.smithi076.stdout:1/893: dwrite d14/d19/d85/d2e/fce [0,4194304] 0 2024-03-28T13:11:22.419 INFO:tasks.workunit.client.0.smithi076.stdout:3/868: rename d1/d7/d30/f115 to d1/d7/d30/d38/d14/d27/f12f 0 2024-03-28T13:11:22.419 INFO:tasks.workunit.client.0.smithi076.stdout:3/869: chown d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d93/dd4/fdf 35982 1 2024-03-28T13:11:22.419 INFO:tasks.workunit.client.0.smithi076.stdout:3/870: stat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d58/l99 0 2024-03-28T13:11:22.424 INFO:tasks.workunit.client.0.smithi076.stdout:1/894: write d14/d19/d85/d2e/d91/fa0 [1412967,130685] 0 2024-03-28T13:11:22.450 INFO:tasks.workunit.client.0.smithi076.stdout:1/895: write d14/d19/d85/d2e/d3c/f10f [1007008,58563] 0 2024-03-28T13:11:22.450 INFO:tasks.workunit.client.0.smithi076.stdout:1/896: truncate d14/d6c/d74/fd3 2146283 0 2024-03-28T13:11:22.574 INFO:tasks.workunit.client.0.smithi076.stdout:7/933: rename d1/d8/dc2/l135 to d1/d8/l144 0 2024-03-28T13:11:22.575 INFO:tasks.workunit.client.0.smithi076.stdout:3/871: mknod d1/d7/d30/d38/d14/d4a/ddc/ded/df3/c130 0 2024-03-28T13:11:22.575 INFO:tasks.workunit.client.0.smithi076.stdout:7/934: write d1/d18/d3c/f20 [490872,9787] 0 2024-03-28T13:11:22.575 INFO:tasks.workunit.client.0.smithi076.stdout:7/935: readlink d1/l92 0 2024-03-28T13:11:22.575 INFO:tasks.workunit.client.0.smithi076.stdout:7/936: write d1/d18/d3c/d7b/f11a [989071,15714] 0 2024-03-28T13:11:22.593 INFO:tasks.workunit.client.0.smithi076.stdout:1/897: truncate d14/d19/d85/d2e/d31/d49/f63 3469756 0 2024-03-28T13:11:22.595 INFO:tasks.workunit.client.0.smithi076.stdout:7/937: dwrite d1/f5 [0,4194304] 0 2024-03-28T13:11:22.776 INFO:tasks.workunit.client.0.smithi076.stdout:3/872: creat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d74/f131 x:0 0 0 2024-03-28T13:11:22.776 INFO:tasks.workunit.client.0.smithi076.stdout:3/873: stat d1/d7/d30/d38/d14/d36/d56/d5b/d6d/d8d/d58 0 2024-03-28T13:11:22.797 INFO:tasks.workunit.client.0.smithi076.stdout:1/898: rename d14/d19/d85/dd6/fe1 to d14/d19/d85/d2e/d3c/d7e/d131/f132 0 2024-03-28T13:11:22.797 INFO:tasks.workunit.client.0.smithi076.stdout:7/938: creat d1/d8/dc2/dc4/d104/f145 x:0 0 0 2024-03-28T13:11:22.797 INFO:tasks.workunit.client.0.smithi076.stdout:7/939: write d1/dc/f6e [241852,37469] 0 2024-03-28T13:11:22.798 INFO:tasks.workunit.client.0.smithi076.stdout:7/940: chown d1/d8/dc2/d100/cf7 8608 1 2024-03-28T13:11:22.804 INFO:tasks.workunit.client.0.smithi076.stdout:7/941: write d1/d8/dc2/d100/fbb [915977,110149] 0 2024-03-28T13:11:22.919 INFO:tasks.workunit.client.0.smithi076.stdout:1/899: mkdir d14/def/d133 0 2024-03-28T13:11:22.919 INFO:tasks.workunit.client.0.smithi076.stdout:3/874: fdatasync d1/d7/d30/d38/d14/d27/ff0 0 2024-03-28T13:11:22.920 INFO:tasks.workunit.client.0.smithi076.stdout:7/942: creat d1/dc/d8b/dbf/d127/f146 x:0 0 0 2024-03-28T13:11:22.921 INFO:tasks.workunit.client.0.smithi076.stdout:7/943: read d1/d81/dc3/f88 [171803,5405] 0 2024-03-28T13:11:22.921 INFO:tasks.workunit.client.0.smithi076.stdout:7/944: readlink d1/d8/dc2/dc4/ld8 0 2024-03-28T13:11:23.083 INFO:tasks.workunit.client.0.smithi076.stdout:9/981: sync 2024-03-28T13:11:23.213 INFO:tasks.workunit.client.0.smithi076.stdout:1/900: creat d14/d6c/d74/f134 x:0 0 0 2024-03-28T13:11:23.214 INFO:tasks.workunit.client.0.smithi076.stdout:9/982: creat d9/d74/f12e x:0 0 0 2024-03-28T13:11:23.240 INFO:tasks.workunit.client.0.smithi076.stdout:9/983: dwrite d9/dd/df/d11/d14/f16 [0,4194304] 0 2024-03-28T13:11:23.298 INFO:tasks.workunit.client.0.smithi076.stdout:3/875: link d1/d7/d30/le7 d1/d2/l132 0 2024-03-28T13:11:23.302 INFO:tasks.workunit.client.0.smithi076.stdout:1/901: stat d14/d6c/d74/lec 0 2024-03-28T13:11:23.303 INFO:tasks.workunit.client.0.smithi076.stdout:1/902: dread - d14/d19/d20/dbf/ff1 zero size 2024-03-28T13:11:23.317 INFO:tasks.workunit.client.0.smithi076.stdout:1/903: dread d14/d19/d85/d2e/d31/d51/f70 [0,4194304] 0 2024-03-28T13:11:23.317 INFO:tasks.workunit.client.0.smithi076.stdout:1/904: fdatasync d14/d19/d85/d2e/f6a 0 2024-03-28T13:11:23.559 INFO:tasks.workunit.client.0.smithi076.stdout:3/876: unlink d1/d2/fee 0 2024-03-28T13:11:23.559 INFO:tasks.workunit.client.0.smithi076.stdout:9/984: creat d9/d3c/f12f x:0 0 0 2024-03-28T13:11:23.559 INFO:tasks.workunit.client.0.smithi076.stdout:9/985: chown d9/dd/f2e 2414 1 2024-03-28T13:11:23.606 INFO:tasks.workunit.client.0.smithi076.stdout:9/986: dwrite d9/dd/df/fde [0,4194304] 0 2024-03-28T13:11:23.610 INFO:tasks.workunit.client.0.smithi076.stdout:9/987: dread d9/dd/df/d11/d14/fa3 [0,4194304] 0 2024-03-28T13:11:23.637 INFO:tasks.workunit.client.0.smithi076.stdout:7/945: dwrite d1/dc/d8b/dbf/f106 [0,4194304] 0 2024-03-28T13:11:23.663 INFO:tasks.workunit.client.0.smithi076.stdout:7/946: dread d1/d18/d3c/d48/d69/f70 [0,4194304] 0 2024-03-28T13:11:23.664 INFO:tasks.workunit.client.0.smithi076.stdout:7/947: chown d1/d8/d37/cc5 348574 1 2024-03-28T13:11:23.664 INFO:tasks.workunit.client.0.smithi076.stdout:9/988: dwrite d9/d74/db3/db5/ffb [0,4194304] 0 2024-03-28T13:11:23.677 INFO:tasks.workunit.client.0.smithi076.stdout:7/948: dread d1/d18/f93 [4194304,4194304] 0 2024-03-28T13:11:23.677 INFO:tasks.workunit.client.0.smithi076.stdout:1/905: mkdir d14/d19/d85/d2e/d31/d51/d92/da4/db5/d135 0 2024-03-28T13:11:23.769 INFO:tasks.workunit.client.0.smithi076.stdout:3/877: rename d1/d7/d30/d38/d14/d36/d56/d5b to d1/d7/d30/d38/d14/d4a/ddc/d10e/d133 0 2024-03-28T13:11:23.856 INFO:tasks.workunit.client.0.smithi076.stdout:9/989: getdents d9/dd/d48/dd7/dd9/d101 0 2024-03-28T13:11:23.873 INFO:tasks.workunit.client.0.smithi076.stdout:1/906: rmdir d14/d19/d85 39 2024-03-28T13:11:23.873 INFO:tasks.workunit.client.0.smithi076.stdout:7/949: creat d1/d8/dc2/f147 x:0 0 0 2024-03-28T13:11:23.930 INFO:tasks.workunit.client.0.smithi076.stdout:3/878: rename d1/d7/d30/d38/d14/d97/fcc to d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d3a/dcd/f134 0 2024-03-28T13:11:23.931 INFO:tasks.workunit.client.0.smithi076.stdout:3/879: chown d1/d7/d30/d38/d9b/d120 6847 1 2024-03-28T13:11:23.931 INFO:tasks.workunit.client.0.smithi076.stdout:3/880: readlink d1/d2/l132 0 2024-03-28T13:11:23.977 INFO:tasks.workunit.client.0.smithi076.stdout:9/990: creat d9/dd/d105/f130 x:0 0 0 2024-03-28T13:11:23.978 INFO:tasks.workunit.client.0.smithi076.stdout:7/950: getdents d1/d8/dc2/dc4/d12b/d13b 0 2024-03-28T13:11:24.190 INFO:tasks.workunit.client.0.smithi076.stdout:1/907: rename d14/d19/d20/c25 to d14/d19/d85/d2e/d31/d8f/d12a/c136 0 2024-03-28T13:11:24.190 INFO:tasks.workunit.client.0.smithi076.stdout:1/908: chown d14/d19/d85/dc3 4418116 1 2024-03-28T13:11:24.190 INFO:tasks.workunit.client.0.smithi076.stdout:3/881: mkdir d1/d7/d30/d38/d14/d4a/ddc/ded/d119/d135 0 2024-03-28T13:11:24.190 INFO:tasks.workunit.client.0.smithi076.stdout:3/882: fdatasync d1/d7/d30/d38/fad 0 2024-03-28T13:11:24.190 INFO:tasks.workunit.client.0.smithi076.stdout:3/883: readlink d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/la1 0 2024-03-28T13:11:24.195 INFO:tasks.workunit.client.0.smithi076.stdout:9/991: unlink d9/dd/df/d11/f22 0 2024-03-28T13:11:24.195 INFO:tasks.workunit.client.0.smithi076.stdout:7/951: symlink d1/d8/dc2/dc4/d104/l148 0 2024-03-28T13:11:24.220 INFO:tasks.workunit.client.0.smithi076.stdout:9/992: dread d9/dd/df/f25 [0,4194304] 0 2024-03-28T13:11:24.238 INFO:tasks.workunit.client.0.smithi076.stdout:7/952: dread d1/d18/d3c/f24 [0,4194304] 0 2024-03-28T13:11:24.255 INFO:tasks.workunit.client.0.smithi076.stdout:1/909: chown d14/d19/d85/d2e/d91/fae 100733197 1 2024-03-28T13:11:24.564 INFO:tasks.workunit.client.0.smithi076.stdout:9/993: unlink d9/dd/df7/f124 0 2024-03-28T13:11:24.564 INFO:tasks.workunit.client.0.smithi076.stdout:7/953: mknod d1/d8/d37/d53/dae/c149 0 2024-03-28T13:11:24.564 INFO:tasks.workunit.client.0.smithi076.stdout:9/994: chown d9/d74/db3/lb9 273 1 2024-03-28T13:11:24.564 INFO:tasks.workunit.client.0.smithi076.stdout:3/884: symlink d1/d7/d30/d38/d14/d27/dc7/l136 0 2024-03-28T13:11:24.573 INFO:tasks.workunit.client.0.smithi076.stdout:1/910: mkdir d14/d19/d85/d2e/d31/d51/d92/da4/db5/d137 0 2024-03-28T13:11:24.578 INFO:tasks.workunit.client.0.smithi076.stdout:1/911: read d14/f26 [203417,19727] 0 2024-03-28T13:11:24.578 INFO:tasks.workunit.client.0.smithi076.stdout:1/912: chown d14/d19/d85/d2e 0 1 2024-03-28T13:11:24.578 INFO:tasks.workunit.client.0.smithi076.stdout:1/913: readlink d14/d19/d20/dd7/l11a 0 2024-03-28T13:11:24.579 INFO:tasks.workunit.client.0.smithi076.stdout:7/954: dread d1/d18/d3c/f20 [0,4194304] 0 2024-03-28T13:11:24.583 INFO:tasks.workunit.client.0.smithi076.stdout:9/995: dread d9/f36 [0,4194304] 0 2024-03-28T13:11:24.612 INFO:tasks.workunit.client.0.smithi076.stdout:9/996: dwrite d9/dd/f2e [4194304,4194304] 0 2024-03-28T13:11:24.900 INFO:tasks.workunit.client.0.smithi076.stdout:7/955: truncate d1/d8/d37/f47 1357890 0 2024-03-28T13:11:25.024 INFO:tasks.workunit.client.0.smithi076.stdout:9/997: getdents d9/da 0 2024-03-28T13:11:25.402 INFO:tasks.workunit.client.0.smithi076.stdout:7/956: getdents d1/d18/d2d 0 2024-03-28T13:11:25.402 INFO:tasks.workunit.client.0.smithi076.stdout:7/957: fsync d1/d8/fd5 0 2024-03-28T13:11:25.456 INFO:tasks.workunit.client.0.smithi076.stdout:9/998: stat d9/dd/df/d11/d37/l81 0 2024-03-28T13:11:25.477 INFO:tasks.workunit.client.0.smithi076.stdout:9/999: write d9/d74/f83 [629072,112177] 0 2024-03-28T13:11:25.940 INFO:tasks.workunit.client.0.smithi076.stdout:3/885: write d1/d7/d30/d38/d14/f1f [4092200,46002] 0 2024-03-28T13:11:25.993 INFO:tasks.workunit.client.0.smithi076.stdout:7/958: getdents d1/d8/dc2/dc4/d12b 0 2024-03-28T13:11:26.039 INFO:tasks.workunit.client.0.smithi076.stdout:7/959: dwrite d1/f4f [4194304,4194304] 0 2024-03-28T13:11:26.040 INFO:tasks.workunit.client.0.smithi076.stdout:7/960: readlink d1/d8/dc2/dc4/d104/l148 0 2024-03-28T13:11:26.636 INFO:tasks.workunit.client.0.smithi076.stdout:7/961: mkdir d1/d18/d3c/d48/d69/d79/d14a 0 2024-03-28T13:11:26.636 INFO:tasks.workunit.client.0.smithi076.stdout:7/962: write d1/d18/d3c/f20 [3493069,98557] 0 2024-03-28T13:11:26.738 INFO:tasks.workunit.client.0.smithi076.stdout:1/914: rename d14/f32 to d14/d19/d85/d2e/d31/d46/f138 0 2024-03-28T13:11:26.779 INFO:tasks.workunit.client.0.smithi076.stdout:7/963: mkdir d1/d8/d37/d53/dae/d14b 0 2024-03-28T13:11:26.797 INFO:tasks.workunit.client.0.smithi076.stdout:7/964: read d1/d18/d3c/f20 [8080546,54819] 0 2024-03-28T13:11:26.810 INFO:tasks.workunit.client.0.smithi076.stdout:7/965: dread d1/d8/f1e [0,4194304] 0 2024-03-28T13:11:26.862 INFO:tasks.workunit.client.0.smithi076.stdout:3/886: rename d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d74/db5/d121 to d1/d7/d137 0 2024-03-28T13:11:26.896 INFO:tasks.workunit.client.0.smithi076.stdout:1/915: unlink d14/d19/d85/d2e/d3c/d7e/cf8 0 2024-03-28T13:11:26.896 INFO:tasks.workunit.client.0.smithi076.stdout:1/916: chown d14/d19/d85/d2e/d31/f53 30 1 2024-03-28T13:11:26.963 INFO:tasks.workunit.client.0.smithi076.stdout:7/966: mknod d1/d18/c14c 0 2024-03-28T13:11:26.964 INFO:tasks.workunit.client.0.smithi076.stdout:7/967: write d1/d81/dd7/f137 [795953,109882] 0 2024-03-28T13:11:27.110 INFO:tasks.workunit.client.0.smithi076.stdout:3/887: mknod d1/d7/d30/d38/d9b/c138 0 2024-03-28T13:11:27.110 INFO:tasks.workunit.client.0.smithi076.stdout:1/917: mkdir d14/d19/d20/dd7/d139 0 2024-03-28T13:11:27.117 INFO:tasks.workunit.client.0.smithi076.stdout:7/968: unlink d1/d8/l144 0 2024-03-28T13:11:27.268 INFO:tasks.workunit.client.0.smithi076.stdout:1/918: mknod d14/d19/d85/d2e/d31/c13a 0 2024-03-28T13:11:27.268 INFO:tasks.workunit.client.0.smithi076.stdout:3/888: creat d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d3a/df6/f139 x:0 0 0 2024-03-28T13:11:27.268 INFO:tasks.workunit.client.0.smithi076.stdout:7/969: symlink d1/d18/d3c/d48/d69/l14d 0 2024-03-28T13:11:27.268 INFO:tasks.workunit.client.0.smithi076.stdout:7/970: dread - d1/dc/f110 zero size 2024-03-28T13:11:27.282 INFO:tasks.workunit.client.0.smithi076.stdout:7/971: write d1/d81/dd7/f102 [1267755,108895] 0 2024-03-28T13:11:27.389 INFO:tasks.workunit.client.0.smithi076.stdout:3/889: truncate d1/d7/d30/d38/d14/f8e 486909 0 2024-03-28T13:11:27.389 INFO:tasks.workunit.client.0.smithi076.stdout:7/972: rmdir d1/d18/d3c/d48 39 2024-03-28T13:11:27.515 INFO:tasks.workunit.client.0.smithi076.stdout:1/919: truncate d14/d19/d85/d2e/d3c/d7e/fcc 2603049 0 2024-03-28T13:11:27.515 INFO:tasks.workunit.client.0.smithi076.stdout:3/890: mkdir d1/d7/d30/d38/d14/d4a/ddc/d10e/d13a 0 2024-03-28T13:11:27.515 INFO:tasks.workunit.client.0.smithi076.stdout:3/891: chown d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d58/cd5 61681606 1 2024-03-28T13:11:27.521 INFO:tasks.workunit.client.0.smithi076.stdout:7/973: rename d1/d8/lb2 to d1/d18/d3c/d48/d69/d79/d14a/l14e 0 2024-03-28T13:11:27.635 INFO:tasks.workunit.client.0.smithi076.stdout:3/892: symlink d1/d7/d30/d38/d14/d4a/ddc/ded/l13b 0 2024-03-28T13:11:27.643 INFO:tasks.workunit.client.0.smithi076.stdout:7/974: mkdir d1/d18/d3c/d48/d69/d79/d14f 0 2024-03-28T13:11:27.653 INFO:tasks.workunit.client.0.smithi076.stdout:3/893: write d1/d7/f17 [3275427,20963] 0 2024-03-28T13:11:27.688 INFO:tasks.workunit.client.0.smithi076.stdout:7/975: mknod d1/d8/dc2/c150 0 2024-03-28T13:11:27.701 INFO:tasks.workunit.client.0.smithi076.stdout:7/976: write d1/d18/f95 [3895623,47296] 0 2024-03-28T13:11:27.701 INFO:tasks.workunit.client.0.smithi076.stdout:7/977: readlink d1/d8/dc2/dc4/d104/l11f 0 2024-03-28T13:11:27.741 INFO:tasks.workunit.client.0.smithi076.stdout:7/978: dwrite d1/dc/d8b/fd4 [0,4194304] 0 2024-03-28T13:11:27.755 INFO:tasks.workunit.client.0.smithi076.stdout:3/894: symlink d1/d7/l13c 0 2024-03-28T13:11:27.755 INFO:tasks.workunit.client.0.smithi076.stdout:3/895: write d1/f63 [4044078,96421] 0 2024-03-28T13:11:27.755 INFO:tasks.workunit.client.0.smithi076.stdout:3/896: dread - d1/d7/d30/d38/d14/d97/f109 zero size 2024-03-28T13:11:28.044 INFO:tasks.workunit.client.0.smithi076.stdout:7/979: getdents d1/d18/d3c 0 2024-03-28T13:11:28.045 INFO:tasks.workunit.client.0.smithi076.stdout:7/980: dread - d1/d8/dc2/d113/f131 zero size 2024-03-28T13:11:28.045 INFO:tasks.workunit.client.0.smithi076.stdout:7/981: fsync d1/f7 0 2024-03-28T13:11:28.048 INFO:tasks.workunit.client.0.smithi076.stdout:3/897: creat d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d93/f13d x:0 0 0 2024-03-28T13:11:28.229 INFO:tasks.workunit.client.0.smithi076.stdout:7/982: creat d1/d8/d37/d53/dae/d14b/f151 x:0 0 0 2024-03-28T13:11:28.233 INFO:tasks.workunit.client.0.smithi076.stdout:7/983: dread d1/d18/d3c/fc6 [0,4194304] 0 2024-03-28T13:11:28.233 INFO:tasks.workunit.client.0.smithi076.stdout:7/984: dread - d1/d18/d3c/f119 zero size 2024-03-28T13:11:28.267 INFO:tasks.workunit.client.0.smithi076.stdout:3/898: read d1/d7/d30/d38/d14/d27/f4e [2216603,42178] 0 2024-03-28T13:11:28.267 INFO:tasks.workunit.client.0.smithi076.stdout:3/899: write d1/d7/fef [9148228,9359] 0 2024-03-28T13:11:28.337 INFO:tasks.workunit.client.0.smithi076.stdout:7/985: symlink d1/d18/l152 0 2024-03-28T13:11:28.337 INFO:tasks.workunit.client.0.smithi076.stdout:7/986: chown d1/dc/d8b/dbf/lf6 2932484 1 2024-03-28T13:11:28.412 INFO:tasks.workunit.client.0.smithi076.stdout:3/900: unlink d1/d7/d30/d38/d14/d4a/ddc/ff7 0 2024-03-28T13:11:28.412 INFO:tasks.workunit.client.0.smithi076.stdout:3/901: chown d1/d7/d30/d38/d14/f1f 6 1 2024-03-28T13:11:28.413 INFO:tasks.workunit.client.0.smithi076.stdout:3/902: chown d1/d7/d30/d38/d14/d97/cf5 56489 1 2024-03-28T13:11:28.413 INFO:tasks.workunit.client.0.smithi076.stdout:3/903: chown d1/d7/d30/d60/f88 14881821 1 2024-03-28T13:11:28.428 INFO:tasks.workunit.client.0.smithi076.stdout:3/904: dread d1/d2/f4f [0,4194304] 0 2024-03-28T13:11:29.074 INFO:tasks.workunit.client.0.smithi076.stdout:7/987: mkdir d1/dc/d8b/dbf/d153 0 2024-03-28T13:11:29.074 INFO:tasks.workunit.client.0.smithi076.stdout:7/988: chown d1/d8/dc2/ce4 19225 1 2024-03-28T13:11:29.074 INFO:tasks.workunit.client.0.smithi076.stdout:7/989: dread - d1/dc/f110 zero size 2024-03-28T13:11:29.075 INFO:tasks.workunit.client.0.smithi076.stdout:3/905: rmdir d1/d7/d30/d38/d14/d36/d56 39 2024-03-28T13:11:29.078 INFO:tasks.workunit.client.0.smithi076.stdout:1/920: sync 2024-03-28T13:11:29.079 INFO:tasks.workunit.client.0.smithi076.stdout:1/921: write d14/d19/d85/d2e/d31/d8f/ffd [492678,9851] 0 2024-03-28T13:11:29.098 INFO:tasks.workunit.client.0.smithi076.stdout:1/922: dread d14/d19/f47 [0,4194304] 0 2024-03-28T13:11:29.098 INFO:tasks.workunit.client.0.smithi076.stdout:1/923: truncate d14/fb1 1289654 0 2024-03-28T13:11:29.268 INFO:tasks.workunit.client.0.smithi076.stdout:1/924: rmdir d14/d19/d85/d2e/d31/d6f 39 2024-03-28T13:11:29.333 INFO:tasks.workunit.client.0.smithi076.stdout:3/906: rename d1/d7/d30/d38/d14/l67 to d1/d7/d30/d38/d14/d4a/ddc/l13e 0 2024-03-28T13:11:29.333 INFO:tasks.workunit.client.0.smithi076.stdout:3/907: read - d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d3a/dcd/db9/f10f zero size 2024-03-28T13:11:29.433 INFO:tasks.workunit.client.0.smithi076.stdout:1/925: dread d14/d6c/d74/f95 [0,4194304] 0 2024-03-28T13:11:29.450 INFO:tasks.workunit.client.0.smithi076.stdout:3/908: mknod d1/d7/d30/d38/d14/d36/c13f 0 2024-03-28T13:11:29.531 INFO:tasks.workunit.client.0.smithi076.stdout:1/926: mkdir d14/d6c/d13b 0 2024-03-28T13:11:29.802 INFO:tasks.workunit.client.0.smithi076.stdout:3/909: fdatasync d1/d7/d30/d38/d14/d27/f80 0 2024-03-28T13:11:29.802 INFO:tasks.workunit.client.0.smithi076.stdout:1/927: rmdir d14/d6c/d13b 0 2024-03-28T13:11:29.809 INFO:tasks.workunit.client.0.smithi076.stdout:1/928: write d14/d19/d85/d2e/d31/d8f/fc1 [527872,30365] 0 2024-03-28T13:11:30.196 INFO:tasks.workunit.client.0.smithi076.stdout:1/929: unlink d14/d19/d85/d2e/d31/d49/ce3 0 2024-03-28T13:11:30.239 INFO:tasks.workunit.client.0.smithi076.stdout:7/990: dwrite d1/f142 [0,4194304] 0 2024-03-28T13:11:30.456 INFO:tasks.workunit.client.0.smithi076.stdout:1/930: rename d14/d19/d85/d2e/d31/d3b/ff2 to d14/d19/d85/d2e/d3c/d7e/d131/f13c 0 2024-03-28T13:11:30.685 INFO:tasks.workunit.client.0.smithi076.stdout:1/931: mknod d14/d6c/d74/d9e/c13d 0 2024-03-28T13:11:30.917 INFO:tasks.workunit.client.0.smithi076.stdout:7/991: rename d1/d18/d3c/d7b/d7d/f10c to d1/d18/d3c/d48/f154 0 2024-03-28T13:11:30.928 INFO:tasks.workunit.client.0.smithi076.stdout:1/932: truncate f5 3544114 0 2024-03-28T13:11:30.928 INFO:tasks.workunit.client.0.smithi076.stdout:1/933: readlink d14/d19/d85/d2e/d3c/d7e/d128/ld8 0 2024-03-28T13:11:31.125 INFO:tasks.workunit.client.0.smithi076.stdout:3/910: sync 2024-03-28T13:11:31.260 INFO:tasks.workunit.client.0.smithi076.stdout:7/992: rmdir d1/d8/dc2/dc4 39 2024-03-28T13:11:31.316 INFO:tasks.workunit.client.0.smithi076.stdout:1/934: creat d14/d19/d85/dc3/f13e x:0 0 0 2024-03-28T13:11:31.384 INFO:tasks.workunit.client.0.smithi076.stdout:3/911: write d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d3a/dcd/f134 [1941350,34718] 0 2024-03-28T13:11:31.553 INFO:tasks.workunit.client.0.smithi076.stdout:3/912: mknod d1/d7/d30/d38/d14/d4a/ddc/ded/d119/d135/c140 0 2024-03-28T13:11:31.584 INFO:tasks.workunit.client.0.smithi076.stdout:3/913: dwrite d1/d7/d30/d38/d14/d4a/d66/f6a [4194304,4194304] 0 2024-03-28T13:11:31.639 INFO:tasks.workunit.client.0.smithi076.stdout:7/993: symlink d1/d18/d3c/d48/d69/d79/d14f/l155 0 2024-03-28T13:11:31.676 INFO:tasks.workunit.client.0.smithi076.stdout:7/994: dwrite d1/d8/d37/d53/dae/d14b/f151 [0,4194304] 0 2024-03-28T13:11:31.697 INFO:tasks.workunit.client.0.smithi076.stdout:7/995: dwrite d1/d18/fad [4194304,4194304] 0 2024-03-28T13:11:31.820 INFO:tasks.workunit.client.0.smithi076.stdout:3/914: mknod d1/d7/d30/d38/d14/d4a/ddc/ded/df3/c141 0 2024-03-28T13:11:31.975 INFO:tasks.workunit.client.0.smithi076.stdout:3/915: getdents d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d3a/dcd/db9 0 2024-03-28T13:11:31.975 INFO:tasks.workunit.client.0.smithi076.stdout:3/916: fdatasync d1/d7/d30/d38/fb7 0 2024-03-28T13:11:32.200 INFO:tasks.workunit.client.0.smithi076.stdout:1/935: sync 2024-03-28T13:11:32.233 INFO:tasks.workunit.client.0.smithi076.stdout:7/996: creat d1/d18/d3c/d48/de5/f156 x:0 0 0 2024-03-28T13:11:32.241 INFO:tasks.workunit.client.0.smithi076.stdout:7/997: write d1/d18/d3c/d48/d69/fd0 [72670,39988] 0 2024-03-28T13:11:32.241 INFO:tasks.workunit.client.0.smithi076.stdout:7/998: chown d1/dc/f110 33702 1 2024-03-28T13:11:32.265 INFO:tasks.workunit.client.0.smithi076.stdout:7/999: dwrite d1/d8/fdc [0,4194304] 0 2024-03-28T13:11:32.371 INFO:tasks.workunit.client.0.smithi076.stdout:1/936: creat d14/d19/d85/d2e/d31/d46/f13f x:0 0 0 2024-03-28T13:11:32.371 INFO:tasks.workunit.client.0.smithi076.stdout:1/937: chown d14/d19/d20/dbf/cff 92 1 2024-03-28T13:11:32.371 INFO:tasks.workunit.client.0.smithi076.stdout:1/938: write d14/d19/d85/d2e/d91/fa0 [2461930,65796] 0 2024-03-28T13:11:32.565 INFO:tasks.workunit.client.0.smithi076.stdout:3/917: unlink d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d74/db5/f10a 0 2024-03-28T13:11:32.565 INFO:tasks.workunit.client.0.smithi076.stdout:1/939: rename d14/d19/d20/ceb to d14/d19/d85/d2e/d31/d51/d92/da4/dfb/c140 0 2024-03-28T13:11:32.581 INFO:tasks.workunit.client.0.smithi076.stdout:1/940: dread d14/d19/d85/d2e/d31/d3b/f43 [0,4194304] 0 2024-03-28T13:11:32.637 INFO:tasks.workunit.client.0.smithi076.stdout:1/941: rename d14/d19/d85/d2e/d3c/lb6 to d14/d19/d85/d2e/d31/l141 0 2024-03-28T13:11:32.665 INFO:tasks.workunit.client.0.smithi076.stdout:3/918: mknod d1/d7/d30/d71/c142 0 2024-03-28T13:11:32.688 INFO:tasks.workunit.client.0.smithi076.stdout:1/942: rmdir d14/d19/d85/d2e/d31/d49/d113 39 2024-03-28T13:11:32.783 INFO:tasks.workunit.client.0.smithi076.stdout:1/943: rmdir d14/d19 39 2024-03-28T13:11:32.783 INFO:tasks.workunit.client.0.smithi076.stdout:3/919: creat d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d3a/dcd/f143 x:0 0 0 2024-03-28T13:11:32.783 INFO:tasks.workunit.client.0.smithi076.stdout:3/920: dread - d1/d7/d30/d38/d14/d27/ff0 zero size 2024-03-28T13:11:32.790 INFO:tasks.workunit.client.0.smithi076.stdout:3/921: dread d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/f83 [0,4194304] 0 2024-03-28T13:11:32.846 INFO:tasks.workunit.client.0.smithi076.stdout:1/944: unlink d14/d6c/d74/d9e/f12d 0 2024-03-28T13:11:32.860 INFO:tasks.workunit.client.0.smithi076.stdout:1/945: write d14/d19/d85/d2e/f61 [3902239,105202] 0 2024-03-28T13:11:32.893 INFO:tasks.workunit.client.0.smithi076.stdout:3/922: symlink d1/d2/l144 0 2024-03-28T13:11:32.945 INFO:tasks.workunit.client.0.smithi076.stdout:1/946: mknod d14/d19/d85/d2e/d31/df3/c142 0 2024-03-28T13:11:33.006 INFO:tasks.workunit.client.0.smithi076.stdout:1/947: rmdir d14/d19/d85/dd6 39 2024-03-28T13:11:33.007 INFO:tasks.workunit.client.0.smithi076.stdout:3/923: symlink d1/d7/d30/l145 0 2024-03-28T13:11:33.362 INFO:tasks.workunit.client.0.smithi076.stdout:1/948: rename d14/d6c/d74 to d14/d19/d85/d2e/d31/d51/d92/da4/dfb/d143 0 2024-03-28T13:11:33.575 INFO:tasks.workunit.client.0.smithi076.stdout:3/924: rename d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d3a/dcd/db9 to d1/d7/d30/d38/d14/d27/d146 0 2024-03-28T13:11:33.576 INFO:tasks.workunit.client.0.smithi076.stdout:3/925: chown d1/d7/d30/d38/d14/d4a/f84 132749 1 2024-03-28T13:11:33.576 INFO:tasks.workunit.client.0.smithi076.stdout:3/926: read d1/d7/d30/d38/d14/d36/f16 [2744586,45272] 0 2024-03-28T13:11:33.707 INFO:tasks.workunit.client.0.smithi076.stdout:3/927: rename d1/d7/d30/d38/d14/d27/d69 to d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d147 0 2024-03-28T13:11:33.743 INFO:tasks.workunit.client.0.smithi076.stdout:1/949: dwrite d14/d19/f4b [0,4194304] 0 2024-03-28T13:11:33.743 INFO:tasks.workunit.client.0.smithi076.stdout:1/950: dread - d14/d19/d85/dc3/f13e zero size 2024-03-28T13:11:33.743 INFO:tasks.workunit.client.0.smithi076.stdout:1/951: dread - d14/d19/d85/d2e/d31/d51/d92/da4/dfb/d143/d9e/f10c zero size 2024-03-28T13:11:33.764 INFO:tasks.workunit.client.0.smithi076.stdout:3/928: mknod d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d3a/df6/c148 0 2024-03-28T13:11:33.898 INFO:tasks.workunit.client.0.smithi076.stdout:1/952: creat d14/d19/d20/dd7/d139/f144 x:0 0 0 2024-03-28T13:11:33.905 INFO:tasks.workunit.client.0.smithi076.stdout:1/953: write fc [94103,84681] 0 2024-03-28T13:11:33.930 INFO:tasks.workunit.client.0.smithi076.stdout:3/929: dwrite d1/d7/d30/d5f/f9d [0,4194304] 0 2024-03-28T13:11:33.931 INFO:tasks.workunit.client.0.smithi076.stdout:3/930: dread - d1/d7/d30/d38/d14/d4a/ddc/ded/df3/f123 zero size 2024-03-28T13:11:33.931 INFO:tasks.workunit.client.0.smithi076.stdout:1/954: dwrite d14/f6b [0,4194304] 0 2024-03-28T13:11:34.106 INFO:tasks.workunit.client.0.smithi076.stdout:3/931: mknod d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d8f/c149 0 2024-03-28T13:11:34.154 INFO:tasks.workunit.client.0.smithi076.stdout:1/955: mkdir d14/d19/d85/dd6/d145 0 2024-03-28T13:11:34.154 INFO:tasks.workunit.client.0.smithi076.stdout:1/956: chown d14/d19/d20/f29 1 1 2024-03-28T13:11:34.175 INFO:tasks.workunit.client.0.smithi076.stdout:3/932: dread d1/d7/f78 [0,4194304] 0 2024-03-28T13:11:34.175 INFO:tasks.workunit.client.0.smithi076.stdout:3/933: truncate d1/f63 4510160 0 2024-03-28T13:11:34.175 INFO:tasks.workunit.client.0.smithi076.stdout:3/934: stat d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/lb4 0 2024-03-28T13:11:34.181 INFO:tasks.workunit.client.0.smithi076.stdout:1/957: dwrite d14/d19/d85/d2e/d31/d51/f114 [0,4194304] 0 2024-03-28T13:11:34.182 INFO:tasks.workunit.client.0.smithi076.stdout:1/958: chown d14/d19/d85/d2e/d3c/d7e/d131/f13c 154611 1 2024-03-28T13:11:34.218 INFO:tasks.workunit.client.0.smithi076.stdout:1/959: dwrite f8 [0,4194304] 0 2024-03-28T13:11:34.218 INFO:tasks.workunit.client.0.smithi076.stdout:1/960: chown d14/d19/d85/d2e/d31/d51/d92/da4/dfb/f100 25687936 1 2024-03-28T13:11:34.367 INFO:tasks.workunit.client.0.smithi076.stdout:3/935: creat d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d8f/f14a x:0 0 0 2024-03-28T13:11:34.367 INFO:tasks.workunit.client.0.smithi076.stdout:3/936: stat d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/l4b 0 2024-03-28T13:11:34.394 INFO:tasks.workunit.client.0.smithi076.stdout:3/937: dwrite d1/d7/d30/d38/d14/d4a/d66/fa8 [0,4194304] 0 2024-03-28T13:11:34.470 INFO:tasks.workunit.client.0.smithi076.stdout:1/961: creat d14/d19/d85/d2e/d31/d8f/f146 x:0 0 0 2024-03-28T13:11:34.513 INFO:tasks.workunit.client.0.smithi076.stdout:3/938: mknod d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d93/dd4/c14b 0 2024-03-28T13:11:34.560 INFO:tasks.workunit.client.0.smithi076.stdout:1/962: read f5 [3282121,3812] 0 2024-03-28T13:11:34.560 INFO:tasks.workunit.client.0.smithi076.stdout:1/963: getdents d14/d19/d85/d2e/d31/d51/d92/da4/db5/d123 0 2024-03-28T13:11:34.615 INFO:tasks.workunit.client.0.smithi076.stdout:1/964: dwrite d14/d19/d85/d2e/d3c/f10f [0,4194304] 0 2024-03-28T13:11:34.615 INFO:tasks.workunit.client.0.smithi076.stdout:1/965: fsync d14/d19/d85/d2e/d31/d3b/f55 0 2024-03-28T13:11:34.615 INFO:tasks.workunit.client.0.smithi076.stdout:1/966: readlink d14/d19/d85/d2e/d3c/d7e/d128/l106 0 2024-03-28T13:11:34.736 INFO:tasks.workunit.client.0.smithi076.stdout:1/967: rename d14/d19/d85/d2e/d31/d51/d92/da4/db7/dc8/le2 to d14/d19/d85/d2e/d31/d51/d92/da4/db5/d123/l147 0 2024-03-28T13:11:34.739 INFO:tasks.workunit.client.0.smithi076.stdout:3/939: mknod d1/d7/d30/d38/d14/d27/d42/d122/c14c 0 2024-03-28T13:11:34.787 INFO:tasks.workunit.client.0.smithi076.stdout:1/968: mknod d14/d6c/c148 0 2024-03-28T13:11:34.787 INFO:tasks.workunit.client.0.smithi076.stdout:1/969: truncate d14/d19/d85/d2e/d31/d8f/d102/f12f 682656 0 2024-03-28T13:11:34.787 INFO:tasks.workunit.client.0.smithi076.stdout:1/970: stat d14/la1 0 2024-03-28T13:11:34.788 INFO:tasks.workunit.client.0.smithi076.stdout:1/971: dread - d14/d19/d85/d2e/d31/d51/d92/fbb zero size 2024-03-28T13:11:35.109 INFO:tasks.workunit.client.0.smithi076.stdout:1/972: creat d14/d19/d85/dc3/f149 x:0 0 0 2024-03-28T13:11:35.109 INFO:tasks.workunit.client.0.smithi076.stdout:1/973: readlink d14/l28 0 2024-03-28T13:11:35.161 INFO:tasks.workunit.client.0.smithi076.stdout:1/974: link d14/d19/d85/d2e/d31/d51/d92/da4/dfb/d143/f95 d14/d19/d85/d2e/d31/d8f/d102/f14a 0 2024-03-28T13:11:35.161 INFO:tasks.workunit.client.0.smithi076.stdout:1/975: write d14/f26 [1201296,70893] 0 2024-03-28T13:11:35.454 INFO:tasks.workunit.client.0.smithi076.stdout:3/940: write d1/d7/d30/d38/d14/d36/d56/fd7 [1181551,129567] 0 2024-03-28T13:11:36.037 INFO:tasks.workunit.client.0.smithi076.stdout:3/941: unlink d1/d7/d30/d38/d14/d4a/d66/f6a 0 2024-03-28T13:11:36.038 INFO:tasks.workunit.client.0.smithi076.stdout:1/976: rmdir d14/d19/d85/d2e/d3c/d7e 39 2024-03-28T13:11:36.119 INFO:tasks.workunit.client.0.smithi076.stdout:3/942: rename d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d58/la0 to d1/d7/d30/d38/d14/d97/l14d 0 2024-03-28T13:11:36.129 INFO:tasks.workunit.client.0.smithi076.stdout:1/977: dread d14/d19/d85/d2e/d31/d51/d92/da4/dfb/d143/fd3 [0,4194304] 0 2024-03-28T13:11:36.129 INFO:tasks.workunit.client.0.smithi076.stdout:1/978: getdents d14/d19/d85/d2e/d31/d51/d92/da4/db7/dc8/d118 0 2024-03-28T13:11:36.150 INFO:tasks.workunit.client.0.smithi076.stdout:3/943: dwrite d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d74/db5/dfc/f11a [4194304,4194304] 0 2024-03-28T13:11:36.408 INFO:tasks.workunit.client.0.smithi076.stdout:1/979: dread d14/d19/d85/d2e/d3c/d7e/fcc [0,4194304] 0 2024-03-28T13:11:36.470 INFO:tasks.workunit.client.0.smithi076.stdout:3/944: rename d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d3a/df6/f139 to d1/d7/d30/d38/d14/f14e 0 2024-03-28T13:11:36.675 INFO:tasks.workunit.client.0.smithi076.stdout:1/980: rename d14/d19/d85/d2e/d31/d3b/f43 to d14/d19/d85/d62/f14b 0 2024-03-28T13:11:36.698 INFO:tasks.workunit.client.0.smithi076.stdout:1/981: read d14/d19/d85/d2e/fce [97944,29293] 0 2024-03-28T13:11:36.720 INFO:tasks.workunit.client.0.smithi076.stdout:1/982: write d14/d19/d85/d2e/d31/d49/f64 [5379,77432] 0 2024-03-28T13:11:36.720 INFO:tasks.workunit.client.0.smithi076.stdout:1/983: write d14/d19/d85/d2e/d31/d8f/ffd [1210358,50558] 0 2024-03-28T13:11:36.720 INFO:tasks.workunit.client.0.smithi076.stdout:1/984: fsync d14/d19/d85/d2e/d31/d3b/f3d 0 2024-03-28T13:11:36.969 INFO:tasks.workunit.client.0.smithi076.stdout:1/985: truncate d14/d19/d85/d2e/d31/d49/f7a 501557 0 2024-03-28T13:11:36.969 INFO:tasks.workunit.client.0.smithi076.stdout:1/986: chown d14/cf6 2 1 2024-03-28T13:11:37.149 INFO:tasks.workunit.client.0.smithi076.stdout:3/945: sync 2024-03-28T13:11:37.149 INFO:tasks.workunit.client.0.smithi076.stdout:3/946: truncate d1/d2/fe0 830435 0 2024-03-28T13:11:37.178 INFO:tasks.workunit.client.0.smithi076.stdout:3/947: dwrite d1/d7/d30/d38/fad [0,4194304] 0 2024-03-28T13:11:37.202 INFO:tasks.workunit.client.0.smithi076.stdout:1/987: creat d14/d19/f14c x:0 0 0 2024-03-28T13:11:37.294 INFO:tasks.workunit.client.0.smithi076.stdout:3/948: stat d1/d7/d30/d81 0 2024-03-28T13:11:37.294 INFO:tasks.workunit.client.0.smithi076.stdout:1/988: dread - d14/d19/d85/d2e/d3c/d7e/d128/f54 zero size 2024-03-28T13:11:37.294 INFO:tasks.workunit.client.0.smithi076.stdout:1/989: chown d14/d19/d85/d2e/d31/d51/d92/da4/dfb/d143/fb4 215 1 2024-03-28T13:11:37.294 INFO:tasks.workunit.client.0.smithi076.stdout:1/990: fsync d14/d19/d85/d2e/d3c/d7e/d128/f54 0 2024-03-28T13:11:37.294 INFO:tasks.workunit.client.0.smithi076.stdout:1/991: fsync d14/d19/d85/d2e/d31/d8f/dde/fee 0 2024-03-28T13:11:37.294 INFO:tasks.workunit.client.0.smithi076.stdout:1/992: dread - d14/d19/f14c zero size 2024-03-28T13:11:37.294 INFO:tasks.workunit.client.0.smithi076.stdout:1/993: stat d14/d19/d85/d2e/d3c/d7e/d128/l10a 0 2024-03-28T13:11:37.436 INFO:tasks.workunit.client.0.smithi076.stdout:3/949: rename d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d3a/c6c to d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/c14f 0 2024-03-28T13:11:37.439 INFO:tasks.workunit.client.0.smithi076.stdout:1/994: dread d14/d19/d85/d2e/d31/d8f/ff9 [0,4194304] 0 2024-03-28T13:11:37.441 INFO:tasks.workunit.client.0.smithi076.stdout:1/995: dread d14/d19/d85/d2e/d31/d8f/ff9 [0,4194304] 0 2024-03-28T13:11:37.493 INFO:tasks.workunit.client.0.smithi076.stdout:3/950: mknod d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d8f/d11e/c150 0 2024-03-28T13:11:37.504 INFO:tasks.workunit.client.0.smithi076.stdout:3/951: dread d1/d7/d30/d38/d14/d36/f16 [0,4194304] 0 2024-03-28T13:11:37.509 INFO:tasks.workunit.client.0.smithi076.stdout:3/952: dread d1/d7/d30/d38/d14/d97/fa5 [0,4194304] 0 2024-03-28T13:11:37.524 INFO:tasks.workunit.client.0.smithi076.stdout:1/996: getdents d14/d19/d20/dd7/d139 0 2024-03-28T13:11:37.633 INFO:tasks.workunit.client.0.smithi076.stdout:1/997: fsync d14/d19/d85/d2e/d31/d49/f7a 0 2024-03-28T13:11:37.633 INFO:tasks.workunit.client.0.smithi076.stdout:1/998: chown d14/d19/d85/d2e/d3c/c86 26 1 2024-03-28T13:11:37.635 INFO:tasks.workunit.client.0.smithi076.stdout:3/953: creat d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d8f/d11e/f151 x:0 0 0 2024-03-28T13:11:37.648 INFO:tasks.workunit.client.0.smithi076.stdout:1/999: write d14/d19/d85/d2e/d31/d51/f70 [2329539,98046] 0 2024-03-28T13:11:37.765 INFO:tasks.workunit.client.0.smithi076.stdout:3/954: mkdir d1/d7/d30/d81/d152 0 2024-03-28T13:11:37.765 INFO:tasks.workunit.client.0.smithi076.stdout:3/955: fdatasync d1/d7/d30/d38/d14/d36/d56/fd7 0 2024-03-28T13:11:37.765 INFO:tasks.workunit.client.0.smithi076.stdout:3/956: chown d1/d7/d30/d38/d14/d4a/d66 4 1 2024-03-28T13:11:37.819 INFO:tasks.workunit.client.0.smithi076.stdout:3/957: dwrite d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d74/db5/dfc/f104 [0,4194304] 0 2024-03-28T13:11:37.819 INFO:tasks.workunit.client.0.smithi076.stdout:3/958: readlink d1/d2/l13 0 2024-03-28T13:11:37.824 INFO:tasks.workunit.client.0.smithi076.stdout:3/959: dread d1/d2/fcb [0,4194304] 0 2024-03-28T13:11:37.902 INFO:tasks.workunit.client.0.smithi076.stdout:3/960: creat d1/d7/d30/d5f/df9/f153 x:0 0 0 2024-03-28T13:11:37.956 INFO:tasks.workunit.client.0.smithi076.stdout:3/961: creat d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/f154 x:0 0 0 2024-03-28T13:11:38.178 INFO:tasks.workunit.client.0.smithi076.stdout:3/962: sync 2024-03-28T13:11:38.208 INFO:tasks.workunit.client.0.smithi076.stdout:3/963: getdents d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d3a 0 2024-03-28T13:11:38.292 INFO:tasks.workunit.client.0.smithi076.stdout:3/964: creat d1/d7/d30/d38/d14/d97/f155 x:0 0 0 2024-03-28T13:11:38.292 INFO:tasks.workunit.client.0.smithi076.stdout:3/965: chown d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/dd3 398473265 1 2024-03-28T13:11:38.382 INFO:tasks.workunit.client.0.smithi076.stdout:3/966: rename d1/d7/d30/d60/f88 to d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d74/f156 0 2024-03-28T13:11:38.433 INFO:tasks.workunit.client.0.smithi076.stdout:3/967: rename d1/d7/d30/d81 to d1/d7/d30/d38/d14/d36/d157 0 2024-03-28T13:11:38.481 INFO:tasks.workunit.client.0.smithi076.stdout:3/968: symlink d1/d7/d30/d38/d14/d4a/ddc/ded/d119/l158 0 2024-03-28T13:11:38.481 INFO:tasks.workunit.client.0.smithi076.stdout:3/969: write d1/d7/d30/d38/d14/d27/d146/fe8 [641698,56949] 0 2024-03-28T13:11:38.483 INFO:tasks.workunit.client.0.smithi076.stdout:3/970: write d1/d7/d30/d71/ff1 [15297,23232] 0 2024-03-28T13:11:38.483 INFO:tasks.workunit.client.0.smithi076.stdout:3/971: chown d1/d7/d30/d38/d14/d4a/ddc/d10e/l111 4112196 1 2024-03-28T13:11:38.483 INFO:tasks.workunit.client.0.smithi076.stdout:3/972: write d1/d7/d30/d38/d14/d4a/ddc/f112 [80357,121065] 0 2024-03-28T13:11:38.526 INFO:tasks.workunit.client.0.smithi076.stdout:3/973: truncate d1/f63 648068 0 2024-03-28T13:11:38.571 INFO:tasks.workunit.client.0.smithi076.stdout:3/974: rmdir d1/d7/d30/d38/d14/d36/d56 39 2024-03-28T13:11:38.630 INFO:tasks.workunit.client.0.smithi076.stdout:3/975: mknod d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/c159 0 2024-03-28T13:11:38.710 INFO:tasks.workunit.client.0.smithi076.stdout:3/976: dwrite d1/d7/d30/d38/d14/d36/d56/f9a [0,4194304] 0 2024-03-28T13:11:38.711 INFO:tasks.workunit.client.0.smithi076.stdout:3/977: write d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d93/dd4/fdf [677978,51466] 0 2024-03-28T13:11:39.061 INFO:tasks.workunit.client.0.smithi076.stdout:3/978: dwrite d1/d7/d30/d38/d14/f8e [0,4194304] 0 2024-03-28T13:11:39.145 INFO:tasks.workunit.client.0.smithi076.stdout:3/979: mkdir d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d93/dd4/d15a 0 2024-03-28T13:11:39.145 INFO:tasks.workunit.client.0.smithi076.stdout:3/980: fdatasync d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d74/db5/dfc/f104 0 2024-03-28T13:11:39.209 INFO:tasks.workunit.client.0.smithi076.stdout:3/981: dwrite d1/d7/d30/d38/d14/d27/f7e [4194304,4194304] 0 2024-03-28T13:11:39.209 INFO:tasks.workunit.client.0.smithi076.stdout:3/982: truncate d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d74/db5/dfc/f104 4963170 0 2024-03-28T13:11:39.258 INFO:tasks.workunit.client.0.smithi076.stdout:3/983: creat d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d93/dd4/f15b x:0 0 0 2024-03-28T13:11:39.285 INFO:tasks.workunit.client.0.smithi076.stdout:3/984: dwrite d1/d7/d30/d60/f91 [0,4194304] 0 2024-03-28T13:11:39.317 INFO:tasks.workunit.client.0.smithi076.stdout:3/985: dwrite d1/d7/d30/d38/d14/d27/dc7/f12e [0,4194304] 0 2024-03-28T13:11:39.435 INFO:tasks.workunit.client.0.smithi076.stdout:3/986: creat d1/d7/d30/d38/d14/d36/d157/f15c x:0 0 0 2024-03-28T13:11:39.534 INFO:tasks.workunit.client.0.smithi076.stdout:3/987: unlink d1/le9 0 2024-03-28T13:11:39.550 INFO:tasks.workunit.client.0.smithi076.stdout:3/988: dread d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/f82 [0,4194304] 0 2024-03-28T13:11:39.550 INFO:tasks.workunit.client.0.smithi076.stdout:3/989: write d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/f82 [3979540,69665] 0 2024-03-28T13:11:39.590 INFO:tasks.workunit.client.0.smithi076.stdout:3/990: truncate d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/f83 665081 0 2024-03-28T13:11:39.679 INFO:tasks.workunit.client.0.smithi076.stdout:3/991: link d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d8d/d3a/df6/c12d d1/d7/d30/d38/c15d 0 2024-03-28T13:11:39.705 INFO:tasks.workunit.client.0.smithi076.stdout:3/992: truncate d1/f92 1100417 0 2024-03-28T13:11:39.756 INFO:tasks.workunit.client.0.smithi076.stdout:3/993: creat d1/d7/d30/d38/d9b/d120/f15e x:0 0 0 2024-03-28T13:11:40.782 INFO:tasks.workunit.client.0.smithi076.stdout:3/994: sync 2024-03-28T13:11:40.786 INFO:tasks.workunit.client.0.smithi076.stdout:3/995: dread d1/d7/d30/d38/d14/d97/fa5 [0,4194304] 0 2024-03-28T13:11:41.068 INFO:tasks.workunit.client.0.smithi076.stdout:3/996: creat d1/d7/d30/d38/d14/d4a/ddc/d10e/d133/d6d/d74/f15f x:0 0 0 2024-03-28T13:11:41.148 INFO:tasks.workunit.client.0.smithi076.stdout:3/997: rename d1/d7/d30/d38/d14/d4a/ddc/ded/df3/c141 to d1/d7/d30/d38/d14/d4a/ddc/ded/df3/c160 0 2024-03-28T13:11:41.168 INFO:tasks.workunit.client.0.smithi076.stdout:3/998: dwrite d1/d7/d30/d38/d14/d36/f57 [0,4194304] 0 2024-03-28T13:11:41.347 INFO:tasks.workunit.client.0.smithi076.stdout:3/999: rmdir d1/d7/d30/d38/d14/d4a/ddc/d10e/d13a 0 2024-03-28T13:11:41.431 INFO:tasks.workunit.client.0.smithi076.stderr:+ rm -rf -- ./tmp.TaPi7Wcq54 2024-03-28T13:11:43.524 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:11:43.528 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:12:13.584 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:12:13.589 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:12:43.810 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:12:43.814 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:13:14.029 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:13:14.036 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:13:28.839 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:32:46.025 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:13:28.848 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:32:46.034 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:13:28.898 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:32:46.012 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:13:28.898 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:32:46.013 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:13:28.902 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:32:46.017 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:13:28.903 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:32:46.018 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:13:28.965 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:32:46.151 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:13:29.019 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:32:46.134 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:13:29.043 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:32:46.159 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:13:44.121 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:13:44.126 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:13:55.214 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:33:12.400 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:13:55.218 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:33:12.403 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:13:55.247 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:33:12.433 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:13:55.271 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:33:12.386 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:13:55.360 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:33:12.473 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:13:55.360 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:33:12.475 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:13:55.364 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:33:12.478 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:13:55.408 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:33:12.522 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:13:55.469 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:33:12.584 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:14:14.376 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:14:14.380 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:14:44.431 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:14:44.436 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:15:14.563 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:15:14.567 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:15:44.618 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:15:44.622 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:16:14.733 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:16:14.736 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:16:44.864 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:16:44.869 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:17:14.927 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:17:14.931 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:17:24.393 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:36:41.578 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:17:24.399 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:36:41.585 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:17:24.426 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:36:41.540 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:17:24.427 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:36:41.542 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:17:24.430 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:36:41.543 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:17:24.433 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:36:41.547 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:17:24.504 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:36:41.689 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:17:24.544 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:36:41.659 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:17:24.545 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:36:41.658 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:17:45.283 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:17:45.287 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:18:15.338 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:18:15.342 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:18:45.479 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:18:45.483 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:19:15.550 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:19:15.554 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:19:45.617 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:19:45.622 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:20:15.681 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:20:15.686 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:20:45.737 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:20:45.741 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:21:15.804 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:21:15.808 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:21:29.519 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:40:46.703 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:21:29.524 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:40:46.709 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:21:29.554 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:40:46.668 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:21:29.558 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:40:46.672 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:21:29.568 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:40:46.683 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:21:29.572 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:40:46.687 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:21:29.634 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:40:46.819 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:21:29.668 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:40:46.782 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:21:29.680 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:40:46.795 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:21:45.859 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:21:45.864 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:21:47.185 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:41:04.370 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:21:47.239 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:41:04.423 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:21:47.271 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:41:04.386 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:21:47.274 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:41:04.459 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:21:47.275 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:41:04.390 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:21:47.310 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:41:04.425 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:21:47.330 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:41:04.443 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:21:47.336 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:41:04.449 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:21:47.371 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:41:04.485 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:22:15.916 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:22:15.920 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:22:45.972 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:22:45.975 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:23:16.028 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:23:16.032 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:23:42.724 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:42:59.908 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:23:42.730 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:42:59.915 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:23:42.795 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:42:59.979 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:23:42.809 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:42:59.924 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:23:42.821 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:42:59.935 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:23:42.832 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:42:59.946 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:23:42.842 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:42:59.956 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:23:42.881 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:42:59.996 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:23:42.952 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:43:00.065 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:23:46.085 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:23:46.089 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:23:50.664 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-28T13:23:50.664 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-28T13:24:16.259 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:24:16.263 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:24:46.335 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:24:46.339 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:25:16.387 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:25:16.392 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:25:35.562 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:44:52.745 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:25:35.567 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:44:52.751 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:25:35.595 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:44:52.708 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:25:35.596 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:44:52.710 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:25:35.600 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:44:52.714 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:25:35.629 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:44:52.743 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:25:35.644 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:44:52.828 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:25:35.689 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:44:52.802 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:25:35.712 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:44:52.826 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:25:46.513 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:25:46.517 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:26:16.561 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:26:16.565 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:26:46.633 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:26:46.637 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:27:16.713 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:27:16.718 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:27:46.981 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:27:46.985 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:28:17.024 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:28:17.028 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:28:47.138 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:28:47.142 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:29:17.201 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:29:17.206 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:29:44.636 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:49:01.820 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:29:44.644 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:49:01.828 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:29:44.652 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:49:01.766 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:29:44.654 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:49:01.768 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:29:44.668 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:49:01.781 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:29:44.671 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:49:01.784 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:29:44.757 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:49:01.941 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:29:44.805 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:49:01.919 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:29:44.805 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:49:01.918 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:29:47.348 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:29:47.352 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:30:17.395 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:30:17.399 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:30:47.502 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:30:47.506 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:31:17.568 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:31:17.573 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:31:47.671 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:31:47.675 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:32:04.403 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:51:21.587 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:32:04.413 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:51:21.598 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:32:04.469 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:51:21.654 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:32:04.572 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:51:21.685 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:32:04.574 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:51:21.687 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:32:04.575 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:51:21.690 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:32:04.577 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:51:21.691 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:32:04.631 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:51:21.744 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:32:04.634 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:51:21.749 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:32:17.718 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:32:17.725 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:32:47.780 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:32:47.784 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:33:17.840 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:33:17.844 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:33:47.986 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:33:47.991 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:33:51.514 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:53:08.698 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:33:51.526 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:53:08.710 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:33:51.539 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:53:08.653 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:33:51.541 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:53:08.654 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:33:51.542 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:53:08.657 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:33:51.544 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:53:08.657 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:33:51.599 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:53:08.783 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:33:51.627 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:53:08.741 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:33:51.641 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:53:08.754 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:34:18.058 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:34:18.062 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:34:48.124 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:34:48.128 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:35:18.268 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:35:18.273 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:35:48.395 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:35:48.399 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:36:18.469 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:36:18.473 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:36:48.599 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:36:48.604 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:37:18.673 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:37:18.678 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:37:48.980 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:37:48.984 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:37:59.516 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:57:16.699 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:37:59.522 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:57:16.706 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:37:59.547 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:57:16.660 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:37:59.548 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:57:16.662 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:37:59.550 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:57:16.663 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:37:59.552 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:57:16.667 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:37:59.654 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:57:16.837 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:37:59.669 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:57:16.783 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:37:59.680 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:57:16.793 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:38:19.027 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:38:19.032 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:38:30.677 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:57:47.861 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:38:30.686 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:57:47.870 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:38:30.731 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:57:47.915 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:38:30.796 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:57:47.910 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:38:30.799 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:57:47.912 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:38:30.799 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:57:47.912 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:38:30.801 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:57:47.914 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:38:30.829 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:57:47.942 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:38:30.833 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:57:47.947 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:38:49.117 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:38:49.122 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:39:19.249 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:39:19.253 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:39:49.422 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:39:49.426 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:40:19.478 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:40:19.482 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:40:26.071 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:59:43.254 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:40:26.081 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:59:43.263 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:40:26.126 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:00:59:43.309 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:40:26.207 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:59:43.320 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:40:26.214 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:59:43.327 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:40:26.215 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:59:43.328 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:40:26.222 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:59:43.336 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:40:26.275 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:00:59:43.387 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:40:26.286 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:00:59:43.400 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:40:49.591 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:40:49.596 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:41:19.942 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:41:19.946 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:41:49.999 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:41:50.003 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:42:05.342 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:01:01:22.525 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:42:05.350 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:01:01:22.534 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:42:05.373 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:01:01:22.486 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:42:05.376 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:01:01:22.490 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:42:05.380 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:01:01:22.493 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:42:05.381 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:01:01:22.494 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:42:05.421 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:01:01:22.605 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:42:05.462 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:01:01:22.575 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:42:05.465 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:01:01:22.578 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:42:20.348 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:42:20.352 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:42:50.570 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:42:50.574 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:43:20.767 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:43:20.772 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:43:50.899 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:43:50.904 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:44:21.170 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:44:21.173 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:44:51.376 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:44:51.381 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:45:21.435 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:45:21.439 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:45:51.501 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:45:51.505 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:46:14.683 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:01:05:31.866 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:46:14.688 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:01:05:31.872 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:46:14.707 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:01:05:31.819 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:46:14.709 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:01:05:31.822 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:46:14.710 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:01:05:31.823 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:46:14.712 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:01:05:31.826 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:46:14.822 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:01:05:31.935 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:46:14.838 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:01:05:31.951 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:46:14.840 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:01:05:32.023 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:46:21.676 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:46:21.680 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:46:51.730 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:46:51.735 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:46:52.215 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:01:06:09.399 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:46:52.217 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:01:06:09.401 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:46:52.275 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:01:06:09.458 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:46:52.327 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:01:06:09.440 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:46:52.337 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:01:06:09.450 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:46:52.343 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:01:06:09.456 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:46:52.347 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:01:06:09.460 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:46:52.375 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:01:06:09.489 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:46:52.383 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:01:06:09.496 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:47:21.844 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:47:21.849 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:47:52.124 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:47:52.128 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:48:22.230 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:48:22.235 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:48:47.732 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:01:08:04.915 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:48:47.738 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:01:08:04.921 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:48:47.790 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:01:08:04.973 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:48:47.847 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:01:08:04.960 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:48:47.851 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:01:08:04.963 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:48:47.858 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:01:08:04.972 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:48:47.868 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:01:08:04.981 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:48:47.899 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:01:08:05.012 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:48:47.919 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:01:08:05.033 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:48:52.361 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:48:52.366 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:49:22.432 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:49:22.436 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:49:52.580 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:49:52.583 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:50:16.022 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-03-28T13:50:16.022 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-28T13:50:17.031 DEBUG:teuthology.parallel:result is None 2024-03-28T13:50:17.031 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-28T13:50:17.349 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-28T13:50:17.349 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-28T13:50:17.359 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-28T13:50:17.359 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T13:50:17.359 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T13:50:17.368 DEBUG:teuthology.orchestra.run.smithi076:> set -ex 2024-03-28T13:50:17.368 DEBUG:teuthology.orchestra.run.smithi076:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-28T13:50:17.426 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T13:50:17.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.615+0000 7f6268800640 1 Processor -- start 2024-03-28T13:50:17.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.615+0000 7f6268800640 1 -- start start 2024-03-28T13:50:17.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.615+0000 7f6268800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f626014f3f0 0x7f62600c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:17.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.615+0000 7f6268800640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62600c8070 con 0x7f6260073990 2024-03-28T13:50:17.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.615+0000 7f6268800640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f626014f7d0 con 0x7f62600c7c00 2024-03-28T13:50:17.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.615+0000 7f6268800640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f62600c7230 con 0x7f626014f3f0 2024-03-28T13:50:17.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.615+0000 7f6265400640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f6260073990 0x7f62600c5f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:36950/0 (socket says 172.21.15.76:36950) 2024-03-28T13:50:17.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.615+0000 7f6265400640 1 -- 172.21.15.76:0/4293884329 learned_addr learned my addr 172.21.15.76:0/4293884329 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:50:17.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.619+0000 7f6265e00640 1 --2- 172.21.15.76:0/4293884329 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f626014f3f0 0x7f62600c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:17.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.623+0000 7f6264a00640 1 -- 172.21.15.76:0/4293884329 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3559930549 0 0) 0x7f62600c8070 con 0x7f6260073990 2024-03-28T13:50:17.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.623+0000 7f6264a00640 1 -- 172.21.15.76:0/4293884329 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6248003530 con 0x7f6260073990 2024-03-28T13:50:17.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.623+0000 7f6264a00640 1 -- 172.21.15.76:0/4293884329 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 303666117 0 0) 0x7f626014f7d0 con 0x7f62600c7c00 2024-03-28T13:50:17.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.623+0000 7f6264a00640 1 -- 172.21.15.76:0/4293884329 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62600c8070 con 0x7f62600c7c00 2024-03-28T13:50:17.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.623+0000 7f6265e00640 1 -- 172.21.15.76:0/4293884329 >> v1:172.21.15.111:6789/0 conn(0x7f62600c7c00 legacy=0x7f6260163020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:17.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.623+0000 7f6265e00640 1 -- 172.21.15.76:0/4293884329 >> v1:172.21.15.76:6789/0 conn(0x7f6260073990 legacy=0x7f62600c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:17.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.623+0000 7f6265e00640 1 -- 172.21.15.76:0/4293884329 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62600c9ec0 con 0x7f626014f3f0 2024-03-28T13:50:17.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.635+0000 7f6265e00640 1 --2- 172.21.15.76:0/4293884329 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f626014f3f0 0x7f62600c76c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f62540097f0 tx=0x7f625401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6e870d850f3377c server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:17.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.643+0000 7f6264a00640 1 -- 172.21.15.76:0/4293884329 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62540b0070 con 0x7f626014f3f0 2024-03-28T13:50:17.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.643+0000 7f6264a00640 1 -- 172.21.15.76:0/4293884329 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62540a4e50 con 0x7f626014f3f0 2024-03-28T13:50:17.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.643+0000 7f6264a00640 1 -- 172.21.15.76:0/4293884329 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62540ab820 con 0x7f626014f3f0 2024-03-28T13:50:17.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.643+0000 7f6268800640 1 -- 172.21.15.76:0/4293884329 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f626014f3f0 msgr2=0x7f62600c76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:17.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.643+0000 7f6268800640 1 --2- 172.21.15.76:0/4293884329 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f626014f3f0 0x7f62600c76c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f62540097f0 tx=0x7f625401c3c0 comp rx=0 tx=0).stop 2024-03-28T13:50:17.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.643+0000 7f6268800640 1 -- 172.21.15.76:0/4293884329 shutdown_connections 2024-03-28T13:50:17.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.643+0000 7f6268800640 1 --2- 172.21.15.76:0/4293884329 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f626014f3f0 0x7f62600c76c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:17.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.643+0000 7f6268800640 1 -- 172.21.15.76:0/4293884329 >> 172.21.15.76:0/4293884329 conn(0x7f62600c9330 msgr2=0x7f62600c9710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:17.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.643+0000 7f6268800640 1 -- 172.21.15.76:0/4293884329 shutdown_connections 2024-03-28T13:50:17.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.643+0000 7f6268800640 1 -- 172.21.15.76:0/4293884329 wait complete. 2024-03-28T13:50:17.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.647+0000 7f6268800640 1 Processor -- start 2024-03-28T13:50:17.645 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.647+0000 7f6268800640 1 -- start start 2024-03-28T13:50:17.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.647+0000 7f6268800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6260073990 0x7f6260155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:17.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.647+0000 7f6268800640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62600c7c00 0x7f6260153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:17.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.647+0000 7f6268800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f626014f3f0 0x7f6260146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:17.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.647+0000 7f6268800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f626006f580 con 0x7f6260073990 2024-03-28T13:50:17.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.647+0000 7f6268800640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6260067900 con 0x7f62600c7c00 2024-03-28T13:50:17.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.647+0000 7f6268800640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f626006cc70 con 0x7f626014f3f0 2024-03-28T13:50:17.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.647+0000 7f6265e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6260073990 0x7f6260155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:17.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.647+0000 7f6266800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f626014f3f0 0x7f6260146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:17.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.647+0000 7f6265e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6260073990 0x7f6260155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44306/0 (socket says 172.21.15.76:44306) 2024-03-28T13:50:17.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.647+0000 7f6265e00640 1 -- 172.21.15.76:0/1702018018 learned_addr learned my addr 172.21.15.76:0/1702018018 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:17.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.647+0000 7f6265400640 1 --2- 172.21.15.76:0/1702018018 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62600c7c00 0x7f6260153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:17.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.651+0000 7f6265e00640 1 -- 172.21.15.76:0/1702018018 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f626014f3f0 msgr2=0x7f6260146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:17.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.651+0000 7f6265e00640 1 --2- 172.21.15.76:0/1702018018 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f626014f3f0 0x7f6260146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:17.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.651+0000 7f6265e00640 1 -- 172.21.15.76:0/1702018018 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62600c7c00 msgr2=0x7f6260153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:17.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.651+0000 7f6265e00640 1 --2- 172.21.15.76:0/1702018018 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62600c7c00 0x7f6260153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:17.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.651+0000 7f6265e00640 1 -- 172.21.15.76:0/1702018018 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f626014e390 con 0x7f6260073990 2024-03-28T13:50:17.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.655+0000 7f6265e00640 1 --2- 172.21.15.76:0/1702018018 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6260073990 0x7f6260155450 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6254018fd0 tx=0x7f625401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:17.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.655+0000 7f625a000640 1 -- 172.21.15.76:0/1702018018 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62540b0050 con 0x7f6260073990 2024-03-28T13:50:17.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.655+0000 7f6268800640 1 -- 172.21.15.76:0/1702018018 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62601f7e00 con 0x7f6260073990 2024-03-28T13:50:17.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.655+0000 7f6268800640 1 -- 172.21.15.76:0/1702018018 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6260151650 con 0x7f6260073990 2024-03-28T13:50:17.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.659+0000 7f6268800640 1 -- 172.21.15.76:0/1702018018 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f626006cfc0 con 0x7f6260073990 2024-03-28T13:50:17.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.659+0000 7f625a000640 1 -- 172.21.15.76:0/1702018018 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62540bc070 con 0x7f6260073990 2024-03-28T13:50:17.658 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.659+0000 7f625a000640 1 -- 172.21.15.76:0/1702018018 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62540c1660 con 0x7f6260073990 2024-03-28T13:50:17.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.935+0000 7f625a000640 1 -- 172.21.15.76:0/1702018018 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f62540c1800 con 0x7f6260073990 2024-03-28T13:50:17.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.935+0000 7f625a000640 1 --2- 172.21.15.76:0/1702018018 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6244067fc0 0x7f624406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:17.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.935+0000 7f6265400640 1 --2- 172.21.15.76:0/1702018018 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6244067fc0 0x7f624406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:17.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.939+0000 7f6265400640 1 --2- 172.21.15.76:0/1702018018 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6244067fc0 0x7f624406a480 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f62600c9d40 tx=0x7f6250007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:17.950 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.951+0000 7f625a000640 1 -- 172.21.15.76:0/1702018018 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f62540ef540 con 0x7f6260073990 2024-03-28T13:50:17.951 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:17.951+0000 7f625a000640 1 -- 172.21.15.76:0/1702018018 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f62540160d0 con 0x7f6260073990 2024-03-28T13:50:18.148 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.147+0000 7f6268800640 1 -- 172.21.15.76:0/1702018018 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6260152a40 con 0x7f6260073990 2024-03-28T13:50:18.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.211+0000 7f625a000640 1 -- 172.21.15.76:0/1702018018 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18798 (secure 0 0 0) 0x7f62540f14a0 con 0x7f6260073990 2024-03-28T13:50:18.210 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T13:50:18.210 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":29,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:42:15.156639+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T12:41:58.010965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T12:41:59.698601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-28T12:42:05.363180+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.1","mappings":[{"from":3,"to":4}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]},{"pgid":"4.d","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":5}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T13:50:18.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.215+0000 7f6268800640 1 -- 172.21.15.76:0/1702018018 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6244067fc0 msgr2=0x7f624406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:18.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.215+0000 7f6268800640 1 --2- 172.21.15.76:0/1702018018 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6244067fc0 0x7f624406a480 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f62600c9d40 tx=0x7f6250007d40 comp rx=0 tx=0).stop 2024-03-28T13:50:18.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.215+0000 7f6268800640 1 -- 172.21.15.76:0/1702018018 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6260073990 msgr2=0x7f6260155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:18.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.215+0000 7f6268800640 1 --2- 172.21.15.76:0/1702018018 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6260073990 0x7f6260155450 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6254018fd0 tx=0x7f625401ac00 comp rx=0 tx=0).stop 2024-03-28T13:50:18.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.215+0000 7f6268800640 1 -- 172.21.15.76:0/1702018018 shutdown_connections 2024-03-28T13:50:18.213 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.215+0000 7f6268800640 1 --2- 172.21.15.76:0/1702018018 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6244067fc0 0x7f624406a480 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:18.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.215+0000 7f6268800640 1 --2- 172.21.15.76:0/1702018018 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f626014f3f0 0x7f6260146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:18.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.215+0000 7f6268800640 1 --2- 172.21.15.76:0/1702018018 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62600c7c00 0x7f6260153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:18.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.215+0000 7f6268800640 1 --2- 172.21.15.76:0/1702018018 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6260073990 0x7f6260155450 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:18.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.215+0000 7f6268800640 1 -- 172.21.15.76:0/1702018018 >> 172.21.15.76:0/1702018018 conn(0x7f62600c9330 msgr2=0x7f62600cb810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:18.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.215+0000 7f6268800640 1 -- 172.21.15.76:0/1702018018 shutdown_connections 2024-03-28T13:50:18.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.215+0000 7f6268800640 1 -- 172.21.15.76:0/1702018018 wait complete. 2024-03-28T13:50:18.236 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-28T12:41:23.389090+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-28T12:41:58.010965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-28T12:41:59.698601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-28T12:42:05.363180+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-28T13:50:18.237 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-28T13:50:18.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.431+0000 7f0657600640 1 Processor -- start 2024-03-28T13:50:18.431 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.431+0000 7f0657600640 1 -- start start 2024-03-28T13:50:18.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.435+0000 7f0657600640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f06500c9a70 0x7f06500c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:18.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.435+0000 7f0657600640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06500c3b10 con 0x7f0650070080 2024-03-28T13:50:18.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.435+0000 7f0657600640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06500c3db0 con 0x7f065006ee50 2024-03-28T13:50:18.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.435+0000 7f0657600640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f0650154e90 con 0x7f06500c9a70 2024-03-28T13:50:18.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.435+0000 7f064fe00640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f065006ee50 0x7f065015e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:34256/0 (socket says 172.21.15.76:34256) 2024-03-28T13:50:18.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.435+0000 7f064fe00640 1 -- 172.21.15.76:0/64489736 learned_addr learned my addr 172.21.15.76:0/64489736 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:50:18.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.435+0000 7f0654c00640 1 --2- 172.21.15.76:0/64489736 >> v2:172.21.15.76:3300/0 conn(0x7f06500c9a70 0x7f06500c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:18.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.439+0000 7f064f400640 1 -- 172.21.15.76:0/64489736 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178698787 0 0) 0x7f06500c3db0 con 0x7f065006ee50 2024-03-28T13:50:18.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.439+0000 7f064f400640 1 -- 172.21.15.76:0/64489736 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0638003530 con 0x7f065006ee50 2024-03-28T13:50:18.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.443+0000 7f0654c00640 1 -- 172.21.15.76:0/64489736 >> v1:172.21.15.111:6789/0 conn(0x7f065006ee50 legacy=0x7f065015e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:18.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.443+0000 7f0654c00640 1 -- 172.21.15.76:0/64489736 >> v1:172.21.15.76:6789/0 conn(0x7f0650070080 legacy=0x7f0650165380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:18.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.443+0000 7f0654c00640 1 -- 172.21.15.76:0/64489736 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065006f5e0 con 0x7f06500c9a70 2024-03-28T13:50:18.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.451+0000 7f0654c00640 1 --2- 172.21.15.76:0/64489736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f06500c9a70 0x7f06500c9e50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f06440097c0 tx=0x7f064401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6020e1629d05de4 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:18.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.459+0000 7f064f400640 1 -- 172.21.15.76:0/64489736 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06440b0070 con 0x7f06500c9a70 2024-03-28T13:50:18.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.459+0000 7f064f400640 1 -- 172.21.15.76:0/64489736 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06440ab600 con 0x7f06500c9a70 2024-03-28T13:50:18.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.459+0000 7f064f400640 1 -- 172.21.15.76:0/64489736 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06440ab9b0 con 0x7f06500c9a70 2024-03-28T13:50:18.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.463+0000 7f0657600640 1 -- 172.21.15.76:0/64489736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f06500c9a70 msgr2=0x7f06500c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:18.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.463+0000 7f0657600640 1 --2- 172.21.15.76:0/64489736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f06500c9a70 0x7f06500c9e50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f06440097c0 tx=0x7f064401c4a0 comp rx=0 tx=0).stop 2024-03-28T13:50:18.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.463+0000 7f0657600640 1 -- 172.21.15.76:0/64489736 shutdown_connections 2024-03-28T13:50:18.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.463+0000 7f0657600640 1 --2- 172.21.15.76:0/64489736 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f06500c9a70 0x7f06500c9e50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:18.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.463+0000 7f0657600640 1 -- 172.21.15.76:0/64489736 >> 172.21.15.76:0/64489736 conn(0x7f0650070ca0 msgr2=0x7f06500710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:18.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.463+0000 7f0657600640 1 -- 172.21.15.76:0/64489736 shutdown_connections 2024-03-28T13:50:18.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.463+0000 7f0657600640 1 -- 172.21.15.76:0/64489736 wait complete. 2024-03-28T13:50:18.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.463+0000 7f0657600640 1 Processor -- start 2024-03-28T13:50:18.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.463+0000 7f0657600640 1 -- start start 2024-03-28T13:50:18.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.463+0000 7f0657600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f065006ee50 0x7f0650155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:18.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.463+0000 7f0657600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0650070080 0x7f06500ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:18.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.463+0000 7f0657600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06500c9a70 0x7f06500ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:18.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.463+0000 7f0657600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f06500c81c0 con 0x7f0650070080 2024-03-28T13:50:18.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.463+0000 7f0657600640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f06500c8040 con 0x7f06500c9a70 2024-03-28T13:50:18.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.463+0000 7f0657600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f065015ecc0 con 0x7f065006ee50 2024-03-28T13:50:18.465 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.467+0000 7f0655600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06500c9a70 0x7f06500ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:18.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.467+0000 7f0655600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06500c9a70 0x7f06500ae830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:40392/0 (socket says 172.21.15.76:40392) 2024-03-28T13:50:18.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.467+0000 7f0655600640 1 -- 172.21.15.76:0/2084188768 learned_addr learned my addr 172.21.15.76:0/2084188768 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:18.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.467+0000 7f0654c00640 1 --2- 172.21.15.76:0/2084188768 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f065006ee50 0x7f0650155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:18.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.475+0000 7f0655600640 1 -- 172.21.15.76:0/2084188768 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f065006ee50 msgr2=0x7f0650155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:18.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.475+0000 7f0655600640 1 --2- 172.21.15.76:0/2084188768 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f065006ee50 0x7f0650155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:18.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.475+0000 7f0655600640 1 -- 172.21.15.76:0/2084188768 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0650070080 msgr2=0x7f06500ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:18.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.475+0000 7f0655600640 1 --2- 172.21.15.76:0/2084188768 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0650070080 0x7f06500ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:18.477 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.475+0000 7f0655600640 1 -- 172.21.15.76:0/2084188768 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06500b2290 con 0x7f06500c9a70 2024-03-28T13:50:18.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.483+0000 7f0655600640 1 --2- 172.21.15.76:0/2084188768 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06500c9a70 0x7f06500ae830 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f064800c740 tx=0x7f064800cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:18.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.531+0000 7f064cc00640 1 -- 172.21.15.76:0/2084188768 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0648016020 con 0x7f06500c9a70 2024-03-28T13:50:18.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.531+0000 7f064cc00640 1 -- 172.21.15.76:0/2084188768 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f064800ce50 con 0x7f06500c9a70 2024-03-28T13:50:18.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.531+0000 7f064cc00640 1 -- 172.21.15.76:0/2084188768 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0648003980 con 0x7f06500c9a70 2024-03-28T13:50:18.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.531+0000 7f0657600640 1 -- 172.21.15.76:0/2084188768 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06500b2570 con 0x7f06500c9a70 2024-03-28T13:50:18.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.531+0000 7f0657600640 1 -- 172.21.15.76:0/2084188768 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06500adaf0 con 0x7f06500c9a70 2024-03-28T13:50:18.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.531+0000 7f0657600640 1 -- 172.21.15.76:0/2084188768 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06500686e0 con 0x7f06500c9a70 2024-03-28T13:50:18.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.875+0000 7f064cc00640 1 -- 172.21.15.76:0/2084188768 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f0648003b20 con 0x7f06500c9a70 2024-03-28T13:50:18.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.879+0000 7f064cc00640 1 --2- 172.21.15.76:0/2084188768 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0630067fc0 0x7f063006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:18.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.879+0000 7f0654c00640 1 --2- 172.21.15.76:0/2084188768 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0630067fc0 0x7f063006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:18.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.879+0000 7f0654c00640 1 --2- 172.21.15.76:0/2084188768 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0630067fc0 0x7f063006a480 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f06440ad000 tx=0x7f06440a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:18.886 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.887+0000 7f064cc00640 1 -- 172.21.15.76:0/2084188768 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f0648055090 con 0x7f06500c9a70 2024-03-28T13:50:18.979 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:18.979+0000 7f064cc00640 1 -- 172.21.15.76:0/2084188768 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f0648020020 con 0x7f06500c9a70 2024-03-28T13:50:19.164 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:01:09:36.347 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:50:19.169 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:01:09:36.352 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:50:19.185 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:01:09:36.299 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:50:19.189 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:01:09:36.302 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:50:19.199 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:01:09:36.312 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:50:19.205 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:01:09:36.318 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:50:19.229 INFO:tasks.ceph.mon.a.smithi076.stderr:==00:01:09:36.413 27747== Warning: unimplemented fcntl command: 1036 2024-03-28T13:50:19.246 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.247+0000 7f0657600640 1 -- 172.21.15.76:0/2084188768 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f065006f320 con 0x7f06500c9a70 2024-03-28T13:50:19.281 INFO:tasks.ceph.mon.b.smithi111.stderr:==00:01:09:36.395 28157== Warning: unimplemented fcntl command: 1036 2024-03-28T13:50:19.304 INFO:tasks.ceph.mon.c.smithi111.stderr:==00:01:09:36.416 28158== Warning: unimplemented fcntl command: 1036 2024-03-28T13:50:19.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.731+0000 7f064cc00640 1 -- 172.21.15.76:0/2084188768 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f06480576f0 con 0x7f06500c9a70 2024-03-28T13:50:19.733 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 1 2024-03-28T13:50:19.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.735+0000 7f0657600640 1 -- 172.21.15.76:0/2084188768 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0630067fc0 msgr2=0x7f063006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:19.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.735+0000 7f0657600640 1 --2- 172.21.15.76:0/2084188768 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0630067fc0 0x7f063006a480 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f06440ad000 tx=0x7f06440a6000 comp rx=0 tx=0).stop 2024-03-28T13:50:19.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.735+0000 7f0657600640 1 -- 172.21.15.76:0/2084188768 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06500c9a70 msgr2=0x7f06500ae830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:19.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.735+0000 7f0657600640 1 --2- 172.21.15.76:0/2084188768 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06500c9a70 0x7f06500ae830 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f064800c740 tx=0x7f064800cc00 comp rx=0 tx=0).stop 2024-03-28T13:50:19.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.739+0000 7f0657600640 1 -- 172.21.15.76:0/2084188768 shutdown_connections 2024-03-28T13:50:19.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.739+0000 7f0657600640 1 --2- 172.21.15.76:0/2084188768 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0630067fc0 0x7f063006a480 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:19.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.739+0000 7f0657600640 1 --2- 172.21.15.76:0/2084188768 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f06500c9a70 0x7f06500ae830 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:19.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.739+0000 7f0657600640 1 --2- 172.21.15.76:0/2084188768 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0650070080 0x7f06500ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:19.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.739+0000 7f0657600640 1 --2- 172.21.15.76:0/2084188768 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f065006ee50 0x7f0650155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:19.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.739+0000 7f0657600640 1 -- 172.21.15.76:0/2084188768 >> 172.21.15.76:0/2084188768 conn(0x7f0650070ca0 msgr2=0x7f06500ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:19.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.739+0000 7f0657600640 1 -- 172.21.15.76:0/2084188768 shutdown_connections 2024-03-28T13:50:19.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.739+0000 7f0657600640 1 -- 172.21.15.76:0/2084188768 wait complete. 2024-03-28T13:50:19.758 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-28T13:50:19.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.903+0000 7f648cc00640 1 Processor -- start 2024-03-28T13:50:19.903 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.903+0000 7f648cc00640 1 -- start start 2024-03-28T13:50:19.904 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.903+0000 7f648cc00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6488152760 0x7f648815b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:19.904 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.903+0000 7f648cc00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6488152b40 con 0x7f64880c7aa0 2024-03-28T13:50:19.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.903+0000 7f648cc00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64880c7eb0 con 0x7f6488071ff0 2024-03-28T13:50:19.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.903+0000 7f648cc00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f6488070410 con 0x7f6488152760 2024-03-28T13:50:19.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.907+0000 7f6487e00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f64880c7aa0 0x7f64880733a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:36982/0 (socket says 172.21.15.76:36982) 2024-03-28T13:50:19.905 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.907+0000 7f6487e00640 1 -- 172.21.15.76:0/3633367327 learned_addr learned my addr 172.21.15.76:0/3633367327 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:50:19.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.907+0000 7f6486a00640 1 -- 172.21.15.76:0/3633367327 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2187601523 0 0) 0x7f6488152b40 con 0x7f64880c7aa0 2024-03-28T13:50:19.908 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.907+0000 7f6486a00640 1 -- 172.21.15.76:0/3633367327 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f646c003530 con 0x7f64880c7aa0 2024-03-28T13:50:19.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.915+0000 7f6486a00640 1 -- 172.21.15.76:0/3633367327 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2751708132 0 0) 0x7f646c003530 con 0x7f64880c7aa0 2024-03-28T13:50:19.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.915+0000 7f6486a00640 1 -- 172.21.15.76:0/3633367327 >> v2:172.21.15.111:3300/0 conn(0x7f6488152760 msgr2=0x7f648815b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:19.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.915+0000 7f6486a00640 1 --2- 172.21.15.76:0/3633367327 >> v2:172.21.15.111:3300/0 conn(0x7f6488152760 0x7f648815b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:19.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.915+0000 7f6486a00640 1 -- 172.21.15.76:0/3633367327 >> v1:172.21.15.111:6789/0 conn(0x7f6488071ff0 legacy=0x7f64880c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:19.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.915+0000 7f6486a00640 1 -- 172.21.15.76:0/3633367327 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6488072ab0 con 0x7f64880c7aa0 2024-03-28T13:50:19.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.915+0000 7f6486a00640 1 -- 172.21.15.76:0/3633367327 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7f6480001a00 con 0x7f64880c7aa0 2024-03-28T13:50:19.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.915+0000 7f6486a00640 1 -- 172.21.15.76:0/3633367327 >> v1:172.21.15.76:6789/0 conn(0x7f64880c7aa0 legacy=0x7f64880733a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:19.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.915+0000 7f6486a00640 1 --2- 172.21.15.76:0/3633367327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f646c003a10 0x7f646c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:19.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.915+0000 7f6486a00640 1 --2- 172.21.15.76:0/3633367327 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f646c004810 0x7f646c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:19.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.915+0000 7f6486a00640 1 --2- 172.21.15.76:0/3633367327 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f646c0052f0 0x7f646c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:19.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.915+0000 7f6486a00640 1 -- 172.21.15.76:0/3633367327 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6488070410 con 0x7f646c003a10 2024-03-28T13:50:19.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.915+0000 7f6486a00640 1 -- 172.21.15.76:0/3633367327 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f646c00c230 con 0x7f646c004810 2024-03-28T13:50:19.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.915+0000 7f6486a00640 1 -- 172.21.15.76:0/3633367327 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f646c00c430 con 0x7f646c0052f0 2024-03-28T13:50:19.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.919+0000 7f6487400640 1 --2- 172.21.15.76:0/3633367327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f646c003a10 0x7f646c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:19.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.919+0000 7f6487e00640 1 --2- 172.21.15.76:0/3633367327 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f646c0052f0 0x7f646c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:19.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.923+0000 7f6487e00640 1 -- 172.21.15.76:0/3633367327 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f646c004810 msgr2=0x7f646c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:19.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.923+0000 7f6487e00640 1 --2- 172.21.15.76:0/3633367327 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f646c004810 0x7f646c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:19.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.923+0000 7f6487e00640 1 -- 172.21.15.76:0/3633367327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f646c003a10 msgr2=0x7f646c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:19.923 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.923+0000 7f6487e00640 1 --2- 172.21.15.76:0/3633367327 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f646c003a10 0x7f646c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:19.924 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.923+0000 7f6487e00640 1 -- 172.21.15.76:0/3633367327 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646c003530 con 0x7f646c0052f0 2024-03-28T13:50:19.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.927+0000 7f6487e00640 1 -- 172.21.15.76:0/3633367327 reap_dead start 2024-03-28T13:50:19.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.931+0000 7f6487e00640 1 --2- 172.21.15.76:0/3633367327 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f646c0052f0 0x7f646c00b9d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f648000a760 tx=0x7f648001f9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22ce7934b7b58dad server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:19.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.935+0000 7f6486a00640 1 -- 172.21.15.76:0/3633367327 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648000a3b0 con 0x7f646c0052f0 2024-03-28T13:50:19.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.935+0000 7f6486a00640 1 -- 172.21.15.76:0/3633367327 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64800ad420 con 0x7f646c0052f0 2024-03-28T13:50:19.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.935+0000 7f6486a00640 1 -- 172.21.15.76:0/3633367327 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64800ad7f0 con 0x7f646c0052f0 2024-03-28T13:50:19.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.935+0000 7f648cc00640 1 -- 172.21.15.76:0/3633367327 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f646c0052f0 msgr2=0x7f646c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:19.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.935+0000 7f648cc00640 1 --2- 172.21.15.76:0/3633367327 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f646c0052f0 0x7f646c00b9d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f648000a760 tx=0x7f648001f9c0 comp rx=0 tx=0).stop 2024-03-28T13:50:19.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.935+0000 7f648cc00640 1 -- 172.21.15.76:0/3633367327 shutdown_connections 2024-03-28T13:50:19.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.935+0000 7f648cc00640 1 --2- 172.21.15.76:0/3633367327 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f646c0052f0 0x7f646c00b9d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:19.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.935+0000 7f648cc00640 1 -- 172.21.15.76:0/3633367327 >> 172.21.15.76:0/3633367327 conn(0x7f64880cbe80 msgr2=0x7f64880cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:19.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.935+0000 7f648cc00640 1 -- 172.21.15.76:0/3633367327 shutdown_connections 2024-03-28T13:50:19.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.935+0000 7f648cc00640 1 -- 172.21.15.76:0/3633367327 wait complete. 2024-03-28T13:50:19.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.939+0000 7f648cc00640 1 Processor -- start 2024-03-28T13:50:19.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.939+0000 7f648cc00640 1 -- start start 2024-03-28T13:50:19.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.939+0000 7f648cc00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f646c0052f0 0x7f648814e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:19.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.939+0000 7f648cc00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f648814cfd0 0x7f64881eff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:19.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.939+0000 7f648cc00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6488155a80 0x7f64881f0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:19.939 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.939+0000 7f648cc00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f64880c7580 con 0x7f6488155a80 2024-03-28T13:50:19.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.939+0000 7f648cc00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f64880c72a0 con 0x7f646c0052f0 2024-03-28T13:50:19.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.939+0000 7f648cc00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6488072860 con 0x7f648814cfd0 2024-03-28T13:50:19.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.939+0000 7f6487e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6488155a80 0x7f64881f0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:19.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.939+0000 7f6487e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6488155a80 0x7f64881f0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44338/0 (socket says 172.21.15.76:44338) 2024-03-28T13:50:19.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.939+0000 7f6487e00640 1 -- 172.21.15.76:0/1082172170 learned_addr learned my addr 172.21.15.76:0/1082172170 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:19.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.943+0000 7f647fe00640 1 --2- 172.21.15.76:0/1082172170 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f648814cfd0 0x7f64881eff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:19.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.943+0000 7f6487400640 1 --2- 172.21.15.76:0/1082172170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f646c0052f0 0x7f648814e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:19.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.947+0000 7f6487e00640 1 -- 172.21.15.76:0/1082172170 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f648814cfd0 msgr2=0x7f64881eff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:19.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.947+0000 7f6487e00640 1 --2- 172.21.15.76:0/1082172170 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f648814cfd0 0x7f64881eff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:19.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.947+0000 7f6487e00640 1 -- 172.21.15.76:0/1082172170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f646c0052f0 msgr2=0x7f648814e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:19.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.947+0000 7f6487e00640 1 --2- 172.21.15.76:0/1082172170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f646c0052f0 0x7f648814e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:19.946 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.947+0000 7f6487e00640 1 -- 172.21.15.76:0/1082172170 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64881f34b0 con 0x7f6488155a80 2024-03-28T13:50:19.949 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.951+0000 7f6487e00640 1 --2- 172.21.15.76:0/1082172170 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6488155a80 0x7f64881f0450 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6480020260 tx=0x7f646c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:19.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.951+0000 7f647f400640 1 -- 172.21.15.76:0/1082172170 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480001880 con 0x7f6488155a80 2024-03-28T13:50:19.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.955+0000 7f647f400640 1 -- 172.21.15.76:0/1082172170 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6480004b70 con 0x7f6488155a80 2024-03-28T13:50:19.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.955+0000 7f647f400640 1 -- 172.21.15.76:0/1082172170 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64800ad5d0 con 0x7f6488155a80 2024-03-28T13:50:19.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.955+0000 7f648cc00640 1 -- 172.21.15.76:0/1082172170 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64881f3750 con 0x7f6488155a80 2024-03-28T13:50:19.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.955+0000 7f648cc00640 1 -- 172.21.15.76:0/1082172170 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64881f3d10 con 0x7f6488155a80 2024-03-28T13:50:19.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.955+0000 7f648cc00640 1 -- 172.21.15.76:0/1082172170 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64880686e0 con 0x7f6488155a80 2024-03-28T13:50:19.988 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.987+0000 7f647f400640 1 -- 172.21.15.76:0/1082172170 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f64800ad770 con 0x7f6488155a80 2024-03-28T13:50:19.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.991+0000 7f647f400640 1 --2- 172.21.15.76:0/1082172170 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6464067fc0 0x7f646406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:19.989 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.991+0000 7f6487400640 1 --2- 172.21.15.76:0/1082172170 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6464067fc0 0x7f646406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:19.990 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:19.991+0000 7f6487400640 1 --2- 172.21.15.76:0/1082172170 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6464067fc0 0x7f646406a480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6478009870 tx=0x7f6478008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:20.019 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.019+0000 7f647f400640 1 -- 172.21.15.76:0/1082172170 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f6480001a20 con 0x7f6488155a80 2024-03-28T13:50:20.257 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.259+0000 7f647f400640 1 -- 172.21.15.76:0/1082172170 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f64800196d0 con 0x7f6488155a80 2024-03-28T13:50:20.428 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.427+0000 7f648cc00640 1 -- 172.21.15.76:0/1082172170 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6488072640 con 0x7f6488155a80 2024-03-28T13:50:20.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.435+0000 7f647f400640 1 -- 172.21.15.76:0/1082172170 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f64800f37a0 con 0x7f6488155a80 2024-03-28T13:50:20.436 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-03-28T13:50:20.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.439+0000 7f648cc00640 1 -- 172.21.15.76:0/1082172170 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6464067fc0 msgr2=0x7f646406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:20.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.439+0000 7f648cc00640 1 --2- 172.21.15.76:0/1082172170 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6464067fc0 0x7f646406a480 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6478009870 tx=0x7f6478008040 comp rx=0 tx=0).stop 2024-03-28T13:50:20.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.439+0000 7f648cc00640 1 -- 172.21.15.76:0/1082172170 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6488155a80 msgr2=0x7f64881f0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:20.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.439+0000 7f648cc00640 1 --2- 172.21.15.76:0/1082172170 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6488155a80 0x7f64881f0450 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6480020260 tx=0x7f646c005840 comp rx=0 tx=0).stop 2024-03-28T13:50:20.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.439+0000 7f648cc00640 1 -- 172.21.15.76:0/1082172170 shutdown_connections 2024-03-28T13:50:20.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.439+0000 7f648cc00640 1 --2- 172.21.15.76:0/1082172170 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6464067fc0 0x7f646406a480 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:20.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.439+0000 7f648cc00640 1 --2- 172.21.15.76:0/1082172170 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6488155a80 0x7f64881f0450 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:20.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.439+0000 7f648cc00640 1 --2- 172.21.15.76:0/1082172170 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f648814cfd0 0x7f64881eff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:20.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.439+0000 7f648cc00640 1 --2- 172.21.15.76:0/1082172170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f646c0052f0 0x7f648814e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:20.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.439+0000 7f648cc00640 1 -- 172.21.15.76:0/1082172170 >> 172.21.15.76:0/1082172170 conn(0x7f64880cbe80 msgr2=0x7f648814f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:20.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.439+0000 7f648cc00640 1 -- 172.21.15.76:0/1082172170 shutdown_connections 2024-03-28T13:50:20.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.439+0000 7f648cc00640 1 -- 172.21.15.76:0/1082172170 wait complete. 2024-03-28T13:50:20.469 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-28T13:50:20.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.619+0000 7f638b200640 1 Processor -- start 2024-03-28T13:50:20.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.623+0000 7f638b200640 1 -- start start 2024-03-28T13:50:20.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.623+0000 7f638b200640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f63840c62a0 0x7f6384152310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:20.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.623+0000 7f638b200640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6384158960 con 0x7f63840708a0 2024-03-28T13:50:20.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.623+0000 7f638b200640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63841594c0 con 0x7f63840c5ec0 2024-03-28T13:50:20.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.623+0000 7f638b200640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f6384158c20 con 0x7f63840c62a0 2024-03-28T13:50:20.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.623+0000 7f638a800640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f63840708a0 0x7f638415c0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:36984/0 (socket says 172.21.15.76:36984) 2024-03-28T13:50:20.624 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.623+0000 7f638a800640 1 -- 172.21.15.76:0/1290961997 learned_addr learned my addr 172.21.15.76:0/1290961997 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:50:20.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.627+0000 7f6388a00640 1 -- 172.21.15.76:0/1290961997 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3529633064 0 0) 0x7f6384158960 con 0x7f63840708a0 2024-03-28T13:50:20.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.627+0000 7f6388a00640 1 -- 172.21.15.76:0/1290961997 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f636c003530 con 0x7f63840708a0 2024-03-28T13:50:20.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.631+0000 7f6388a00640 1 -- 172.21.15.76:0/1290961997 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 606713608 0 0) 0x7f636c003530 con 0x7f63840708a0 2024-03-28T13:50:20.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.631+0000 7f6388a00640 1 -- 172.21.15.76:0/1290961997 >> v2:172.21.15.111:3300/0 conn(0x7f63840c62a0 msgr2=0x7f6384152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:20.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.631+0000 7f6388a00640 1 --2- 172.21.15.76:0/1290961997 >> v2:172.21.15.111:3300/0 conn(0x7f63840c62a0 0x7f6384152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:20.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.631+0000 7f6388a00640 1 -- 172.21.15.76:0/1290961997 >> v1:172.21.15.111:6789/0 conn(0x7f63840c5ec0 legacy=0x7f638406ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:20.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.631+0000 7f6388a00640 1 -- 172.21.15.76:0/1290961997 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6384158f00 con 0x7f63840708a0 2024-03-28T13:50:20.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.631+0000 7f6388a00640 1 -- 172.21.15.76:0/1290961997 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7f6380001a00 con 0x7f63840708a0 2024-03-28T13:50:20.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.631+0000 7f6388a00640 1 -- 172.21.15.76:0/1290961997 >> v1:172.21.15.76:6789/0 conn(0x7f63840708a0 legacy=0x7f638415c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:20.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.631+0000 7f6388a00640 1 --2- 172.21.15.76:0/1290961997 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f636c003a10 0x7f636c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:20.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.631+0000 7f6388a00640 1 --2- 172.21.15.76:0/1290961997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f636c004810 0x7f636c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:20.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.631+0000 7f6388a00640 1 --2- 172.21.15.76:0/1290961997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f636c0052f0 0x7f636c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:20.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.631+0000 7f6388a00640 1 -- 172.21.15.76:0/1290961997 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6384158c20 con 0x7f636c004810 2024-03-28T13:50:20.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.631+0000 7f6388a00640 1 -- 172.21.15.76:0/1290961997 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f636c00c240 con 0x7f636c0052f0 2024-03-28T13:50:20.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.631+0000 7f6388a00640 1 -- 172.21.15.76:0/1290961997 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f636c00c440 con 0x7f636c003a10 2024-03-28T13:50:20.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.631+0000 7f6389e00640 1 --2- 172.21.15.76:0/1290961997 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f636c003a10 0x7f636c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:20.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.635+0000 7f6389400640 1 --2- 172.21.15.76:0/1290961997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f636c004810 0x7f636c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:20.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.639+0000 7f6389e00640 1 -- 172.21.15.76:0/1290961997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f636c0052f0 msgr2=0x7f636c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:20.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.639+0000 7f6389e00640 1 --2- 172.21.15.76:0/1290961997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f636c0052f0 0x7f636c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:20.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.639+0000 7f6389e00640 1 -- 172.21.15.76:0/1290961997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f636c004810 msgr2=0x7f636c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:20.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.639+0000 7f6389e00640 1 --2- 172.21.15.76:0/1290961997 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f636c004810 0x7f636c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:20.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.639+0000 7f6389e00640 1 -- 172.21.15.76:0/1290961997 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636c003530 con 0x7f636c003a10 2024-03-28T13:50:20.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.639+0000 7f638a800640 1 -- 172.21.15.76:0/1290961997 reap_dead start 2024-03-28T13:50:20.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.643+0000 7f6389e00640 1 --2- 172.21.15.76:0/1290961997 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f636c003a10 0x7f636c003e10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6378007fd0 tx=0x7f637801c2a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67e9e3a9b91d3e54 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:20.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.647+0000 7f6388a00640 1 -- 172.21.15.76:0/1290961997 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378001250 con 0x7f636c003a10 2024-03-28T13:50:20.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.651+0000 7f6388a00640 1 -- 172.21.15.76:0/1290961997 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6378005270 con 0x7f636c003a10 2024-03-28T13:50:20.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.651+0000 7f6388a00640 1 -- 172.21.15.76:0/1290961997 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378003860 con 0x7f636c003a10 2024-03-28T13:50:20.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.651+0000 7f638b200640 1 -- 172.21.15.76:0/1290961997 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f636c003a10 msgr2=0x7f636c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:20.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.651+0000 7f638b200640 1 --2- 172.21.15.76:0/1290961997 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f636c003a10 0x7f636c003e10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6378007fd0 tx=0x7f637801c2a0 comp rx=0 tx=0).stop 2024-03-28T13:50:20.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.651+0000 7f638b200640 1 -- 172.21.15.76:0/1290961997 shutdown_connections 2024-03-28T13:50:20.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.651+0000 7f638b200640 1 --2- 172.21.15.76:0/1290961997 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f636c003a10 0x7f636c003e10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:20.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.651+0000 7f638b200640 1 -- 172.21.15.76:0/1290961997 >> 172.21.15.76:0/1290961997 conn(0x7f63840ccd70 msgr2=0x7f6384070190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:20.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.651+0000 7f638b200640 1 -- 172.21.15.76:0/1290961997 shutdown_connections 2024-03-28T13:50:20.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.651+0000 7f638b200640 1 -- 172.21.15.76:0/1290961997 wait complete. 2024-03-28T13:50:20.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.655+0000 7f638b200640 1 Processor -- start 2024-03-28T13:50:20.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.655+0000 7f638b200640 1 -- start start 2024-03-28T13:50:20.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.655+0000 7f638b200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f636c003a10 0x7f6384150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:20.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.655+0000 7f638b200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f638413a3b0 0x7f63840c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:20.655 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.655+0000 7f638b200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f638413a7f0 0x7f63840c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:20.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.655+0000 7f638b200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6384158540 con 0x7f638413a7f0 2024-03-28T13:50:20.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.655+0000 7f638b200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f638415bbd0 con 0x7f638413a3b0 2024-03-28T13:50:20.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.655+0000 7f638b200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f63841586c0 con 0x7f636c003a10 2024-03-28T13:50:20.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.655+0000 7f6389e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f636c003a10 0x7f6384150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:20.656 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.655+0000 7f6389400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f638413a3b0 0x7f63840c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:20.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.659+0000 7f6389e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f636c003a10 0x7f6384150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:45956/0 (socket says 172.21.15.76:45956) 2024-03-28T13:50:20.657 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.659+0000 7f6389e00640 1 -- 172.21.15.76:0/753012331 learned_addr learned my addr 172.21.15.76:0/753012331 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:20.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.663+0000 7f6389e00640 1 -- 172.21.15.76:0/753012331 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f638413a3b0 msgr2=0x7f63840c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:20.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.663+0000 7f6389e00640 1 --2- 172.21.15.76:0/753012331 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f638413a3b0 0x7f63840c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:20.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.663+0000 7f6389e00640 1 -- 172.21.15.76:0/753012331 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f638413a7f0 msgr2=0x7f63840c53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:20.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.663+0000 7f6389e00640 1 --2- 172.21.15.76:0/753012331 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f638413a7f0 0x7f63840c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:20.663 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.663+0000 7f6389e00640 1 -- 172.21.15.76:0/753012331 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f638415b890 con 0x7f636c003a10 2024-03-28T13:50:20.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.667+0000 7f6389e00640 1 --2- 172.21.15.76:0/753012331 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f636c003a10 0x7f6384150ec0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6378097bd0 tx=0x7f636c005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:20.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.675+0000 7f637e000640 1 -- 172.21.15.76:0/753012331 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378007a60 con 0x7f636c003a10 2024-03-28T13:50:20.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.675+0000 7f637e000640 1 -- 172.21.15.76:0/753012331 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63780076a0 con 0x7f636c003a10 2024-03-28T13:50:20.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.675+0000 7f637e000640 1 -- 172.21.15.76:0/753012331 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63780050d0 con 0x7f636c003a10 2024-03-28T13:50:20.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.675+0000 7f638b200640 1 -- 172.21.15.76:0/753012331 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6384139d50 con 0x7f636c003a10 2024-03-28T13:50:20.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.675+0000 7f638b200640 1 -- 172.21.15.76:0/753012331 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f63840c34c0 con 0x7f636c003a10 2024-03-28T13:50:20.675 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.675+0000 7f638b200640 1 -- 172.21.15.76:0/753012331 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6384068df0 con 0x7f636c003a10 2024-03-28T13:50:20.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.711+0000 7f637e000640 1 -- 172.21.15.76:0/753012331 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f63780067c0 con 0x7f636c003a10 2024-03-28T13:50:20.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.711+0000 7f637e000640 1 --2- 172.21.15.76:0/753012331 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6368067ff0 0x7f636806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:20.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.711+0000 7f6389400640 1 --2- 172.21.15.76:0/753012331 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6368067ff0 0x7f636806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:20.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.711+0000 7f6389400640 1 --2- 172.21.15.76:0/753012331 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6368067ff0 0x7f636806a4b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f63841563d0 tx=0x7f6374009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:20.716 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:20.715+0000 7f637e000640 1 -- 172.21.15.76:0/753012331 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f63780ee330 con 0x7f636c003a10 2024-03-28T13:50:21.129 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.131+0000 7f637e000640 1 -- 172.21.15.76:0/753012331 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f63780c6080 con 0x7f636c003a10 2024-03-28T13:50:21.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.319+0000 7f638b200640 1 -- 172.21.15.76:0/753012331 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f63841594c0 con 0x7f636c003a10 2024-03-28T13:50:21.442 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.443+0000 7f637e000640 1 -- 172.21.15.76:0/753012331 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f6378015fb0 con 0x7f636c003a10 2024-03-28T13:50:21.443 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 64 2024-03-28T13:50:21.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.443+0000 7f638b200640 1 -- 172.21.15.76:0/753012331 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6368067ff0 msgr2=0x7f636806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:21.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.443+0000 7f638b200640 1 --2- 172.21.15.76:0/753012331 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6368067ff0 0x7f636806a4b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f63841563d0 tx=0x7f6374009060 comp rx=0 tx=0).stop 2024-03-28T13:50:21.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.443+0000 7f638b200640 1 -- 172.21.15.76:0/753012331 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f636c003a10 msgr2=0x7f6384150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:21.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.443+0000 7f638b200640 1 --2- 172.21.15.76:0/753012331 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f636c003a10 0x7f6384150ec0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6378097bd0 tx=0x7f636c005840 comp rx=0 tx=0).stop 2024-03-28T13:50:21.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.443+0000 7f638b200640 1 -- 172.21.15.76:0/753012331 shutdown_connections 2024-03-28T13:50:21.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.443+0000 7f638b200640 1 --2- 172.21.15.76:0/753012331 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6368067ff0 0x7f636806a4b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:21.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.443+0000 7f638b200640 1 --2- 172.21.15.76:0/753012331 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f638413a7f0 0x7f63840c53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:21.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.443+0000 7f638b200640 1 --2- 172.21.15.76:0/753012331 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f638413a3b0 0x7f63840c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:21.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.443+0000 7f638b200640 1 --2- 172.21.15.76:0/753012331 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f636c003a10 0x7f6384150ec0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:21.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.443+0000 7f638b200640 1 -- 172.21.15.76:0/753012331 >> 172.21.15.76:0/753012331 conn(0x7f63840ccd70 msgr2=0x7f63840c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:21.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.447+0000 7f638b200640 1 -- 172.21.15.76:0/753012331 shutdown_connections 2024-03-28T13:50:21.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.447+0000 7f638b200640 1 -- 172.21.15.76:0/753012331 wait complete. 2024-03-28T13:50:21.466 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-28T13:50:21.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.619+0000 7fcc67200640 1 Processor -- start 2024-03-28T13:50:21.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.619+0000 7fcc67200640 1 -- start start 2024-03-28T13:50:21.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.619+0000 7fcc67200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fcc68071e10 0x7fcc6815a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:21.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.623+0000 7fcc67200640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc680c8990 con 0x7fcc680721f0 2024-03-28T13:50:21.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.623+0000 7fcc67200640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc6815e000 con 0x7fcc680ca2a0 2024-03-28T13:50:21.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.623+0000 7fcc67200640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fcc6815ddb0 con 0x7fcc68071e10 2024-03-28T13:50:21.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.623+0000 7fcc65e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fcc68071e10 0x7fcc6815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:21.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.623+0000 7fcc66800640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fcc680ca2a0 0x7fcc68154370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:34274/0 (socket says 172.21.15.76:34274) 2024-03-28T13:50:21.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.623+0000 7fcc66800640 1 -- 172.21.15.76:0/1260712487 learned_addr learned my addr 172.21.15.76:0/1260712487 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:50:21.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.627+0000 7fcc65e00640 1 -- 172.21.15.76:0/1260712487 >> v1:172.21.15.111:6789/0 conn(0x7fcc680ca2a0 legacy=0x7fcc68154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:21.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.627+0000 7fcc65e00640 1 -- 172.21.15.76:0/1260712487 >> v1:172.21.15.76:6789/0 conn(0x7fcc680721f0 legacy=0x7fcc680c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:21.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.627+0000 7fcc65e00640 1 -- 172.21.15.76:0/1260712487 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6815e2e0 con 0x7fcc68071e10 2024-03-28T13:50:21.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.631+0000 7fcc65e00640 1 --2- 172.21.15.76:0/1260712487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc68071e10 0x7fcc6815a720 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcc6815df30 tx=0x7fcc5801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ca1b025a3f71be server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:21.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.635+0000 7fcc64a00640 1 -- 172.21.15.76:0/1260712487 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc580b5070 con 0x7fcc68071e10 2024-03-28T13:50:21.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.635+0000 7fcc64a00640 1 -- 172.21.15.76:0/1260712487 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc580a8990 con 0x7fcc68071e10 2024-03-28T13:50:21.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.635+0000 7fcc64a00640 1 -- 172.21.15.76:0/1260712487 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc580a8d60 con 0x7fcc68071e10 2024-03-28T13:50:21.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.635+0000 7fcc67200640 1 -- 172.21.15.76:0/1260712487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc68071e10 msgr2=0x7fcc6815a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:21.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.635+0000 7fcc67200640 1 --2- 172.21.15.76:0/1260712487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc68071e10 0x7fcc6815a720 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcc6815df30 tx=0x7fcc5801ecb0 comp rx=0 tx=0).stop 2024-03-28T13:50:21.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.635+0000 7fcc67200640 1 -- 172.21.15.76:0/1260712487 shutdown_connections 2024-03-28T13:50:21.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.635+0000 7fcc67200640 1 --2- 172.21.15.76:0/1260712487 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc68071e10 0x7fcc6815a720 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:21.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.635+0000 7fcc67200640 1 -- 172.21.15.76:0/1260712487 >> 172.21.15.76:0/1260712487 conn(0x7fcc6806bba0 msgr2=0x7fcc6806ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:21.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.635+0000 7fcc67200640 1 -- 172.21.15.76:0/1260712487 shutdown_connections 2024-03-28T13:50:21.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.635+0000 7fcc67200640 1 -- 172.21.15.76:0/1260712487 wait complete. 2024-03-28T13:50:21.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.639+0000 7fcc67200640 1 Processor -- start 2024-03-28T13:50:21.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.639+0000 7fcc67200640 1 -- start start 2024-03-28T13:50:21.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.639+0000 7fcc67200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc68071e10 0x7fcc68152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:21.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.639+0000 7fcc67200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc680721f0 0x7fcc680c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:21.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.639+0000 7fcc67200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcc680ca2a0 0x7fcc680c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:21.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.639+0000 7fcc67200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6815e8a0 con 0x7fcc68071e10 2024-03-28T13:50:21.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.639+0000 7fcc67200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6815ec10 con 0x7fcc680721f0 2024-03-28T13:50:21.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.639+0000 7fcc67200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fcc680cb620 con 0x7fcc680ca2a0 2024-03-28T13:50:21.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.639+0000 7fcc65e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc68071e10 0x7fcc68152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:21.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.639+0000 7fcc65e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc68071e10 0x7fcc68152a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44390/0 (socket says 172.21.15.76:44390) 2024-03-28T13:50:21.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.639+0000 7fcc65e00640 1 -- 172.21.15.76:0/813645955 learned_addr learned my addr 172.21.15.76:0/813645955 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:21.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.639+0000 7fcc65400640 1 --2- 172.21.15.76:0/813645955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc680721f0 0x7fcc680c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:21.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.643+0000 7fcc66800640 1 --2- 172.21.15.76:0/813645955 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcc680ca2a0 0x7fcc680c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:21.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.643+0000 7fcc65e00640 1 -- 172.21.15.76:0/813645955 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcc680ca2a0 msgr2=0x7fcc680c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:21.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.643+0000 7fcc65e00640 1 --2- 172.21.15.76:0/813645955 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcc680ca2a0 0x7fcc680c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:21.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.643+0000 7fcc65e00640 1 -- 172.21.15.76:0/813645955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc680721f0 msgr2=0x7fcc680c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:21.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.643+0000 7fcc65e00640 1 --2- 172.21.15.76:0/813645955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc680721f0 0x7fcc680c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:21.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.643+0000 7fcc65e00640 1 -- 172.21.15.76:0/813645955 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc68067fc0 con 0x7fcc68071e10 2024-03-28T13:50:21.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.647+0000 7fcc65e00640 1 --2- 172.21.15.76:0/813645955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc68071e10 0x7fcc68152a50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcc5801c8e0 tx=0x7fcc5801ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:21.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.647+0000 7fcc5e000640 1 -- 172.21.15.76:0/813645955 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc580be070 con 0x7fcc68071e10 2024-03-28T13:50:21.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.651+0000 7fcc67200640 1 -- 172.21.15.76:0/813645955 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc6815c540 con 0x7fcc68071e10 2024-03-28T13:50:21.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.651+0000 7fcc67200640 1 -- 172.21.15.76:0/813645955 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc6815cb00 con 0x7fcc68071e10 2024-03-28T13:50:21.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.651+0000 7fcc5e000640 1 -- 172.21.15.76:0/813645955 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc580a8990 con 0x7fcc68071e10 2024-03-28T13:50:21.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.651+0000 7fcc5e000640 1 -- 172.21.15.76:0/813645955 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc580b5040 con 0x7fcc68071e10 2024-03-28T13:50:21.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.651+0000 7fcc67200640 1 -- 172.21.15.76:0/813645955 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc680686e0 con 0x7fcc68071e10 2024-03-28T13:50:21.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.671+0000 7fcc5e000640 1 -- 172.21.15.76:0/813645955 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fcc580c1070 con 0x7fcc68071e10 2024-03-28T13:50:21.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.671+0000 7fcc5e000640 1 --2- 172.21.15.76:0/813645955 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcc48067ff0 0x7fcc4806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:21.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.671+0000 7fcc65400640 1 --2- 172.21.15.76:0/813645955 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcc48067ff0 0x7fcc4806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:21.672 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.675+0000 7fcc65400640 1 --2- 172.21.15.76:0/813645955 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcc48067ff0 0x7fcc4806a4b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcc681f1bb0 tx=0x7fcc54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:21.673 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.675+0000 7fcc5e000640 1 -- 172.21.15.76:0/813645955 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fcc580f1a60 con 0x7fcc68071e10 2024-03-28T13:50:21.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:21.935+0000 7fcc5e000640 1 -- 172.21.15.76:0/813645955 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fcc580c9070 con 0x7fcc68071e10 2024-03-28T13:50:22.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.111+0000 7fcc67200640 1 -- 172.21.15.76:0/813645955 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fcc6806e4c0 con 0x7fcc68071e10 2024-03-28T13:50:22.125 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.123+0000 7fcc5e000640 1 -- 172.21.15.76:0/813645955 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fcc58018810 con 0x7fcc68071e10 2024-03-28T13:50:22.125 INFO:teuthology.orchestra.run.smithi076.stdout:pg_num: 32 2024-03-28T13:50:22.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.127+0000 7fcc67200640 1 -- 172.21.15.76:0/813645955 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcc48067ff0 msgr2=0x7fcc4806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:22.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.127+0000 7fcc67200640 1 --2- 172.21.15.76:0/813645955 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcc48067ff0 0x7fcc4806a4b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcc681f1bb0 tx=0x7fcc54009040 comp rx=0 tx=0).stop 2024-03-28T13:50:22.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.127+0000 7fcc67200640 1 -- 172.21.15.76:0/813645955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc68071e10 msgr2=0x7fcc68152a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:22.127 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.127+0000 7fcc67200640 1 --2- 172.21.15.76:0/813645955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc68071e10 0x7fcc68152a50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcc5801c8e0 tx=0x7fcc5801ba50 comp rx=0 tx=0).stop 2024-03-28T13:50:22.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.127+0000 7fcc67200640 1 -- 172.21.15.76:0/813645955 shutdown_connections 2024-03-28T13:50:22.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.127+0000 7fcc67200640 1 --2- 172.21.15.76:0/813645955 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fcc48067ff0 0x7fcc4806a4b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:22.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.127+0000 7fcc67200640 1 --2- 172.21.15.76:0/813645955 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcc680ca2a0 0x7fcc680c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:22.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.127+0000 7fcc67200640 1 --2- 172.21.15.76:0/813645955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc680721f0 0x7fcc680c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:22.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.127+0000 7fcc67200640 1 --2- 172.21.15.76:0/813645955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fcc68071e10 0x7fcc68152a50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:22.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.127+0000 7fcc67200640 1 -- 172.21.15.76:0/813645955 >> 172.21.15.76:0/813645955 conn(0x7fcc6806bba0 msgr2=0x7fcc68074e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:22.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.127+0000 7fcc67200640 1 -- 172.21.15.76:0/813645955 shutdown_connections 2024-03-28T13:50:22.128 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.127+0000 7fcc67200640 1 -- 172.21.15.76:0/813645955 wait complete. 2024-03-28T13:50:22.157 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-28T13:50:22.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.319+0000 7f216d200640 1 Processor -- start 2024-03-28T13:50:22.318 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.319+0000 7f216d200640 1 -- start start 2024-03-28T13:50:22.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.319+0000 7f216d200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21681546e0 0x7f21680c7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:22.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.319+0000 7f216d200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f216806c640 0x7f2168072f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:22.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.319+0000 7f216d200640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f216806caa0 con 0x7f21680676f0 2024-03-28T13:50:22.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.319+0000 7f216d200640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f2168154ac0 con 0x7f216806c640 2024-03-28T13:50:22.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.319+0000 7f216d200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f216806c1b0 con 0x7f21681546e0 2024-03-28T13:50:22.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.323+0000 7f2167e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f216806c640 0x7f2168072f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:22.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.323+0000 7f2167e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f216806c640 0x7f2168072f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:44396/0 (socket says 172.21.15.76:44396) 2024-03-28T13:50:22.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.323+0000 7f2167e00640 1 -- 172.21.15.76:0/2477837795 learned_addr learned my addr 172.21.15.76:0/2477837795 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:22.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.323+0000 7f2167400640 1 --2- 172.21.15.76:0/2477837795 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21681546e0 0x7f21680c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:22.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.327+0000 7f2167e00640 1 -- 172.21.15.76:0/2477837795 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21681546e0 msgr2=0x7f21680c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:22.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.327+0000 7f2167e00640 1 --2- 172.21.15.76:0/2477837795 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21681546e0 0x7f21680c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:22.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.327+0000 7f2167e00640 1 -- 172.21.15.76:0/2477837795 >> v1:172.21.15.76:6789/0 conn(0x7f21680676f0 legacy=0x7f2168072860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:22.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.327+0000 7f2167e00640 1 -- 172.21.15.76:0/2477837795 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216815b460 con 0x7f216806c640 2024-03-28T13:50:22.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.335+0000 7f2167e00640 1 --2- 172.21.15.76:0/2477837795 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f216806c640 0x7f2168072f70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2160009e50 tx=0x7f216001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af54c4c88f363c7e server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:22.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.347+0000 7f2166a00640 1 -- 172.21.15.76:0/2477837795 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21600b4070 con 0x7f216806c640 2024-03-28T13:50:22.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.347+0000 7f2166a00640 1 -- 172.21.15.76:0/2477837795 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21600af400 con 0x7f216806c640 2024-03-28T13:50:22.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.347+0000 7f2166a00640 1 -- 172.21.15.76:0/2477837795 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21600af7d0 con 0x7f216806c640 2024-03-28T13:50:22.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.347+0000 7f216d200640 1 -- 172.21.15.76:0/2477837795 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f216806c640 msgr2=0x7f2168072f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:22.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.347+0000 7f216d200640 1 --2- 172.21.15.76:0/2477837795 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f216806c640 0x7f2168072f70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2160009e50 tx=0x7f216001f210 comp rx=0 tx=0).stop 2024-03-28T13:50:22.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.347+0000 7f216d200640 1 -- 172.21.15.76:0/2477837795 shutdown_connections 2024-03-28T13:50:22.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.347+0000 7f216d200640 1 --2- 172.21.15.76:0/2477837795 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f216806c640 0x7f2168072f70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:22.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.347+0000 7f216d200640 1 --2- 172.21.15.76:0/2477837795 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21681546e0 0x7f21680c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:22.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.347+0000 7f216d200640 1 -- 172.21.15.76:0/2477837795 >> 172.21.15.76:0/2477837795 conn(0x7f21680c8fe0 msgr2=0x7f21680c93f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:22.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.347+0000 7f216d200640 1 -- 172.21.15.76:0/2477837795 shutdown_connections 2024-03-28T13:50:22.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.347+0000 7f216d200640 1 -- 172.21.15.76:0/2477837795 wait complete. 2024-03-28T13:50:22.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.351+0000 7f216d200640 1 Processor -- start 2024-03-28T13:50:22.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.351+0000 7f216d200640 1 -- start start 2024-03-28T13:50:22.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.351+0000 7f216d200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f21680676f0 0x7f21681f4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:22.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.351+0000 7f216d200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f216806c640 0x7f21680ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:22.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.351+0000 7f216d200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21681546e0 0x7f2168159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:22.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.351+0000 7f216d200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f216806bb60 con 0x7f21680676f0 2024-03-28T13:50:22.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.351+0000 7f216d200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f216806b880 con 0x7f216806c640 2024-03-28T13:50:22.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.351+0000 7f216d200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f216806be40 con 0x7f21681546e0 2024-03-28T13:50:22.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.351+0000 7f215fe00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f216806c640 0x7f21680ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:22.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.355+0000 7f215fe00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f216806c640 0x7f21680ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:40452/0 (socket says 172.21.15.76:40452) 2024-03-28T13:50:22.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.355+0000 7f215fe00640 1 -- 172.21.15.76:0/271328447 learned_addr learned my addr 172.21.15.76:0/271328447 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:22.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.355+0000 7f2167e00640 1 --2- 172.21.15.76:0/271328447 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21681546e0 0x7f2168159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:22.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.355+0000 7f2167400640 1 --2- 172.21.15.76:0/271328447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f21680676f0 0x7f21681f4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:22.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.359+0000 7f215fe00640 1 -- 172.21.15.76:0/271328447 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21681546e0 msgr2=0x7f2168159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:22.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.359+0000 7f215fe00640 1 --2- 172.21.15.76:0/271328447 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21681546e0 0x7f2168159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:22.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.359+0000 7f215fe00640 1 -- 172.21.15.76:0/271328447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f21680676f0 msgr2=0x7f21681f4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:22.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.359+0000 7f215fe00640 1 --2- 172.21.15.76:0/271328447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f21680676f0 0x7f21681f4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:22.359 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.359+0000 7f215fe00640 1 -- 172.21.15.76:0/271328447 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216814d8a0 con 0x7f216806c640 2024-03-28T13:50:22.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.363+0000 7f215fe00640 1 --2- 172.21.15.76:0/271328447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f216806c640 0x7f21680ca870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f215000c370 tx=0x7f215000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:22.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.367+0000 7f215f400640 1 -- 172.21.15.76:0/271328447 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21500052d0 con 0x7f216806c640 2024-03-28T13:50:22.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.367+0000 7f215f400640 1 -- 172.21.15.76:0/271328447 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2150005470 con 0x7f216806c640 2024-03-28T13:50:22.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.367+0000 7f216d200640 1 -- 172.21.15.76:0/271328447 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216814de60 con 0x7f216806c640 2024-03-28T13:50:22.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.367+0000 7f215f400640 1 -- 172.21.15.76:0/271328447 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150007260 con 0x7f216806c640 2024-03-28T13:50:22.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.367+0000 7f216d200640 1 -- 172.21.15.76:0/271328447 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21681584a0 con 0x7f216806c640 2024-03-28T13:50:22.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.367+0000 7f216d200640 1 -- 172.21.15.76:0/271328447 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21680686e0 con 0x7f216806c640 2024-03-28T13:50:22.635 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:50:22.639 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:50:22.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.707+0000 7f215f400640 1 -- 172.21.15.76:0/271328447 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f2150007400 con 0x7f216806c640 2024-03-28T13:50:22.705 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.707+0000 7f215f400640 1 --2- 172.21.15.76:0/271328447 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2144068010 0x7f214406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:22.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.707+0000 7f2167400640 1 --2- 172.21.15.76:0/271328447 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2144068010 0x7f214406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:22.706 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.707+0000 7f2167400640 1 --2- 172.21.15.76:0/271328447 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2144068010 0x7f214406a4d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2158009af0 tx=0x7f2158008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:22.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.727+0000 7f215f400640 1 -- 172.21.15.76:0/271328447 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f2150054340 con 0x7f216806c640 2024-03-28T13:50:22.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:22.747+0000 7f215f400640 1 -- 172.21.15.76:0/271328447 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f21500562a0 con 0x7f216806c640 2024-03-28T13:50:23.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:23.031+0000 7f216d200640 1 -- 172.21.15.76:0/271328447 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f21680c9d40 con 0x7f216806c640 2024-03-28T13:50:23.043 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:23.043+0000 7f215f400640 1 -- 172.21.15.76:0/271328447 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f215005a5a0 con 0x7f216806c640 2024-03-28T13:50:23.043 INFO:teuthology.orchestra.run.smithi076.stderr:listed 0 entries 2024-03-28T13:50:23.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:23.047+0000 7f216d200640 1 -- 172.21.15.76:0/271328447 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2144068010 msgr2=0x7f214406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:23.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:23.047+0000 7f216d200640 1 --2- 172.21.15.76:0/271328447 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2144068010 0x7f214406a4d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2158009af0 tx=0x7f2158008040 comp rx=0 tx=0).stop 2024-03-28T13:50:23.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:23.047+0000 7f216d200640 1 -- 172.21.15.76:0/271328447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f216806c640 msgr2=0x7f21680ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:23.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:23.047+0000 7f216d200640 1 --2- 172.21.15.76:0/271328447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f216806c640 0x7f21680ca870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f215000c370 tx=0x7f215000c830 comp rx=0 tx=0).stop 2024-03-28T13:50:23.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:23.047+0000 7f216d200640 1 -- 172.21.15.76:0/271328447 shutdown_connections 2024-03-28T13:50:23.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:23.047+0000 7f216d200640 1 --2- 172.21.15.76:0/271328447 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2144068010 0x7f214406a4d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:23.047 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:23.047+0000 7f216d200640 1 --2- 172.21.15.76:0/271328447 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21681546e0 0x7f2168159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:23.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:23.047+0000 7f216d200640 1 --2- 172.21.15.76:0/271328447 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f216806c640 0x7f21680ca870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:23.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:23.047+0000 7f216d200640 1 --2- 172.21.15.76:0/271328447 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f21680676f0 0x7f21681f4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:23.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:23.047+0000 7f216d200640 1 -- 172.21.15.76:0/271328447 >> 172.21.15.76:0/271328447 conn(0x7f21680c8fe0 msgr2=0x7f216814c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:23.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:23.047+0000 7f216d200640 1 -- 172.21.15.76:0/271328447 shutdown_connections 2024-03-28T13:50:23.048 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:23.047+0000 7f216d200640 1 -- 172.21.15.76:0/271328447 wait complete. 2024-03-28T13:50:23.077 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-28T13:50:23.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T13:50:23.077 DEBUG:teuthology.orchestra.run.smithi076:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-28T13:50:23.567 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi076.front.sepia.ceph.com 2024-03-28T13:50:23.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T13:50:23.568 DEBUG:teuthology.orchestra.run.smithi076:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-28T13:50:23.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T13:50:23.586 DEBUG:teuthology.orchestra.run.smithi076:> ip netns list 2024-03-28T13:50:23.637 INFO:teuthology.orchestra.run.smithi076.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-28T13:50:23.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T13:50:23.639 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-28T13:50:23.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-28T13:50:23.707 DEBUG:teuthology.orchestra.run.smithi076:> sudo ip link delete ceph-brx 2024-03-28T13:50:23.900 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-28T13:50:23.910 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-28T13:50:23.910 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T13:50:24.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.055+0000 7ff643e00640 1 Processor -- start 2024-03-28T13:50:24.054 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.055+0000 7ff643e00640 1 -- start start 2024-03-28T13:50:24.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.055+0000 7ff643e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff644154990 0x7ff6440cb220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:24.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.055+0000 7ff643e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff6440c8920 0x7ff64415e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:24.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.055+0000 7ff643e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff64415e930 0x7ff6440c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:24.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.055+0000 7ff643e00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7ff644154d70 con 0x7ff64415e930 2024-03-28T13:50:24.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.055+0000 7ff643e00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7ff64415abf0 con 0x7ff6440c8920 2024-03-28T13:50:24.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.055+0000 7ff643e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff64415aed0 con 0x7ff644154990 2024-03-28T13:50:24.056 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.055+0000 7ff643400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff64415e930 0x7ff6440c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:24.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.059+0000 7ff643400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff64415e930 0x7ff6440c9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52924/0 (socket says 172.21.15.76:52924) 2024-03-28T13:50:24.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.059+0000 7ff643400640 1 -- 172.21.15.76:0/3121937632 learned_addr learned my addr 172.21.15.76:0/3121937632 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:24.057 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.059+0000 7ff642a00640 1 --2- 172.21.15.76:0/3121937632 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff644154990 0x7ff6440cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:24.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.059+0000 7ff643400640 1 -- 172.21.15.76:0/3121937632 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff644154990 msgr2=0x7ff6440cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:24.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.059+0000 7ff643400640 1 --2- 172.21.15.76:0/3121937632 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff644154990 0x7ff6440cb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.059+0000 7ff643400640 1 -- 172.21.15.76:0/3121937632 >> v2:172.21.15.111:3300/0 conn(0x7ff6440c8920 msgr2=0x7ff64415e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:24.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.059+0000 7ff643400640 1 --2- 172.21.15.76:0/3121937632 >> v2:172.21.15.111:3300/0 conn(0x7ff6440c8920 0x7ff64415e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.059 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.059+0000 7ff643400640 1 -- 172.21.15.76:0/3121937632 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64415b1b0 con 0x7ff64415e930 2024-03-28T13:50:24.063 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.063+0000 7ff643400640 1 --2- 172.21.15.76:0/3121937632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff64415e930 0x7ff6440c9950 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff6440cbae0 tx=0x7ff63c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b71251514af78fd server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:24.066 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.067+0000 7ff641600640 1 -- 172.21.15.76:0/3121937632 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0a5780 con 0x7ff64415e930 2024-03-28T13:50:24.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.067+0000 7ff641600640 1 -- 172.21.15.76:0/3121937632 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff63c0a5920 con 0x7ff64415e930 2024-03-28T13:50:24.067 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.067+0000 7ff641600640 1 -- 172.21.15.76:0/3121937632 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63c0a5cf0 con 0x7ff64415e930 2024-03-28T13:50:24.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.067+0000 7ff643e00640 1 -- 172.21.15.76:0/3121937632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff64415e930 msgr2=0x7ff6440c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:24.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.067+0000 7ff643e00640 1 --2- 172.21.15.76:0/3121937632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff64415e930 0x7ff6440c9950 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff6440cbae0 tx=0x7ff63c01c9f0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.067+0000 7ff643e00640 1 -- 172.21.15.76:0/3121937632 shutdown_connections 2024-03-28T13:50:24.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.067+0000 7ff643e00640 1 --2- 172.21.15.76:0/3121937632 >> v2:172.21.15.111:3300/0 conn(0x7ff6440c8920 0x7ff64415e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.067+0000 7ff643e00640 1 --2- 172.21.15.76:0/3121937632 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff64415e930 0x7ff6440c9950 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.067+0000 7ff643e00640 1 --2- 172.21.15.76:0/3121937632 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff644154990 0x7ff6440cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.067+0000 7ff643e00640 1 -- 172.21.15.76:0/3121937632 >> 172.21.15.76:0/3121937632 conn(0x7ff64406bc50 msgr2=0x7ff64406ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:24.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.067+0000 7ff643e00640 1 -- 172.21.15.76:0/3121937632 shutdown_connections 2024-03-28T13:50:24.068 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.067+0000 7ff643e00640 1 -- 172.21.15.76:0/3121937632 wait complete. 2024-03-28T13:50:24.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.071+0000 7ff643e00640 1 Processor -- start 2024-03-28T13:50:24.070 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.071+0000 7ff643e00640 1 -- start start 2024-03-28T13:50:24.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.071+0000 7ff643e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6440c8920 0x7ff6440af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:24.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.071+0000 7ff643e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff644154990 0x7ff6440aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:24.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.071+0000 7ff643e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff64415e930 0x7ff6440b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:24.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.071+0000 7ff643e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff6440c4cc0 con 0x7ff6440c8920 2024-03-28T13:50:24.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.071+0000 7ff643e00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff6440c4b40 con 0x7ff644154990 2024-03-28T13:50:24.072 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.071+0000 7ff643e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff6440c4e40 con 0x7ff64415e930 2024-03-28T13:50:24.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.075+0000 7ff642a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6440c8920 0x7ff6440af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:24.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.075+0000 7ff642a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6440c8920 0x7ff6440af440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52936/0 (socket says 172.21.15.76:52936) 2024-03-28T13:50:24.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.075+0000 7ff642a00640 1 -- 172.21.15.76:0/3697289455 learned_addr learned my addr 172.21.15.76:0/3697289455 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:24.073 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.075+0000 7ff643400640 1 --2- 172.21.15.76:0/3697289455 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff64415e930 0x7ff6440b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:24.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.075+0000 7ff642a00640 1 -- 172.21.15.76:0/3697289455 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff64415e930 msgr2=0x7ff6440b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:24.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.075+0000 7ff642a00640 1 --2- 172.21.15.76:0/3697289455 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff64415e930 0x7ff6440b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.075+0000 7ff642a00640 1 -- 172.21.15.76:0/3697289455 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff644154990 msgr2=0x7ff6440aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:24.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.075+0000 7ff642a00640 1 --2- 172.21.15.76:0/3697289455 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff644154990 0x7ff6440aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.075+0000 7ff642a00640 1 -- 172.21.15.76:0/3697289455 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6440b1690 con 0x7ff6440c8920 2024-03-28T13:50:24.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.079+0000 7ff642a00640 1 --2- 172.21.15.76:0/3697289455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6440c8920 0x7ff6440af440 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff63400e960 tx=0x7ff63400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:24.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.083+0000 7ff63aa00640 1 -- 172.21.15.76:0/3697289455 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff634017070 con 0x7ff6440c8920 2024-03-28T13:50:24.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.083+0000 7ff63aa00640 1 -- 172.21.15.76:0/3697289455 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff63400ca00 con 0x7ff6440c8920 2024-03-28T13:50:24.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.083+0000 7ff63aa00640 1 -- 172.21.15.76:0/3697289455 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff63400cdb0 con 0x7ff6440c8920 2024-03-28T13:50:24.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.083+0000 7ff643e00640 1 -- 172.21.15.76:0/3697289455 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6440b10d0 con 0x7ff6440c8920 2024-03-28T13:50:24.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.083+0000 7ff643e00640 1 -- 172.21.15.76:0/3697289455 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6440b1e20 con 0x7ff6440c8920 2024-03-28T13:50:24.084 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.083+0000 7ff643e00640 1 -- 172.21.15.76:0/3697289455 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6440686e0 con 0x7ff6440c8920 2024-03-28T13:50:24.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.103+0000 7ff63aa00640 1 -- 172.21.15.76:0/3697289455 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff63401a070 con 0x7ff6440c8920 2024-03-28T13:50:24.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.103+0000 7ff63aa00640 1 --2- 172.21.15.76:0/3697289455 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff624067fc0 0x7ff62406a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:24.104 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.103+0000 7ff642000640 1 --2- 172.21.15.76:0/3697289455 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff624067fc0 0x7ff62406a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:24.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.107+0000 7ff63aa00640 1 -- 172.21.15.76:0/3697289455 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7ff634054f10 con 0x7ff6440c8920 2024-03-28T13:50:24.105 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.107+0000 7ff642000640 1 --2- 172.21.15.76:0/3697289455 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff624067fc0 0x7ff62406a480 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff64415cd10 tx=0x7ff630006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:24.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.451+0000 7ff63aa00640 1 -- 172.21.15.76:0/3697289455 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ff634056e70 con 0x7ff6440c8920 2024-03-28T13:50:24.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.647+0000 7ff643e00640 1 -- 172.21.15.76:0/3697289455 --> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff6440b0e60 con 0x7ff624067fc0 2024-03-28T13:50:24.659 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.659+0000 7ff63aa00640 1 -- 172.21.15.76:0/3697289455 <== mgr.4107 v2:172.21.15.76:6800/1313648511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335013 (secure 0 0 0) 0x7ff6440b0e60 con 0x7ff624067fc0 2024-03-28T13:50:24.664 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T13:50:24.667 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-03-28T13:50:24.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.667+0000 7ff643e00640 1 -- 172.21.15.76:0/3697289455 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff624067fc0 msgr2=0x7ff62406a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:24.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.667+0000 7ff643e00640 1 --2- 172.21.15.76:0/3697289455 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff624067fc0 0x7ff62406a480 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff64415cd10 tx=0x7ff630006ca0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.667+0000 7ff643e00640 1 -- 172.21.15.76:0/3697289455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6440c8920 msgr2=0x7ff6440af440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:24.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.667+0000 7ff643e00640 1 --2- 172.21.15.76:0/3697289455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6440c8920 0x7ff6440af440 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff63400e960 tx=0x7ff63400ee20 comp rx=0 tx=0).stop 2024-03-28T13:50:24.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.667+0000 7ff643e00640 1 -- 172.21.15.76:0/3697289455 shutdown_connections 2024-03-28T13:50:24.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.667+0000 7ff643e00640 1 --2- 172.21.15.76:0/3697289455 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff624067fc0 0x7ff62406a480 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.667+0000 7ff643e00640 1 --2- 172.21.15.76:0/3697289455 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff64415e930 0x7ff6440b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.667+0000 7ff643e00640 1 --2- 172.21.15.76:0/3697289455 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff644154990 0x7ff6440aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.667+0000 7ff643e00640 1 --2- 172.21.15.76:0/3697289455 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff6440c8920 0x7ff6440af440 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.667+0000 7ff643e00640 1 -- 172.21.15.76:0/3697289455 >> 172.21.15.76:0/3697289455 conn(0x7ff64406bc50 msgr2=0x7ff6440c8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:24.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.667+0000 7ff643e00640 1 -- 172.21.15.76:0/3697289455 shutdown_connections 2024-03-28T13:50:24.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.667+0000 7ff643e00640 1 -- 172.21.15.76:0/3697289455 wait complete. 2024-03-28T13:50:24.686 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":2095,"stamp":"2024-03-28T13:50:24.033756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":189775996,"num_objects":145,"num_object_clones":0,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":2658,"num_read_kb":3443252,"num_write":48817,"num_write_kb":4437328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59458,"ondisk_log_size":59458,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":930488,"kb_used_data":163640,"kb_used_omap":12,"kb_used_meta":766771,"kb_avail":754044232,"statfs":{"total":773094113280,"available":772141293568,"internally_reserved":0,"allocated":167567360,"data_stored":380578568,"data_compressed":51440597,"data_compressed_allocated":66924544,"data_compressed_original":281636864,"omap_allocated":12752,"internal_metadata":785174064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-249269,"num_objects":-65,"num_object_clones":0,"num_object_copies":-260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-65,"num_whiteouts":0,"num_read":5,"num_read_kb":11,"num_write":113,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003128"},"pg_stats":[{"pgid":"2.1f","version":"29'318","reported_seq":378,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:44.426165+0000","last_change":"2024-03-28T12:42:00.080769+0000","last_active":"2024-03-28T13:49:44.426165+0000","last_peered":"2024-03-28T13:49:44.426165+0000","last_clean":"2024-03-28T13:49:44.426165+0000","last_became_active":"2024-03-28T12:42:00.079900+0000","last_became_peered":"2024-03-28T12:42:00.079900+0000","last_unstale":"2024-03-28T13:49:44.426165+0000","last_undegraded":"2024-03-28T13:49:44.426165+0000","last_fullsized":"2024-03-28T13:49:44.426165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:26.156056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'198","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.300790+0000","last_change":"2024-03-28T12:42:01.960244+0000","last_active":"2024-03-28T13:50:18.300790+0000","last_peered":"2024-03-28T13:50:18.300790+0000","last_clean":"2024-03-28T13:50:18.300790+0000","last_became_active":"2024-03-28T12:42:01.959408+0000","last_became_peered":"2024-03-28T12:42:01.959408+0000","last_unstale":"2024-03-28T13:50:18.300790+0000","last_undegraded":"2024-03-28T13:50:18.300790+0000","last_fullsized":"2024-03-28T13:50:18.300790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:00:51.741925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'806","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.626553+0000","last_change":"2024-03-28T12:42:07.880943+0000","last_active":"2024-03-28T13:50:14.626553+0000","last_peered":"2024-03-28T13:50:14.626553+0000","last_clean":"2024-03-28T13:50:14.626553+0000","last_became_active":"2024-03-28T12:42:07.880354+0000","last_became_peered":"2024-03-28T12:42:07.880354+0000","last_unstale":"2024-03-28T13:50:14.626553+0000","last_undegraded":"2024-03-28T13:50:14.626553+0000","last_fullsized":"2024-03-28T13:50:14.626553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:39.078379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":120104,"num_write":790,"num_write_kb":143940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'158","reported_seq":220,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:13.417457+0000","last_change":"2024-03-28T12:42:00.138569+0000","last_active":"2024-03-28T13:49:13.417457+0000","last_peered":"2024-03-28T13:49:13.417457+0000","last_clean":"2024-03-28T13:49:13.417457+0000","last_became_active":"2024-03-28T12:42:00.137978+0000","last_became_peered":"2024-03-28T12:42:00.137978+0000","last_unstale":"2024-03-28T13:49:13.417457+0000","last_undegraded":"2024-03-28T13:49:13.417457+0000","last_fullsized":"2024-03-28T13:49:13.417457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:38:28.575778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'181","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:49.891465+0000","last_change":"2024-03-28T12:42:01.958236+0000","last_active":"2024-03-28T13:49:49.891465+0000","last_peered":"2024-03-28T13:49:49.891465+0000","last_clean":"2024-03-28T13:49:49.891465+0000","last_became_active":"2024-03-28T12:42:01.957875+0000","last_became_peered":"2024-03-28T12:42:01.957875+0000","last_unstale":"2024-03-28T13:49:49.891465+0000","last_undegraded":"2024-03-28T13:49:49.891465+0000","last_fullsized":"2024-03-28T13:49:49.891465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:48:52.933175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'798","reported_seq":902,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.551364+0000","last_change":"2024-03-28T12:42:07.905799+0000","last_active":"2024-03-28T13:50:14.551364+0000","last_peered":"2024-03-28T13:50:14.551364+0000","last_clean":"2024-03-28T13:50:14.551364+0000","last_became_active":"2024-03-28T12:42:07.905350+0000","last_became_peered":"2024-03-28T12:42:07.905350+0000","last_unstale":"2024-03-28T13:50:14.551364+0000","last_undegraded":"2024-03-28T13:50:14.551364+0000","last_fullsized":"2024-03-28T13:50:14.551364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:33:42.281079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":162211,"num_write":782,"num_write_kb":177125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1182","reported_seq":1236,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.424452+0000","last_change":"2024-03-28T12:42:00.150272+0000","last_active":"2024-03-28T13:50:04.424452+0000","last_peered":"2024-03-28T13:50:04.424452+0000","last_clean":"2024-03-28T13:50:04.424452+0000","last_became_active":"2024-03-28T12:42:00.148367+0000","last_became_peered":"2024-03-28T12:42:00.148367+0000","last_unstale":"2024-03-28T13:50:04.424452+0000","last_undegraded":"2024-03-28T13:50:04.424452+0000","last_fullsized":"2024-03-28T13:50:04.424452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:26.156056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1357,"num_write_kb":12879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'180","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:54.148733+0000","last_change":"2024-03-28T12:42:01.965158+0000","last_active":"2024-03-28T13:49:54.148733+0000","last_peered":"2024-03-28T13:49:54.148733+0000","last_clean":"2024-03-28T13:49:54.148733+0000","last_became_active":"2024-03-28T12:42:01.964817+0000","last_became_peered":"2024-03-28T12:42:01.964817+0000","last_unstale":"2024-03-28T13:49:54.148733+0000","last_undegraded":"2024-03-28T13:49:54.148733+0000","last_fullsized":"2024-03-28T13:49:54.148733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'762","reported_seq":839,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.394329+0000","last_change":"2024-03-28T12:42:07.906794+0000","last_active":"2024-03-28T13:50:14.394329+0000","last_peered":"2024-03-28T13:50:14.394329+0000","last_clean":"2024-03-28T13:50:14.394329+0000","last_became_active":"2024-03-28T12:42:07.905522+0000","last_became_peered":"2024-03-28T12:42:07.905522+0000","last_unstale":"2024-03-28T13:50:14.394329+0000","last_undegraded":"2024-03-28T13:50:14.394329+0000","last_fullsized":"2024-03-28T13:50:14.394329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:21.970094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":115606,"num_write":742,"num_write_kb":142838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'844","reported_seq":898,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:49.078377+0000","last_change":"2024-03-28T12:42:00.149947+0000","last_active":"2024-03-28T13:49:49.078377+0000","last_peered":"2024-03-28T13:49:49.078377+0000","last_clean":"2024-03-28T13:49:49.078377+0000","last_became_active":"2024-03-28T12:42:00.148446+0000","last_became_peered":"2024-03-28T12:42:00.148446+0000","last_unstale":"2024-03-28T13:49:49.078377+0000","last_undegraded":"2024-03-28T13:49:49.078377+0000","last_fullsized":"2024-03-28T13:49:49.078377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:47:28.765823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'189","reported_seq":242,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.728289+0000","last_change":"2024-03-28T12:42:01.935596+0000","last_active":"2024-03-28T13:50:08.728289+0000","last_peered":"2024-03-28T13:50:08.728289+0000","last_clean":"2024-03-28T13:50:08.728289+0000","last_became_active":"2024-03-28T12:42:01.935231+0000","last_became_peered":"2024-03-28T12:42:01.935231+0000","last_unstale":"2024-03-28T13:50:08.728289+0000","last_undegraded":"2024-03-28T13:50:08.728289+0000","last_fullsized":"2024-03-28T13:50:08.728289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:17:41.296627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'756","reported_seq":818,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:09.199693+0000","last_change":"2024-03-28T12:42:07.904616+0000","last_active":"2024-03-28T13:50:09.199693+0000","last_peered":"2024-03-28T13:50:09.199693+0000","last_clean":"2024-03-28T13:50:09.199693+0000","last_became_active":"2024-03-28T12:42:07.904240+0000","last_became_peered":"2024-03-28T12:42:07.904240+0000","last_unstale":"2024-03-28T13:50:09.199693+0000","last_undegraded":"2024-03-28T13:50:09.199693+0000","last_fullsized":"2024-03-28T13:50:09.199693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:19:27.175393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":42901,"num_write":735,"num_write_kb":89492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'210","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.983392+0000","last_change":"2024-03-28T12:42:01.963116+0000","last_active":"2024-03-28T13:50:14.983392+0000","last_peered":"2024-03-28T13:50:14.983392+0000","last_clean":"2024-03-28T13:50:14.983392+0000","last_became_active":"2024-03-28T12:42:01.962885+0000","last_became_peered":"2024-03-28T12:42:01.962885+0000","last_unstale":"2024-03-28T13:50:14.983392+0000","last_undegraded":"2024-03-28T13:50:14.983392+0000","last_fullsized":"2024-03-28T13:50:14.983392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:19:06.640780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'621","reported_seq":679,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:28.940898+0000","last_change":"2024-03-28T12:42:00.134353+0000","last_active":"2024-03-28T13:49:28.940898+0000","last_peered":"2024-03-28T13:49:28.940898+0000","last_clean":"2024-03-28T13:49:28.940898+0000","last_became_active":"2024-03-28T12:42:00.133880+0000","last_became_peered":"2024-03-28T12:42:00.133880+0000","last_unstale":"2024-03-28T13:49:28.940898+0000","last_undegraded":"2024-03-28T13:49:28.940898+0000","last_fullsized":"2024-03-28T13:49:28.940898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:45:14.194934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":12550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'827","reported_seq":932,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.428091+0000","last_change":"2024-03-28T12:42:15.238142+0000","last_active":"2024-03-28T13:50:04.428091+0000","last_peered":"2024-03-28T13:50:04.428091+0000","last_clean":"2024-03-28T13:50:04.428091+0000","last_became_active":"2024-03-28T12:42:15.237739+0000","last_became_peered":"2024-03-28T12:42:15.237739+0000","last_unstale":"2024-03-28T13:50:04.428091+0000","last_undegraded":"2024-03-28T13:50:04.428091+0000","last_fullsized":"2024-03-28T13:50:04.428091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:41:14.243482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":166655,"num_write":808,"num_write_kb":213920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'203","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:34.279894+0000","last_change":"2024-03-28T12:42:01.948688+0000","last_active":"2024-03-28T13:49:34.279894+0000","last_peered":"2024-03-28T13:49:34.279894+0000","last_clean":"2024-03-28T13:49:34.279894+0000","last_became_active":"2024-03-28T12:42:01.948049+0000","last_became_peered":"2024-03-28T12:42:01.948049+0000","last_unstale":"2024-03-28T13:49:34.279894+0000","last_undegraded":"2024-03-28T13:49:34.279894+0000","last_fullsized":"2024-03-28T13:49:34.279894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'872","reported_seq":930,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.816043+0000","last_change":"2024-03-28T12:42:00.139208+0000","last_active":"2024-03-28T13:50:15.816043+0000","last_peered":"2024-03-28T13:50:15.816043+0000","last_clean":"2024-03-28T13:50:15.816043+0000","last_became_active":"2024-03-28T12:42:00.138264+0000","last_became_peered":"2024-03-28T12:42:00.138264+0000","last_unstale":"2024-03-28T13:50:15.816043+0000","last_undegraded":"2024-03-28T13:50:15.816043+0000","last_fullsized":"2024-03-28T13:50:15.816043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7256295,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":7576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'824","reported_seq":898,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.939869+0000","last_change":"2024-03-28T12:42:07.941636+0000","last_active":"2024-03-28T13:50:14.939869+0000","last_peered":"2024-03-28T13:50:14.939869+0000","last_clean":"2024-03-28T13:50:14.939869+0000","last_became_active":"2024-03-28T12:42:07.941114+0000","last_became_peered":"2024-03-28T12:42:07.941114+0000","last_unstale":"2024-03-28T13:50:14.939869+0000","last_undegraded":"2024-03-28T13:50:14.939869+0000","last_fullsized":"2024-03-28T13:50:14.939869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:00:58.736580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":77884,"num_write":800,"num_write_kb":72822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'198","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:44.614126+0000","last_change":"2024-03-28T12:42:01.949545+0000","last_active":"2024-03-28T13:49:44.614126+0000","last_peered":"2024-03-28T13:49:44.614126+0000","last_clean":"2024-03-28T13:49:44.614126+0000","last_became_active":"2024-03-28T12:42:01.946576+0000","last_became_peered":"2024-03-28T12:42:01.946576+0000","last_unstale":"2024-03-28T13:49:44.614126+0000","last_undegraded":"2024-03-28T13:49:44.614126+0000","last_fullsized":"2024-03-28T13:49:44.614126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:32.704186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'258","reported_seq":317,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:12.902420+0000","last_change":"2024-03-28T12:42:00.142804+0000","last_active":"2024-03-28T13:49:12.902420+0000","last_peered":"2024-03-28T13:49:12.902420+0000","last_clean":"2024-03-28T13:49:12.902420+0000","last_became_active":"2024-03-28T12:42:00.142063+0000","last_became_peered":"2024-03-28T12:42:00.142063+0000","last_unstale":"2024-03-28T13:49:12.902420+0000","last_undegraded":"2024-03-28T13:49:12.902420+0000","last_fullsized":"2024-03-28T13:49:12.902420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:20:01.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'752","reported_seq":836,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.513787+0000","last_change":"2024-03-28T12:42:15.234431+0000","last_active":"2024-03-28T13:50:14.513787+0000","last_peered":"2024-03-28T13:50:14.513787+0000","last_clean":"2024-03-28T13:50:14.513787+0000","last_became_active":"2024-03-28T12:42:15.232928+0000","last_became_peered":"2024-03-28T12:42:15.232928+0000","last_unstale":"2024-03-28T13:50:14.513787+0000","last_undegraded":"2024-03-28T13:50:14.513787+0000","last_fullsized":"2024-03-28T13:50:14.513787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:05:19.841176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":85819,"num_write":731,"num_write_kb":97778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,5],"acting":[7,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'220","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.372553+0000","last_change":"2024-03-28T12:42:01.787457+0000","last_active":"2024-03-28T13:50:14.372553+0000","last_peered":"2024-03-28T13:50:14.372553+0000","last_clean":"2024-03-28T13:50:14.372553+0000","last_became_active":"2024-03-28T12:42:01.787253+0000","last_became_peered":"2024-03-28T12:42:01.787253+0000","last_unstale":"2024-03-28T13:50:14.372553+0000","last_undegraded":"2024-03-28T13:50:14.372553+0000","last_fullsized":"2024-03-28T13:50:14.372553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:33.620394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'771","reported_seq":829,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:23.369953+0000","last_change":"2024-03-28T12:42:00.146723+0000","last_active":"2024-03-28T13:49:23.369953+0000","last_peered":"2024-03-28T13:49:23.369953+0000","last_clean":"2024-03-28T13:49:23.369953+0000","last_became_active":"2024-03-28T12:42:00.146394+0000","last_became_peered":"2024-03-28T12:42:00.146394+0000","last_unstale":"2024-03-28T13:49:23.369953+0000","last_undegraded":"2024-03-28T13:49:23.369953+0000","last_fullsized":"2024-03-28T13:49:23.369953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:20:01.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'732","reported_seq":812,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.104446+0000","last_change":"2024-03-28T12:42:07.906623+0000","last_active":"2024-03-28T13:50:15.104446+0000","last_peered":"2024-03-28T13:50:15.104446+0000","last_clean":"2024-03-28T13:50:15.104446+0000","last_became_active":"2024-03-28T12:42:07.906233+0000","last_became_peered":"2024-03-28T12:42:07.906233+0000","last_unstale":"2024-03-28T13:50:15.104446+0000","last_undegraded":"2024-03-28T13:50:15.104446+0000","last_fullsized":"2024-03-28T13:50:15.104446+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:45.857353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":108609,"num_write":711,"num_write_kb":134735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'218","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.110350+0000","last_change":"2024-03-28T12:42:01.946498+0000","last_active":"2024-03-28T13:50:15.110350+0000","last_peered":"2024-03-28T13:50:15.110350+0000","last_clean":"2024-03-28T13:50:15.110350+0000","last_became_active":"2024-03-28T12:42:01.946087+0000","last_became_peered":"2024-03-28T12:42:01.946087+0000","last_unstale":"2024-03-28T13:50:15.110350+0000","last_undegraded":"2024-03-28T13:50:15.110350+0000","last_fullsized":"2024-03-28T13:50:15.110350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:05:13.466983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'253","reported_seq":312,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:40.083465+0000","last_change":"2024-03-28T12:42:00.143860+0000","last_active":"2024-03-28T13:49:40.083465+0000","last_peered":"2024-03-28T13:49:40.083465+0000","last_clean":"2024-03-28T13:49:40.083465+0000","last_became_active":"2024-03-28T12:42:00.143537+0000","last_became_peered":"2024-03-28T12:42:00.143537+0000","last_unstale":"2024-03-28T13:49:40.083465+0000","last_undegraded":"2024-03-28T13:49:40.083465+0000","last_fullsized":"2024-03-28T13:49:40.083465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:38:32.416338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":4185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'820","reported_seq":928,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.550528+0000","last_change":"2024-03-28T12:42:15.365975+0000","last_active":"2024-03-28T13:50:14.550528+0000","last_peered":"2024-03-28T13:50:14.550528+0000","last_clean":"2024-03-28T13:50:14.550528+0000","last_became_active":"2024-03-28T12:42:15.365535+0000","last_became_peered":"2024-03-28T12:42:15.365535+0000","last_unstale":"2024-03-28T13:50:14.550528+0000","last_undegraded":"2024-03-28T13:50:14.550528+0000","last_fullsized":"2024-03-28T13:50:14.550528+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":174138,"num_write":805,"num_write_kb":205369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,1],"acting":[2,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'170","reported_seq":227,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:39.978541+0000","last_change":"2024-03-28T12:42:01.802128+0000","last_active":"2024-03-28T13:49:39.978541+0000","last_peered":"2024-03-28T13:49:39.978541+0000","last_clean":"2024-03-28T13:49:39.978541+0000","last_became_active":"2024-03-28T12:42:01.801492+0000","last_became_peered":"2024-03-28T12:42:01.801492+0000","last_unstale":"2024-03-28T13:49:39.978541+0000","last_undegraded":"2024-03-28T13:49:39.978541+0000","last_fullsized":"2024-03-28T13:49:39.978541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:23:08.932618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'3005","reported_seq":3064,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:17.434838+0000","last_change":"2024-03-28T12:42:00.145914+0000","last_active":"2024-03-28T13:50:17.434838+0000","last_peered":"2024-03-28T13:50:17.434838+0000","last_clean":"2024-03-28T13:50:17.434838+0000","last_became_active":"2024-03-28T12:42:00.145638+0000","last_became_peered":"2024-03-28T12:42:00.145638+0000","last_unstale":"2024-03-28T13:50:17.434838+0000","last_undegraded":"2024-03-28T13:50:17.434838+0000","last_fullsized":"2024-03-28T13:50:17.434838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3005,"log_dups_size":0,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:47:28.765823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6731,"num_write_kb":3813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'791","reported_seq":864,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.443936+0000","last_change":"2024-03-28T12:42:07.882697+0000","last_active":"2024-03-28T13:50:04.443936+0000","last_peered":"2024-03-28T13:50:04.443936+0000","last_clean":"2024-03-28T13:50:04.443936+0000","last_became_active":"2024-03-28T12:42:07.881730+0000","last_became_peered":"2024-03-28T12:42:07.881730+0000","last_unstale":"2024-03-28T13:50:04.443936+0000","last_undegraded":"2024-03-28T13:50:04.443936+0000","last_fullsized":"2024-03-28T13:50:04.443936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:12:27.231636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":64976,"num_write":766,"num_write_kb":85207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'195","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.718553+0000","last_change":"2024-03-28T12:42:01.810914+0000","last_active":"2024-03-28T13:50:08.718553+0000","last_peered":"2024-03-28T13:50:08.718553+0000","last_clean":"2024-03-28T13:50:08.718553+0000","last_became_active":"2024-03-28T12:42:01.810207+0000","last_became_peered":"2024-03-28T12:42:01.810207+0000","last_unstale":"2024-03-28T13:50:08.718553+0000","last_undegraded":"2024-03-28T13:50:08.718553+0000","last_fullsized":"2024-03-28T13:50:08.718553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:32.704186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'669","reported_seq":729,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:23.207829+0000","last_change":"2024-03-28T12:42:00.078402+0000","last_active":"2024-03-28T13:49:23.207829+0000","last_peered":"2024-03-28T13:49:23.207829+0000","last_clean":"2024-03-28T13:49:23.207829+0000","last_became_active":"2024-03-28T12:42:00.077988+0000","last_became_peered":"2024-03-28T12:42:00.077988+0000","last_unstale":"2024-03-28T13:49:23.207829+0000","last_undegraded":"2024-03-28T13:49:23.207829+0000","last_fullsized":"2024-03-28T13:49:23.207829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:21:58.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":8525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'762","reported_seq":849,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.824806+0000","last_change":"2024-03-28T12:42:07.936419+0000","last_active":"2024-03-28T13:50:08.824806+0000","last_peered":"2024-03-28T13:50:08.824806+0000","last_clean":"2024-03-28T13:50:08.824806+0000","last_became_active":"2024-03-28T12:42:07.935820+0000","last_became_peered":"2024-03-28T12:42:07.935820+0000","last_unstale":"2024-03-28T13:50:08.824806+0000","last_undegraded":"2024-03-28T13:50:08.824806+0000","last_fullsized":"2024-03-28T13:50:08.824806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:35:08.334379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":124547,"num_write":741,"num_write_kb":143298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'206","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.676800+0000","last_change":"2024-03-28T12:42:01.968887+0000","last_active":"2024-03-28T13:50:14.676800+0000","last_peered":"2024-03-28T13:50:14.676800+0000","last_clean":"2024-03-28T13:50:14.676800+0000","last_became_active":"2024-03-28T12:42:01.965491+0000","last_became_peered":"2024-03-28T12:42:01.965491+0000","last_unstale":"2024-03-28T13:50:14.676800+0000","last_undegraded":"2024-03-28T13:50:14.676800+0000","last_fullsized":"2024-03-28T13:50:14.676800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:35:50.246850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'378","reported_seq":438,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:48:53.431765+0000","last_change":"2024-03-28T12:42:00.135482+0000","last_active":"2024-03-28T13:48:53.431765+0000","last_peered":"2024-03-28T13:48:53.431765+0000","last_clean":"2024-03-28T13:48:53.431765+0000","last_became_active":"2024-03-28T12:42:00.132939+0000","last_became_peered":"2024-03-28T12:42:00.132939+0000","last_unstale":"2024-03-28T13:48:53.431765+0000","last_undegraded":"2024-03-28T13:48:53.431765+0000","last_fullsized":"2024-03-28T13:48:53.431765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:31:41.407157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'754","reported_seq":812,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.841272+0000","last_change":"2024-03-28T12:42:07.865644+0000","last_active":"2024-03-28T13:50:08.841272+0000","last_peered":"2024-03-28T13:50:08.841272+0000","last_clean":"2024-03-28T13:50:08.841272+0000","last_became_active":"2024-03-28T12:42:07.864804+0000","last_became_peered":"2024-03-28T12:42:07.864804+0000","last_unstale":"2024-03-28T13:50:08.841272+0000","last_undegraded":"2024-03-28T13:50:08.841272+0000","last_fullsized":"2024-03-28T13:50:08.841272+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:28.659784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":19361,"num_write":730,"num_write_kb":84308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'195","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:49.984071+0000","last_change":"2024-03-28T12:42:01.966222+0000","last_active":"2024-03-28T13:49:49.984071+0000","last_peered":"2024-03-28T13:49:49.984071+0000","last_clean":"2024-03-28T13:49:49.984071+0000","last_became_active":"2024-03-28T12:42:01.962305+0000","last_became_peered":"2024-03-28T12:42:01.962305+0000","last_unstale":"2024-03-28T13:49:49.984071+0000","last_undegraded":"2024-03-28T13:49:49.984071+0000","last_fullsized":"2024-03-28T13:49:49.984071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:33:35.906886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'899","reported_seq":959,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:48:08.735973+0000","last_change":"2024-03-28T12:42:00.137406+0000","last_active":"2024-03-28T13:48:08.735973+0000","last_peered":"2024-03-28T13:48:08.735973+0000","last_clean":"2024-03-28T13:48:08.735973+0000","last_became_active":"2024-03-28T12:42:00.137086+0000","last_became_peered":"2024-03-28T12:42:00.137086+0000","last_unstale":"2024-03-28T13:48:08.735973+0000","last_undegraded":"2024-03-28T13:48:08.735973+0000","last_fullsized":"2024-03-28T13:48:08.735973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:44:10.945015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389450,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":8591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'738","reported_seq":816,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.304618+0000","last_change":"2024-03-28T12:42:07.940726+0000","last_active":"2024-03-28T13:50:18.304618+0000","last_peered":"2024-03-28T13:50:18.304618+0000","last_clean":"2024-03-28T13:50:18.304618+0000","last_became_active":"2024-03-28T12:42:07.939926+0000","last_became_peered":"2024-03-28T12:42:07.939926+0000","last_unstale":"2024-03-28T13:50:18.304618+0000","last_undegraded":"2024-03-28T13:50:18.304618+0000","last_fullsized":"2024-03-28T13:50:18.304618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:45.857353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":104657,"num_write":715,"num_write_kb":183622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'203","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.453979+0000","last_change":"2024-03-28T12:42:01.949510+0000","last_active":"2024-03-28T13:50:04.453979+0000","last_peered":"2024-03-28T13:50:04.453979+0000","last_clean":"2024-03-28T13:50:04.453979+0000","last_became_active":"2024-03-28T12:42:01.949046+0000","last_became_peered":"2024-03-28T12:42:01.949046+0000","last_unstale":"2024-03-28T13:50:04.453979+0000","last_undegraded":"2024-03-28T13:50:04.453979+0000","last_fullsized":"2024-03-28T13:50:04.453979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:50:04.915302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1503","reported_seq":2997,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.279902+0000","last_change":"2024-03-28T12:42:00.150734+0000","last_active":"2024-03-28T13:50:18.279902+0000","last_peered":"2024-03-28T13:50:18.279902+0000","last_clean":"2024-03-28T13:50:18.279902+0000","last_became_active":"2024-03-28T12:42:00.150209+0000","last_became_peered":"2024-03-28T12:42:00.150209+0000","last_unstale":"2024-03-28T13:50:18.279902+0000","last_undegraded":"2024-03-28T13:50:18.279902+0000","last_fullsized":"2024-03-28T13:50:18.279902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1503,"log_dups_size":0,"ondisk_log_size":1503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:01:08.734929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1566263,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1436,"num_read_kb":2621,"num_write":1442,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'706","reported_seq":785,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.371808+0000","last_change":"2024-03-28T12:42:07.935974+0000","last_active":"2024-03-28T13:50:14.371808+0000","last_peered":"2024-03-28T13:50:14.371808+0000","last_clean":"2024-03-28T13:50:14.371808+0000","last_became_active":"2024-03-28T12:42:07.935342+0000","last_became_peered":"2024-03-28T12:42:07.935342+0000","last_unstale":"2024-03-28T13:50:14.371808+0000","last_undegraded":"2024-03-28T13:50:14.371808+0000","last_fullsized":"2024-03-28T13:50:14.371808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:21.970094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":64573,"num_write":698,"num_write_kb":72611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'193","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.635107+0000","last_change":"2024-03-28T12:42:01.961701+0000","last_active":"2024-03-28T13:50:03.635107+0000","last_peered":"2024-03-28T13:50:03.635107+0000","last_clean":"2024-03-28T13:50:03.635107+0000","last_became_active":"2024-03-28T12:42:01.961228+0000","last_became_peered":"2024-03-28T12:42:01.961228+0000","last_unstale":"2024-03-28T13:50:03.635107+0000","last_undegraded":"2024-03-28T13:50:03.635107+0000","last_fullsized":"2024-03-28T13:50:03.635107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'517","reported_seq":579,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:54.262943+0000","last_change":"2024-03-28T12:42:00.069398+0000","last_active":"2024-03-28T13:49:54.262943+0000","last_peered":"2024-03-28T13:49:54.262943+0000","last_clean":"2024-03-28T13:49:54.262943+0000","last_became_active":"2024-03-28T12:42:00.069134+0000","last_became_peered":"2024-03-28T12:42:00.069134+0000","last_unstale":"2024-03-28T13:49:54.262943+0000","last_undegraded":"2024-03-28T13:49:54.262943+0000","last_fullsized":"2024-03-28T13:49:54.262943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:57:54.776311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":460,"num_write_kb":12504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'872","reported_seq":971,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.109378+0000","last_change":"2024-03-28T12:42:15.365776+0000","last_active":"2024-03-28T13:50:15.109378+0000","last_peered":"2024-03-28T13:50:15.109378+0000","last_clean":"2024-03-28T13:50:15.109378+0000","last_became_active":"2024-03-28T12:42:15.364496+0000","last_became_peered":"2024-03-28T12:42:15.364496+0000","last_unstale":"2024-03-28T13:50:15.109378+0000","last_undegraded":"2024-03-28T13:50:15.109378+0000","last_fullsized":"2024-03-28T13:50:15.109378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:22:09.948471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":158824,"num_write":857,"num_write_kb":176540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'180","reported_seq":238,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:59.827677+0000","last_change":"2024-03-28T12:42:01.959210+0000","last_active":"2024-03-28T13:49:59.827677+0000","last_peered":"2024-03-28T13:49:59.827677+0000","last_clean":"2024-03-28T13:49:59.827677+0000","last_became_active":"2024-03-28T12:42:01.958117+0000","last_became_peered":"2024-03-28T12:42:01.958117+0000","last_unstale":"2024-03-28T13:49:59.827677+0000","last_undegraded":"2024-03-28T13:49:59.827677+0000","last_fullsized":"2024-03-28T13:49:59.827677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:28:17.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'274","reported_seq":334,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.456569+0000","last_change":"2024-03-28T12:42:00.134120+0000","last_active":"2024-03-28T13:50:04.456569+0000","last_peered":"2024-03-28T13:50:04.456569+0000","last_clean":"2024-03-28T13:50:04.456569+0000","last_became_active":"2024-03-28T12:42:00.133540+0000","last_became_peered":"2024-03-28T12:42:00.133540+0000","last_unstale":"2024-03-28T13:50:04.456569+0000","last_undegraded":"2024-03-28T13:50:04.456569+0000","last_fullsized":"2024-03-28T13:50:04.456569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:49:47.641947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":216,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:47:49.340422+0000","last_change":"2024-03-28T12:41:26.701485+0000","last_active":"2024-03-28T13:47:49.340422+0000","last_peered":"2024-03-28T13:47:49.340422+0000","last_clean":"2024-03-28T13:47:49.340422+0000","last_became_active":"2024-03-28T12:41:26.700338+0000","last_became_peered":"2024-03-28T12:41:26.700338+0000","last_unstale":"2024-03-28T13:47:49.340422+0000","last_undegraded":"2024-03-28T13:47:49.340422+0000","last_fullsized":"2024-03-28T13:47:49.340422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:24.290713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:24.290713+0000","last_clean_scrub_stamp":"2024-03-28T12:41:24.290713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:58:57.536691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'778","reported_seq":854,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.666868+0000","last_change":"2024-03-28T12:42:07.938384+0000","last_active":"2024-03-28T13:50:14.666868+0000","last_peered":"2024-03-28T13:50:14.666868+0000","last_clean":"2024-03-28T13:50:14.666868+0000","last_became_active":"2024-03-28T12:42:07.937553+0000","last_became_peered":"2024-03-28T12:42:07.937553+0000","last_unstale":"2024-03-28T13:50:14.666868+0000","last_undegraded":"2024-03-28T13:50:14.666868+0000","last_fullsized":"2024-03-28T13:50:14.666868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:28:13.502930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":72658,"num_write":755,"num_write_kb":105142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'204","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:35.203603+0000","last_change":"2024-03-28T12:42:01.960107+0000","last_active":"2024-03-28T13:49:35.203603+0000","last_peered":"2024-03-28T13:49:35.203603+0000","last_clean":"2024-03-28T13:49:35.203603+0000","last_became_active":"2024-03-28T12:42:01.959809+0000","last_became_peered":"2024-03-28T12:42:01.959809+0000","last_unstale":"2024-03-28T13:49:35.203603+0000","last_undegraded":"2024-03-28T13:49:35.203603+0000","last_fullsized":"2024-03-28T13:49:35.203603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:38.797683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'367","reported_seq":424,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:44.803574+0000","last_change":"2024-03-28T12:42:00.144133+0000","last_active":"2024-03-28T13:49:44.803574+0000","last_peered":"2024-03-28T13:49:44.803574+0000","last_clean":"2024-03-28T13:49:44.803574+0000","last_became_active":"2024-03-28T12:42:00.143460+0000","last_became_peered":"2024-03-28T12:42:00.143460+0000","last_unstale":"2024-03-28T13:49:44.803574+0000","last_undegraded":"2024-03-28T13:49:44.803574+0000","last_fullsized":"2024-03-28T13:49:44.803574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195728,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'802","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.003550+0000","last_change":"2024-03-28T12:42:07.902848+0000","last_active":"2024-03-28T13:50:15.003550+0000","last_peered":"2024-03-28T13:50:15.003550+0000","last_clean":"2024-03-28T13:50:15.003550+0000","last_became_active":"2024-03-28T12:42:07.902428+0000","last_became_peered":"2024-03-28T12:42:07.902428+0000","last_unstale":"2024-03-28T13:50:15.003550+0000","last_undegraded":"2024-03-28T13:50:15.003550+0000","last_fullsized":"2024-03-28T13:50:15.003550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:28.659784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":87583,"num_write":773,"num_write_kb":126746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'220","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.939704+0000","last_change":"2024-03-28T12:42:01.950786+0000","last_active":"2024-03-28T13:50:14.939704+0000","last_peered":"2024-03-28T13:50:14.939704+0000","last_clean":"2024-03-28T13:50:14.939704+0000","last_became_active":"2024-03-28T12:42:01.950592+0000","last_became_peered":"2024-03-28T12:42:01.950592+0000","last_unstale":"2024-03-28T13:50:14.939704+0000","last_undegraded":"2024-03-28T13:50:14.939704+0000","last_fullsized":"2024-03-28T13:50:14.939704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:53.224241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'817","reported_seq":875,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:18.008064+0000","last_change":"2024-03-28T12:42:00.148307+0000","last_active":"2024-03-28T13:49:18.008064+0000","last_peered":"2024-03-28T13:49:18.008064+0000","last_clean":"2024-03-28T13:49:18.008064+0000","last_became_active":"2024-03-28T12:42:00.139237+0000","last_became_peered":"2024-03-28T12:42:00.139237+0000","last_unstale":"2024-03-28T13:49:18.008064+0000","last_undegraded":"2024-03-28T13:49:18.008064+0000","last_fullsized":"2024-03-28T13:49:18.008064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:43:33.699843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":4460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'797","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.417907+0000","last_change":"2024-03-28T12:42:07.885520+0000","last_active":"2024-03-28T13:50:04.417907+0000","last_peered":"2024-03-28T13:50:04.417907+0000","last_clean":"2024-03-28T13:50:04.417907+0000","last_became_active":"2024-03-28T12:42:07.880300+0000","last_became_peered":"2024-03-28T12:42:07.880300+0000","last_unstale":"2024-03-28T13:50:04.417907+0000","last_undegraded":"2024-03-28T13:50:04.417907+0000","last_fullsized":"2024-03-28T13:50:04.417907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:17:47.670820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":105873,"num_write":776,"num_write_kb":138943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'192","reported_seq":247,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.944693+0000","last_change":"2024-03-28T12:42:01.962888+0000","last_active":"2024-03-28T13:50:08.944693+0000","last_peered":"2024-03-28T13:50:08.944693+0000","last_clean":"2024-03-28T13:50:08.944693+0000","last_became_active":"2024-03-28T12:42:01.962604+0000","last_became_peered":"2024-03-28T12:42:01.962604+0000","last_unstale":"2024-03-28T13:50:08.944693+0000","last_undegraded":"2024-03-28T13:50:08.944693+0000","last_fullsized":"2024-03-28T13:50:08.944693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:49.327792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'793","reported_seq":851,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:03.609064+0000","last_change":"2024-03-28T12:42:00.085372+0000","last_active":"2024-03-28T13:49:03.609064+0000","last_peered":"2024-03-28T13:49:03.609064+0000","last_clean":"2024-03-28T13:49:03.609064+0000","last_became_active":"2024-03-28T12:42:00.084866+0000","last_became_peered":"2024-03-28T12:42:00.084866+0000","last_unstale":"2024-03-28T13:49:03.609064+0000","last_undegraded":"2024-03-28T13:49:03.609064+0000","last_fullsized":"2024-03-28T13:49:03.609064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:21:45.688123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'769","reported_seq":847,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.305858+0000","last_change":"2024-03-28T12:42:07.899218+0000","last_active":"2024-03-28T13:50:18.305858+0000","last_peered":"2024-03-28T13:50:18.305858+0000","last_clean":"2024-03-28T13:50:18.305858+0000","last_became_active":"2024-03-28T12:42:07.898853+0000","last_became_peered":"2024-03-28T12:42:07.898853+0000","last_unstale":"2024-03-28T13:50:18.305858+0000","last_undegraded":"2024-03-28T13:50:18.305858+0000","last_fullsized":"2024-03-28T13:50:18.305858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:21.240557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":96622,"num_write":756,"num_write_kb":72915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'182","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.583860+0000","last_change":"2024-03-28T12:42:01.965370+0000","last_active":"2024-03-28T13:50:03.583860+0000","last_peered":"2024-03-28T13:50:03.583860+0000","last_clean":"2024-03-28T13:50:03.583860+0000","last_became_active":"2024-03-28T12:42:01.964442+0000","last_became_peered":"2024-03-28T12:42:01.964442+0000","last_unstale":"2024-03-28T13:50:03.583860+0000","last_undegraded":"2024-03-28T13:50:03.583860+0000","last_fullsized":"2024-03-28T13:50:03.583860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:35.775033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'907","reported_seq":964,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:59.756156+0000","last_change":"2024-03-28T12:42:00.153658+0000","last_active":"2024-03-28T13:49:59.756156+0000","last_peered":"2024-03-28T13:49:59.756156+0000","last_clean":"2024-03-28T13:49:59.756156+0000","last_became_active":"2024-03-28T12:42:00.153292+0000","last_became_peered":"2024-03-28T12:42:00.153292+0000","last_unstale":"2024-03-28T13:49:59.756156+0000","last_undegraded":"2024-03-28T13:49:59.756156+0000","last_fullsized":"2024-03-28T13:49:59.756156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":907,"log_dups_size":0,"ondisk_log_size":907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:54.524905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1005,"num_write_kb":4546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'806","reported_seq":886,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.373691+0000","last_change":"2024-03-28T12:42:07.900126+0000","last_active":"2024-03-28T13:50:14.373691+0000","last_peered":"2024-03-28T13:50:14.373691+0000","last_clean":"2024-03-28T13:50:14.373691+0000","last_became_active":"2024-03-28T12:42:07.899780+0000","last_became_peered":"2024-03-28T12:42:07.899780+0000","last_unstale":"2024-03-28T13:50:14.373691+0000","last_undegraded":"2024-03-28T13:50:14.373691+0000","last_fullsized":"2024-03-28T13:50:14.373691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:31.070732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":86897,"num_write":794,"num_write_kb":118337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'228","reported_seq":283,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.944207+0000","last_change":"2024-03-28T12:42:01.962221+0000","last_active":"2024-03-28T13:50:14.944207+0000","last_peered":"2024-03-28T13:50:14.944207+0000","last_clean":"2024-03-28T13:50:14.944207+0000","last_became_active":"2024-03-28T12:42:01.961938+0000","last_became_peered":"2024-03-28T12:42:01.961938+0000","last_unstale":"2024-03-28T13:50:14.944207+0000","last_undegraded":"2024-03-28T13:50:14.944207+0000","last_fullsized":"2024-03-28T13:50:14.944207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:55:52.354803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'476","reported_seq":533,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:39.980515+0000","last_change":"2024-03-28T12:42:00.132287+0000","last_active":"2024-03-28T13:49:39.980515+0000","last_peered":"2024-03-28T13:49:39.980515+0000","last_clean":"2024-03-28T13:49:39.980515+0000","last_became_active":"2024-03-28T12:42:00.131064+0000","last_became_peered":"2024-03-28T12:42:00.131064+0000","last_unstale":"2024-03-28T13:49:39.980515+0000","last_undegraded":"2024-03-28T13:49:39.980515+0000","last_fullsized":"2024-03-28T13:49:39.980515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":8385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'776","reported_seq":858,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.958070+0000","last_change":"2024-03-28T12:42:07.887453+0000","last_active":"2024-03-28T13:50:08.958070+0000","last_peered":"2024-03-28T13:50:08.958070+0000","last_clean":"2024-03-28T13:50:08.958070+0000","last_became_active":"2024-03-28T12:42:07.886685+0000","last_became_peered":"2024-03-28T12:42:07.886685+0000","last_unstale":"2024-03-28T13:50:08.958070+0000","last_undegraded":"2024-03-28T13:50:08.958070+0000","last_fullsized":"2024-03-28T13:50:08.958070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:10:05.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":115085,"num_write":757,"num_write_kb":114512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'210","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:00.030145+0000","last_change":"2024-03-28T12:42:01.961318+0000","last_active":"2024-03-28T13:50:00.030145+0000","last_peered":"2024-03-28T13:50:00.030145+0000","last_clean":"2024-03-28T13:50:00.030145+0000","last_became_active":"2024-03-28T12:42:01.960102+0000","last_became_peered":"2024-03-28T12:42:01.960102+0000","last_unstale":"2024-03-28T13:50:00.030145+0000","last_undegraded":"2024-03-28T13:50:00.030145+0000","last_fullsized":"2024-03-28T13:50:00.030145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'64","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:48:43.809325+0000","last_change":"2024-03-28T12:42:00.145117+0000","last_active":"2024-03-28T13:48:43.809325+0000","last_peered":"2024-03-28T13:48:43.809325+0000","last_clean":"2024-03-28T13:48:43.809325+0000","last_became_active":"2024-03-28T12:42:00.144572+0000","last_became_peered":"2024-03-28T12:42:00.144572+0000","last_unstale":"2024-03-28T13:48:43.809325+0000","last_undegraded":"2024-03-28T13:48:43.809325+0000","last_fullsized":"2024-03-28T13:48:43.809325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:21:45.688123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":842,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'777","reported_seq":838,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.732192+0000","last_change":"2024-03-28T12:42:07.885727+0000","last_active":"2024-03-28T13:50:03.732192+0000","last_peered":"2024-03-28T13:50:03.732192+0000","last_clean":"2024-03-28T13:50:03.732192+0000","last_became_active":"2024-03-28T12:42:07.884760+0000","last_became_peered":"2024-03-28T12:42:07.884760+0000","last_unstale":"2024-03-28T13:50:03.732192+0000","last_undegraded":"2024-03-28T13:50:03.732192+0000","last_fullsized":"2024-03-28T13:50:03.732192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:45.171876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":41596,"num_write":756,"num_write_kb":91419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'188","reported_seq":243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.758331+0000","last_change":"2024-03-28T12:42:01.936371+0000","last_active":"2024-03-28T13:50:03.758331+0000","last_peered":"2024-03-28T13:50:03.758331+0000","last_clean":"2024-03-28T13:50:03.758331+0000","last_became_active":"2024-03-28T12:42:01.936080+0000","last_became_peered":"2024-03-28T12:42:01.936080+0000","last_unstale":"2024-03-28T13:50:03.758331+0000","last_undegraded":"2024-03-28T13:50:03.758331+0000","last_fullsized":"2024-03-28T13:50:03.758331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:36.955339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'56","reported_seq":113,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.341470+0000","last_change":"2024-03-28T12:42:00.139149+0000","last_active":"2024-03-28T13:50:18.341470+0000","last_peered":"2024-03-28T13:50:18.341470+0000","last_clean":"2024-03-28T13:50:18.341470+0000","last_became_active":"2024-03-28T12:42:00.138555+0000","last_became_peered":"2024-03-28T12:42:00.138555+0000","last_unstale":"2024-03-28T13:50:18.341470+0000","last_undegraded":"2024-03-28T13:50:18.341470+0000","last_fullsized":"2024-03-28T13:50:18.341470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:44:12.403916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'757","reported_seq":858,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:09.340082+0000","last_change":"2024-03-28T12:42:07.940362+0000","last_active":"2024-03-28T13:50:09.340082+0000","last_peered":"2024-03-28T13:50:09.340082+0000","last_clean":"2024-03-28T13:50:09.340082+0000","last_became_active":"2024-03-28T12:42:07.939396+0000","last_became_peered":"2024-03-28T12:42:07.939396+0000","last_unstale":"2024-03-28T13:50:09.340082+0000","last_undegraded":"2024-03-28T13:50:09.340082+0000","last_fullsized":"2024-03-28T13:50:09.340082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:59.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":181074,"num_write":742,"num_write_kb":169009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'203","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.008880+0000","last_change":"2024-03-28T12:42:01.800361+0000","last_active":"2024-03-28T13:50:15.008880+0000","last_peered":"2024-03-28T13:50:15.008880+0000","last_clean":"2024-03-28T13:50:15.008880+0000","last_became_active":"2024-03-28T12:42:01.799594+0000","last_became_peered":"2024-03-28T12:42:01.799594+0000","last_unstale":"2024-03-28T13:50:15.008880+0000","last_undegraded":"2024-03-28T13:50:15.008880+0000","last_fullsized":"2024-03-28T13:50:15.008880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:35.775033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'343","reported_seq":398,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:23.356856+0000","last_change":"2024-03-28T12:42:00.143501+0000","last_active":"2024-03-28T13:49:23.356856+0000","last_peered":"2024-03-28T13:49:23.356856+0000","last_clean":"2024-03-28T13:49:23.356856+0000","last_became_active":"2024-03-28T12:42:00.142913+0000","last_became_peered":"2024-03-28T12:42:00.142913+0000","last_unstale":"2024-03-28T13:49:23.356856+0000","last_undegraded":"2024-03-28T13:49:23.356856+0000","last_fullsized":"2024-03-28T13:49:23.356856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":8326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'745","reported_seq":819,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.946235+0000","last_change":"2024-03-28T12:42:07.938687+0000","last_active":"2024-03-28T13:50:14.946235+0000","last_peered":"2024-03-28T13:50:14.946235+0000","last_clean":"2024-03-28T13:50:14.946235+0000","last_became_active":"2024-03-28T12:42:07.938081+0000","last_became_peered":"2024-03-28T12:42:07.938081+0000","last_unstale":"2024-03-28T13:50:14.946235+0000","last_undegraded":"2024-03-28T13:50:14.946235+0000","last_fullsized":"2024-03-28T13:50:14.946235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:47.148457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":86453,"num_write":732,"num_write_kb":138137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'196","reported_seq":249,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.441692+0000","last_change":"2024-03-28T12:42:01.938516+0000","last_active":"2024-03-28T13:50:14.441692+0000","last_peered":"2024-03-28T13:50:14.441692+0000","last_clean":"2024-03-28T13:50:14.441692+0000","last_became_active":"2024-03-28T12:42:01.938251+0000","last_became_peered":"2024-03-28T12:42:01.938251+0000","last_unstale":"2024-03-28T13:50:14.441692+0000","last_undegraded":"2024-03-28T13:50:14.441692+0000","last_fullsized":"2024-03-28T13:50:14.441692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:15.595901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'883","reported_seq":939,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:59.232474+0000","last_change":"2024-03-28T12:42:00.141127+0000","last_active":"2024-03-28T13:49:59.232474+0000","last_peered":"2024-03-28T13:49:59.232474+0000","last_clean":"2024-03-28T13:49:59.232474+0000","last_became_active":"2024-03-28T12:42:00.140832+0000","last_became_peered":"2024-03-28T12:42:00.140832+0000","last_unstale":"2024-03-28T13:49:59.232474+0000","last_undegraded":"2024-03-28T13:49:59.232474+0000","last_fullsized":"2024-03-28T13:49:59.232474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:01:04.151858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":843,"num_write_kb":12855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'810","reported_seq":900,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.011730+0000","last_change":"2024-03-28T12:42:07.936963+0000","last_active":"2024-03-28T13:50:15.011730+0000","last_peered":"2024-03-28T13:50:15.011730+0000","last_clean":"2024-03-28T13:50:15.011730+0000","last_became_active":"2024-03-28T12:42:07.936606+0000","last_became_peered":"2024-03-28T12:42:07.936606+0000","last_unstale":"2024-03-28T13:50:15.011730+0000","last_undegraded":"2024-03-28T13:50:15.011730+0000","last_fullsized":"2024-03-28T13:50:15.011730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:37:04.083032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":136867,"num_write":788,"num_write_kb":148031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'195","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.657441+0000","last_change":"2024-03-28T12:42:01.962855+0000","last_active":"2024-03-28T13:50:03.657441+0000","last_peered":"2024-03-28T13:50:03.657441+0000","last_clean":"2024-03-28T13:50:03.657441+0000","last_became_active":"2024-03-28T12:42:01.962546+0000","last_became_peered":"2024-03-28T12:42:01.962546+0000","last_unstale":"2024-03-28T13:50:03.657441+0000","last_undegraded":"2024-03-28T13:50:03.657441+0000","last_fullsized":"2024-03-28T13:50:03.657441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:08.429940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'1090","reported_seq":1144,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.216592+0000","last_change":"2024-03-28T12:42:00.138923+0000","last_active":"2024-03-28T13:50:15.216592+0000","last_peered":"2024-03-28T13:50:15.216592+0000","last_clean":"2024-03-28T13:50:15.216592+0000","last_became_active":"2024-03-28T12:42:00.138233+0000","last_became_peered":"2024-03-28T12:42:00.138233+0000","last_unstale":"2024-03-28T13:50:15.216592+0000","last_undegraded":"2024-03-28T13:50:15.216592+0000","last_fullsized":"2024-03-28T13:50:15.216592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1090,"log_dups_size":0,"ondisk_log_size":1090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1041,"num_write_kb":5032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'724","reported_seq":796,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.443533+0000","last_change":"2024-03-28T12:42:07.907163+0000","last_active":"2024-03-28T13:50:14.443533+0000","last_peered":"2024-03-28T13:50:14.443533+0000","last_clean":"2024-03-28T13:50:14.443533+0000","last_became_active":"2024-03-28T12:42:07.906334+0000","last_became_peered":"2024-03-28T12:42:07.906334+0000","last_unstale":"2024-03-28T13:50:14.443533+0000","last_undegraded":"2024-03-28T13:50:14.443533+0000","last_fullsized":"2024-03-28T13:50:14.443533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:59.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":82415,"num_write":704,"num_write_kb":118989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'192","reported_seq":246,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.581520+0000","last_change":"2024-03-28T12:42:01.809232+0000","last_active":"2024-03-28T13:50:03.581520+0000","last_peered":"2024-03-28T13:50:03.581520+0000","last_clean":"2024-03-28T13:50:03.581520+0000","last_became_active":"2024-03-28T12:42:01.805284+0000","last_became_peered":"2024-03-28T12:42:01.805284+0000","last_unstale":"2024-03-28T13:50:03.581520+0000","last_undegraded":"2024-03-28T13:50:03.581520+0000","last_fullsized":"2024-03-28T13:50:03.581520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:20:54.180080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'401","reported_seq":456,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:53.953125+0000","last_change":"2024-03-28T12:42:00.147739+0000","last_active":"2024-03-28T13:49:53.953125+0000","last_peered":"2024-03-28T13:49:53.953125+0000","last_clean":"2024-03-28T13:49:53.953125+0000","last_became_active":"2024-03-28T12:42:00.147407+0000","last_became_peered":"2024-03-28T12:42:00.147407+0000","last_unstale":"2024-03-28T13:49:53.953125+0000","last_undegraded":"2024-03-28T13:49:53.953125+0000","last_fullsized":"2024-03-28T13:49:53.953125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:29.908949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'847","reported_seq":927,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.548369+0000","last_change":"2024-03-28T12:42:07.900662+0000","last_active":"2024-03-28T13:50:14.548369+0000","last_peered":"2024-03-28T13:50:14.548369+0000","last_clean":"2024-03-28T13:50:14.548369+0000","last_became_active":"2024-03-28T12:42:07.899628+0000","last_became_peered":"2024-03-28T12:42:07.899628+0000","last_unstale":"2024-03-28T13:50:14.548369+0000","last_undegraded":"2024-03-28T13:50:14.548369+0000","last_fullsized":"2024-03-28T13:50:14.548369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:31.070732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":75354,"num_write":826,"num_write_kb":110616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'204","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:54.140065+0000","last_change":"2024-03-28T12:42:01.967776+0000","last_active":"2024-03-28T13:49:54.140065+0000","last_peered":"2024-03-28T13:49:54.140065+0000","last_clean":"2024-03-28T13:49:54.140065+0000","last_became_active":"2024-03-28T12:42:01.964830+0000","last_became_peered":"2024-03-28T12:42:01.964830+0000","last_unstale":"2024-03-28T13:49:54.140065+0000","last_undegraded":"2024-03-28T13:49:54.140065+0000","last_fullsized":"2024-03-28T13:49:54.140065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'62","reported_seq":116,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:39.349935+0000","last_change":"2024-03-28T12:42:00.142326+0000","last_active":"2024-03-28T13:49:39.349935+0000","last_peered":"2024-03-28T13:49:39.349935+0000","last_clean":"2024-03-28T13:49:39.349935+0000","last_became_active":"2024-03-28T12:42:00.141602+0000","last_became_peered":"2024-03-28T12:42:00.141602+0000","last_unstale":"2024-03-28T13:49:39.349935+0000","last_undegraded":"2024-03-28T13:49:39.349935+0000","last_fullsized":"2024-03-28T13:49:39.349935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'910","reported_seq":1032,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.938964+0000","last_change":"2024-03-28T12:42:07.935882+0000","last_active":"2024-03-28T13:50:14.938964+0000","last_peered":"2024-03-28T13:50:14.938964+0000","last_clean":"2024-03-28T13:50:14.938964+0000","last_became_active":"2024-03-28T12:42:07.935525+0000","last_became_peered":"2024-03-28T12:42:07.935525+0000","last_unstale":"2024-03-28T13:50:14.938964+0000","last_undegraded":"2024-03-28T13:50:14.938964+0000","last_fullsized":"2024-03-28T13:50:14.938964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:50:31.463779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":257511,"num_write":888,"num_write_kb":259792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'811","reported_seq":911,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.444896+0000","last_change":"2024-03-28T12:42:07.882782+0000","last_active":"2024-03-28T13:50:14.444896+0000","last_peered":"2024-03-28T13:50:14.444896+0000","last_clean":"2024-03-28T13:50:14.444896+0000","last_became_active":"2024-03-28T12:42:07.881527+0000","last_became_peered":"2024-03-28T12:42:07.881527+0000","last_unstale":"2024-03-28T13:50:14.444896+0000","last_undegraded":"2024-03-28T13:50:14.444896+0000","last_fullsized":"2024-03-28T13:50:14.444896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:55.701985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":165977,"num_write":788,"num_write_kb":136221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'206","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:09.231448+0000","last_change":"2024-03-28T12:42:01.958791+0000","last_active":"2024-03-28T13:50:09.231448+0000","last_peered":"2024-03-28T13:50:09.231448+0000","last_clean":"2024-03-28T13:50:09.231448+0000","last_became_active":"2024-03-28T12:42:01.957991+0000","last_became_peered":"2024-03-28T12:42:01.957991+0000","last_unstale":"2024-03-28T13:50:09.231448+0000","last_undegraded":"2024-03-28T13:50:09.231448+0000","last_fullsized":"2024-03-28T13:50:09.231448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:24.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'1719","reported_seq":1775,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:42.912733+0000","last_change":"2024-03-28T12:42:00.132942+0000","last_active":"2024-03-28T13:49:42.912733+0000","last_peered":"2024-03-28T13:49:42.912733+0000","last_clean":"2024-03-28T13:49:42.912733+0000","last_became_active":"2024-03-28T12:42:00.132663+0000","last_became_peered":"2024-03-28T12:42:00.132663+0000","last_unstale":"2024-03-28T13:49:42.912733+0000","last_undegraded":"2024-03-28T13:49:42.912733+0000","last_fullsized":"2024-03-28T13:49:42.912733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1719,"log_dups_size":0,"ondisk_log_size":1719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:41.612613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1652,"num_write_kb":13078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'750","reported_seq":827,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:59.767304+0000","last_change":"2024-03-28T12:42:07.901907+0000","last_active":"2024-03-28T13:49:59.767304+0000","last_peered":"2024-03-28T13:49:59.767304+0000","last_clean":"2024-03-28T13:49:59.767304+0000","last_became_active":"2024-03-28T12:42:07.901398+0000","last_became_peered":"2024-03-28T12:42:07.901398+0000","last_unstale":"2024-03-28T13:49:59.767304+0000","last_undegraded":"2024-03-28T13:49:59.767304+0000","last_fullsized":"2024-03-28T13:49:59.767304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:49:41.408808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":90732,"num_write":732,"num_write_kb":110234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'218","reported_seq":272,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:54.353248+0000","last_change":"2024-03-28T12:42:01.811306+0000","last_active":"2024-03-28T13:49:54.353248+0000","last_peered":"2024-03-28T13:49:54.353248+0000","last_clean":"2024-03-28T13:49:54.353248+0000","last_became_active":"2024-03-28T12:42:01.810142+0000","last_became_peered":"2024-03-28T12:42:01.810142+0000","last_unstale":"2024-03-28T13:49:54.353248+0000","last_undegraded":"2024-03-28T13:49:54.353248+0000","last_fullsized":"2024-03-28T13:49:54.353248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:37:22.386341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'118","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:59.338833+0000","last_change":"2024-03-28T12:42:00.142916+0000","last_active":"2024-03-28T13:49:59.338833+0000","last_peered":"2024-03-28T13:49:59.338833+0000","last_clean":"2024-03-28T13:49:59.338833+0000","last_became_active":"2024-03-28T12:42:00.142006+0000","last_became_peered":"2024-03-28T12:42:00.142006+0000","last_unstale":"2024-03-28T13:49:59.338833+0000","last_undegraded":"2024-03-28T13:49:59.338833+0000","last_fullsized":"2024-03-28T13:49:59.338833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:01:08.734929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'739","reported_seq":794,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:23.266261+0000","last_change":"2024-03-28T12:42:00.143738+0000","last_active":"2024-03-28T13:49:23.266261+0000","last_peered":"2024-03-28T13:49:23.266261+0000","last_clean":"2024-03-28T13:49:23.266261+0000","last_became_active":"2024-03-28T12:42:00.143474+0000","last_became_peered":"2024-03-28T12:42:00.143474+0000","last_unstale":"2024-03-28T13:49:23.266261+0000","last_undegraded":"2024-03-28T13:49:23.266261+0000","last_fullsized":"2024-03-28T13:49:23.266261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:43:33.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":12641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'178","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.826397+0000","last_change":"2024-03-28T12:42:01.938147+0000","last_active":"2024-03-28T13:50:03.826397+0000","last_peered":"2024-03-28T13:50:03.826397+0000","last_clean":"2024-03-28T13:50:03.826397+0000","last_became_active":"2024-03-28T12:42:01.937612+0000","last_became_peered":"2024-03-28T12:42:01.937612+0000","last_unstale":"2024-03-28T13:50:03.826397+0000","last_undegraded":"2024-03-28T13:50:03.826397+0000","last_fullsized":"2024-03-28T13:50:03.826397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:31:15.643101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'736","reported_seq":808,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.442217+0000","last_change":"2024-03-28T12:42:07.870201+0000","last_active":"2024-03-28T13:50:14.442217+0000","last_peered":"2024-03-28T13:50:14.442217+0000","last_clean":"2024-03-28T13:50:14.442217+0000","last_became_active":"2024-03-28T12:42:07.869628+0000","last_became_peered":"2024-03-28T12:42:07.869628+0000","last_unstale":"2024-03-28T13:50:14.442217+0000","last_undegraded":"2024-03-28T13:50:14.442217+0000","last_fullsized":"2024-03-28T13:50:14.442217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":78605,"num_write":708,"num_write_kb":126589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'198","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:18.249461+0000","last_change":"2024-03-28T12:42:00.146260+0000","last_active":"2024-03-28T13:49:18.249461+0000","last_peered":"2024-03-28T13:49:18.249461+0000","last_clean":"2024-03-28T13:49:18.249461+0000","last_became_active":"2024-03-28T12:42:00.146052+0000","last_became_peered":"2024-03-28T12:42:00.146052+0000","last_unstale":"2024-03-28T13:49:18.249461+0000","last_undegraded":"2024-03-28T13:49:18.249461+0000","last_fullsized":"2024-03-28T13:49:18.249461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:08.118205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'199","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.403657+0000","last_change":"2024-03-28T12:42:01.966002+0000","last_active":"2024-03-28T13:50:04.403657+0000","last_peered":"2024-03-28T13:50:04.403657+0000","last_clean":"2024-03-28T13:50:04.403657+0000","last_became_active":"2024-03-28T12:42:01.965598+0000","last_became_peered":"2024-03-28T12:42:01.965598+0000","last_unstale":"2024-03-28T13:50:04.403657+0000","last_undegraded":"2024-03-28T13:50:04.403657+0000","last_fullsized":"2024-03-28T13:50:04.403657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:35:50.246850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'725","reported_seq":796,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.725373+0000","last_change":"2024-03-28T12:42:15.361649+0000","last_active":"2024-03-28T13:50:08.725373+0000","last_peered":"2024-03-28T13:50:08.725373+0000","last_clean":"2024-03-28T13:50:08.725373+0000","last_became_active":"2024-03-28T12:42:15.360743+0000","last_became_peered":"2024-03-28T12:42:15.360743+0000","last_unstale":"2024-03-28T13:50:08.725373+0000","last_undegraded":"2024-03-28T13:50:08.725373+0000","last_fullsized":"2024-03-28T13:50:08.725373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:55.701985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":88364,"num_write":704,"num_write_kb":127819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"29'211","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.585044+0000","last_change":"2024-03-28T12:42:01.965237+0000","last_active":"2024-03-28T13:50:03.585044+0000","last_peered":"2024-03-28T13:50:03.585044+0000","last_clean":"2024-03-28T13:50:03.585044+0000","last_became_active":"2024-03-28T12:42:01.964468+0000","last_became_peered":"2024-03-28T12:42:01.964468+0000","last_unstale":"2024-03-28T13:50:03.585044+0000","last_undegraded":"2024-03-28T13:50:03.585044+0000","last_fullsized":"2024-03-28T13:50:03.585044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:05.744451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'206","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.741058+0000","last_change":"2024-03-28T12:42:01.959553+0000","last_active":"2024-03-28T13:50:08.741058+0000","last_peered":"2024-03-28T13:50:08.741058+0000","last_clean":"2024-03-28T13:50:08.741058+0000","last_became_active":"2024-03-28T12:42:01.958333+0000","last_became_peered":"2024-03-28T12:42:01.958333+0000","last_unstale":"2024-03-28T13:50:08.741058+0000","last_undegraded":"2024-03-28T13:50:08.741058+0000","last_fullsized":"2024-03-28T13:50:08.741058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:05.744451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'227","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.422962+0000","last_change":"2024-03-28T12:42:01.805452+0000","last_active":"2024-03-28T13:50:04.422962+0000","last_peered":"2024-03-28T13:50:04.422962+0000","last_clean":"2024-03-28T13:50:04.422962+0000","last_became_active":"2024-03-28T12:42:01.805288+0000","last_became_peered":"2024-03-28T12:42:01.805288+0000","last_unstale":"2024-03-28T13:50:04.422962+0000","last_undegraded":"2024-03-28T13:50:04.422962+0000","last_fullsized":"2024-03-28T13:50:04.422962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:17:01.582670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'197","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.832771+0000","last_change":"2024-03-28T12:42:01.947234+0000","last_active":"2024-03-28T13:50:08.832771+0000","last_peered":"2024-03-28T13:50:08.832771+0000","last_clean":"2024-03-28T13:50:08.832771+0000","last_became_active":"2024-03-28T12:42:01.946859+0000","last_became_peered":"2024-03-28T12:42:01.946859+0000","last_unstale":"2024-03-28T13:50:08.832771+0000","last_undegraded":"2024-03-28T13:50:08.832771+0000","last_fullsized":"2024-03-28T13:50:08.832771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:36:05.320541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'183","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.302934+0000","last_change":"2024-03-28T12:42:01.935265+0000","last_active":"2024-03-28T13:50:18.302934+0000","last_peered":"2024-03-28T13:50:18.302934+0000","last_clean":"2024-03-28T13:50:18.302934+0000","last_became_active":"2024-03-28T12:42:01.934578+0000","last_became_peered":"2024-03-28T12:42:01.934578+0000","last_unstale":"2024-03-28T13:50:18.302934+0000","last_undegraded":"2024-03-28T13:50:18.302934+0000","last_fullsized":"2024-03-28T13:50:18.302934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:24.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'202","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:54.060534+0000","last_change":"2024-03-28T12:42:01.946191+0000","last_active":"2024-03-28T13:49:54.060534+0000","last_peered":"2024-03-28T13:49:54.060534+0000","last_clean":"2024-03-28T13:49:54.060534+0000","last_became_active":"2024-03-28T12:42:01.945804+0000","last_became_peered":"2024-03-28T12:42:01.945804+0000","last_unstale":"2024-03-28T13:49:54.060534+0000","last_undegraded":"2024-03-28T13:49:54.060534+0000","last_fullsized":"2024-03-28T13:49:54.060534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:40.221005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'229","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:59.711792+0000","last_change":"2024-03-28T12:42:01.969416+0000","last_active":"2024-03-28T13:49:59.711792+0000","last_peered":"2024-03-28T13:49:59.711792+0000","last_clean":"2024-03-28T13:49:59.711792+0000","last_became_active":"2024-03-28T12:42:01.969078+0000","last_became_peered":"2024-03-28T12:42:01.969078+0000","last_unstale":"2024-03-28T13:49:59.711792+0000","last_undegraded":"2024-03-28T13:49:59.711792+0000","last_fullsized":"2024-03-28T13:49:59.711792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'193","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.894344+0000","last_change":"2024-03-28T12:42:01.958402+0000","last_active":"2024-03-28T13:50:08.894344+0000","last_peered":"2024-03-28T13:50:08.894344+0000","last_clean":"2024-03-28T13:50:08.894344+0000","last_became_active":"2024-03-28T12:42:01.958074+0000","last_became_peered":"2024-03-28T12:42:01.958074+0000","last_unstale":"2024-03-28T13:50:08.894344+0000","last_undegraded":"2024-03-28T13:50:08.894344+0000","last_fullsized":"2024-03-28T13:50:08.894344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:18:04.255456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'213","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.307568+0000","last_change":"2024-03-28T12:42:01.811823+0000","last_active":"2024-03-28T13:50:18.307568+0000","last_peered":"2024-03-28T13:50:18.307568+0000","last_clean":"2024-03-28T13:50:18.307568+0000","last_became_active":"2024-03-28T12:42:01.811548+0000","last_became_peered":"2024-03-28T12:42:01.811548+0000","last_unstale":"2024-03-28T13:50:18.307568+0000","last_undegraded":"2024-03-28T13:50:18.307568+0000","last_fullsized":"2024-03-28T13:50:18.307568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:00:51.741925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'199","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.204475+0000","last_change":"2024-03-28T12:42:01.959291+0000","last_active":"2024-03-28T13:50:04.204475+0000","last_peered":"2024-03-28T13:50:04.204475+0000","last_clean":"2024-03-28T13:50:04.204475+0000","last_became_active":"2024-03-28T12:42:01.958942+0000","last_became_peered":"2024-03-28T12:42:01.958942+0000","last_unstale":"2024-03-28T13:50:04.204475+0000","last_undegraded":"2024-03-28T13:50:04.204475+0000","last_fullsized":"2024-03-28T13:50:04.204475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:52:46.128830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'204","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:49.896805+0000","last_change":"2024-03-28T12:42:01.965790+0000","last_active":"2024-03-28T13:49:49.896805+0000","last_peered":"2024-03-28T13:49:49.896805+0000","last_clean":"2024-03-28T13:49:49.896805+0000","last_became_active":"2024-03-28T12:42:01.965526+0000","last_became_peered":"2024-03-28T12:42:01.965526+0000","last_unstale":"2024-03-28T13:49:49.896805+0000","last_undegraded":"2024-03-28T13:49:49.896805+0000","last_fullsized":"2024-03-28T13:49:49.896805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'205","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.421166+0000","last_change":"2024-03-28T12:42:01.960761+0000","last_active":"2024-03-28T13:50:04.421166+0000","last_peered":"2024-03-28T13:50:04.421166+0000","last_clean":"2024-03-28T13:50:04.421166+0000","last_became_active":"2024-03-28T12:42:01.960325+0000","last_became_peered":"2024-03-28T12:42:01.960325+0000","last_unstale":"2024-03-28T13:50:04.421166+0000","last_undegraded":"2024-03-28T13:50:04.421166+0000","last_fullsized":"2024-03-28T13:50:04.421166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:40.221005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'213","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:40.081568+0000","last_change":"2024-03-28T12:42:01.960053+0000","last_active":"2024-03-28T13:49:40.081568+0000","last_peered":"2024-03-28T13:49:40.081568+0000","last_clean":"2024-03-28T13:49:40.081568+0000","last_became_active":"2024-03-28T12:42:01.959801+0000","last_became_peered":"2024-03-28T12:42:01.959801+0000","last_unstale":"2024-03-28T13:49:40.081568+0000","last_undegraded":"2024-03-28T13:49:40.081568+0000","last_fullsized":"2024-03-28T13:49:40.081568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:22.285591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'196","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.424881+0000","last_change":"2024-03-28T12:42:01.788603+0000","last_active":"2024-03-28T13:50:04.424881+0000","last_peered":"2024-03-28T13:50:04.424881+0000","last_clean":"2024-03-28T13:50:04.424881+0000","last_became_active":"2024-03-28T12:42:01.788431+0000","last_became_peered":"2024-03-28T12:42:01.788431+0000","last_unstale":"2024-03-28T13:50:04.424881+0000","last_undegraded":"2024-03-28T13:50:04.424881+0000","last_fullsized":"2024-03-28T13:50:04.424881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:09:59.404128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'195","reported_seq":248,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.036293+0000","last_change":"2024-03-28T12:42:01.960518+0000","last_active":"2024-03-28T13:50:15.036293+0000","last_peered":"2024-03-28T13:50:15.036293+0000","last_clean":"2024-03-28T13:50:15.036293+0000","last_became_active":"2024-03-28T12:42:01.959832+0000","last_became_peered":"2024-03-28T12:42:01.959832+0000","last_unstale":"2024-03-28T13:50:15.036293+0000","last_undegraded":"2024-03-28T13:50:15.036293+0000","last_fullsized":"2024-03-28T13:50:15.036293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'198","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:09.232667+0000","last_change":"2024-03-28T12:42:01.936477+0000","last_active":"2024-03-28T13:50:09.232667+0000","last_peered":"2024-03-28T13:50:09.232667+0000","last_clean":"2024-03-28T13:50:09.232667+0000","last_became_active":"2024-03-28T12:42:01.936175+0000","last_became_peered":"2024-03-28T12:42:01.936175+0000","last_unstale":"2024-03-28T13:50:09.232667+0000","last_undegraded":"2024-03-28T13:50:09.232667+0000","last_fullsized":"2024-03-28T13:50:09.232667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:14:14.822668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'209","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.453599+0000","last_change":"2024-03-28T12:42:01.960054+0000","last_active":"2024-03-28T13:50:14.453599+0000","last_peered":"2024-03-28T13:50:14.453599+0000","last_clean":"2024-03-28T13:50:14.453599+0000","last_became_active":"2024-03-28T12:42:01.959791+0000","last_became_peered":"2024-03-28T12:42:01.959791+0000","last_unstale":"2024-03-28T13:50:14.453599+0000","last_undegraded":"2024-03-28T13:50:14.453599+0000","last_fullsized":"2024-03-28T13:50:14.453599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:06:44.099531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'211","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:41.908840+0000","last_change":"2024-03-28T12:42:15.233310+0000","last_active":"2024-03-28T13:49:41.908840+0000","last_peered":"2024-03-28T13:49:41.908840+0000","last_clean":"2024-03-28T13:49:41.908840+0000","last_became_active":"2024-03-28T12:42:15.232678+0000","last_became_peered":"2024-03-28T12:42:15.232678+0000","last_unstale":"2024-03-28T13:49:41.908840+0000","last_undegraded":"2024-03-28T13:49:41.908840+0000","last_fullsized":"2024-03-28T13:49:41.908840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:11:33.781054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'208","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.339356+0000","last_change":"2024-03-28T12:42:01.948602+0000","last_active":"2024-03-28T13:50:04.339356+0000","last_peered":"2024-03-28T13:50:04.339356+0000","last_clean":"2024-03-28T13:50:04.339356+0000","last_became_active":"2024-03-28T12:42:01.947869+0000","last_became_peered":"2024-03-28T12:42:01.947869+0000","last_unstale":"2024-03-28T13:50:04.339356+0000","last_undegraded":"2024-03-28T13:50:04.339356+0000","last_fullsized":"2024-03-28T13:50:04.339356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'189","reported_seq":242,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:54.060702+0000","last_change":"2024-03-28T12:42:01.940521+0000","last_active":"2024-03-28T13:49:54.060702+0000","last_peered":"2024-03-28T13:49:54.060702+0000","last_clean":"2024-03-28T13:49:54.060702+0000","last_became_active":"2024-03-28T12:42:01.939756+0000","last_became_peered":"2024-03-28T12:42:01.939756+0000","last_unstale":"2024-03-28T13:49:54.060702+0000","last_undegraded":"2024-03-28T13:49:54.060702+0000","last_fullsized":"2024-03-28T13:49:54.060702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:53:37.869232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'177","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.889992+0000","last_change":"2024-03-28T12:42:01.960377+0000","last_active":"2024-03-28T13:50:08.889992+0000","last_peered":"2024-03-28T13:50:08.889992+0000","last_clean":"2024-03-28T13:50:08.889992+0000","last_became_active":"2024-03-28T12:42:01.960012+0000","last_became_peered":"2024-03-28T12:42:01.960012+0000","last_unstale":"2024-03-28T13:50:08.889992+0000","last_undegraded":"2024-03-28T13:50:08.889992+0000","last_fullsized":"2024-03-28T13:50:08.889992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:19:20.801201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'183","reported_seq":236,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.526354+0000","last_change":"2024-03-28T12:42:01.937280+0000","last_active":"2024-03-28T13:50:04.526354+0000","last_peered":"2024-03-28T13:50:04.526354+0000","last_clean":"2024-03-28T13:50:04.526354+0000","last_became_active":"2024-03-28T12:42:01.936999+0000","last_became_peered":"2024-03-28T12:42:01.936999+0000","last_unstale":"2024-03-28T13:50:04.526354+0000","last_undegraded":"2024-03-28T13:50:04.526354+0000","last_fullsized":"2024-03-28T13:50:04.526354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:35:01.960186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'190","reported_seq":243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.480981+0000","last_change":"2024-03-28T12:42:01.961991+0000","last_active":"2024-03-28T13:50:04.480981+0000","last_peered":"2024-03-28T13:50:04.480981+0000","last_clean":"2024-03-28T13:50:04.480981+0000","last_became_active":"2024-03-28T12:42:01.961694+0000","last_became_peered":"2024-03-28T12:42:01.961694+0000","last_unstale":"2024-03-28T13:50:04.480981+0000","last_undegraded":"2024-03-28T13:50:04.480981+0000","last_fullsized":"2024-03-28T13:50:04.480981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:12:20.857443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'199","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.352032+0000","last_change":"2024-03-28T12:42:01.966943+0000","last_active":"2024-03-28T13:50:04.352032+0000","last_peered":"2024-03-28T13:50:04.352032+0000","last_clean":"2024-03-28T13:50:04.352032+0000","last_became_active":"2024-03-28T12:42:01.966629+0000","last_became_peered":"2024-03-28T12:42:01.966629+0000","last_unstale":"2024-03-28T13:50:04.352032+0000","last_undegraded":"2024-03-28T13:50:04.352032+0000","last_fullsized":"2024-03-28T13:50:04.352032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'184","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.547262+0000","last_change":"2024-03-28T12:42:01.934727+0000","last_active":"2024-03-28T13:50:14.547262+0000","last_peered":"2024-03-28T13:50:14.547262+0000","last_clean":"2024-03-28T13:50:14.547262+0000","last_became_active":"2024-03-28T12:42:01.934130+0000","last_became_peered":"2024-03-28T12:42:01.934130+0000","last_unstale":"2024-03-28T13:50:14.547262+0000","last_undegraded":"2024-03-28T13:50:14.547262+0000","last_fullsized":"2024-03-28T13:50:14.547262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:20:32.024373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'204","reported_seq":256,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:54.685106+0000","last_change":"2024-03-28T12:42:01.940164+0000","last_active":"2024-03-28T13:49:54.685106+0000","last_peered":"2024-03-28T13:49:54.685106+0000","last_clean":"2024-03-28T13:49:54.685106+0000","last_became_active":"2024-03-28T12:42:01.939962+0000","last_became_peered":"2024-03-28T12:42:01.939962+0000","last_unstale":"2024-03-28T13:49:54.685106+0000","last_undegraded":"2024-03-28T13:49:54.685106+0000","last_fullsized":"2024-03-28T13:49:54.685106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:31:15.643101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'189","reported_seq":241,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:09.198928+0000","last_change":"2024-03-28T12:42:01.968043+0000","last_active":"2024-03-28T13:50:09.198928+0000","last_peered":"2024-03-28T13:50:09.198928+0000","last_clean":"2024-03-28T13:50:09.198928+0000","last_became_active":"2024-03-28T12:42:01.964888+0000","last_became_peered":"2024-03-28T12:42:01.964888+0000","last_unstale":"2024-03-28T13:50:09.198928+0000","last_undegraded":"2024-03-28T13:50:09.198928+0000","last_fullsized":"2024-03-28T13:50:09.198928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'205","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.883503+0000","last_change":"2024-03-28T12:42:01.939665+0000","last_active":"2024-03-28T13:50:03.883503+0000","last_peered":"2024-03-28T13:50:03.883503+0000","last_clean":"2024-03-28T13:50:03.883503+0000","last_became_active":"2024-03-28T12:42:01.939448+0000","last_became_peered":"2024-03-28T12:42:01.939448+0000","last_unstale":"2024-03-28T13:50:03.883503+0000","last_undegraded":"2024-03-28T13:50:03.883503+0000","last_fullsized":"2024-03-28T13:50:03.883503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:39.483160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'188","reported_seq":246,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.447778+0000","last_change":"2024-03-28T12:42:01.961147+0000","last_active":"2024-03-28T13:50:14.447778+0000","last_peered":"2024-03-28T13:50:14.447778+0000","last_clean":"2024-03-28T13:50:14.447778+0000","last_became_active":"2024-03-28T12:42:01.960511+0000","last_became_peered":"2024-03-28T12:42:01.960511+0000","last_unstale":"2024-03-28T13:50:14.447778+0000","last_undegraded":"2024-03-28T13:50:14.447778+0000","last_fullsized":"2024-03-28T13:50:14.447778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'190","reported_seq":248,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:48.956383+0000","last_change":"2024-03-28T12:42:01.809029+0000","last_active":"2024-03-28T13:49:48.956383+0000","last_peered":"2024-03-28T13:49:48.956383+0000","last_clean":"2024-03-28T13:49:48.956383+0000","last_became_active":"2024-03-28T12:42:01.805168+0000","last_became_peered":"2024-03-28T12:42:01.805168+0000","last_unstale":"2024-03-28T13:49:48.956383+0000","last_undegraded":"2024-03-28T13:49:48.956383+0000","last_fullsized":"2024-03-28T13:49:48.956383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:00:10.281819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'211","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.250522+0000","last_change":"2024-03-28T12:42:01.809169+0000","last_active":"2024-03-28T13:50:04.250522+0000","last_peered":"2024-03-28T13:50:04.250522+0000","last_clean":"2024-03-28T13:50:04.250522+0000","last_became_active":"2024-03-28T12:42:01.805382+0000","last_became_peered":"2024-03-28T12:42:01.805382+0000","last_unstale":"2024-03-28T13:50:04.250522+0000","last_undegraded":"2024-03-28T13:50:04.250522+0000","last_fullsized":"2024-03-28T13:50:04.250522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:26:32.791857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'204","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:49.877043+0000","last_change":"2024-03-28T12:42:01.938613+0000","last_active":"2024-03-28T13:49:49.877043+0000","last_peered":"2024-03-28T13:49:49.877043+0000","last_clean":"2024-03-28T13:49:49.877043+0000","last_became_active":"2024-03-28T12:42:01.938408+0000","last_became_peered":"2024-03-28T12:42:01.938408+0000","last_unstale":"2024-03-28T13:49:49.877043+0000","last_undegraded":"2024-03-28T13:49:49.877043+0000","last_fullsized":"2024-03-28T13:49:49.877043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:36:57.708839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1106,"num_read_kb":3440531,"num_write":24390,"num_write_kb":4237056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25020,"ondisk_log_size":25020,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12766,"ondisk_log_size":12766,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":189185628,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":1436,"num_read_kb":2621,"num_write":24268,"num_write_kb":197856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":164978688,"data_stored":378386672,"data_compressed":51374103,"data_compressed_allocated":66834432,"data_compressed_original":280489984,"omap_allocated":0,"internal_metadata":0},"log_size":21555,"ondisk_log_size":21555,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66494,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510271,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99252,"kb_used_data":9836,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94272588,"statfs":{"total":96636764160,"available":96535130112,"internally_reserved":0,"allocated":10072064,"data_stored":26859424,"data_compressed":3937950,"data_compressed_allocated":4919296,"data_compressed_original":21925888,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510271,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85184,"kb_used_data":13752,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94286656,"statfs":{"total":96636764160,"available":96549535744,"internally_reserved":0,"allocated":14082048,"data_stored":32551656,"data_compressed":4545413,"data_compressed_allocated":5947392,"data_compressed_original":24616960,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510271,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127140,"kb_used_data":19676,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94244700,"statfs":{"total":96636764160,"available":96506572800,"internally_reserved":0,"allocated":20148224,"data_stored":50460553,"data_compressed":7401383,"data_compressed_allocated":9674752,"data_compressed_original":40218624,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510270,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76200,"kb_used_data":13088,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94295640,"statfs":{"total":96636764160,"available":96558735360,"internally_reserved":0,"allocated":13402112,"data_stored":33681567,"data_compressed":4660285,"data_compressed_allocated":6107136,"data_compressed_original":26583040,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510270,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120852,"kb_used_data":21708,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94250988,"statfs":{"total":96636764160,"available":96513011712,"internally_reserved":0,"allocated":22228992,"data_stored":38466913,"data_compressed":4150831,"data_compressed_allocated":5660672,"data_compressed_original":22102016,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510272,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140836,"kb_used_data":29212,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94231004,"statfs":{"total":96636764160,"available":96492548096,"internally_reserved":0,"allocated":29913088,"data_stored":67238309,"data_compressed":8806079,"data_compressed_allocated":11505664,"data_compressed_original":49045504,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542977,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":155132,"kb_used_data":33780,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94216708,"statfs":{"total":96636764160,"available":96477908992,"internally_reserved":0,"allocated":34590720,"data_stored":84015705,"data_compressed":11869280,"data_compressed_allocated":15233024,"data_compressed_original":64880640,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575680,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125892,"kb_used_data":22588,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94245948,"statfs":{"total":96636764160,"available":96507850752,"internally_reserved":0,"allocated":23130112,"data_stored":47304441,"data_compressed":6069376,"data_compressed_allocated":7876608,"data_compressed_original":32264192,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29605888,"data_stored":67111914,"data_compressed":8806079,"data_compressed_allocated":11505664,"data_compressed_original":49045504,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21856256,"data_stored":37750150,"data_compressed":4117584,"data_compressed_allocated":5615616,"data_compressed_original":21528576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13094912,"data_stored":33555172,"data_compressed":4660285,"data_compressed_allocated":6107136,"data_compressed_original":26583040,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34283520,"data_stored":83889310,"data_compressed":11869280,"data_compressed_allocated":15233024,"data_compressed_original":64880640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19841024,"data_stored":50334158,"data_compressed":7401383,"data_compressed_allocated":9674752,"data_compressed_original":40218624,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22757376,"data_stored":46587678,"data_compressed":6036129,"data_compressed_allocated":7831552,"data_compressed_original":31690752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13774848,"data_stored":32425261,"data_compressed":4545413,"data_compressed_allocated":5947392,"data_compressed_original":24616960,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9764864,"data_stored":26733029,"data_compressed":3937950,"data_compressed_allocated":4919296,"data_compressed_original":21925888,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T13:50:24.692 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T13:50:24.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.875+0000 7f36a8200640 1 Processor -- start 2024-03-28T13:50:24.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.875+0000 7f36a8200640 1 -- start start 2024-03-28T13:50:24.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.875+0000 7f36a8200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36a0072060 0x7f36a00cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:24.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.875+0000 7f36a8200640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f36a0072440 0x7f36a01524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:24.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.875+0000 7f36a8200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f36a01592a0 0x7f36a01529f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:24.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.875+0000 7f36a8200640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f36a00c31e0 con 0x7f36a01592a0 2024-03-28T13:50:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.875+0000 7f36a8200640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f36a015bf40 con 0x7f36a0072440 2024-03-28T13:50:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.875+0000 7f36a8200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f36a015c220 con 0x7f36a0072060 2024-03-28T13:50:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.875+0000 7f36a6200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f36a01592a0 0x7f36a01529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.879+0000 7f36a6200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f36a01592a0 0x7f36a01529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52938/0 (socket says 172.21.15.76:52938) 2024-03-28T13:50:24.877 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.879+0000 7f36a6200640 1 -- 172.21.15.76:0/3944318784 learned_addr learned my addr 172.21.15.76:0/3944318784 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.879+0000 7f36a5800640 1 --2- 172.21.15.76:0/3944318784 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36a0072060 0x7f36a00cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:24.878 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.879+0000 7f36a4e00640 1 --2- 172.21.15.76:0/3944318784 >> v2:172.21.15.111:3300/0 conn(0x7f36a0072440 0x7f36a01524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.883+0000 7f36a6200640 1 -- 172.21.15.76:0/3944318784 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36a0072060 msgr2=0x7f36a00cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.883+0000 7f36a6200640 1 --2- 172.21.15.76:0/3944318784 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36a0072060 0x7f36a00cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.883+0000 7f36a6200640 1 -- 172.21.15.76:0/3944318784 >> v2:172.21.15.111:3300/0 conn(0x7f36a0072440 msgr2=0x7f36a01524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:24.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.883+0000 7f36a6200640 1 --2- 172.21.15.76:0/3944318784 >> v2:172.21.15.111:3300/0 conn(0x7f36a0072440 0x7f36a01524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.882 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.883+0000 7f36a6200640 1 -- 172.21.15.76:0/3944318784 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a015c500 con 0x7f36a01592a0 2024-03-28T13:50:24.892 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.891+0000 7f36a6200640 1 --2- 172.21.15.76:0/3944318784 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36a01592a0 0x7f36a01529f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f36a006c510 tx=0x7f369801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1393ccf2ca99ecfa server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:24.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.955+0000 7f369fe00640 1 -- 172.21.15.76:0/3944318784 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36980a5780 con 0x7f36a01592a0 2024-03-28T13:50:24.953 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.955+0000 7f369fe00640 1 -- 172.21.15.76:0/3944318784 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36980a5920 con 0x7f36a01592a0 2024-03-28T13:50:24.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.955+0000 7f369fe00640 1 -- 172.21.15.76:0/3944318784 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36980a5cf0 con 0x7f36a01592a0 2024-03-28T13:50:24.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.955+0000 7f36a8200640 1 -- 172.21.15.76:0/3944318784 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36a01592a0 msgr2=0x7f36a01529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:24.954 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.955+0000 7f36a8200640 1 --2- 172.21.15.76:0/3944318784 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36a01592a0 0x7f36a01529f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f36a006c510 tx=0x7f369801c9f0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.955+0000 7f36a8200640 1 -- 172.21.15.76:0/3944318784 shutdown_connections 2024-03-28T13:50:24.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.955+0000 7f36a8200640 1 --2- 172.21.15.76:0/3944318784 >> v2:172.21.15.111:3300/0 conn(0x7f36a0072440 0x7f36a01524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.955+0000 7f36a8200640 1 --2- 172.21.15.76:0/3944318784 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36a01592a0 0x7f36a01529f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.955+0000 7f36a8200640 1 --2- 172.21.15.76:0/3944318784 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36a0072060 0x7f36a00cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.955+0000 7f36a8200640 1 -- 172.21.15.76:0/3944318784 >> 172.21.15.76:0/3944318784 conn(0x7f36a0071520 msgr2=0x7f36a0070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:24.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.955+0000 7f36a8200640 1 -- 172.21.15.76:0/3944318784 shutdown_connections 2024-03-28T13:50:24.955 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.955+0000 7f36a8200640 1 -- 172.21.15.76:0/3944318784 wait complete. 2024-03-28T13:50:24.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.955+0000 7f36a8200640 1 Processor -- start 2024-03-28T13:50:24.956 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.955+0000 7f36a8200640 1 -- start start 2024-03-28T13:50:24.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.959+0000 7f36a8200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36a0072060 0x7f36a01574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:24.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.959+0000 7f36a8200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36a0072440 0x7f36a006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:24.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.959+0000 7f36a8200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f36a01592a0 0x7f36a006d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:24.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.959+0000 7f36a8200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f36a00ce110 con 0x7f36a0072060 2024-03-28T13:50:24.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.959+0000 7f36a8200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f36a00cdf90 con 0x7f36a01592a0 2024-03-28T13:50:24.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.959+0000 7f36a8200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f36a00ce290 con 0x7f36a0072440 2024-03-28T13:50:24.958 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.959+0000 7f36a5800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36a0072060 0x7f36a01574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:24.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.959+0000 7f36a5800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36a0072060 0x7f36a01574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52944/0 (socket says 172.21.15.76:52944) 2024-03-28T13:50:24.959 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.959+0000 7f36a5800640 1 -- 172.21.15.76:0/2293917233 learned_addr learned my addr 172.21.15.76:0/2293917233 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:24.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.963+0000 7f36a5800640 1 -- 172.21.15.76:0/2293917233 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36a0072440 msgr2=0x7f36a006d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:24.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.963+0000 7f36a5800640 1 --2- 172.21.15.76:0/2293917233 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36a0072440 0x7f36a006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.963+0000 7f36a5800640 1 -- 172.21.15.76:0/2293917233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f36a01592a0 msgr2=0x7f36a006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:24.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.963+0000 7f36a5800640 1 --2- 172.21.15.76:0/2293917233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f36a01592a0 0x7f36a006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:24.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.963+0000 7f36a5800640 1 -- 172.21.15.76:0/2293917233 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a01565f0 con 0x7f36a0072060 2024-03-28T13:50:24.965 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.967+0000 7f36a5800640 1 --2- 172.21.15.76:0/2293917233 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36a0072060 0x7f36a01574d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f369400e8b0 tx=0x7f369400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:24.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.971+0000 7f369d600640 1 -- 172.21.15.76:0/2293917233 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3694017070 con 0x7f36a0072060 2024-03-28T13:50:24.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.971+0000 7f369d600640 1 -- 172.21.15.76:0/2293917233 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369400c940 con 0x7f36a0072060 2024-03-28T13:50:24.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.971+0000 7f369d600640 1 -- 172.21.15.76:0/2293917233 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369400cd10 con 0x7f36a0072060 2024-03-28T13:50:24.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.971+0000 7f36a8200640 1 -- 172.21.15.76:0/2293917233 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a00cd890 con 0x7f36a0072060 2024-03-28T13:50:24.971 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.971+0000 7f36a8200640 1 -- 172.21.15.76:0/2293917233 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a00c83d0 con 0x7f36a0072060 2024-03-28T13:50:24.972 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.971+0000 7f36a8200640 1 -- 172.21.15.76:0/2293917233 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36a00686e0 con 0x7f36a0072060 2024-03-28T13:50:24.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.995+0000 7f369d600640 1 -- 172.21.15.76:0/2293917233 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f369401a070 con 0x7f36a0072060 2024-03-28T13:50:24.996 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.995+0000 7f369d600640 1 --2- 172.21.15.76:0/2293917233 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3680067fc0 0x7f368006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:24.997 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.999+0000 7f36a4e00640 1 --2- 172.21.15.76:0/2293917233 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3680067fc0 0x7f368006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:24.998 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:24.999+0000 7f36a4e00640 1 --2- 172.21.15.76:0/2293917233 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3680067fc0 0x7f368006a480 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f36a00cdf20 tx=0x7f368c0095c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:25.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.271+0000 7f369d600640 1 -- 172.21.15.76:0/2293917233 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f3694054e70 con 0x7f36a0072060 2024-03-28T13:50:25.271 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.271+0000 7f369d600640 1 -- 172.21.15.76:0/2293917233 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f36940574d0 con 0x7f36a0072060 2024-03-28T13:50:25.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.439+0000 7f36a8200640 1 -- 172.21.15.76:0/2293917233 --> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36a00ca390 con 0x7f3680067fc0 2024-03-28T13:50:25.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.451+0000 7f369d600640 1 -- 172.21.15.76:0/2293917233 <== mgr.4107 v2:172.21.15.76:6800/1313648511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335013 (secure 0 0 0) 0x7f36a00ca390 con 0x7f3680067fc0 2024-03-28T13:50:25.457 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T13:50:25.459 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-03-28T13:50:25.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.455+0000 7f36a8200640 1 -- 172.21.15.76:0/2293917233 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3680067fc0 msgr2=0x7f368006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:25.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.455+0000 7f36a8200640 1 --2- 172.21.15.76:0/2293917233 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3680067fc0 0x7f368006a480 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f36a00cdf20 tx=0x7f368c0095c0 comp rx=0 tx=0).stop 2024-03-28T13:50:25.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.455+0000 7f36a8200640 1 -- 172.21.15.76:0/2293917233 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36a0072060 msgr2=0x7f36a01574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:25.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.455+0000 7f36a8200640 1 --2- 172.21.15.76:0/2293917233 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36a0072060 0x7f36a01574d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f369400e8b0 tx=0x7f369400ed70 comp rx=0 tx=0).stop 2024-03-28T13:50:25.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.455+0000 7f36a8200640 1 -- 172.21.15.76:0/2293917233 shutdown_connections 2024-03-28T13:50:25.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.455+0000 7f36a8200640 1 --2- 172.21.15.76:0/2293917233 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f3680067fc0 0x7f368006a480 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:25.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.455+0000 7f36a8200640 1 --2- 172.21.15.76:0/2293917233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f36a01592a0 0x7f36a006d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:25.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.455+0000 7f36a8200640 1 --2- 172.21.15.76:0/2293917233 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f36a0072440 0x7f36a006d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:25.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.455+0000 7f36a8200640 1 --2- 172.21.15.76:0/2293917233 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f36a0072060 0x7f36a01574d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:25.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.455+0000 7f36a8200640 1 -- 172.21.15.76:0/2293917233 >> 172.21.15.76:0/2293917233 conn(0x7f36a0071520 msgr2=0x7f36a0074e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:25.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.459+0000 7f36a8200640 1 -- 172.21.15.76:0/2293917233 shutdown_connections 2024-03-28T13:50:25.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.459+0000 7f36a8200640 1 -- 172.21.15.76:0/2293917233 wait complete. 2024-03-28T13:50:25.478 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":2095,"stamp":"2024-03-28T13:50:24.033756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":189775996,"num_objects":145,"num_object_clones":0,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":2658,"num_read_kb":3443252,"num_write":48817,"num_write_kb":4437328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59458,"ondisk_log_size":59458,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":930488,"kb_used_data":163640,"kb_used_omap":12,"kb_used_meta":766771,"kb_avail":754044232,"statfs":{"total":773094113280,"available":772141293568,"internally_reserved":0,"allocated":167567360,"data_stored":380578568,"data_compressed":51440597,"data_compressed_allocated":66924544,"data_compressed_original":281636864,"omap_allocated":12752,"internal_metadata":785174064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-249269,"num_objects":-65,"num_object_clones":0,"num_object_copies":-260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-65,"num_whiteouts":0,"num_read":5,"num_read_kb":11,"num_write":113,"num_write_kb":270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003128"},"pg_stats":[{"pgid":"2.1f","version":"29'318","reported_seq":378,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:44.426165+0000","last_change":"2024-03-28T12:42:00.080769+0000","last_active":"2024-03-28T13:49:44.426165+0000","last_peered":"2024-03-28T13:49:44.426165+0000","last_clean":"2024-03-28T13:49:44.426165+0000","last_became_active":"2024-03-28T12:42:00.079900+0000","last_became_peered":"2024-03-28T12:42:00.079900+0000","last_unstale":"2024-03-28T13:49:44.426165+0000","last_undegraded":"2024-03-28T13:49:44.426165+0000","last_fullsized":"2024-03-28T13:49:44.426165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:26.156056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":277,"num_write_kb":8321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'198","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.300790+0000","last_change":"2024-03-28T12:42:01.960244+0000","last_active":"2024-03-28T13:50:18.300790+0000","last_peered":"2024-03-28T13:50:18.300790+0000","last_clean":"2024-03-28T13:50:18.300790+0000","last_became_active":"2024-03-28T12:42:01.959408+0000","last_became_peered":"2024-03-28T12:42:01.959408+0000","last_unstale":"2024-03-28T13:50:18.300790+0000","last_undegraded":"2024-03-28T13:50:18.300790+0000","last_fullsized":"2024-03-28T13:50:18.300790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:00:51.741925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'806","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.626553+0000","last_change":"2024-03-28T12:42:07.880943+0000","last_active":"2024-03-28T13:50:14.626553+0000","last_peered":"2024-03-28T13:50:14.626553+0000","last_clean":"2024-03-28T13:50:14.626553+0000","last_became_active":"2024-03-28T12:42:07.880354+0000","last_became_peered":"2024-03-28T12:42:07.880354+0000","last_unstale":"2024-03-28T13:50:14.626553+0000","last_undegraded":"2024-03-28T13:50:14.626553+0000","last_fullsized":"2024-03-28T13:50:14.626553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:39.078379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":120104,"num_write":790,"num_write_kb":143940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'158","reported_seq":220,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:13.417457+0000","last_change":"2024-03-28T12:42:00.138569+0000","last_active":"2024-03-28T13:49:13.417457+0000","last_peered":"2024-03-28T13:49:13.417457+0000","last_clean":"2024-03-28T13:49:13.417457+0000","last_became_active":"2024-03-28T12:42:00.137978+0000","last_became_peered":"2024-03-28T12:42:00.137978+0000","last_unstale":"2024-03-28T13:49:13.417457+0000","last_undegraded":"2024-03-28T13:49:13.417457+0000","last_fullsized":"2024-03-28T13:49:13.417457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:38:28.575778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'181","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:49.891465+0000","last_change":"2024-03-28T12:42:01.958236+0000","last_active":"2024-03-28T13:49:49.891465+0000","last_peered":"2024-03-28T13:49:49.891465+0000","last_clean":"2024-03-28T13:49:49.891465+0000","last_became_active":"2024-03-28T12:42:01.957875+0000","last_became_peered":"2024-03-28T12:42:01.957875+0000","last_unstale":"2024-03-28T13:49:49.891465+0000","last_undegraded":"2024-03-28T13:49:49.891465+0000","last_fullsized":"2024-03-28T13:49:49.891465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:48:52.933175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'798","reported_seq":902,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.551364+0000","last_change":"2024-03-28T12:42:07.905799+0000","last_active":"2024-03-28T13:50:14.551364+0000","last_peered":"2024-03-28T13:50:14.551364+0000","last_clean":"2024-03-28T13:50:14.551364+0000","last_became_active":"2024-03-28T12:42:07.905350+0000","last_became_peered":"2024-03-28T12:42:07.905350+0000","last_unstale":"2024-03-28T13:50:14.551364+0000","last_undegraded":"2024-03-28T13:50:14.551364+0000","last_fullsized":"2024-03-28T13:50:14.551364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:33:42.281079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":162211,"num_write":782,"num_write_kb":177125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1182","reported_seq":1236,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.424452+0000","last_change":"2024-03-28T12:42:00.150272+0000","last_active":"2024-03-28T13:50:04.424452+0000","last_peered":"2024-03-28T13:50:04.424452+0000","last_clean":"2024-03-28T13:50:04.424452+0000","last_became_active":"2024-03-28T12:42:00.148367+0000","last_became_peered":"2024-03-28T12:42:00.148367+0000","last_unstale":"2024-03-28T13:50:04.424452+0000","last_undegraded":"2024-03-28T13:50:04.424452+0000","last_fullsized":"2024-03-28T13:50:04.424452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:26.156056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1357,"num_write_kb":12879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'180","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:54.148733+0000","last_change":"2024-03-28T12:42:01.965158+0000","last_active":"2024-03-28T13:49:54.148733+0000","last_peered":"2024-03-28T13:49:54.148733+0000","last_clean":"2024-03-28T13:49:54.148733+0000","last_became_active":"2024-03-28T12:42:01.964817+0000","last_became_peered":"2024-03-28T12:42:01.964817+0000","last_unstale":"2024-03-28T13:49:54.148733+0000","last_undegraded":"2024-03-28T13:49:54.148733+0000","last_fullsized":"2024-03-28T13:49:54.148733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'762","reported_seq":839,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.394329+0000","last_change":"2024-03-28T12:42:07.906794+0000","last_active":"2024-03-28T13:50:14.394329+0000","last_peered":"2024-03-28T13:50:14.394329+0000","last_clean":"2024-03-28T13:50:14.394329+0000","last_became_active":"2024-03-28T12:42:07.905522+0000","last_became_peered":"2024-03-28T12:42:07.905522+0000","last_unstale":"2024-03-28T13:50:14.394329+0000","last_undegraded":"2024-03-28T13:50:14.394329+0000","last_fullsized":"2024-03-28T13:50:14.394329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:21.970094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":115606,"num_write":742,"num_write_kb":142838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'844","reported_seq":898,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:49.078377+0000","last_change":"2024-03-28T12:42:00.149947+0000","last_active":"2024-03-28T13:49:49.078377+0000","last_peered":"2024-03-28T13:49:49.078377+0000","last_clean":"2024-03-28T13:49:49.078377+0000","last_became_active":"2024-03-28T12:42:00.148446+0000","last_became_peered":"2024-03-28T12:42:00.148446+0000","last_unstale":"2024-03-28T13:49:49.078377+0000","last_undegraded":"2024-03-28T13:49:49.078377+0000","last_fullsized":"2024-03-28T13:49:49.078377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:47:28.765823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'189","reported_seq":242,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.728289+0000","last_change":"2024-03-28T12:42:01.935596+0000","last_active":"2024-03-28T13:50:08.728289+0000","last_peered":"2024-03-28T13:50:08.728289+0000","last_clean":"2024-03-28T13:50:08.728289+0000","last_became_active":"2024-03-28T12:42:01.935231+0000","last_became_peered":"2024-03-28T12:42:01.935231+0000","last_unstale":"2024-03-28T13:50:08.728289+0000","last_undegraded":"2024-03-28T13:50:08.728289+0000","last_fullsized":"2024-03-28T13:50:08.728289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:17:41.296627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'756","reported_seq":818,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:09.199693+0000","last_change":"2024-03-28T12:42:07.904616+0000","last_active":"2024-03-28T13:50:09.199693+0000","last_peered":"2024-03-28T13:50:09.199693+0000","last_clean":"2024-03-28T13:50:09.199693+0000","last_became_active":"2024-03-28T12:42:07.904240+0000","last_became_peered":"2024-03-28T12:42:07.904240+0000","last_unstale":"2024-03-28T13:50:09.199693+0000","last_undegraded":"2024-03-28T13:50:09.199693+0000","last_fullsized":"2024-03-28T13:50:09.199693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:19:27.175393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":42901,"num_write":735,"num_write_kb":89492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'210","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.983392+0000","last_change":"2024-03-28T12:42:01.963116+0000","last_active":"2024-03-28T13:50:14.983392+0000","last_peered":"2024-03-28T13:50:14.983392+0000","last_clean":"2024-03-28T13:50:14.983392+0000","last_became_active":"2024-03-28T12:42:01.962885+0000","last_became_peered":"2024-03-28T12:42:01.962885+0000","last_unstale":"2024-03-28T13:50:14.983392+0000","last_undegraded":"2024-03-28T13:50:14.983392+0000","last_fullsized":"2024-03-28T13:50:14.983392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:19:06.640780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'621","reported_seq":679,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:28.940898+0000","last_change":"2024-03-28T12:42:00.134353+0000","last_active":"2024-03-28T13:49:28.940898+0000","last_peered":"2024-03-28T13:49:28.940898+0000","last_clean":"2024-03-28T13:49:28.940898+0000","last_became_active":"2024-03-28T12:42:00.133880+0000","last_became_peered":"2024-03-28T12:42:00.133880+0000","last_unstale":"2024-03-28T13:49:28.940898+0000","last_undegraded":"2024-03-28T13:49:28.940898+0000","last_fullsized":"2024-03-28T13:49:28.940898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:45:14.194934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":12550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'827","reported_seq":932,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.428091+0000","last_change":"2024-03-28T12:42:15.238142+0000","last_active":"2024-03-28T13:50:04.428091+0000","last_peered":"2024-03-28T13:50:04.428091+0000","last_clean":"2024-03-28T13:50:04.428091+0000","last_became_active":"2024-03-28T12:42:15.237739+0000","last_became_peered":"2024-03-28T12:42:15.237739+0000","last_unstale":"2024-03-28T13:50:04.428091+0000","last_undegraded":"2024-03-28T13:50:04.428091+0000","last_fullsized":"2024-03-28T13:50:04.428091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:41:14.243482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":166655,"num_write":808,"num_write_kb":213920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'203","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:34.279894+0000","last_change":"2024-03-28T12:42:01.948688+0000","last_active":"2024-03-28T13:49:34.279894+0000","last_peered":"2024-03-28T13:49:34.279894+0000","last_clean":"2024-03-28T13:49:34.279894+0000","last_became_active":"2024-03-28T12:42:01.948049+0000","last_became_peered":"2024-03-28T12:42:01.948049+0000","last_unstale":"2024-03-28T13:49:34.279894+0000","last_undegraded":"2024-03-28T13:49:34.279894+0000","last_fullsized":"2024-03-28T13:49:34.279894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'872","reported_seq":930,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.816043+0000","last_change":"2024-03-28T12:42:00.139208+0000","last_active":"2024-03-28T13:50:15.816043+0000","last_peered":"2024-03-28T13:50:15.816043+0000","last_clean":"2024-03-28T13:50:15.816043+0000","last_became_active":"2024-03-28T12:42:00.138264+0000","last_became_peered":"2024-03-28T12:42:00.138264+0000","last_unstale":"2024-03-28T13:50:15.816043+0000","last_undegraded":"2024-03-28T13:50:15.816043+0000","last_fullsized":"2024-03-28T13:50:15.816043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7256295,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":7576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'824","reported_seq":898,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.939869+0000","last_change":"2024-03-28T12:42:07.941636+0000","last_active":"2024-03-28T13:50:14.939869+0000","last_peered":"2024-03-28T13:50:14.939869+0000","last_clean":"2024-03-28T13:50:14.939869+0000","last_became_active":"2024-03-28T12:42:07.941114+0000","last_became_peered":"2024-03-28T12:42:07.941114+0000","last_unstale":"2024-03-28T13:50:14.939869+0000","last_undegraded":"2024-03-28T13:50:14.939869+0000","last_fullsized":"2024-03-28T13:50:14.939869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:00:58.736580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":77884,"num_write":800,"num_write_kb":72822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'198","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:44.614126+0000","last_change":"2024-03-28T12:42:01.949545+0000","last_active":"2024-03-28T13:49:44.614126+0000","last_peered":"2024-03-28T13:49:44.614126+0000","last_clean":"2024-03-28T13:49:44.614126+0000","last_became_active":"2024-03-28T12:42:01.946576+0000","last_became_peered":"2024-03-28T12:42:01.946576+0000","last_unstale":"2024-03-28T13:49:44.614126+0000","last_undegraded":"2024-03-28T13:49:44.614126+0000","last_fullsized":"2024-03-28T13:49:44.614126+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:32.704186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'258","reported_seq":317,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:12.902420+0000","last_change":"2024-03-28T12:42:00.142804+0000","last_active":"2024-03-28T13:49:12.902420+0000","last_peered":"2024-03-28T13:49:12.902420+0000","last_clean":"2024-03-28T13:49:12.902420+0000","last_became_active":"2024-03-28T12:42:00.142063+0000","last_became_peered":"2024-03-28T12:42:00.142063+0000","last_unstale":"2024-03-28T13:49:12.902420+0000","last_undegraded":"2024-03-28T13:49:12.902420+0000","last_fullsized":"2024-03-28T13:49:12.902420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:20:01.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'752","reported_seq":836,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.513787+0000","last_change":"2024-03-28T12:42:15.234431+0000","last_active":"2024-03-28T13:50:14.513787+0000","last_peered":"2024-03-28T13:50:14.513787+0000","last_clean":"2024-03-28T13:50:14.513787+0000","last_became_active":"2024-03-28T12:42:15.232928+0000","last_became_peered":"2024-03-28T12:42:15.232928+0000","last_unstale":"2024-03-28T13:50:14.513787+0000","last_undegraded":"2024-03-28T13:50:14.513787+0000","last_fullsized":"2024-03-28T13:50:14.513787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:05:19.841176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":85819,"num_write":731,"num_write_kb":97778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,5],"acting":[7,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'220","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.372553+0000","last_change":"2024-03-28T12:42:01.787457+0000","last_active":"2024-03-28T13:50:14.372553+0000","last_peered":"2024-03-28T13:50:14.372553+0000","last_clean":"2024-03-28T13:50:14.372553+0000","last_became_active":"2024-03-28T12:42:01.787253+0000","last_became_peered":"2024-03-28T12:42:01.787253+0000","last_unstale":"2024-03-28T13:50:14.372553+0000","last_undegraded":"2024-03-28T13:50:14.372553+0000","last_fullsized":"2024-03-28T13:50:14.372553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:33.620394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'771","reported_seq":829,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:23.369953+0000","last_change":"2024-03-28T12:42:00.146723+0000","last_active":"2024-03-28T13:49:23.369953+0000","last_peered":"2024-03-28T13:49:23.369953+0000","last_clean":"2024-03-28T13:49:23.369953+0000","last_became_active":"2024-03-28T12:42:00.146394+0000","last_became_peered":"2024-03-28T12:42:00.146394+0000","last_unstale":"2024-03-28T13:49:23.369953+0000","last_undegraded":"2024-03-28T13:49:23.369953+0000","last_fullsized":"2024-03-28T13:49:23.369953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:20:01.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'732","reported_seq":812,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.104446+0000","last_change":"2024-03-28T12:42:07.906623+0000","last_active":"2024-03-28T13:50:15.104446+0000","last_peered":"2024-03-28T13:50:15.104446+0000","last_clean":"2024-03-28T13:50:15.104446+0000","last_became_active":"2024-03-28T12:42:07.906233+0000","last_became_peered":"2024-03-28T12:42:07.906233+0000","last_unstale":"2024-03-28T13:50:15.104446+0000","last_undegraded":"2024-03-28T13:50:15.104446+0000","last_fullsized":"2024-03-28T13:50:15.104446+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:45.857353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":108609,"num_write":711,"num_write_kb":134735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'218","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.110350+0000","last_change":"2024-03-28T12:42:01.946498+0000","last_active":"2024-03-28T13:50:15.110350+0000","last_peered":"2024-03-28T13:50:15.110350+0000","last_clean":"2024-03-28T13:50:15.110350+0000","last_became_active":"2024-03-28T12:42:01.946087+0000","last_became_peered":"2024-03-28T12:42:01.946087+0000","last_unstale":"2024-03-28T13:50:15.110350+0000","last_undegraded":"2024-03-28T13:50:15.110350+0000","last_fullsized":"2024-03-28T13:50:15.110350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:05:13.466983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'253","reported_seq":312,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:40.083465+0000","last_change":"2024-03-28T12:42:00.143860+0000","last_active":"2024-03-28T13:49:40.083465+0000","last_peered":"2024-03-28T13:49:40.083465+0000","last_clean":"2024-03-28T13:49:40.083465+0000","last_became_active":"2024-03-28T12:42:00.143537+0000","last_became_peered":"2024-03-28T12:42:00.143537+0000","last_unstale":"2024-03-28T13:49:40.083465+0000","last_undegraded":"2024-03-28T13:49:40.083465+0000","last_fullsized":"2024-03-28T13:49:40.083465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:38:32.416338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":4185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'820","reported_seq":928,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.550528+0000","last_change":"2024-03-28T12:42:15.365975+0000","last_active":"2024-03-28T13:50:14.550528+0000","last_peered":"2024-03-28T13:50:14.550528+0000","last_clean":"2024-03-28T13:50:14.550528+0000","last_became_active":"2024-03-28T12:42:15.365535+0000","last_became_peered":"2024-03-28T12:42:15.365535+0000","last_unstale":"2024-03-28T13:50:14.550528+0000","last_undegraded":"2024-03-28T13:50:14.550528+0000","last_fullsized":"2024-03-28T13:50:14.550528+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":174138,"num_write":805,"num_write_kb":205369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,1],"acting":[2,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'170","reported_seq":227,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:39.978541+0000","last_change":"2024-03-28T12:42:01.802128+0000","last_active":"2024-03-28T13:49:39.978541+0000","last_peered":"2024-03-28T13:49:39.978541+0000","last_clean":"2024-03-28T13:49:39.978541+0000","last_became_active":"2024-03-28T12:42:01.801492+0000","last_became_peered":"2024-03-28T12:42:01.801492+0000","last_unstale":"2024-03-28T13:49:39.978541+0000","last_undegraded":"2024-03-28T13:49:39.978541+0000","last_fullsized":"2024-03-28T13:49:39.978541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:23:08.932618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'3005","reported_seq":3064,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:17.434838+0000","last_change":"2024-03-28T12:42:00.145914+0000","last_active":"2024-03-28T13:50:17.434838+0000","last_peered":"2024-03-28T13:50:17.434838+0000","last_clean":"2024-03-28T13:50:17.434838+0000","last_became_active":"2024-03-28T12:42:00.145638+0000","last_became_peered":"2024-03-28T12:42:00.145638+0000","last_unstale":"2024-03-28T13:50:17.434838+0000","last_undegraded":"2024-03-28T13:50:17.434838+0000","last_fullsized":"2024-03-28T13:50:17.434838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3005,"log_dups_size":0,"ondisk_log_size":3005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:47:28.765823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6731,"num_write_kb":3813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'791","reported_seq":864,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.443936+0000","last_change":"2024-03-28T12:42:07.882697+0000","last_active":"2024-03-28T13:50:04.443936+0000","last_peered":"2024-03-28T13:50:04.443936+0000","last_clean":"2024-03-28T13:50:04.443936+0000","last_became_active":"2024-03-28T12:42:07.881730+0000","last_became_peered":"2024-03-28T12:42:07.881730+0000","last_unstale":"2024-03-28T13:50:04.443936+0000","last_undegraded":"2024-03-28T13:50:04.443936+0000","last_fullsized":"2024-03-28T13:50:04.443936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:12:27.231636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":64976,"num_write":766,"num_write_kb":85207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'195","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.718553+0000","last_change":"2024-03-28T12:42:01.810914+0000","last_active":"2024-03-28T13:50:08.718553+0000","last_peered":"2024-03-28T13:50:08.718553+0000","last_clean":"2024-03-28T13:50:08.718553+0000","last_became_active":"2024-03-28T12:42:01.810207+0000","last_became_peered":"2024-03-28T12:42:01.810207+0000","last_unstale":"2024-03-28T13:50:08.718553+0000","last_undegraded":"2024-03-28T13:50:08.718553+0000","last_fullsized":"2024-03-28T13:50:08.718553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:32.704186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'669","reported_seq":729,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:23.207829+0000","last_change":"2024-03-28T12:42:00.078402+0000","last_active":"2024-03-28T13:49:23.207829+0000","last_peered":"2024-03-28T13:49:23.207829+0000","last_clean":"2024-03-28T13:49:23.207829+0000","last_became_active":"2024-03-28T12:42:00.077988+0000","last_became_peered":"2024-03-28T12:42:00.077988+0000","last_unstale":"2024-03-28T13:49:23.207829+0000","last_undegraded":"2024-03-28T13:49:23.207829+0000","last_fullsized":"2024-03-28T13:49:23.207829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:21:58.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":8525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'762","reported_seq":849,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.824806+0000","last_change":"2024-03-28T12:42:07.936419+0000","last_active":"2024-03-28T13:50:08.824806+0000","last_peered":"2024-03-28T13:50:08.824806+0000","last_clean":"2024-03-28T13:50:08.824806+0000","last_became_active":"2024-03-28T12:42:07.935820+0000","last_became_peered":"2024-03-28T12:42:07.935820+0000","last_unstale":"2024-03-28T13:50:08.824806+0000","last_undegraded":"2024-03-28T13:50:08.824806+0000","last_fullsized":"2024-03-28T13:50:08.824806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:35:08.334379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":124547,"num_write":741,"num_write_kb":143298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'206","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.676800+0000","last_change":"2024-03-28T12:42:01.968887+0000","last_active":"2024-03-28T13:50:14.676800+0000","last_peered":"2024-03-28T13:50:14.676800+0000","last_clean":"2024-03-28T13:50:14.676800+0000","last_became_active":"2024-03-28T12:42:01.965491+0000","last_became_peered":"2024-03-28T12:42:01.965491+0000","last_unstale":"2024-03-28T13:50:14.676800+0000","last_undegraded":"2024-03-28T13:50:14.676800+0000","last_fullsized":"2024-03-28T13:50:14.676800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:35:50.246850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'378","reported_seq":438,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:48:53.431765+0000","last_change":"2024-03-28T12:42:00.135482+0000","last_active":"2024-03-28T13:48:53.431765+0000","last_peered":"2024-03-28T13:48:53.431765+0000","last_clean":"2024-03-28T13:48:53.431765+0000","last_became_active":"2024-03-28T12:42:00.132939+0000","last_became_peered":"2024-03-28T12:42:00.132939+0000","last_unstale":"2024-03-28T13:48:53.431765+0000","last_undegraded":"2024-03-28T13:48:53.431765+0000","last_fullsized":"2024-03-28T13:48:53.431765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:31:41.407157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'754","reported_seq":812,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.841272+0000","last_change":"2024-03-28T12:42:07.865644+0000","last_active":"2024-03-28T13:50:08.841272+0000","last_peered":"2024-03-28T13:50:08.841272+0000","last_clean":"2024-03-28T13:50:08.841272+0000","last_became_active":"2024-03-28T12:42:07.864804+0000","last_became_peered":"2024-03-28T12:42:07.864804+0000","last_unstale":"2024-03-28T13:50:08.841272+0000","last_undegraded":"2024-03-28T13:50:08.841272+0000","last_fullsized":"2024-03-28T13:50:08.841272+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:28.659784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":19361,"num_write":730,"num_write_kb":84308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'195","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:49.984071+0000","last_change":"2024-03-28T12:42:01.966222+0000","last_active":"2024-03-28T13:49:49.984071+0000","last_peered":"2024-03-28T13:49:49.984071+0000","last_clean":"2024-03-28T13:49:49.984071+0000","last_became_active":"2024-03-28T12:42:01.962305+0000","last_became_peered":"2024-03-28T12:42:01.962305+0000","last_unstale":"2024-03-28T13:49:49.984071+0000","last_undegraded":"2024-03-28T13:49:49.984071+0000","last_fullsized":"2024-03-28T13:49:49.984071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:33:35.906886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'899","reported_seq":959,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:48:08.735973+0000","last_change":"2024-03-28T12:42:00.137406+0000","last_active":"2024-03-28T13:48:08.735973+0000","last_peered":"2024-03-28T13:48:08.735973+0000","last_clean":"2024-03-28T13:48:08.735973+0000","last_became_active":"2024-03-28T12:42:00.137086+0000","last_became_peered":"2024-03-28T12:42:00.137086+0000","last_unstale":"2024-03-28T13:48:08.735973+0000","last_undegraded":"2024-03-28T13:48:08.735973+0000","last_fullsized":"2024-03-28T13:48:08.735973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:44:10.945015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389450,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":8591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'738","reported_seq":816,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.304618+0000","last_change":"2024-03-28T12:42:07.940726+0000","last_active":"2024-03-28T13:50:18.304618+0000","last_peered":"2024-03-28T13:50:18.304618+0000","last_clean":"2024-03-28T13:50:18.304618+0000","last_became_active":"2024-03-28T12:42:07.939926+0000","last_became_peered":"2024-03-28T12:42:07.939926+0000","last_unstale":"2024-03-28T13:50:18.304618+0000","last_undegraded":"2024-03-28T13:50:18.304618+0000","last_fullsized":"2024-03-28T13:50:18.304618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:45.857353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":104657,"num_write":715,"num_write_kb":183622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'203","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.453979+0000","last_change":"2024-03-28T12:42:01.949510+0000","last_active":"2024-03-28T13:50:04.453979+0000","last_peered":"2024-03-28T13:50:04.453979+0000","last_clean":"2024-03-28T13:50:04.453979+0000","last_became_active":"2024-03-28T12:42:01.949046+0000","last_became_peered":"2024-03-28T12:42:01.949046+0000","last_unstale":"2024-03-28T13:50:04.453979+0000","last_undegraded":"2024-03-28T13:50:04.453979+0000","last_fullsized":"2024-03-28T13:50:04.453979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:50:04.915302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1503","reported_seq":2997,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.279902+0000","last_change":"2024-03-28T12:42:00.150734+0000","last_active":"2024-03-28T13:50:18.279902+0000","last_peered":"2024-03-28T13:50:18.279902+0000","last_clean":"2024-03-28T13:50:18.279902+0000","last_became_active":"2024-03-28T12:42:00.150209+0000","last_became_peered":"2024-03-28T12:42:00.150209+0000","last_unstale":"2024-03-28T13:50:18.279902+0000","last_undegraded":"2024-03-28T13:50:18.279902+0000","last_fullsized":"2024-03-28T13:50:18.279902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1503,"log_dups_size":0,"ondisk_log_size":1503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:01:08.734929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1566263,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1436,"num_read_kb":2621,"num_write":1442,"num_write_kb":2624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'706","reported_seq":785,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.371808+0000","last_change":"2024-03-28T12:42:07.935974+0000","last_active":"2024-03-28T13:50:14.371808+0000","last_peered":"2024-03-28T13:50:14.371808+0000","last_clean":"2024-03-28T13:50:14.371808+0000","last_became_active":"2024-03-28T12:42:07.935342+0000","last_became_peered":"2024-03-28T12:42:07.935342+0000","last_unstale":"2024-03-28T13:50:14.371808+0000","last_undegraded":"2024-03-28T13:50:14.371808+0000","last_fullsized":"2024-03-28T13:50:14.371808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:21.970094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":64573,"num_write":698,"num_write_kb":72611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'193","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.635107+0000","last_change":"2024-03-28T12:42:01.961701+0000","last_active":"2024-03-28T13:50:03.635107+0000","last_peered":"2024-03-28T13:50:03.635107+0000","last_clean":"2024-03-28T13:50:03.635107+0000","last_became_active":"2024-03-28T12:42:01.961228+0000","last_became_peered":"2024-03-28T12:42:01.961228+0000","last_unstale":"2024-03-28T13:50:03.635107+0000","last_undegraded":"2024-03-28T13:50:03.635107+0000","last_fullsized":"2024-03-28T13:50:03.635107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'517","reported_seq":579,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:54.262943+0000","last_change":"2024-03-28T12:42:00.069398+0000","last_active":"2024-03-28T13:49:54.262943+0000","last_peered":"2024-03-28T13:49:54.262943+0000","last_clean":"2024-03-28T13:49:54.262943+0000","last_became_active":"2024-03-28T12:42:00.069134+0000","last_became_peered":"2024-03-28T12:42:00.069134+0000","last_unstale":"2024-03-28T13:49:54.262943+0000","last_undegraded":"2024-03-28T13:49:54.262943+0000","last_fullsized":"2024-03-28T13:49:54.262943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:57:54.776311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":460,"num_write_kb":12504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'872","reported_seq":971,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.109378+0000","last_change":"2024-03-28T12:42:15.365776+0000","last_active":"2024-03-28T13:50:15.109378+0000","last_peered":"2024-03-28T13:50:15.109378+0000","last_clean":"2024-03-28T13:50:15.109378+0000","last_became_active":"2024-03-28T12:42:15.364496+0000","last_became_peered":"2024-03-28T12:42:15.364496+0000","last_unstale":"2024-03-28T13:50:15.109378+0000","last_undegraded":"2024-03-28T13:50:15.109378+0000","last_fullsized":"2024-03-28T13:50:15.109378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:22:09.948471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":158824,"num_write":857,"num_write_kb":176540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'180","reported_seq":238,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:59.827677+0000","last_change":"2024-03-28T12:42:01.959210+0000","last_active":"2024-03-28T13:49:59.827677+0000","last_peered":"2024-03-28T13:49:59.827677+0000","last_clean":"2024-03-28T13:49:59.827677+0000","last_became_active":"2024-03-28T12:42:01.958117+0000","last_became_peered":"2024-03-28T12:42:01.958117+0000","last_unstale":"2024-03-28T13:49:59.827677+0000","last_undegraded":"2024-03-28T13:49:59.827677+0000","last_fullsized":"2024-03-28T13:49:59.827677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:28:17.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'274","reported_seq":334,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.456569+0000","last_change":"2024-03-28T12:42:00.134120+0000","last_active":"2024-03-28T13:50:04.456569+0000","last_peered":"2024-03-28T13:50:04.456569+0000","last_clean":"2024-03-28T13:50:04.456569+0000","last_became_active":"2024-03-28T12:42:00.133540+0000","last_became_peered":"2024-03-28T12:42:00.133540+0000","last_unstale":"2024-03-28T13:50:04.456569+0000","last_undegraded":"2024-03-28T13:50:04.456569+0000","last_fullsized":"2024-03-28T13:50:04.456569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:49:47.641947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":216,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:47:49.340422+0000","last_change":"2024-03-28T12:41:26.701485+0000","last_active":"2024-03-28T13:47:49.340422+0000","last_peered":"2024-03-28T13:47:49.340422+0000","last_clean":"2024-03-28T13:47:49.340422+0000","last_became_active":"2024-03-28T12:41:26.700338+0000","last_became_peered":"2024-03-28T12:41:26.700338+0000","last_unstale":"2024-03-28T13:47:49.340422+0000","last_undegraded":"2024-03-28T13:47:49.340422+0000","last_fullsized":"2024-03-28T13:47:49.340422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:24.290713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:24.290713+0000","last_clean_scrub_stamp":"2024-03-28T12:41:24.290713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:58:57.536691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'778","reported_seq":854,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.666868+0000","last_change":"2024-03-28T12:42:07.938384+0000","last_active":"2024-03-28T13:50:14.666868+0000","last_peered":"2024-03-28T13:50:14.666868+0000","last_clean":"2024-03-28T13:50:14.666868+0000","last_became_active":"2024-03-28T12:42:07.937553+0000","last_became_peered":"2024-03-28T12:42:07.937553+0000","last_unstale":"2024-03-28T13:50:14.666868+0000","last_undegraded":"2024-03-28T13:50:14.666868+0000","last_fullsized":"2024-03-28T13:50:14.666868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:28:13.502930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":72658,"num_write":755,"num_write_kb":105142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'204","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:35.203603+0000","last_change":"2024-03-28T12:42:01.960107+0000","last_active":"2024-03-28T13:49:35.203603+0000","last_peered":"2024-03-28T13:49:35.203603+0000","last_clean":"2024-03-28T13:49:35.203603+0000","last_became_active":"2024-03-28T12:42:01.959809+0000","last_became_peered":"2024-03-28T12:42:01.959809+0000","last_unstale":"2024-03-28T13:49:35.203603+0000","last_undegraded":"2024-03-28T13:49:35.203603+0000","last_fullsized":"2024-03-28T13:49:35.203603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:38.797683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'367","reported_seq":424,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:44.803574+0000","last_change":"2024-03-28T12:42:00.144133+0000","last_active":"2024-03-28T13:49:44.803574+0000","last_peered":"2024-03-28T13:49:44.803574+0000","last_clean":"2024-03-28T13:49:44.803574+0000","last_became_active":"2024-03-28T12:42:00.143460+0000","last_became_peered":"2024-03-28T12:42:00.143460+0000","last_unstale":"2024-03-28T13:49:44.803574+0000","last_undegraded":"2024-03-28T13:49:44.803574+0000","last_fullsized":"2024-03-28T13:49:44.803574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195728,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":4240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'802","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.003550+0000","last_change":"2024-03-28T12:42:07.902848+0000","last_active":"2024-03-28T13:50:15.003550+0000","last_peered":"2024-03-28T13:50:15.003550+0000","last_clean":"2024-03-28T13:50:15.003550+0000","last_became_active":"2024-03-28T12:42:07.902428+0000","last_became_peered":"2024-03-28T12:42:07.902428+0000","last_unstale":"2024-03-28T13:50:15.003550+0000","last_undegraded":"2024-03-28T13:50:15.003550+0000","last_fullsized":"2024-03-28T13:50:15.003550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:28.659784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":87583,"num_write":773,"num_write_kb":126746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'220","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.939704+0000","last_change":"2024-03-28T12:42:01.950786+0000","last_active":"2024-03-28T13:50:14.939704+0000","last_peered":"2024-03-28T13:50:14.939704+0000","last_clean":"2024-03-28T13:50:14.939704+0000","last_became_active":"2024-03-28T12:42:01.950592+0000","last_became_peered":"2024-03-28T12:42:01.950592+0000","last_unstale":"2024-03-28T13:50:14.939704+0000","last_undegraded":"2024-03-28T13:50:14.939704+0000","last_fullsized":"2024-03-28T13:50:14.939704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:53.224241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'817","reported_seq":875,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:18.008064+0000","last_change":"2024-03-28T12:42:00.148307+0000","last_active":"2024-03-28T13:49:18.008064+0000","last_peered":"2024-03-28T13:49:18.008064+0000","last_clean":"2024-03-28T13:49:18.008064+0000","last_became_active":"2024-03-28T12:42:00.139237+0000","last_became_peered":"2024-03-28T12:42:00.139237+0000","last_unstale":"2024-03-28T13:49:18.008064+0000","last_undegraded":"2024-03-28T13:49:18.008064+0000","last_fullsized":"2024-03-28T13:49:18.008064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:43:33.699843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":4460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'797","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.417907+0000","last_change":"2024-03-28T12:42:07.885520+0000","last_active":"2024-03-28T13:50:04.417907+0000","last_peered":"2024-03-28T13:50:04.417907+0000","last_clean":"2024-03-28T13:50:04.417907+0000","last_became_active":"2024-03-28T12:42:07.880300+0000","last_became_peered":"2024-03-28T12:42:07.880300+0000","last_unstale":"2024-03-28T13:50:04.417907+0000","last_undegraded":"2024-03-28T13:50:04.417907+0000","last_fullsized":"2024-03-28T13:50:04.417907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:17:47.670820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":105873,"num_write":776,"num_write_kb":138943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'192","reported_seq":247,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.944693+0000","last_change":"2024-03-28T12:42:01.962888+0000","last_active":"2024-03-28T13:50:08.944693+0000","last_peered":"2024-03-28T13:50:08.944693+0000","last_clean":"2024-03-28T13:50:08.944693+0000","last_became_active":"2024-03-28T12:42:01.962604+0000","last_became_peered":"2024-03-28T12:42:01.962604+0000","last_unstale":"2024-03-28T13:50:08.944693+0000","last_undegraded":"2024-03-28T13:50:08.944693+0000","last_fullsized":"2024-03-28T13:50:08.944693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:49.327792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'793","reported_seq":851,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:03.609064+0000","last_change":"2024-03-28T12:42:00.085372+0000","last_active":"2024-03-28T13:49:03.609064+0000","last_peered":"2024-03-28T13:49:03.609064+0000","last_clean":"2024-03-28T13:49:03.609064+0000","last_became_active":"2024-03-28T12:42:00.084866+0000","last_became_peered":"2024-03-28T12:42:00.084866+0000","last_unstale":"2024-03-28T13:49:03.609064+0000","last_undegraded":"2024-03-28T13:49:03.609064+0000","last_fullsized":"2024-03-28T13:49:03.609064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:21:45.688123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'769","reported_seq":847,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.305858+0000","last_change":"2024-03-28T12:42:07.899218+0000","last_active":"2024-03-28T13:50:18.305858+0000","last_peered":"2024-03-28T13:50:18.305858+0000","last_clean":"2024-03-28T13:50:18.305858+0000","last_became_active":"2024-03-28T12:42:07.898853+0000","last_became_peered":"2024-03-28T12:42:07.898853+0000","last_unstale":"2024-03-28T13:50:18.305858+0000","last_undegraded":"2024-03-28T13:50:18.305858+0000","last_fullsized":"2024-03-28T13:50:18.305858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:21.240557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":96622,"num_write":756,"num_write_kb":72915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'182","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.583860+0000","last_change":"2024-03-28T12:42:01.965370+0000","last_active":"2024-03-28T13:50:03.583860+0000","last_peered":"2024-03-28T13:50:03.583860+0000","last_clean":"2024-03-28T13:50:03.583860+0000","last_became_active":"2024-03-28T12:42:01.964442+0000","last_became_peered":"2024-03-28T12:42:01.964442+0000","last_unstale":"2024-03-28T13:50:03.583860+0000","last_undegraded":"2024-03-28T13:50:03.583860+0000","last_fullsized":"2024-03-28T13:50:03.583860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:35.775033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'907","reported_seq":964,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:59.756156+0000","last_change":"2024-03-28T12:42:00.153658+0000","last_active":"2024-03-28T13:49:59.756156+0000","last_peered":"2024-03-28T13:49:59.756156+0000","last_clean":"2024-03-28T13:49:59.756156+0000","last_became_active":"2024-03-28T12:42:00.153292+0000","last_became_peered":"2024-03-28T12:42:00.153292+0000","last_unstale":"2024-03-28T13:49:59.756156+0000","last_undegraded":"2024-03-28T13:49:59.756156+0000","last_fullsized":"2024-03-28T13:49:59.756156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":907,"log_dups_size":0,"ondisk_log_size":907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:54.524905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1005,"num_write_kb":4546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'806","reported_seq":886,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.373691+0000","last_change":"2024-03-28T12:42:07.900126+0000","last_active":"2024-03-28T13:50:14.373691+0000","last_peered":"2024-03-28T13:50:14.373691+0000","last_clean":"2024-03-28T13:50:14.373691+0000","last_became_active":"2024-03-28T12:42:07.899780+0000","last_became_peered":"2024-03-28T12:42:07.899780+0000","last_unstale":"2024-03-28T13:50:14.373691+0000","last_undegraded":"2024-03-28T13:50:14.373691+0000","last_fullsized":"2024-03-28T13:50:14.373691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:31.070732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":86897,"num_write":794,"num_write_kb":118337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'228","reported_seq":283,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.944207+0000","last_change":"2024-03-28T12:42:01.962221+0000","last_active":"2024-03-28T13:50:14.944207+0000","last_peered":"2024-03-28T13:50:14.944207+0000","last_clean":"2024-03-28T13:50:14.944207+0000","last_became_active":"2024-03-28T12:42:01.961938+0000","last_became_peered":"2024-03-28T12:42:01.961938+0000","last_unstale":"2024-03-28T13:50:14.944207+0000","last_undegraded":"2024-03-28T13:50:14.944207+0000","last_fullsized":"2024-03-28T13:50:14.944207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:55:52.354803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'476","reported_seq":533,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:39.980515+0000","last_change":"2024-03-28T12:42:00.132287+0000","last_active":"2024-03-28T13:49:39.980515+0000","last_peered":"2024-03-28T13:49:39.980515+0000","last_clean":"2024-03-28T13:49:39.980515+0000","last_became_active":"2024-03-28T12:42:00.131064+0000","last_became_peered":"2024-03-28T12:42:00.131064+0000","last_unstale":"2024-03-28T13:49:39.980515+0000","last_undegraded":"2024-03-28T13:49:39.980515+0000","last_fullsized":"2024-03-28T13:49:39.980515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":8385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'776","reported_seq":858,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.958070+0000","last_change":"2024-03-28T12:42:07.887453+0000","last_active":"2024-03-28T13:50:08.958070+0000","last_peered":"2024-03-28T13:50:08.958070+0000","last_clean":"2024-03-28T13:50:08.958070+0000","last_became_active":"2024-03-28T12:42:07.886685+0000","last_became_peered":"2024-03-28T12:42:07.886685+0000","last_unstale":"2024-03-28T13:50:08.958070+0000","last_undegraded":"2024-03-28T13:50:08.958070+0000","last_fullsized":"2024-03-28T13:50:08.958070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:10:05.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":115085,"num_write":757,"num_write_kb":114512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'210","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:00.030145+0000","last_change":"2024-03-28T12:42:01.961318+0000","last_active":"2024-03-28T13:50:00.030145+0000","last_peered":"2024-03-28T13:50:00.030145+0000","last_clean":"2024-03-28T13:50:00.030145+0000","last_became_active":"2024-03-28T12:42:01.960102+0000","last_became_peered":"2024-03-28T12:42:01.960102+0000","last_unstale":"2024-03-28T13:50:00.030145+0000","last_undegraded":"2024-03-28T13:50:00.030145+0000","last_fullsized":"2024-03-28T13:50:00.030145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'64","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:48:43.809325+0000","last_change":"2024-03-28T12:42:00.145117+0000","last_active":"2024-03-28T13:48:43.809325+0000","last_peered":"2024-03-28T13:48:43.809325+0000","last_clean":"2024-03-28T13:48:43.809325+0000","last_became_active":"2024-03-28T12:42:00.144572+0000","last_became_peered":"2024-03-28T12:42:00.144572+0000","last_unstale":"2024-03-28T13:48:43.809325+0000","last_undegraded":"2024-03-28T13:48:43.809325+0000","last_fullsized":"2024-03-28T13:48:43.809325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:21:45.688123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":842,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'777","reported_seq":838,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.732192+0000","last_change":"2024-03-28T12:42:07.885727+0000","last_active":"2024-03-28T13:50:03.732192+0000","last_peered":"2024-03-28T13:50:03.732192+0000","last_clean":"2024-03-28T13:50:03.732192+0000","last_became_active":"2024-03-28T12:42:07.884760+0000","last_became_peered":"2024-03-28T12:42:07.884760+0000","last_unstale":"2024-03-28T13:50:03.732192+0000","last_undegraded":"2024-03-28T13:50:03.732192+0000","last_fullsized":"2024-03-28T13:50:03.732192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:45.171876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":41596,"num_write":756,"num_write_kb":91419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'188","reported_seq":243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.758331+0000","last_change":"2024-03-28T12:42:01.936371+0000","last_active":"2024-03-28T13:50:03.758331+0000","last_peered":"2024-03-28T13:50:03.758331+0000","last_clean":"2024-03-28T13:50:03.758331+0000","last_became_active":"2024-03-28T12:42:01.936080+0000","last_became_peered":"2024-03-28T12:42:01.936080+0000","last_unstale":"2024-03-28T13:50:03.758331+0000","last_undegraded":"2024-03-28T13:50:03.758331+0000","last_fullsized":"2024-03-28T13:50:03.758331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:36.955339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'56","reported_seq":113,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.341470+0000","last_change":"2024-03-28T12:42:00.139149+0000","last_active":"2024-03-28T13:50:18.341470+0000","last_peered":"2024-03-28T13:50:18.341470+0000","last_clean":"2024-03-28T13:50:18.341470+0000","last_became_active":"2024-03-28T12:42:00.138555+0000","last_became_peered":"2024-03-28T12:42:00.138555+0000","last_unstale":"2024-03-28T13:50:18.341470+0000","last_undegraded":"2024-03-28T13:50:18.341470+0000","last_fullsized":"2024-03-28T13:50:18.341470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:44:12.403916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'757","reported_seq":858,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:09.340082+0000","last_change":"2024-03-28T12:42:07.940362+0000","last_active":"2024-03-28T13:50:09.340082+0000","last_peered":"2024-03-28T13:50:09.340082+0000","last_clean":"2024-03-28T13:50:09.340082+0000","last_became_active":"2024-03-28T12:42:07.939396+0000","last_became_peered":"2024-03-28T12:42:07.939396+0000","last_unstale":"2024-03-28T13:50:09.340082+0000","last_undegraded":"2024-03-28T13:50:09.340082+0000","last_fullsized":"2024-03-28T13:50:09.340082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:59.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":181074,"num_write":742,"num_write_kb":169009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'203","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.008880+0000","last_change":"2024-03-28T12:42:01.800361+0000","last_active":"2024-03-28T13:50:15.008880+0000","last_peered":"2024-03-28T13:50:15.008880+0000","last_clean":"2024-03-28T13:50:15.008880+0000","last_became_active":"2024-03-28T12:42:01.799594+0000","last_became_peered":"2024-03-28T12:42:01.799594+0000","last_unstale":"2024-03-28T13:50:15.008880+0000","last_undegraded":"2024-03-28T13:50:15.008880+0000","last_fullsized":"2024-03-28T13:50:15.008880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:35.775033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'343","reported_seq":398,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:23.356856+0000","last_change":"2024-03-28T12:42:00.143501+0000","last_active":"2024-03-28T13:49:23.356856+0000","last_peered":"2024-03-28T13:49:23.356856+0000","last_clean":"2024-03-28T13:49:23.356856+0000","last_became_active":"2024-03-28T12:42:00.142913+0000","last_became_peered":"2024-03-28T12:42:00.142913+0000","last_unstale":"2024-03-28T13:49:23.356856+0000","last_undegraded":"2024-03-28T13:49:23.356856+0000","last_fullsized":"2024-03-28T13:49:23.356856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":8326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'745","reported_seq":819,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.946235+0000","last_change":"2024-03-28T12:42:07.938687+0000","last_active":"2024-03-28T13:50:14.946235+0000","last_peered":"2024-03-28T13:50:14.946235+0000","last_clean":"2024-03-28T13:50:14.946235+0000","last_became_active":"2024-03-28T12:42:07.938081+0000","last_became_peered":"2024-03-28T12:42:07.938081+0000","last_unstale":"2024-03-28T13:50:14.946235+0000","last_undegraded":"2024-03-28T13:50:14.946235+0000","last_fullsized":"2024-03-28T13:50:14.946235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:47.148457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":86453,"num_write":732,"num_write_kb":138137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'196","reported_seq":249,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.441692+0000","last_change":"2024-03-28T12:42:01.938516+0000","last_active":"2024-03-28T13:50:14.441692+0000","last_peered":"2024-03-28T13:50:14.441692+0000","last_clean":"2024-03-28T13:50:14.441692+0000","last_became_active":"2024-03-28T12:42:01.938251+0000","last_became_peered":"2024-03-28T12:42:01.938251+0000","last_unstale":"2024-03-28T13:50:14.441692+0000","last_undegraded":"2024-03-28T13:50:14.441692+0000","last_fullsized":"2024-03-28T13:50:14.441692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:15.595901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'883","reported_seq":939,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:59.232474+0000","last_change":"2024-03-28T12:42:00.141127+0000","last_active":"2024-03-28T13:49:59.232474+0000","last_peered":"2024-03-28T13:49:59.232474+0000","last_clean":"2024-03-28T13:49:59.232474+0000","last_became_active":"2024-03-28T12:42:00.140832+0000","last_became_peered":"2024-03-28T12:42:00.140832+0000","last_unstale":"2024-03-28T13:49:59.232474+0000","last_undegraded":"2024-03-28T13:49:59.232474+0000","last_fullsized":"2024-03-28T13:49:59.232474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":883,"log_dups_size":0,"ondisk_log_size":883,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:01:04.151858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":843,"num_write_kb":12855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'810","reported_seq":900,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.011730+0000","last_change":"2024-03-28T12:42:07.936963+0000","last_active":"2024-03-28T13:50:15.011730+0000","last_peered":"2024-03-28T13:50:15.011730+0000","last_clean":"2024-03-28T13:50:15.011730+0000","last_became_active":"2024-03-28T12:42:07.936606+0000","last_became_peered":"2024-03-28T12:42:07.936606+0000","last_unstale":"2024-03-28T13:50:15.011730+0000","last_undegraded":"2024-03-28T13:50:15.011730+0000","last_fullsized":"2024-03-28T13:50:15.011730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:37:04.083032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":136867,"num_write":788,"num_write_kb":148031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'195","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.657441+0000","last_change":"2024-03-28T12:42:01.962855+0000","last_active":"2024-03-28T13:50:03.657441+0000","last_peered":"2024-03-28T13:50:03.657441+0000","last_clean":"2024-03-28T13:50:03.657441+0000","last_became_active":"2024-03-28T12:42:01.962546+0000","last_became_peered":"2024-03-28T12:42:01.962546+0000","last_unstale":"2024-03-28T13:50:03.657441+0000","last_undegraded":"2024-03-28T13:50:03.657441+0000","last_fullsized":"2024-03-28T13:50:03.657441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:08.429940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'1090","reported_seq":1144,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.216592+0000","last_change":"2024-03-28T12:42:00.138923+0000","last_active":"2024-03-28T13:50:15.216592+0000","last_peered":"2024-03-28T13:50:15.216592+0000","last_clean":"2024-03-28T13:50:15.216592+0000","last_became_active":"2024-03-28T12:42:00.138233+0000","last_became_peered":"2024-03-28T12:42:00.138233+0000","last_unstale":"2024-03-28T13:50:15.216592+0000","last_undegraded":"2024-03-28T13:50:15.216592+0000","last_fullsized":"2024-03-28T13:50:15.216592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1090,"log_dups_size":0,"ondisk_log_size":1090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1041,"num_write_kb":5032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'724","reported_seq":796,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.443533+0000","last_change":"2024-03-28T12:42:07.907163+0000","last_active":"2024-03-28T13:50:14.443533+0000","last_peered":"2024-03-28T13:50:14.443533+0000","last_clean":"2024-03-28T13:50:14.443533+0000","last_became_active":"2024-03-28T12:42:07.906334+0000","last_became_peered":"2024-03-28T12:42:07.906334+0000","last_unstale":"2024-03-28T13:50:14.443533+0000","last_undegraded":"2024-03-28T13:50:14.443533+0000","last_fullsized":"2024-03-28T13:50:14.443533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:59.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":82415,"num_write":704,"num_write_kb":118989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'192","reported_seq":246,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.581520+0000","last_change":"2024-03-28T12:42:01.809232+0000","last_active":"2024-03-28T13:50:03.581520+0000","last_peered":"2024-03-28T13:50:03.581520+0000","last_clean":"2024-03-28T13:50:03.581520+0000","last_became_active":"2024-03-28T12:42:01.805284+0000","last_became_peered":"2024-03-28T12:42:01.805284+0000","last_unstale":"2024-03-28T13:50:03.581520+0000","last_undegraded":"2024-03-28T13:50:03.581520+0000","last_fullsized":"2024-03-28T13:50:03.581520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:20:54.180080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'401","reported_seq":456,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:53.953125+0000","last_change":"2024-03-28T12:42:00.147739+0000","last_active":"2024-03-28T13:49:53.953125+0000","last_peered":"2024-03-28T13:49:53.953125+0000","last_clean":"2024-03-28T13:49:53.953125+0000","last_became_active":"2024-03-28T12:42:00.147407+0000","last_became_peered":"2024-03-28T12:42:00.147407+0000","last_unstale":"2024-03-28T13:49:53.953125+0000","last_undegraded":"2024-03-28T13:49:53.953125+0000","last_fullsized":"2024-03-28T13:49:53.953125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:29.908949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'847","reported_seq":927,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.548369+0000","last_change":"2024-03-28T12:42:07.900662+0000","last_active":"2024-03-28T13:50:14.548369+0000","last_peered":"2024-03-28T13:50:14.548369+0000","last_clean":"2024-03-28T13:50:14.548369+0000","last_became_active":"2024-03-28T12:42:07.899628+0000","last_became_peered":"2024-03-28T12:42:07.899628+0000","last_unstale":"2024-03-28T13:50:14.548369+0000","last_undegraded":"2024-03-28T13:50:14.548369+0000","last_fullsized":"2024-03-28T13:50:14.548369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:31.070732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":75354,"num_write":826,"num_write_kb":110616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'204","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:54.140065+0000","last_change":"2024-03-28T12:42:01.967776+0000","last_active":"2024-03-28T13:49:54.140065+0000","last_peered":"2024-03-28T13:49:54.140065+0000","last_clean":"2024-03-28T13:49:54.140065+0000","last_became_active":"2024-03-28T12:42:01.964830+0000","last_became_peered":"2024-03-28T12:42:01.964830+0000","last_unstale":"2024-03-28T13:49:54.140065+0000","last_undegraded":"2024-03-28T13:49:54.140065+0000","last_fullsized":"2024-03-28T13:49:54.140065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'62","reported_seq":116,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:39.349935+0000","last_change":"2024-03-28T12:42:00.142326+0000","last_active":"2024-03-28T13:49:39.349935+0000","last_peered":"2024-03-28T13:49:39.349935+0000","last_clean":"2024-03-28T13:49:39.349935+0000","last_became_active":"2024-03-28T12:42:00.141602+0000","last_became_peered":"2024-03-28T12:42:00.141602+0000","last_unstale":"2024-03-28T13:49:39.349935+0000","last_undegraded":"2024-03-28T13:49:39.349935+0000","last_fullsized":"2024-03-28T13:49:39.349935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'910","reported_seq":1032,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.938964+0000","last_change":"2024-03-28T12:42:07.935882+0000","last_active":"2024-03-28T13:50:14.938964+0000","last_peered":"2024-03-28T13:50:14.938964+0000","last_clean":"2024-03-28T13:50:14.938964+0000","last_became_active":"2024-03-28T12:42:07.935525+0000","last_became_peered":"2024-03-28T12:42:07.935525+0000","last_unstale":"2024-03-28T13:50:14.938964+0000","last_undegraded":"2024-03-28T13:50:14.938964+0000","last_fullsized":"2024-03-28T13:50:14.938964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:50:31.463779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":257511,"num_write":888,"num_write_kb":259792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'811","reported_seq":911,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.444896+0000","last_change":"2024-03-28T12:42:07.882782+0000","last_active":"2024-03-28T13:50:14.444896+0000","last_peered":"2024-03-28T13:50:14.444896+0000","last_clean":"2024-03-28T13:50:14.444896+0000","last_became_active":"2024-03-28T12:42:07.881527+0000","last_became_peered":"2024-03-28T12:42:07.881527+0000","last_unstale":"2024-03-28T13:50:14.444896+0000","last_undegraded":"2024-03-28T13:50:14.444896+0000","last_fullsized":"2024-03-28T13:50:14.444896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:55.701985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":165977,"num_write":788,"num_write_kb":136221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'206","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:09.231448+0000","last_change":"2024-03-28T12:42:01.958791+0000","last_active":"2024-03-28T13:50:09.231448+0000","last_peered":"2024-03-28T13:50:09.231448+0000","last_clean":"2024-03-28T13:50:09.231448+0000","last_became_active":"2024-03-28T12:42:01.957991+0000","last_became_peered":"2024-03-28T12:42:01.957991+0000","last_unstale":"2024-03-28T13:50:09.231448+0000","last_undegraded":"2024-03-28T13:50:09.231448+0000","last_fullsized":"2024-03-28T13:50:09.231448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:24.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'1719","reported_seq":1775,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:42.912733+0000","last_change":"2024-03-28T12:42:00.132942+0000","last_active":"2024-03-28T13:49:42.912733+0000","last_peered":"2024-03-28T13:49:42.912733+0000","last_clean":"2024-03-28T13:49:42.912733+0000","last_became_active":"2024-03-28T12:42:00.132663+0000","last_became_peered":"2024-03-28T12:42:00.132663+0000","last_unstale":"2024-03-28T13:49:42.912733+0000","last_undegraded":"2024-03-28T13:49:42.912733+0000","last_fullsized":"2024-03-28T13:49:42.912733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1719,"log_dups_size":0,"ondisk_log_size":1719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:41.612613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1652,"num_write_kb":13078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'750","reported_seq":827,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:59.767304+0000","last_change":"2024-03-28T12:42:07.901907+0000","last_active":"2024-03-28T13:49:59.767304+0000","last_peered":"2024-03-28T13:49:59.767304+0000","last_clean":"2024-03-28T13:49:59.767304+0000","last_became_active":"2024-03-28T12:42:07.901398+0000","last_became_peered":"2024-03-28T12:42:07.901398+0000","last_unstale":"2024-03-28T13:49:59.767304+0000","last_undegraded":"2024-03-28T13:49:59.767304+0000","last_fullsized":"2024-03-28T13:49:59.767304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:49:41.408808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":90732,"num_write":732,"num_write_kb":110234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'218","reported_seq":272,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:54.353248+0000","last_change":"2024-03-28T12:42:01.811306+0000","last_active":"2024-03-28T13:49:54.353248+0000","last_peered":"2024-03-28T13:49:54.353248+0000","last_clean":"2024-03-28T13:49:54.353248+0000","last_became_active":"2024-03-28T12:42:01.810142+0000","last_became_peered":"2024-03-28T12:42:01.810142+0000","last_unstale":"2024-03-28T13:49:54.353248+0000","last_undegraded":"2024-03-28T13:49:54.353248+0000","last_fullsized":"2024-03-28T13:49:54.353248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:37:22.386341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'118","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:59.338833+0000","last_change":"2024-03-28T12:42:00.142916+0000","last_active":"2024-03-28T13:49:59.338833+0000","last_peered":"2024-03-28T13:49:59.338833+0000","last_clean":"2024-03-28T13:49:59.338833+0000","last_became_active":"2024-03-28T12:42:00.142006+0000","last_became_peered":"2024-03-28T12:42:00.142006+0000","last_unstale":"2024-03-28T13:49:59.338833+0000","last_undegraded":"2024-03-28T13:49:59.338833+0000","last_fullsized":"2024-03-28T13:49:59.338833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:01:08.734929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'739","reported_seq":794,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:23.266261+0000","last_change":"2024-03-28T12:42:00.143738+0000","last_active":"2024-03-28T13:49:23.266261+0000","last_peered":"2024-03-28T13:49:23.266261+0000","last_clean":"2024-03-28T13:49:23.266261+0000","last_became_active":"2024-03-28T12:42:00.143474+0000","last_became_peered":"2024-03-28T12:42:00.143474+0000","last_unstale":"2024-03-28T13:49:23.266261+0000","last_undegraded":"2024-03-28T13:49:23.266261+0000","last_fullsized":"2024-03-28T13:49:23.266261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:43:33.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":12641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'178","reported_seq":231,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.826397+0000","last_change":"2024-03-28T12:42:01.938147+0000","last_active":"2024-03-28T13:50:03.826397+0000","last_peered":"2024-03-28T13:50:03.826397+0000","last_clean":"2024-03-28T13:50:03.826397+0000","last_became_active":"2024-03-28T12:42:01.937612+0000","last_became_peered":"2024-03-28T12:42:01.937612+0000","last_unstale":"2024-03-28T13:50:03.826397+0000","last_undegraded":"2024-03-28T13:50:03.826397+0000","last_fullsized":"2024-03-28T13:50:03.826397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:31:15.643101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'736","reported_seq":808,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.442217+0000","last_change":"2024-03-28T12:42:07.870201+0000","last_active":"2024-03-28T13:50:14.442217+0000","last_peered":"2024-03-28T13:50:14.442217+0000","last_clean":"2024-03-28T13:50:14.442217+0000","last_became_active":"2024-03-28T12:42:07.869628+0000","last_became_peered":"2024-03-28T12:42:07.869628+0000","last_unstale":"2024-03-28T13:50:14.442217+0000","last_undegraded":"2024-03-28T13:50:14.442217+0000","last_fullsized":"2024-03-28T13:50:14.442217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":78605,"num_write":708,"num_write_kb":126589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'198","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:18.249461+0000","last_change":"2024-03-28T12:42:00.146260+0000","last_active":"2024-03-28T13:49:18.249461+0000","last_peered":"2024-03-28T13:49:18.249461+0000","last_clean":"2024-03-28T13:49:18.249461+0000","last_became_active":"2024-03-28T12:42:00.146052+0000","last_became_peered":"2024-03-28T12:42:00.146052+0000","last_unstale":"2024-03-28T13:49:18.249461+0000","last_undegraded":"2024-03-28T13:49:18.249461+0000","last_fullsized":"2024-03-28T13:49:18.249461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:08.118205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'199","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.403657+0000","last_change":"2024-03-28T12:42:01.966002+0000","last_active":"2024-03-28T13:50:04.403657+0000","last_peered":"2024-03-28T13:50:04.403657+0000","last_clean":"2024-03-28T13:50:04.403657+0000","last_became_active":"2024-03-28T12:42:01.965598+0000","last_became_peered":"2024-03-28T12:42:01.965598+0000","last_unstale":"2024-03-28T13:50:04.403657+0000","last_undegraded":"2024-03-28T13:50:04.403657+0000","last_fullsized":"2024-03-28T13:50:04.403657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:35:50.246850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'725","reported_seq":796,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.725373+0000","last_change":"2024-03-28T12:42:15.361649+0000","last_active":"2024-03-28T13:50:08.725373+0000","last_peered":"2024-03-28T13:50:08.725373+0000","last_clean":"2024-03-28T13:50:08.725373+0000","last_became_active":"2024-03-28T12:42:15.360743+0000","last_became_peered":"2024-03-28T12:42:15.360743+0000","last_unstale":"2024-03-28T13:50:08.725373+0000","last_undegraded":"2024-03-28T13:50:08.725373+0000","last_fullsized":"2024-03-28T13:50:08.725373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:55.701985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":88364,"num_write":704,"num_write_kb":127819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"29'211","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.585044+0000","last_change":"2024-03-28T12:42:01.965237+0000","last_active":"2024-03-28T13:50:03.585044+0000","last_peered":"2024-03-28T13:50:03.585044+0000","last_clean":"2024-03-28T13:50:03.585044+0000","last_became_active":"2024-03-28T12:42:01.964468+0000","last_became_peered":"2024-03-28T12:42:01.964468+0000","last_unstale":"2024-03-28T13:50:03.585044+0000","last_undegraded":"2024-03-28T13:50:03.585044+0000","last_fullsized":"2024-03-28T13:50:03.585044+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:05.744451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'206","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.741058+0000","last_change":"2024-03-28T12:42:01.959553+0000","last_active":"2024-03-28T13:50:08.741058+0000","last_peered":"2024-03-28T13:50:08.741058+0000","last_clean":"2024-03-28T13:50:08.741058+0000","last_became_active":"2024-03-28T12:42:01.958333+0000","last_became_peered":"2024-03-28T12:42:01.958333+0000","last_unstale":"2024-03-28T13:50:08.741058+0000","last_undegraded":"2024-03-28T13:50:08.741058+0000","last_fullsized":"2024-03-28T13:50:08.741058+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:05.744451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'227","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.422962+0000","last_change":"2024-03-28T12:42:01.805452+0000","last_active":"2024-03-28T13:50:04.422962+0000","last_peered":"2024-03-28T13:50:04.422962+0000","last_clean":"2024-03-28T13:50:04.422962+0000","last_became_active":"2024-03-28T12:42:01.805288+0000","last_became_peered":"2024-03-28T12:42:01.805288+0000","last_unstale":"2024-03-28T13:50:04.422962+0000","last_undegraded":"2024-03-28T13:50:04.422962+0000","last_fullsized":"2024-03-28T13:50:04.422962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:17:01.582670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'197","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.832771+0000","last_change":"2024-03-28T12:42:01.947234+0000","last_active":"2024-03-28T13:50:08.832771+0000","last_peered":"2024-03-28T13:50:08.832771+0000","last_clean":"2024-03-28T13:50:08.832771+0000","last_became_active":"2024-03-28T12:42:01.946859+0000","last_became_peered":"2024-03-28T12:42:01.946859+0000","last_unstale":"2024-03-28T13:50:08.832771+0000","last_undegraded":"2024-03-28T13:50:08.832771+0000","last_fullsized":"2024-03-28T13:50:08.832771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:36:05.320541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'183","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.302934+0000","last_change":"2024-03-28T12:42:01.935265+0000","last_active":"2024-03-28T13:50:18.302934+0000","last_peered":"2024-03-28T13:50:18.302934+0000","last_clean":"2024-03-28T13:50:18.302934+0000","last_became_active":"2024-03-28T12:42:01.934578+0000","last_became_peered":"2024-03-28T12:42:01.934578+0000","last_unstale":"2024-03-28T13:50:18.302934+0000","last_undegraded":"2024-03-28T13:50:18.302934+0000","last_fullsized":"2024-03-28T13:50:18.302934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:24.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'202","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:54.060534+0000","last_change":"2024-03-28T12:42:01.946191+0000","last_active":"2024-03-28T13:49:54.060534+0000","last_peered":"2024-03-28T13:49:54.060534+0000","last_clean":"2024-03-28T13:49:54.060534+0000","last_became_active":"2024-03-28T12:42:01.945804+0000","last_became_peered":"2024-03-28T12:42:01.945804+0000","last_unstale":"2024-03-28T13:49:54.060534+0000","last_undegraded":"2024-03-28T13:49:54.060534+0000","last_fullsized":"2024-03-28T13:49:54.060534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:40.221005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'229","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:59.711792+0000","last_change":"2024-03-28T12:42:01.969416+0000","last_active":"2024-03-28T13:49:59.711792+0000","last_peered":"2024-03-28T13:49:59.711792+0000","last_clean":"2024-03-28T13:49:59.711792+0000","last_became_active":"2024-03-28T12:42:01.969078+0000","last_became_peered":"2024-03-28T12:42:01.969078+0000","last_unstale":"2024-03-28T13:49:59.711792+0000","last_undegraded":"2024-03-28T13:49:59.711792+0000","last_fullsized":"2024-03-28T13:49:59.711792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'193","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.894344+0000","last_change":"2024-03-28T12:42:01.958402+0000","last_active":"2024-03-28T13:50:08.894344+0000","last_peered":"2024-03-28T13:50:08.894344+0000","last_clean":"2024-03-28T13:50:08.894344+0000","last_became_active":"2024-03-28T12:42:01.958074+0000","last_became_peered":"2024-03-28T12:42:01.958074+0000","last_unstale":"2024-03-28T13:50:08.894344+0000","last_undegraded":"2024-03-28T13:50:08.894344+0000","last_fullsized":"2024-03-28T13:50:08.894344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:18:04.255456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'213","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.307568+0000","last_change":"2024-03-28T12:42:01.811823+0000","last_active":"2024-03-28T13:50:18.307568+0000","last_peered":"2024-03-28T13:50:18.307568+0000","last_clean":"2024-03-28T13:50:18.307568+0000","last_became_active":"2024-03-28T12:42:01.811548+0000","last_became_peered":"2024-03-28T12:42:01.811548+0000","last_unstale":"2024-03-28T13:50:18.307568+0000","last_undegraded":"2024-03-28T13:50:18.307568+0000","last_fullsized":"2024-03-28T13:50:18.307568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:00:51.741925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'199","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.204475+0000","last_change":"2024-03-28T12:42:01.959291+0000","last_active":"2024-03-28T13:50:04.204475+0000","last_peered":"2024-03-28T13:50:04.204475+0000","last_clean":"2024-03-28T13:50:04.204475+0000","last_became_active":"2024-03-28T12:42:01.958942+0000","last_became_peered":"2024-03-28T12:42:01.958942+0000","last_unstale":"2024-03-28T13:50:04.204475+0000","last_undegraded":"2024-03-28T13:50:04.204475+0000","last_fullsized":"2024-03-28T13:50:04.204475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:52:46.128830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'204","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:49.896805+0000","last_change":"2024-03-28T12:42:01.965790+0000","last_active":"2024-03-28T13:49:49.896805+0000","last_peered":"2024-03-28T13:49:49.896805+0000","last_clean":"2024-03-28T13:49:49.896805+0000","last_became_active":"2024-03-28T12:42:01.965526+0000","last_became_peered":"2024-03-28T12:42:01.965526+0000","last_unstale":"2024-03-28T13:49:49.896805+0000","last_undegraded":"2024-03-28T13:49:49.896805+0000","last_fullsized":"2024-03-28T13:49:49.896805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'205","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.421166+0000","last_change":"2024-03-28T12:42:01.960761+0000","last_active":"2024-03-28T13:50:04.421166+0000","last_peered":"2024-03-28T13:50:04.421166+0000","last_clean":"2024-03-28T13:50:04.421166+0000","last_became_active":"2024-03-28T12:42:01.960325+0000","last_became_peered":"2024-03-28T12:42:01.960325+0000","last_unstale":"2024-03-28T13:50:04.421166+0000","last_undegraded":"2024-03-28T13:50:04.421166+0000","last_fullsized":"2024-03-28T13:50:04.421166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:40.221005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'213","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:40.081568+0000","last_change":"2024-03-28T12:42:01.960053+0000","last_active":"2024-03-28T13:49:40.081568+0000","last_peered":"2024-03-28T13:49:40.081568+0000","last_clean":"2024-03-28T13:49:40.081568+0000","last_became_active":"2024-03-28T12:42:01.959801+0000","last_became_peered":"2024-03-28T12:42:01.959801+0000","last_unstale":"2024-03-28T13:49:40.081568+0000","last_undegraded":"2024-03-28T13:49:40.081568+0000","last_fullsized":"2024-03-28T13:49:40.081568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:22.285591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'196","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.424881+0000","last_change":"2024-03-28T12:42:01.788603+0000","last_active":"2024-03-28T13:50:04.424881+0000","last_peered":"2024-03-28T13:50:04.424881+0000","last_clean":"2024-03-28T13:50:04.424881+0000","last_became_active":"2024-03-28T12:42:01.788431+0000","last_became_peered":"2024-03-28T12:42:01.788431+0000","last_unstale":"2024-03-28T13:50:04.424881+0000","last_undegraded":"2024-03-28T13:50:04.424881+0000","last_fullsized":"2024-03-28T13:50:04.424881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:09:59.404128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'195","reported_seq":248,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.036293+0000","last_change":"2024-03-28T12:42:01.960518+0000","last_active":"2024-03-28T13:50:15.036293+0000","last_peered":"2024-03-28T13:50:15.036293+0000","last_clean":"2024-03-28T13:50:15.036293+0000","last_became_active":"2024-03-28T12:42:01.959832+0000","last_became_peered":"2024-03-28T12:42:01.959832+0000","last_unstale":"2024-03-28T13:50:15.036293+0000","last_undegraded":"2024-03-28T13:50:15.036293+0000","last_fullsized":"2024-03-28T13:50:15.036293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'198","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:09.232667+0000","last_change":"2024-03-28T12:42:01.936477+0000","last_active":"2024-03-28T13:50:09.232667+0000","last_peered":"2024-03-28T13:50:09.232667+0000","last_clean":"2024-03-28T13:50:09.232667+0000","last_became_active":"2024-03-28T12:42:01.936175+0000","last_became_peered":"2024-03-28T12:42:01.936175+0000","last_unstale":"2024-03-28T13:50:09.232667+0000","last_undegraded":"2024-03-28T13:50:09.232667+0000","last_fullsized":"2024-03-28T13:50:09.232667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:14:14.822668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'209","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.453599+0000","last_change":"2024-03-28T12:42:01.960054+0000","last_active":"2024-03-28T13:50:14.453599+0000","last_peered":"2024-03-28T13:50:14.453599+0000","last_clean":"2024-03-28T13:50:14.453599+0000","last_became_active":"2024-03-28T12:42:01.959791+0000","last_became_peered":"2024-03-28T12:42:01.959791+0000","last_unstale":"2024-03-28T13:50:14.453599+0000","last_undegraded":"2024-03-28T13:50:14.453599+0000","last_fullsized":"2024-03-28T13:50:14.453599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:06:44.099531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'211","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:41.908840+0000","last_change":"2024-03-28T12:42:15.233310+0000","last_active":"2024-03-28T13:49:41.908840+0000","last_peered":"2024-03-28T13:49:41.908840+0000","last_clean":"2024-03-28T13:49:41.908840+0000","last_became_active":"2024-03-28T12:42:15.232678+0000","last_became_peered":"2024-03-28T12:42:15.232678+0000","last_unstale":"2024-03-28T13:49:41.908840+0000","last_undegraded":"2024-03-28T13:49:41.908840+0000","last_fullsized":"2024-03-28T13:49:41.908840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:11:33.781054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'208","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.339356+0000","last_change":"2024-03-28T12:42:01.948602+0000","last_active":"2024-03-28T13:50:04.339356+0000","last_peered":"2024-03-28T13:50:04.339356+0000","last_clean":"2024-03-28T13:50:04.339356+0000","last_became_active":"2024-03-28T12:42:01.947869+0000","last_became_peered":"2024-03-28T12:42:01.947869+0000","last_unstale":"2024-03-28T13:50:04.339356+0000","last_undegraded":"2024-03-28T13:50:04.339356+0000","last_fullsized":"2024-03-28T13:50:04.339356+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'189","reported_seq":242,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:54.060702+0000","last_change":"2024-03-28T12:42:01.940521+0000","last_active":"2024-03-28T13:49:54.060702+0000","last_peered":"2024-03-28T13:49:54.060702+0000","last_clean":"2024-03-28T13:49:54.060702+0000","last_became_active":"2024-03-28T12:42:01.939756+0000","last_became_peered":"2024-03-28T12:42:01.939756+0000","last_unstale":"2024-03-28T13:49:54.060702+0000","last_undegraded":"2024-03-28T13:49:54.060702+0000","last_fullsized":"2024-03-28T13:49:54.060702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:53:37.869232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'177","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.889992+0000","last_change":"2024-03-28T12:42:01.960377+0000","last_active":"2024-03-28T13:50:08.889992+0000","last_peered":"2024-03-28T13:50:08.889992+0000","last_clean":"2024-03-28T13:50:08.889992+0000","last_became_active":"2024-03-28T12:42:01.960012+0000","last_became_peered":"2024-03-28T12:42:01.960012+0000","last_unstale":"2024-03-28T13:50:08.889992+0000","last_undegraded":"2024-03-28T13:50:08.889992+0000","last_fullsized":"2024-03-28T13:50:08.889992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:19:20.801201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'183","reported_seq":236,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.526354+0000","last_change":"2024-03-28T12:42:01.937280+0000","last_active":"2024-03-28T13:50:04.526354+0000","last_peered":"2024-03-28T13:50:04.526354+0000","last_clean":"2024-03-28T13:50:04.526354+0000","last_became_active":"2024-03-28T12:42:01.936999+0000","last_became_peered":"2024-03-28T12:42:01.936999+0000","last_unstale":"2024-03-28T13:50:04.526354+0000","last_undegraded":"2024-03-28T13:50:04.526354+0000","last_fullsized":"2024-03-28T13:50:04.526354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:35:01.960186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'190","reported_seq":243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.480981+0000","last_change":"2024-03-28T12:42:01.961991+0000","last_active":"2024-03-28T13:50:04.480981+0000","last_peered":"2024-03-28T13:50:04.480981+0000","last_clean":"2024-03-28T13:50:04.480981+0000","last_became_active":"2024-03-28T12:42:01.961694+0000","last_became_peered":"2024-03-28T12:42:01.961694+0000","last_unstale":"2024-03-28T13:50:04.480981+0000","last_undegraded":"2024-03-28T13:50:04.480981+0000","last_fullsized":"2024-03-28T13:50:04.480981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:12:20.857443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'199","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.352032+0000","last_change":"2024-03-28T12:42:01.966943+0000","last_active":"2024-03-28T13:50:04.352032+0000","last_peered":"2024-03-28T13:50:04.352032+0000","last_clean":"2024-03-28T13:50:04.352032+0000","last_became_active":"2024-03-28T12:42:01.966629+0000","last_became_peered":"2024-03-28T12:42:01.966629+0000","last_unstale":"2024-03-28T13:50:04.352032+0000","last_undegraded":"2024-03-28T13:50:04.352032+0000","last_fullsized":"2024-03-28T13:50:04.352032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'184","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.547262+0000","last_change":"2024-03-28T12:42:01.934727+0000","last_active":"2024-03-28T13:50:14.547262+0000","last_peered":"2024-03-28T13:50:14.547262+0000","last_clean":"2024-03-28T13:50:14.547262+0000","last_became_active":"2024-03-28T12:42:01.934130+0000","last_became_peered":"2024-03-28T12:42:01.934130+0000","last_unstale":"2024-03-28T13:50:14.547262+0000","last_undegraded":"2024-03-28T13:50:14.547262+0000","last_fullsized":"2024-03-28T13:50:14.547262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:20:32.024373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'204","reported_seq":256,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:54.685106+0000","last_change":"2024-03-28T12:42:01.940164+0000","last_active":"2024-03-28T13:49:54.685106+0000","last_peered":"2024-03-28T13:49:54.685106+0000","last_clean":"2024-03-28T13:49:54.685106+0000","last_became_active":"2024-03-28T12:42:01.939962+0000","last_became_peered":"2024-03-28T12:42:01.939962+0000","last_unstale":"2024-03-28T13:49:54.685106+0000","last_undegraded":"2024-03-28T13:49:54.685106+0000","last_fullsized":"2024-03-28T13:49:54.685106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:31:15.643101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'189","reported_seq":241,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:09.198928+0000","last_change":"2024-03-28T12:42:01.968043+0000","last_active":"2024-03-28T13:50:09.198928+0000","last_peered":"2024-03-28T13:50:09.198928+0000","last_clean":"2024-03-28T13:50:09.198928+0000","last_became_active":"2024-03-28T12:42:01.964888+0000","last_became_peered":"2024-03-28T12:42:01.964888+0000","last_unstale":"2024-03-28T13:50:09.198928+0000","last_undegraded":"2024-03-28T13:50:09.198928+0000","last_fullsized":"2024-03-28T13:50:09.198928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'205","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.883503+0000","last_change":"2024-03-28T12:42:01.939665+0000","last_active":"2024-03-28T13:50:03.883503+0000","last_peered":"2024-03-28T13:50:03.883503+0000","last_clean":"2024-03-28T13:50:03.883503+0000","last_became_active":"2024-03-28T12:42:01.939448+0000","last_became_peered":"2024-03-28T12:42:01.939448+0000","last_unstale":"2024-03-28T13:50:03.883503+0000","last_undegraded":"2024-03-28T13:50:03.883503+0000","last_fullsized":"2024-03-28T13:50:03.883503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:39.483160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'188","reported_seq":246,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.447778+0000","last_change":"2024-03-28T12:42:01.961147+0000","last_active":"2024-03-28T13:50:14.447778+0000","last_peered":"2024-03-28T13:50:14.447778+0000","last_clean":"2024-03-28T13:50:14.447778+0000","last_became_active":"2024-03-28T12:42:01.960511+0000","last_became_peered":"2024-03-28T12:42:01.960511+0000","last_unstale":"2024-03-28T13:50:14.447778+0000","last_undegraded":"2024-03-28T13:50:14.447778+0000","last_fullsized":"2024-03-28T13:50:14.447778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'190","reported_seq":248,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:48.956383+0000","last_change":"2024-03-28T12:42:01.809029+0000","last_active":"2024-03-28T13:49:48.956383+0000","last_peered":"2024-03-28T13:49:48.956383+0000","last_clean":"2024-03-28T13:49:48.956383+0000","last_became_active":"2024-03-28T12:42:01.805168+0000","last_became_peered":"2024-03-28T12:42:01.805168+0000","last_unstale":"2024-03-28T13:49:48.956383+0000","last_undegraded":"2024-03-28T13:49:48.956383+0000","last_fullsized":"2024-03-28T13:49:48.956383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:00:10.281819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'211","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.250522+0000","last_change":"2024-03-28T12:42:01.809169+0000","last_active":"2024-03-28T13:50:04.250522+0000","last_peered":"2024-03-28T13:50:04.250522+0000","last_clean":"2024-03-28T13:50:04.250522+0000","last_became_active":"2024-03-28T12:42:01.805382+0000","last_became_peered":"2024-03-28T12:42:01.805382+0000","last_unstale":"2024-03-28T13:50:04.250522+0000","last_undegraded":"2024-03-28T13:50:04.250522+0000","last_fullsized":"2024-03-28T13:50:04.250522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:26:32.791857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'204","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:49.877043+0000","last_change":"2024-03-28T12:42:01.938613+0000","last_active":"2024-03-28T13:49:49.877043+0000","last_peered":"2024-03-28T13:49:49.877043+0000","last_clean":"2024-03-28T13:49:49.877043+0000","last_became_active":"2024-03-28T12:42:01.938408+0000","last_became_peered":"2024-03-28T12:42:01.938408+0000","last_unstale":"2024-03-28T13:49:49.877043+0000","last_undegraded":"2024-03-28T13:49:49.877043+0000","last_fullsized":"2024-03-28T13:49:49.877043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:36:57.708839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1106,"num_read_kb":3440531,"num_write":24390,"num_write_kb":4237056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25020,"ondisk_log_size":25020,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12766,"ondisk_log_size":12766,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":189185628,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":1436,"num_read_kb":2621,"num_write":24268,"num_write_kb":197856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":164978688,"data_stored":378386672,"data_compressed":51374103,"data_compressed_allocated":66834432,"data_compressed_original":280489984,"omap_allocated":0,"internal_metadata":0},"log_size":21555,"ondisk_log_size":21555,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66494,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510271,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99252,"kb_used_data":9836,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94272588,"statfs":{"total":96636764160,"available":96535130112,"internally_reserved":0,"allocated":10072064,"data_stored":26859424,"data_compressed":3937950,"data_compressed_allocated":4919296,"data_compressed_original":21925888,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510271,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85184,"kb_used_data":13752,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94286656,"statfs":{"total":96636764160,"available":96549535744,"internally_reserved":0,"allocated":14082048,"data_stored":32551656,"data_compressed":4545413,"data_compressed_allocated":5947392,"data_compressed_original":24616960,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510271,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127140,"kb_used_data":19676,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94244700,"statfs":{"total":96636764160,"available":96506572800,"internally_reserved":0,"allocated":20148224,"data_stored":50460553,"data_compressed":7401383,"data_compressed_allocated":9674752,"data_compressed_original":40218624,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510270,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76200,"kb_used_data":13088,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94295640,"statfs":{"total":96636764160,"available":96558735360,"internally_reserved":0,"allocated":13402112,"data_stored":33681567,"data_compressed":4660285,"data_compressed_allocated":6107136,"data_compressed_original":26583040,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510270,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120852,"kb_used_data":21708,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94250988,"statfs":{"total":96636764160,"available":96513011712,"internally_reserved":0,"allocated":22228992,"data_stored":38466913,"data_compressed":4150831,"data_compressed_allocated":5660672,"data_compressed_original":22102016,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510272,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140836,"kb_used_data":29212,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94231004,"statfs":{"total":96636764160,"available":96492548096,"internally_reserved":0,"allocated":29913088,"data_stored":67238309,"data_compressed":8806079,"data_compressed_allocated":11505664,"data_compressed_original":49045504,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542977,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":155132,"kb_used_data":33780,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94216708,"statfs":{"total":96636764160,"available":96477908992,"internally_reserved":0,"allocated":34590720,"data_stored":84015705,"data_compressed":11869280,"data_compressed_allocated":15233024,"data_compressed_original":64880640,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575680,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125892,"kb_used_data":22588,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94245948,"statfs":{"total":96636764160,"available":96507850752,"internally_reserved":0,"allocated":23130112,"data_stored":47304441,"data_compressed":6069376,"data_compressed_allocated":7876608,"data_compressed_original":32264192,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29605888,"data_stored":67111914,"data_compressed":8806079,"data_compressed_allocated":11505664,"data_compressed_original":49045504,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21856256,"data_stored":37750150,"data_compressed":4117584,"data_compressed_allocated":5615616,"data_compressed_original":21528576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13094912,"data_stored":33555172,"data_compressed":4660285,"data_compressed_allocated":6107136,"data_compressed_original":26583040,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34283520,"data_stored":83889310,"data_compressed":11869280,"data_compressed_allocated":15233024,"data_compressed_original":64880640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19841024,"data_stored":50334158,"data_compressed":7401383,"data_compressed_allocated":9674752,"data_compressed_original":40218624,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22757376,"data_stored":46587678,"data_compressed":6036129,"data_compressed_allocated":7831552,"data_compressed_original":31690752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13774848,"data_stored":32425261,"data_compressed":4545413,"data_compressed_allocated":5947392,"data_compressed_original":24616960,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9764864,"data_stored":26733029,"data_compressed":3937950,"data_compressed_allocated":4919296,"data_compressed_original":21925888,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T13:50:25.484 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-28T13:50:25.484 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T13:50:25.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.667+0000 7f425f200640 1 Processor -- start 2024-03-28T13:50:25.668 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.667+0000 7f425f200640 1 -- start start 2024-03-28T13:50:25.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.671+0000 7f425f200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f42600c76b0 0x7f4260073750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:25.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.671+0000 7f425f200640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f426006b5a0 0x7f426015ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:25.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.671+0000 7f425f200640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42600c8de0 con 0x7f4260154770 2024-03-28T13:50:25.669 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.671+0000 7f425f200640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f4260073c90 con 0x7f42600c76b0 2024-03-28T13:50:25.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.671+0000 7f425f200640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f42600732c0 con 0x7f426006b5a0 2024-03-28T13:50:25.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.671+0000 7f425d400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f42600c76b0 0x7f4260073750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:25.670 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.671+0000 7f425e800640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f426006b5a0 0x7f426015ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:25.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.671+0000 7f425de00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f4260154770 0x7f426015a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:38584/0 (socket says 172.21.15.76:38584) 2024-03-28T13:50:25.671 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.671+0000 7f425de00640 1 -- 172.21.15.76:0/3756960978 learned_addr learned my addr 172.21.15.76:0/3756960978 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:50:25.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.675+0000 7f425e800640 1 -- 172.21.15.76:0/3756960978 >> v2:172.21.15.76:3300/0 conn(0x7f42600c76b0 msgr2=0x7f4260073750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:25.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.675+0000 7f425e800640 1 --2- 172.21.15.76:0/3756960978 >> v2:172.21.15.76:3300/0 conn(0x7f42600c76b0 0x7f4260073750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:25.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.675+0000 7f425e800640 1 -- 172.21.15.76:0/3756960978 >> v1:172.21.15.76:6789/0 conn(0x7f4260154770 legacy=0x7f426015a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:25.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.675+0000 7f425e800640 1 -- 172.21.15.76:0/3756960978 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42600c8b00 con 0x7f426006b5a0 2024-03-28T13:50:25.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.683+0000 7f425e800640 1 --2- 172.21.15.76:0/3756960978 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f426006b5a0 0x7f426015ac30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f426006e660 tx=0x7f425801c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2f615d5a85154f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:25.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.695+0000 7f425ca00640 1 -- 172.21.15.76:0/3756960978 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42580b2070 con 0x7f426006b5a0 2024-03-28T13:50:25.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.695+0000 7f425ca00640 1 -- 172.21.15.76:0/3756960978 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42580a5850 con 0x7f426006b5a0 2024-03-28T13:50:25.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.695+0000 7f425ca00640 1 -- 172.21.15.76:0/3756960978 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42580a5c20 con 0x7f426006b5a0 2024-03-28T13:50:25.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.699+0000 7f425f200640 1 -- 172.21.15.76:0/3756960978 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f426006b5a0 msgr2=0x7f426015ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:25.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.699+0000 7f425f200640 1 --2- 172.21.15.76:0/3756960978 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f426006b5a0 0x7f426015ac30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f426006e660 tx=0x7f425801c8a0 comp rx=0 tx=0).stop 2024-03-28T13:50:25.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.699+0000 7f425f200640 1 -- 172.21.15.76:0/3756960978 shutdown_connections 2024-03-28T13:50:25.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.699+0000 7f425f200640 1 --2- 172.21.15.76:0/3756960978 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f426006b5a0 0x7f426015ac30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:25.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.699+0000 7f425f200640 1 --2- 172.21.15.76:0/3756960978 >> v2:172.21.15.76:3300/0 conn(0x7f42600c76b0 0x7f4260073750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:25.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.699+0000 7f425f200640 1 -- 172.21.15.76:0/3756960978 >> 172.21.15.76:0/3756960978 conn(0x7f42600c9050 msgr2=0x7f42600c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:25.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.699+0000 7f425f200640 1 -- 172.21.15.76:0/3756960978 shutdown_connections 2024-03-28T13:50:25.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.699+0000 7f425f200640 1 -- 172.21.15.76:0/3756960978 wait complete. 2024-03-28T13:50:25.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.699+0000 7f425f200640 1 Processor -- start 2024-03-28T13:50:25.700 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.699+0000 7f425f200640 1 -- start start 2024-03-28T13:50:25.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.703+0000 7f425f200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f426006b5a0 0x7f42601f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:25.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.703+0000 7f425f200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42600c76b0 0x7f42601562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:25.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.703+0000 7f425f200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4260154770 0x7f42600ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:25.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.703+0000 7f425f200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f4260154b50 con 0x7f426006b5a0 2024-03-28T13:50:25.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.703+0000 7f425f200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f42600c87a0 con 0x7f4260154770 2024-03-28T13:50:25.702 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.703+0000 7f425f200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f4260154cd0 con 0x7f42600c76b0 2024-03-28T13:50:25.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.703+0000 7f425e800640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4260154770 0x7f42600ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:25.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.703+0000 7f425de00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f426006b5a0 0x7f42601f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:25.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.703+0000 7f425d400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42600c76b0 0x7f42601562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:25.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.703+0000 7f425de00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f426006b5a0 0x7f42601f71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52952/0 (socket says 172.21.15.76:52952) 2024-03-28T13:50:25.704 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.703+0000 7f425de00640 1 -- 172.21.15.76:0/2552484624 learned_addr learned my addr 172.21.15.76:0/2552484624 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:25.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.711+0000 7f425de00640 1 -- 172.21.15.76:0/2552484624 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42600c76b0 msgr2=0x7f42601562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:25.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.711+0000 7f425de00640 1 --2- 172.21.15.76:0/2552484624 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42600c76b0 0x7f42601562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:25.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.711+0000 7f425de00640 1 -- 172.21.15.76:0/2552484624 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4260154770 msgr2=0x7f42600ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:25.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.711+0000 7f425de00640 1 --2- 172.21.15.76:0/2552484624 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4260154770 0x7f42600ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:25.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.711+0000 7f425de00640 1 -- 172.21.15.76:0/2552484624 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4260154fa0 con 0x7f426006b5a0 2024-03-28T13:50:25.712 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.711+0000 7f425de00640 1 --2- 172.21.15.76:0/2552484624 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f426006b5a0 0x7f42601f71f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f425000c3a0 tx=0x7f425000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:25.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.719+0000 7f4256000640 1 -- 172.21.15.76:0/2552484624 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4250017070 con 0x7f426006b5a0 2024-03-28T13:50:25.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.719+0000 7f4256000640 1 -- 172.21.15.76:0/2552484624 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4250005cf0 con 0x7f426006b5a0 2024-03-28T13:50:25.717 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.719+0000 7f425f200640 1 -- 172.21.15.76:0/2552484624 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4260155240 con 0x7f426006b5a0 2024-03-28T13:50:25.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.719+0000 7f4256000640 1 -- 172.21.15.76:0/2552484624 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42500072f0 con 0x7f426006b5a0 2024-03-28T13:50:25.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.719+0000 7f425f200640 1 -- 172.21.15.76:0/2552484624 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42601f69f0 con 0x7f426006b5a0 2024-03-28T13:50:25.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.719+0000 7f425f200640 1 -- 172.21.15.76:0/2552484624 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4260068df0 con 0x7f426006b5a0 2024-03-28T13:50:25.744 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.743+0000 7f4256000640 1 -- 172.21.15.76:0/2552484624 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f425001a070 con 0x7f426006b5a0 2024-03-28T13:50:25.744 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.743+0000 7f4256000640 1 --2- 172.21.15.76:0/2552484624 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f4240068010 0x7f424006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:25.744 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.747+0000 7f425d400640 1 --2- 172.21.15.76:0/2552484624 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f4240068010 0x7f424006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:25.745 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.747+0000 7f425d400640 1 --2- 172.21.15.76:0/2552484624 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f4240068010 0x7f424006a4d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4260140f30 tx=0x7f424c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:25.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:25.747+0000 7f4256000640 1 -- 172.21.15.76:0/2552484624 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f4250053e10 con 0x7f426006b5a0 2024-03-28T13:50:26.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.010+0000 7f4256000640 1 -- 172.21.15.76:0/2552484624 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f4250021020 con 0x7f426006b5a0 2024-03-28T13:50:26.193 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.194+0000 7f425f200640 1 -- 172.21.15.76:0/2552484624 --> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f426006c9c0 con 0x7f4240068010 2024-03-28T13:50:26.210 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.210+0000 7f4256000640 1 -- 172.21.15.76:0/2552484624 <== mgr.4107 v2:172.21.15.76:6800/1313648511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335041 (secure 0 0 0) 0x7f426006c9c0 con 0x7f4240068010 2024-03-28T13:50:26.215 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T13:50:26.217 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-03-28T13:50:26.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.214+0000 7f425f200640 1 -- 172.21.15.76:0/2552484624 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f4240068010 msgr2=0x7f424006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:26.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.214+0000 7f425f200640 1 --2- 172.21.15.76:0/2552484624 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f4240068010 0x7f424006a4d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4260140f30 tx=0x7f424c009190 comp rx=0 tx=0).stop 2024-03-28T13:50:26.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.214+0000 7f425f200640 1 -- 172.21.15.76:0/2552484624 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f426006b5a0 msgr2=0x7f42601f71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:26.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.214+0000 7f425f200640 1 --2- 172.21.15.76:0/2552484624 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f426006b5a0 0x7f42601f71f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f425000c3a0 tx=0x7f425000c860 comp rx=0 tx=0).stop 2024-03-28T13:50:26.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.214+0000 7f425f200640 1 -- 172.21.15.76:0/2552484624 shutdown_connections 2024-03-28T13:50:26.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.214+0000 7f425f200640 1 --2- 172.21.15.76:0/2552484624 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f4240068010 0x7f424006a4d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:26.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.214+0000 7f425f200640 1 --2- 172.21.15.76:0/2552484624 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4260154770 0x7f42600ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:26.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.214+0000 7f425f200640 1 --2- 172.21.15.76:0/2552484624 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42600c76b0 0x7f42601562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:26.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.214+0000 7f425f200640 1 --2- 172.21.15.76:0/2552484624 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f426006b5a0 0x7f42601f71f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:26.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.214+0000 7f425f200640 1 -- 172.21.15.76:0/2552484624 >> 172.21.15.76:0/2552484624 conn(0x7f42600c9050 msgr2=0x7f4260149ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:26.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.214+0000 7f425f200640 1 -- 172.21.15.76:0/2552484624 shutdown_connections 2024-03-28T13:50:26.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.218+0000 7f425f200640 1 -- 172.21.15.76:0/2552484624 wait complete. 2024-03-28T13:50:26.246 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":2096,"stamp":"2024-03-28T13:50:26.034136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":189792643,"num_objects":145,"num_object_clones":0,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":2659,"num_read_kb":3443253,"num_write":48834,"num_write_kb":4437356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59795,"ondisk_log_size":59795,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":930496,"kb_used_data":163648,"kb_used_omap":12,"kb_used_meta":766771,"kb_avail":754044224,"statfs":{"total":773094113280,"available":772141285376,"internally_reserved":0,"allocated":167575552,"data_stored":380594963,"data_compressed":51442660,"data_compressed_allocated":66928640,"data_compressed_original":281649152,"omap_allocated":12752,"internal_metadata":785174064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-228899,"num_objects":-63,"num_object_clones":0,"num_object_copies":-252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-63,"num_whiteouts":0,"num_read":6,"num_read_kb":12,"num_write":128,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003019"},"pg_stats":[{"pgid":"2.1f","version":"29'319","reported_seq":379,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.325178+0000","last_change":"2024-03-28T12:42:00.080769+0000","last_active":"2024-03-28T13:50:18.325178+0000","last_peered":"2024-03-28T13:50:18.325178+0000","last_clean":"2024-03-28T13:50:18.325178+0000","last_became_active":"2024-03-28T12:42:00.079900+0000","last_became_peered":"2024-03-28T12:42:00.079900+0000","last_unstale":"2024-03-28T13:50:18.325178+0000","last_undegraded":"2024-03-28T13:50:18.325178+0000","last_fullsized":"2024-03-28T13:50:18.325178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:26.156056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":8322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'198","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.300790+0000","last_change":"2024-03-28T12:42:01.960244+0000","last_active":"2024-03-28T13:50:18.300790+0000","last_peered":"2024-03-28T13:50:18.300790+0000","last_clean":"2024-03-28T13:50:18.300790+0000","last_became_active":"2024-03-28T12:42:01.959408+0000","last_became_peered":"2024-03-28T12:42:01.959408+0000","last_unstale":"2024-03-28T13:50:18.300790+0000","last_undegraded":"2024-03-28T13:50:18.300790+0000","last_fullsized":"2024-03-28T13:50:18.300790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:00:51.741925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'806","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.626553+0000","last_change":"2024-03-28T12:42:07.880943+0000","last_active":"2024-03-28T13:50:14.626553+0000","last_peered":"2024-03-28T13:50:14.626553+0000","last_clean":"2024-03-28T13:50:14.626553+0000","last_became_active":"2024-03-28T12:42:07.880354+0000","last_became_peered":"2024-03-28T12:42:07.880354+0000","last_unstale":"2024-03-28T13:50:14.626553+0000","last_undegraded":"2024-03-28T13:50:14.626553+0000","last_fullsized":"2024-03-28T13:50:14.626553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:39.078379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":120104,"num_write":790,"num_write_kb":143940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'158","reported_seq":220,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:13.417457+0000","last_change":"2024-03-28T12:42:00.138569+0000","last_active":"2024-03-28T13:49:13.417457+0000","last_peered":"2024-03-28T13:49:13.417457+0000","last_clean":"2024-03-28T13:49:13.417457+0000","last_became_active":"2024-03-28T12:42:00.137978+0000","last_became_peered":"2024-03-28T12:42:00.137978+0000","last_unstale":"2024-03-28T13:49:13.417457+0000","last_undegraded":"2024-03-28T13:49:13.417457+0000","last_fullsized":"2024-03-28T13:49:13.417457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:38:28.575778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'181","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:49.891465+0000","last_change":"2024-03-28T12:42:01.958236+0000","last_active":"2024-03-28T13:49:49.891465+0000","last_peered":"2024-03-28T13:49:49.891465+0000","last_clean":"2024-03-28T13:49:49.891465+0000","last_became_active":"2024-03-28T12:42:01.957875+0000","last_became_peered":"2024-03-28T12:42:01.957875+0000","last_unstale":"2024-03-28T13:49:49.891465+0000","last_undegraded":"2024-03-28T13:49:49.891465+0000","last_fullsized":"2024-03-28T13:49:49.891465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:48:52.933175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'798","reported_seq":902,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.551364+0000","last_change":"2024-03-28T12:42:07.905799+0000","last_active":"2024-03-28T13:50:14.551364+0000","last_peered":"2024-03-28T13:50:14.551364+0000","last_clean":"2024-03-28T13:50:14.551364+0000","last_became_active":"2024-03-28T12:42:07.905350+0000","last_became_peered":"2024-03-28T12:42:07.905350+0000","last_unstale":"2024-03-28T13:50:14.551364+0000","last_undegraded":"2024-03-28T13:50:14.551364+0000","last_fullsized":"2024-03-28T13:50:14.551364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:33:42.281079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":162211,"num_write":782,"num_write_kb":177125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1182","reported_seq":1236,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.424452+0000","last_change":"2024-03-28T12:42:00.150272+0000","last_active":"2024-03-28T13:50:04.424452+0000","last_peered":"2024-03-28T13:50:04.424452+0000","last_clean":"2024-03-28T13:50:04.424452+0000","last_became_active":"2024-03-28T12:42:00.148367+0000","last_became_peered":"2024-03-28T12:42:00.148367+0000","last_unstale":"2024-03-28T13:50:04.424452+0000","last_undegraded":"2024-03-28T13:50:04.424452+0000","last_fullsized":"2024-03-28T13:50:04.424452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:26.156056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1357,"num_write_kb":12879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'189","reported_seq":240,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.513234+0000","last_change":"2024-03-28T12:42:01.965158+0000","last_active":"2024-03-28T13:50:23.513234+0000","last_peered":"2024-03-28T13:50:23.513234+0000","last_clean":"2024-03-28T13:50:23.513234+0000","last_became_active":"2024-03-28T12:42:01.964817+0000","last_became_peered":"2024-03-28T12:42:01.964817+0000","last_unstale":"2024-03-28T13:50:23.513234+0000","last_undegraded":"2024-03-28T13:50:23.513234+0000","last_fullsized":"2024-03-28T13:50:23.513234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'762","reported_seq":839,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.394329+0000","last_change":"2024-03-28T12:42:07.906794+0000","last_active":"2024-03-28T13:50:14.394329+0000","last_peered":"2024-03-28T13:50:14.394329+0000","last_clean":"2024-03-28T13:50:14.394329+0000","last_became_active":"2024-03-28T12:42:07.905522+0000","last_became_peered":"2024-03-28T12:42:07.905522+0000","last_unstale":"2024-03-28T13:50:14.394329+0000","last_undegraded":"2024-03-28T13:50:14.394329+0000","last_fullsized":"2024-03-28T13:50:14.394329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:21.970094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":115606,"num_write":742,"num_write_kb":142838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'844","reported_seq":898,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:49.078377+0000","last_change":"2024-03-28T12:42:00.149947+0000","last_active":"2024-03-28T13:49:49.078377+0000","last_peered":"2024-03-28T13:49:49.078377+0000","last_clean":"2024-03-28T13:49:49.078377+0000","last_became_active":"2024-03-28T12:42:00.148446+0000","last_became_peered":"2024-03-28T12:42:00.148446+0000","last_unstale":"2024-03-28T13:49:49.078377+0000","last_undegraded":"2024-03-28T13:49:49.078377+0000","last_fullsized":"2024-03-28T13:49:49.078377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:47:28.765823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'189","reported_seq":242,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.728289+0000","last_change":"2024-03-28T12:42:01.935596+0000","last_active":"2024-03-28T13:50:08.728289+0000","last_peered":"2024-03-28T13:50:08.728289+0000","last_clean":"2024-03-28T13:50:08.728289+0000","last_became_active":"2024-03-28T12:42:01.935231+0000","last_became_peered":"2024-03-28T12:42:01.935231+0000","last_unstale":"2024-03-28T13:50:08.728289+0000","last_undegraded":"2024-03-28T13:50:08.728289+0000","last_fullsized":"2024-03-28T13:50:08.728289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:17:41.296627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'756","reported_seq":818,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:09.199693+0000","last_change":"2024-03-28T12:42:07.904616+0000","last_active":"2024-03-28T13:50:09.199693+0000","last_peered":"2024-03-28T13:50:09.199693+0000","last_clean":"2024-03-28T13:50:09.199693+0000","last_became_active":"2024-03-28T12:42:07.904240+0000","last_became_peered":"2024-03-28T12:42:07.904240+0000","last_unstale":"2024-03-28T13:50:09.199693+0000","last_undegraded":"2024-03-28T13:50:09.199693+0000","last_fullsized":"2024-03-28T13:50:09.199693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:19:27.175393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":42901,"num_write":735,"num_write_kb":89492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'210","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.983392+0000","last_change":"2024-03-28T12:42:01.963116+0000","last_active":"2024-03-28T13:50:14.983392+0000","last_peered":"2024-03-28T13:50:14.983392+0000","last_clean":"2024-03-28T13:50:14.983392+0000","last_became_active":"2024-03-28T12:42:01.962885+0000","last_became_peered":"2024-03-28T12:42:01.962885+0000","last_unstale":"2024-03-28T13:50:14.983392+0000","last_undegraded":"2024-03-28T13:50:14.983392+0000","last_fullsized":"2024-03-28T13:50:14.983392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:19:06.640780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'621","reported_seq":679,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:28.940898+0000","last_change":"2024-03-28T12:42:00.134353+0000","last_active":"2024-03-28T13:49:28.940898+0000","last_peered":"2024-03-28T13:49:28.940898+0000","last_clean":"2024-03-28T13:49:28.940898+0000","last_became_active":"2024-03-28T12:42:00.133880+0000","last_became_peered":"2024-03-28T12:42:00.133880+0000","last_unstale":"2024-03-28T13:49:28.940898+0000","last_undegraded":"2024-03-28T13:49:28.940898+0000","last_fullsized":"2024-03-28T13:49:28.940898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:45:14.194934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":12550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'827","reported_seq":932,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.428091+0000","last_change":"2024-03-28T12:42:15.238142+0000","last_active":"2024-03-28T13:50:04.428091+0000","last_peered":"2024-03-28T13:50:04.428091+0000","last_clean":"2024-03-28T13:50:04.428091+0000","last_became_active":"2024-03-28T12:42:15.237739+0000","last_became_peered":"2024-03-28T12:42:15.237739+0000","last_unstale":"2024-03-28T13:50:04.428091+0000","last_undegraded":"2024-03-28T13:50:04.428091+0000","last_fullsized":"2024-03-28T13:50:04.428091+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:41:14.243482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":166655,"num_write":808,"num_write_kb":213920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'211","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.430106+0000","last_change":"2024-03-28T12:42:01.948688+0000","last_active":"2024-03-28T13:50:23.430106+0000","last_peered":"2024-03-28T13:50:23.430106+0000","last_clean":"2024-03-28T13:50:23.430106+0000","last_became_active":"2024-03-28T12:42:01.948049+0000","last_became_peered":"2024-03-28T12:42:01.948049+0000","last_unstale":"2024-03-28T13:50:23.430106+0000","last_undegraded":"2024-03-28T13:50:23.430106+0000","last_fullsized":"2024-03-28T13:50:23.430106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'876","reported_seq":934,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.202750+0000","last_change":"2024-03-28T12:42:00.139208+0000","last_active":"2024-03-28T13:50:23.202750+0000","last_peered":"2024-03-28T13:50:23.202750+0000","last_clean":"2024-03-28T13:50:23.202750+0000","last_became_active":"2024-03-28T12:42:00.138264+0000","last_became_peered":"2024-03-28T12:42:00.138264+0000","last_unstale":"2024-03-28T13:50:23.202750+0000","last_undegraded":"2024-03-28T13:50:23.202750+0000","last_fullsized":"2024-03-28T13:50:23.202750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7272559,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1194,"num_write_kb":7594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'824","reported_seq":898,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.939869+0000","last_change":"2024-03-28T12:42:07.941636+0000","last_active":"2024-03-28T13:50:14.939869+0000","last_peered":"2024-03-28T13:50:14.939869+0000","last_clean":"2024-03-28T13:50:14.939869+0000","last_became_active":"2024-03-28T12:42:07.941114+0000","last_became_peered":"2024-03-28T12:42:07.941114+0000","last_unstale":"2024-03-28T13:50:14.939869+0000","last_undegraded":"2024-03-28T13:50:14.939869+0000","last_fullsized":"2024-03-28T13:50:14.939869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:00:58.736580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":77884,"num_write":800,"num_write_kb":72822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'207","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.620568+0000","last_change":"2024-03-28T12:42:01.949545+0000","last_active":"2024-03-28T13:50:23.620568+0000","last_peered":"2024-03-28T13:50:23.620568+0000","last_clean":"2024-03-28T13:50:23.620568+0000","last_became_active":"2024-03-28T12:42:01.946576+0000","last_became_peered":"2024-03-28T12:42:01.946576+0000","last_unstale":"2024-03-28T13:50:23.620568+0000","last_undegraded":"2024-03-28T13:50:23.620568+0000","last_fullsized":"2024-03-28T13:50:23.620568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:32.704186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'258","reported_seq":317,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:12.902420+0000","last_change":"2024-03-28T12:42:00.142804+0000","last_active":"2024-03-28T13:49:12.902420+0000","last_peered":"2024-03-28T13:49:12.902420+0000","last_clean":"2024-03-28T13:49:12.902420+0000","last_became_active":"2024-03-28T12:42:00.142063+0000","last_became_peered":"2024-03-28T12:42:00.142063+0000","last_unstale":"2024-03-28T13:49:12.902420+0000","last_undegraded":"2024-03-28T13:49:12.902420+0000","last_fullsized":"2024-03-28T13:49:12.902420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:20:01.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'752","reported_seq":836,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.513787+0000","last_change":"2024-03-28T12:42:15.234431+0000","last_active":"2024-03-28T13:50:14.513787+0000","last_peered":"2024-03-28T13:50:14.513787+0000","last_clean":"2024-03-28T13:50:14.513787+0000","last_became_active":"2024-03-28T12:42:15.232928+0000","last_became_peered":"2024-03-28T12:42:15.232928+0000","last_unstale":"2024-03-28T13:50:14.513787+0000","last_undegraded":"2024-03-28T13:50:14.513787+0000","last_fullsized":"2024-03-28T13:50:14.513787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:05:19.841176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":85819,"num_write":731,"num_write_kb":97778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,5],"acting":[7,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'220","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.372553+0000","last_change":"2024-03-28T12:42:01.787457+0000","last_active":"2024-03-28T13:50:14.372553+0000","last_peered":"2024-03-28T13:50:14.372553+0000","last_clean":"2024-03-28T13:50:14.372553+0000","last_became_active":"2024-03-28T12:42:01.787253+0000","last_became_peered":"2024-03-28T12:42:01.787253+0000","last_unstale":"2024-03-28T13:50:14.372553+0000","last_undegraded":"2024-03-28T13:50:14.372553+0000","last_fullsized":"2024-03-28T13:50:14.372553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:33.620394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'771","reported_seq":829,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:23.369953+0000","last_change":"2024-03-28T12:42:00.146723+0000","last_active":"2024-03-28T13:49:23.369953+0000","last_peered":"2024-03-28T13:49:23.369953+0000","last_clean":"2024-03-28T13:49:23.369953+0000","last_became_active":"2024-03-28T12:42:00.146394+0000","last_became_peered":"2024-03-28T12:42:00.146394+0000","last_unstale":"2024-03-28T13:49:23.369953+0000","last_undegraded":"2024-03-28T13:49:23.369953+0000","last_fullsized":"2024-03-28T13:49:23.369953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:20:01.924932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'732","reported_seq":812,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.104446+0000","last_change":"2024-03-28T12:42:07.906623+0000","last_active":"2024-03-28T13:50:15.104446+0000","last_peered":"2024-03-28T13:50:15.104446+0000","last_clean":"2024-03-28T13:50:15.104446+0000","last_became_active":"2024-03-28T12:42:07.906233+0000","last_became_peered":"2024-03-28T12:42:07.906233+0000","last_unstale":"2024-03-28T13:50:15.104446+0000","last_undegraded":"2024-03-28T13:50:15.104446+0000","last_fullsized":"2024-03-28T13:50:15.104446+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:45.857353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":108609,"num_write":711,"num_write_kb":134735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'225","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.623341+0000","last_change":"2024-03-28T12:42:01.946498+0000","last_active":"2024-03-28T13:50:23.623341+0000","last_peered":"2024-03-28T13:50:23.623341+0000","last_clean":"2024-03-28T13:50:23.623341+0000","last_became_active":"2024-03-28T12:42:01.946087+0000","last_became_peered":"2024-03-28T12:42:01.946087+0000","last_unstale":"2024-03-28T13:50:23.623341+0000","last_undegraded":"2024-03-28T13:50:23.623341+0000","last_fullsized":"2024-03-28T13:50:23.623341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:05:13.466983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'253","reported_seq":312,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:40.083465+0000","last_change":"2024-03-28T12:42:00.143860+0000","last_active":"2024-03-28T13:49:40.083465+0000","last_peered":"2024-03-28T13:49:40.083465+0000","last_clean":"2024-03-28T13:49:40.083465+0000","last_became_active":"2024-03-28T12:42:00.143537+0000","last_became_peered":"2024-03-28T12:42:00.143537+0000","last_unstale":"2024-03-28T13:49:40.083465+0000","last_undegraded":"2024-03-28T13:49:40.083465+0000","last_fullsized":"2024-03-28T13:49:40.083465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:38:32.416338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":4185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'820","reported_seq":928,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.550528+0000","last_change":"2024-03-28T12:42:15.365975+0000","last_active":"2024-03-28T13:50:14.550528+0000","last_peered":"2024-03-28T13:50:14.550528+0000","last_clean":"2024-03-28T13:50:14.550528+0000","last_became_active":"2024-03-28T12:42:15.365535+0000","last_became_peered":"2024-03-28T12:42:15.365535+0000","last_unstale":"2024-03-28T13:50:14.550528+0000","last_undegraded":"2024-03-28T13:50:14.550528+0000","last_fullsized":"2024-03-28T13:50:14.550528+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":174138,"num_write":805,"num_write_kb":205369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,1],"acting":[2,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'175","reported_seq":232,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.626409+0000","last_change":"2024-03-28T12:42:01.802128+0000","last_active":"2024-03-28T13:50:23.626409+0000","last_peered":"2024-03-28T13:50:23.626409+0000","last_clean":"2024-03-28T13:50:23.626409+0000","last_became_active":"2024-03-28T12:42:01.801492+0000","last_became_peered":"2024-03-28T12:42:01.801492+0000","last_unstale":"2024-03-28T13:50:23.626409+0000","last_undegraded":"2024-03-28T13:50:23.626409+0000","last_fullsized":"2024-03-28T13:50:23.626409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:23:08.932618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'3007","reported_seq":3066,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:21.438168+0000","last_change":"2024-03-28T12:42:00.145914+0000","last_active":"2024-03-28T13:50:21.438168+0000","last_peered":"2024-03-28T13:50:21.438168+0000","last_clean":"2024-03-28T13:50:21.438168+0000","last_became_active":"2024-03-28T12:42:00.145638+0000","last_became_peered":"2024-03-28T12:42:00.145638+0000","last_unstale":"2024-03-28T13:50:21.438168+0000","last_undegraded":"2024-03-28T13:50:21.438168+0000","last_fullsized":"2024-03-28T13:50:21.438168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3007,"log_dups_size":0,"ondisk_log_size":3007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:47:28.765823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6735,"num_write_kb":3814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'791","reported_seq":864,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.443936+0000","last_change":"2024-03-28T12:42:07.882697+0000","last_active":"2024-03-28T13:50:04.443936+0000","last_peered":"2024-03-28T13:50:04.443936+0000","last_clean":"2024-03-28T13:50:04.443936+0000","last_became_active":"2024-03-28T12:42:07.881730+0000","last_became_peered":"2024-03-28T12:42:07.881730+0000","last_unstale":"2024-03-28T13:50:04.443936+0000","last_undegraded":"2024-03-28T13:50:04.443936+0000","last_fullsized":"2024-03-28T13:50:04.443936+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:12:27.231636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":64976,"num_write":766,"num_write_kb":85207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'204","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.411132+0000","last_change":"2024-03-28T12:42:01.810914+0000","last_active":"2024-03-28T13:50:23.411132+0000","last_peered":"2024-03-28T13:50:23.411132+0000","last_clean":"2024-03-28T13:50:23.411132+0000","last_became_active":"2024-03-28T12:42:01.810207+0000","last_became_peered":"2024-03-28T12:42:01.810207+0000","last_unstale":"2024-03-28T13:50:23.411132+0000","last_undegraded":"2024-03-28T13:50:23.411132+0000","last_fullsized":"2024-03-28T13:50:23.411132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:32.704186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'669","reported_seq":729,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:23.207829+0000","last_change":"2024-03-28T12:42:00.078402+0000","last_active":"2024-03-28T13:49:23.207829+0000","last_peered":"2024-03-28T13:49:23.207829+0000","last_clean":"2024-03-28T13:49:23.207829+0000","last_became_active":"2024-03-28T12:42:00.077988+0000","last_became_peered":"2024-03-28T12:42:00.077988+0000","last_unstale":"2024-03-28T13:49:23.207829+0000","last_undegraded":"2024-03-28T13:49:23.207829+0000","last_fullsized":"2024-03-28T13:49:23.207829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:21:58.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":8525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'762","reported_seq":849,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.824806+0000","last_change":"2024-03-28T12:42:07.936419+0000","last_active":"2024-03-28T13:50:08.824806+0000","last_peered":"2024-03-28T13:50:08.824806+0000","last_clean":"2024-03-28T13:50:08.824806+0000","last_became_active":"2024-03-28T12:42:07.935820+0000","last_became_peered":"2024-03-28T12:42:07.935820+0000","last_unstale":"2024-03-28T13:50:08.824806+0000","last_undegraded":"2024-03-28T13:50:08.824806+0000","last_fullsized":"2024-03-28T13:50:08.824806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:35:08.334379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":124547,"num_write":741,"num_write_kb":143298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'211","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.581294+0000","last_change":"2024-03-28T12:42:01.968887+0000","last_active":"2024-03-28T13:50:23.581294+0000","last_peered":"2024-03-28T13:50:23.581294+0000","last_clean":"2024-03-28T13:50:23.581294+0000","last_became_active":"2024-03-28T12:42:01.965491+0000","last_became_peered":"2024-03-28T12:42:01.965491+0000","last_unstale":"2024-03-28T13:50:23.581294+0000","last_undegraded":"2024-03-28T13:50:23.581294+0000","last_fullsized":"2024-03-28T13:50:23.581294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:35:50.246850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'378","reported_seq":438,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:48:53.431765+0000","last_change":"2024-03-28T12:42:00.135482+0000","last_active":"2024-03-28T13:48:53.431765+0000","last_peered":"2024-03-28T13:48:53.431765+0000","last_clean":"2024-03-28T13:48:53.431765+0000","last_became_active":"2024-03-28T12:42:00.132939+0000","last_became_peered":"2024-03-28T12:42:00.132939+0000","last_unstale":"2024-03-28T13:48:53.431765+0000","last_undegraded":"2024-03-28T13:48:53.431765+0000","last_fullsized":"2024-03-28T13:48:53.431765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:31:41.407157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'754","reported_seq":812,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.841272+0000","last_change":"2024-03-28T12:42:07.865644+0000","last_active":"2024-03-28T13:50:08.841272+0000","last_peered":"2024-03-28T13:50:08.841272+0000","last_clean":"2024-03-28T13:50:08.841272+0000","last_became_active":"2024-03-28T12:42:07.864804+0000","last_became_peered":"2024-03-28T12:42:07.864804+0000","last_unstale":"2024-03-28T13:50:08.841272+0000","last_undegraded":"2024-03-28T13:50:08.841272+0000","last_fullsized":"2024-03-28T13:50:08.841272+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:28.659784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":19361,"num_write":730,"num_write_kb":84308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'202","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.534161+0000","last_change":"2024-03-28T12:42:01.966222+0000","last_active":"2024-03-28T13:50:23.534161+0000","last_peered":"2024-03-28T13:50:23.534161+0000","last_clean":"2024-03-28T13:50:23.534161+0000","last_became_active":"2024-03-28T12:42:01.962305+0000","last_became_peered":"2024-03-28T12:42:01.962305+0000","last_unstale":"2024-03-28T13:50:23.534161+0000","last_undegraded":"2024-03-28T13:50:23.534161+0000","last_fullsized":"2024-03-28T13:50:23.534161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:33:35.906886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'899","reported_seq":959,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:48:08.735973+0000","last_change":"2024-03-28T12:42:00.137406+0000","last_active":"2024-03-28T13:48:08.735973+0000","last_peered":"2024-03-28T13:48:08.735973+0000","last_clean":"2024-03-28T13:48:08.735973+0000","last_became_active":"2024-03-28T12:42:00.137086+0000","last_became_peered":"2024-03-28T12:42:00.137086+0000","last_unstale":"2024-03-28T13:48:08.735973+0000","last_undegraded":"2024-03-28T13:48:08.735973+0000","last_fullsized":"2024-03-28T13:48:08.735973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:44:10.945015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389450,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":8591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'738","reported_seq":816,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.304618+0000","last_change":"2024-03-28T12:42:07.940726+0000","last_active":"2024-03-28T13:50:18.304618+0000","last_peered":"2024-03-28T13:50:18.304618+0000","last_clean":"2024-03-28T13:50:18.304618+0000","last_became_active":"2024-03-28T12:42:07.939926+0000","last_became_peered":"2024-03-28T12:42:07.939926+0000","last_unstale":"2024-03-28T13:50:18.304618+0000","last_undegraded":"2024-03-28T13:50:18.304618+0000","last_fullsized":"2024-03-28T13:50:18.304618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:45.857353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":104657,"num_write":715,"num_write_kb":183622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'203","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.453979+0000","last_change":"2024-03-28T12:42:01.949510+0000","last_active":"2024-03-28T13:50:04.453979+0000","last_peered":"2024-03-28T13:50:04.453979+0000","last_clean":"2024-03-28T13:50:04.453979+0000","last_became_active":"2024-03-28T12:42:01.949046+0000","last_became_peered":"2024-03-28T12:42:01.949046+0000","last_unstale":"2024-03-28T13:50:04.453979+0000","last_undegraded":"2024-03-28T13:50:04.453979+0000","last_fullsized":"2024-03-28T13:50:04.453979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:50:04.915302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1505","reported_seq":3000,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.444907+0000","last_change":"2024-03-28T12:42:00.150734+0000","last_active":"2024-03-28T13:50:23.444907+0000","last_peered":"2024-03-28T13:50:23.444907+0000","last_clean":"2024-03-28T13:50:23.444907+0000","last_became_active":"2024-03-28T12:42:00.150209+0000","last_became_peered":"2024-03-28T12:42:00.150209+0000","last_unstale":"2024-03-28T13:50:23.444907+0000","last_undegraded":"2024-03-28T13:50:23.444907+0000","last_fullsized":"2024-03-28T13:50:23.444907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1505,"log_dups_size":0,"ondisk_log_size":1505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:01:08.734929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1566364,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1437,"num_read_kb":2622,"num_write":1444,"num_write_kb":2626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'706","reported_seq":785,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.371808+0000","last_change":"2024-03-28T12:42:07.935974+0000","last_active":"2024-03-28T13:50:14.371808+0000","last_peered":"2024-03-28T13:50:14.371808+0000","last_clean":"2024-03-28T13:50:14.371808+0000","last_became_active":"2024-03-28T12:42:07.935342+0000","last_became_peered":"2024-03-28T12:42:07.935342+0000","last_unstale":"2024-03-28T13:50:14.371808+0000","last_undegraded":"2024-03-28T13:50:14.371808+0000","last_fullsized":"2024-03-28T13:50:14.371808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:21.970094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":64573,"num_write":698,"num_write_kb":72611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'198","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.410134+0000","last_change":"2024-03-28T12:42:01.961701+0000","last_active":"2024-03-28T13:50:23.410134+0000","last_peered":"2024-03-28T13:50:23.410134+0000","last_clean":"2024-03-28T13:50:23.410134+0000","last_became_active":"2024-03-28T12:42:01.961228+0000","last_became_peered":"2024-03-28T12:42:01.961228+0000","last_unstale":"2024-03-28T13:50:23.410134+0000","last_undegraded":"2024-03-28T13:50:23.410134+0000","last_fullsized":"2024-03-28T13:50:23.410134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'517","reported_seq":579,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:54.262943+0000","last_change":"2024-03-28T12:42:00.069398+0000","last_active":"2024-03-28T13:49:54.262943+0000","last_peered":"2024-03-28T13:49:54.262943+0000","last_clean":"2024-03-28T13:49:54.262943+0000","last_became_active":"2024-03-28T12:42:00.069134+0000","last_became_peered":"2024-03-28T12:42:00.069134+0000","last_unstale":"2024-03-28T13:49:54.262943+0000","last_undegraded":"2024-03-28T13:49:54.262943+0000","last_fullsized":"2024-03-28T13:49:54.262943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:57:54.776311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":460,"num_write_kb":12504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'872","reported_seq":971,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.109378+0000","last_change":"2024-03-28T12:42:15.365776+0000","last_active":"2024-03-28T13:50:15.109378+0000","last_peered":"2024-03-28T13:50:15.109378+0000","last_clean":"2024-03-28T13:50:15.109378+0000","last_became_active":"2024-03-28T12:42:15.364496+0000","last_became_peered":"2024-03-28T12:42:15.364496+0000","last_unstale":"2024-03-28T13:50:15.109378+0000","last_undegraded":"2024-03-28T13:50:15.109378+0000","last_fullsized":"2024-03-28T13:50:15.109378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:22:09.948471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":158824,"num_write":857,"num_write_kb":176540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'188","reported_seq":246,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.591867+0000","last_change":"2024-03-28T12:42:01.959210+0000","last_active":"2024-03-28T13:50:23.591867+0000","last_peered":"2024-03-28T13:50:23.591867+0000","last_clean":"2024-03-28T13:50:23.591867+0000","last_became_active":"2024-03-28T12:42:01.958117+0000","last_became_peered":"2024-03-28T12:42:01.958117+0000","last_unstale":"2024-03-28T13:50:23.591867+0000","last_undegraded":"2024-03-28T13:50:23.591867+0000","last_fullsized":"2024-03-28T13:50:23.591867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:28:17.797002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'274","reported_seq":334,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.456569+0000","last_change":"2024-03-28T12:42:00.134120+0000","last_active":"2024-03-28T13:50:04.456569+0000","last_peered":"2024-03-28T13:50:04.456569+0000","last_clean":"2024-03-28T13:50:04.456569+0000","last_became_active":"2024-03-28T12:42:00.133540+0000","last_became_peered":"2024-03-28T12:42:00.133540+0000","last_unstale":"2024-03-28T13:50:04.456569+0000","last_undegraded":"2024-03-28T13:50:04.456569+0000","last_fullsized":"2024-03-28T13:50:04.456569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:49:47.641947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":216,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:47:49.340422+0000","last_change":"2024-03-28T12:41:26.701485+0000","last_active":"2024-03-28T13:47:49.340422+0000","last_peered":"2024-03-28T13:47:49.340422+0000","last_clean":"2024-03-28T13:47:49.340422+0000","last_became_active":"2024-03-28T12:41:26.700338+0000","last_became_peered":"2024-03-28T12:41:26.700338+0000","last_unstale":"2024-03-28T13:47:49.340422+0000","last_undegraded":"2024-03-28T13:47:49.340422+0000","last_fullsized":"2024-03-28T13:47:49.340422+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:24.290713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:24.290713+0000","last_clean_scrub_stamp":"2024-03-28T12:41:24.290713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:58:57.536691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'778","reported_seq":854,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.666868+0000","last_change":"2024-03-28T12:42:07.938384+0000","last_active":"2024-03-28T13:50:14.666868+0000","last_peered":"2024-03-28T13:50:14.666868+0000","last_clean":"2024-03-28T13:50:14.666868+0000","last_became_active":"2024-03-28T12:42:07.937553+0000","last_became_peered":"2024-03-28T12:42:07.937553+0000","last_unstale":"2024-03-28T13:50:14.666868+0000","last_undegraded":"2024-03-28T13:50:14.666868+0000","last_fullsized":"2024-03-28T13:50:14.666868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:28:13.502930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":72658,"num_write":755,"num_write_kb":105142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'204","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:35.203603+0000","last_change":"2024-03-28T12:42:01.960107+0000","last_active":"2024-03-28T13:49:35.203603+0000","last_peered":"2024-03-28T13:49:35.203603+0000","last_clean":"2024-03-28T13:49:35.203603+0000","last_became_active":"2024-03-28T12:42:01.959809+0000","last_became_peered":"2024-03-28T12:42:01.959809+0000","last_unstale":"2024-03-28T13:49:35.203603+0000","last_undegraded":"2024-03-28T13:49:35.203603+0000","last_fullsized":"2024-03-28T13:49:35.203603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:38.797683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'368","reported_seq":425,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.797733+0000","last_change":"2024-03-28T12:42:00.144133+0000","last_active":"2024-03-28T13:50:08.797733+0000","last_peered":"2024-03-28T13:50:08.797733+0000","last_clean":"2024-03-28T13:50:08.797733+0000","last_became_active":"2024-03-28T12:42:00.143460+0000","last_became_peered":"2024-03-28T12:42:00.143460+0000","last_unstale":"2024-03-28T13:50:08.797733+0000","last_undegraded":"2024-03-28T13:50:08.797733+0000","last_fullsized":"2024-03-28T13:50:08.797733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195869,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'802","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.003550+0000","last_change":"2024-03-28T12:42:07.902848+0000","last_active":"2024-03-28T13:50:15.003550+0000","last_peered":"2024-03-28T13:50:15.003550+0000","last_clean":"2024-03-28T13:50:15.003550+0000","last_became_active":"2024-03-28T12:42:07.902428+0000","last_became_peered":"2024-03-28T12:42:07.902428+0000","last_unstale":"2024-03-28T13:50:15.003550+0000","last_undegraded":"2024-03-28T13:50:15.003550+0000","last_fullsized":"2024-03-28T13:50:15.003550+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:28.659784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":87583,"num_write":773,"num_write_kb":126746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'226","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.532824+0000","last_change":"2024-03-28T12:42:01.950786+0000","last_active":"2024-03-28T13:50:23.532824+0000","last_peered":"2024-03-28T13:50:23.532824+0000","last_clean":"2024-03-28T13:50:23.532824+0000","last_became_active":"2024-03-28T12:42:01.950592+0000","last_became_peered":"2024-03-28T12:42:01.950592+0000","last_unstale":"2024-03-28T13:50:23.532824+0000","last_undegraded":"2024-03-28T13:50:23.532824+0000","last_fullsized":"2024-03-28T13:50:23.532824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:53.224241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'817","reported_seq":875,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:18.008064+0000","last_change":"2024-03-28T12:42:00.148307+0000","last_active":"2024-03-28T13:49:18.008064+0000","last_peered":"2024-03-28T13:49:18.008064+0000","last_clean":"2024-03-28T13:49:18.008064+0000","last_became_active":"2024-03-28T12:42:00.139237+0000","last_became_peered":"2024-03-28T12:42:00.139237+0000","last_unstale":"2024-03-28T13:49:18.008064+0000","last_undegraded":"2024-03-28T13:49:18.008064+0000","last_fullsized":"2024-03-28T13:49:18.008064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:43:33.699843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":4460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'797","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.417907+0000","last_change":"2024-03-28T12:42:07.885520+0000","last_active":"2024-03-28T13:50:04.417907+0000","last_peered":"2024-03-28T13:50:04.417907+0000","last_clean":"2024-03-28T13:50:04.417907+0000","last_became_active":"2024-03-28T12:42:07.880300+0000","last_became_peered":"2024-03-28T12:42:07.880300+0000","last_unstale":"2024-03-28T13:50:04.417907+0000","last_undegraded":"2024-03-28T13:50:04.417907+0000","last_fullsized":"2024-03-28T13:50:04.417907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:17:47.670820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":105873,"num_write":776,"num_write_kb":138943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'201","reported_seq":256,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.533340+0000","last_change":"2024-03-28T12:42:01.962888+0000","last_active":"2024-03-28T13:50:23.533340+0000","last_peered":"2024-03-28T13:50:23.533340+0000","last_clean":"2024-03-28T13:50:23.533340+0000","last_became_active":"2024-03-28T12:42:01.962604+0000","last_became_peered":"2024-03-28T12:42:01.962604+0000","last_unstale":"2024-03-28T13:50:23.533340+0000","last_undegraded":"2024-03-28T13:50:23.533340+0000","last_fullsized":"2024-03-28T13:50:23.533340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:49.327792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'793","reported_seq":851,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:03.609064+0000","last_change":"2024-03-28T12:42:00.085372+0000","last_active":"2024-03-28T13:49:03.609064+0000","last_peered":"2024-03-28T13:49:03.609064+0000","last_clean":"2024-03-28T13:49:03.609064+0000","last_became_active":"2024-03-28T12:42:00.084866+0000","last_became_peered":"2024-03-28T12:42:00.084866+0000","last_unstale":"2024-03-28T13:49:03.609064+0000","last_undegraded":"2024-03-28T13:49:03.609064+0000","last_fullsized":"2024-03-28T13:49:03.609064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:21:45.688123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'769","reported_seq":847,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.305858+0000","last_change":"2024-03-28T12:42:07.899218+0000","last_active":"2024-03-28T13:50:18.305858+0000","last_peered":"2024-03-28T13:50:18.305858+0000","last_clean":"2024-03-28T13:50:18.305858+0000","last_became_active":"2024-03-28T12:42:07.898853+0000","last_became_peered":"2024-03-28T12:42:07.898853+0000","last_unstale":"2024-03-28T13:50:18.305858+0000","last_undegraded":"2024-03-28T13:50:18.305858+0000","last_fullsized":"2024-03-28T13:50:18.305858+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:34:21.240557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":96622,"num_write":756,"num_write_kb":72915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'187","reported_seq":242,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.588562+0000","last_change":"2024-03-28T12:42:01.965370+0000","last_active":"2024-03-28T13:50:23.588562+0000","last_peered":"2024-03-28T13:50:23.588562+0000","last_clean":"2024-03-28T13:50:23.588562+0000","last_became_active":"2024-03-28T12:42:01.964442+0000","last_became_peered":"2024-03-28T12:42:01.964442+0000","last_unstale":"2024-03-28T13:50:23.588562+0000","last_undegraded":"2024-03-28T13:50:23.588562+0000","last_fullsized":"2024-03-28T13:50:23.588562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:35.775033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'907","reported_seq":964,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:59.756156+0000","last_change":"2024-03-28T12:42:00.153658+0000","last_active":"2024-03-28T13:49:59.756156+0000","last_peered":"2024-03-28T13:49:59.756156+0000","last_clean":"2024-03-28T13:49:59.756156+0000","last_became_active":"2024-03-28T12:42:00.153292+0000","last_became_peered":"2024-03-28T12:42:00.153292+0000","last_unstale":"2024-03-28T13:49:59.756156+0000","last_undegraded":"2024-03-28T13:49:59.756156+0000","last_fullsized":"2024-03-28T13:49:59.756156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":907,"log_dups_size":0,"ondisk_log_size":907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:54.524905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1005,"num_write_kb":4546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'806","reported_seq":886,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.373691+0000","last_change":"2024-03-28T12:42:07.900126+0000","last_active":"2024-03-28T13:50:14.373691+0000","last_peered":"2024-03-28T13:50:14.373691+0000","last_clean":"2024-03-28T13:50:14.373691+0000","last_became_active":"2024-03-28T12:42:07.899780+0000","last_became_peered":"2024-03-28T12:42:07.899780+0000","last_unstale":"2024-03-28T13:50:14.373691+0000","last_undegraded":"2024-03-28T13:50:14.373691+0000","last_fullsized":"2024-03-28T13:50:14.373691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:31.070732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":86897,"num_write":794,"num_write_kb":118337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'228","reported_seq":283,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.944207+0000","last_change":"2024-03-28T12:42:01.962221+0000","last_active":"2024-03-28T13:50:14.944207+0000","last_peered":"2024-03-28T13:50:14.944207+0000","last_clean":"2024-03-28T13:50:14.944207+0000","last_became_active":"2024-03-28T12:42:01.961938+0000","last_became_peered":"2024-03-28T12:42:01.961938+0000","last_unstale":"2024-03-28T13:50:14.944207+0000","last_undegraded":"2024-03-28T13:50:14.944207+0000","last_fullsized":"2024-03-28T13:50:14.944207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:55:52.354803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'477","reported_seq":534,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.280447+0000","last_change":"2024-03-28T12:42:00.132287+0000","last_active":"2024-03-28T13:50:18.280447+0000","last_peered":"2024-03-28T13:50:18.280447+0000","last_clean":"2024-03-28T13:50:18.280447+0000","last_became_active":"2024-03-28T12:42:00.131064+0000","last_became_peered":"2024-03-28T12:42:00.131064+0000","last_unstale":"2024-03-28T13:50:18.280447+0000","last_undegraded":"2024-03-28T13:50:18.280447+0000","last_fullsized":"2024-03-28T13:50:18.280447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":8385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'776","reported_seq":858,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.958070+0000","last_change":"2024-03-28T12:42:07.887453+0000","last_active":"2024-03-28T13:50:08.958070+0000","last_peered":"2024-03-28T13:50:08.958070+0000","last_clean":"2024-03-28T13:50:08.958070+0000","last_became_active":"2024-03-28T12:42:07.886685+0000","last_became_peered":"2024-03-28T12:42:07.886685+0000","last_unstale":"2024-03-28T13:50:08.958070+0000","last_undegraded":"2024-03-28T13:50:08.958070+0000","last_fullsized":"2024-03-28T13:50:08.958070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:10:05.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":115085,"num_write":757,"num_write_kb":114512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'216","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.511744+0000","last_change":"2024-03-28T12:42:01.961318+0000","last_active":"2024-03-28T13:50:23.511744+0000","last_peered":"2024-03-28T13:50:23.511744+0000","last_clean":"2024-03-28T13:50:23.511744+0000","last_became_active":"2024-03-28T12:42:01.960102+0000","last_became_peered":"2024-03-28T12:42:01.960102+0000","last_unstale":"2024-03-28T13:50:23.511744+0000","last_undegraded":"2024-03-28T13:50:23.511744+0000","last_fullsized":"2024-03-28T13:50:23.511744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'65","reported_seq":121,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:39.241335+0000","last_change":"2024-03-28T12:42:00.145117+0000","last_active":"2024-03-28T13:49:39.241335+0000","last_peered":"2024-03-28T13:49:39.241335+0000","last_clean":"2024-03-28T13:49:39.241335+0000","last_became_active":"2024-03-28T12:42:00.144572+0000","last_became_peered":"2024-03-28T12:42:00.144572+0000","last_unstale":"2024-03-28T13:49:39.241335+0000","last_undegraded":"2024-03-28T13:49:39.241335+0000","last_fullsized":"2024-03-28T13:49:39.241335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:21:45.688123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'777","reported_seq":838,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.732192+0000","last_change":"2024-03-28T12:42:07.885727+0000","last_active":"2024-03-28T13:50:03.732192+0000","last_peered":"2024-03-28T13:50:03.732192+0000","last_clean":"2024-03-28T13:50:03.732192+0000","last_became_active":"2024-03-28T12:42:07.884760+0000","last_became_peered":"2024-03-28T12:42:07.884760+0000","last_unstale":"2024-03-28T13:50:03.732192+0000","last_undegraded":"2024-03-28T13:50:03.732192+0000","last_fullsized":"2024-03-28T13:50:03.732192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:45.171876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":41596,"num_write":756,"num_write_kb":91419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'188","reported_seq":243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.758331+0000","last_change":"2024-03-28T12:42:01.936371+0000","last_active":"2024-03-28T13:50:03.758331+0000","last_peered":"2024-03-28T13:50:03.758331+0000","last_clean":"2024-03-28T13:50:03.758331+0000","last_became_active":"2024-03-28T12:42:01.936080+0000","last_became_peered":"2024-03-28T12:42:01.936080+0000","last_unstale":"2024-03-28T13:50:03.758331+0000","last_undegraded":"2024-03-28T13:50:03.758331+0000","last_fullsized":"2024-03-28T13:50:03.758331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:36.955339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'56","reported_seq":113,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.341470+0000","last_change":"2024-03-28T12:42:00.139149+0000","last_active":"2024-03-28T13:50:18.341470+0000","last_peered":"2024-03-28T13:50:18.341470+0000","last_clean":"2024-03-28T13:50:18.341470+0000","last_became_active":"2024-03-28T12:42:00.138555+0000","last_became_peered":"2024-03-28T12:42:00.138555+0000","last_unstale":"2024-03-28T13:50:18.341470+0000","last_undegraded":"2024-03-28T13:50:18.341470+0000","last_fullsized":"2024-03-28T13:50:18.341470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T12:44:12.403916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'757","reported_seq":858,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:09.340082+0000","last_change":"2024-03-28T12:42:07.940362+0000","last_active":"2024-03-28T13:50:09.340082+0000","last_peered":"2024-03-28T13:50:09.340082+0000","last_clean":"2024-03-28T13:50:09.340082+0000","last_became_active":"2024-03-28T12:42:07.939396+0000","last_became_peered":"2024-03-28T12:42:07.939396+0000","last_unstale":"2024-03-28T13:50:09.340082+0000","last_undegraded":"2024-03-28T13:50:09.340082+0000","last_fullsized":"2024-03-28T13:50:09.340082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:59.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":181074,"num_write":742,"num_write_kb":169009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'212","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.410111+0000","last_change":"2024-03-28T12:42:01.800361+0000","last_active":"2024-03-28T13:50:23.410111+0000","last_peered":"2024-03-28T13:50:23.410111+0000","last_clean":"2024-03-28T13:50:23.410111+0000","last_became_active":"2024-03-28T12:42:01.799594+0000","last_became_peered":"2024-03-28T12:42:01.799594+0000","last_unstale":"2024-03-28T13:50:23.410111+0000","last_undegraded":"2024-03-28T13:50:23.410111+0000","last_fullsized":"2024-03-28T13:50:23.410111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:35.775033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'343","reported_seq":398,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:23.356856+0000","last_change":"2024-03-28T12:42:00.143501+0000","last_active":"2024-03-28T13:49:23.356856+0000","last_peered":"2024-03-28T13:49:23.356856+0000","last_clean":"2024-03-28T13:49:23.356856+0000","last_became_active":"2024-03-28T12:42:00.142913+0000","last_became_peered":"2024-03-28T12:42:00.142913+0000","last_unstale":"2024-03-28T13:49:23.356856+0000","last_undegraded":"2024-03-28T13:49:23.356856+0000","last_fullsized":"2024-03-28T13:49:23.356856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":8326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'745","reported_seq":819,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.946235+0000","last_change":"2024-03-28T12:42:07.938687+0000","last_active":"2024-03-28T13:50:14.946235+0000","last_peered":"2024-03-28T13:50:14.946235+0000","last_clean":"2024-03-28T13:50:14.946235+0000","last_became_active":"2024-03-28T12:42:07.938081+0000","last_became_peered":"2024-03-28T12:42:07.938081+0000","last_unstale":"2024-03-28T13:50:14.946235+0000","last_undegraded":"2024-03-28T13:50:14.946235+0000","last_fullsized":"2024-03-28T13:50:14.946235+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:47.148457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":86453,"num_write":732,"num_write_kb":138137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'202","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.530403+0000","last_change":"2024-03-28T12:42:01.938516+0000","last_active":"2024-03-28T13:50:23.530403+0000","last_peered":"2024-03-28T13:50:23.530403+0000","last_clean":"2024-03-28T13:50:23.530403+0000","last_became_active":"2024-03-28T12:42:01.938251+0000","last_became_peered":"2024-03-28T12:42:01.938251+0000","last_unstale":"2024-03-28T13:50:23.530403+0000","last_undegraded":"2024-03-28T13:50:23.530403+0000","last_fullsized":"2024-03-28T13:50:23.530403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:15.595901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'884","reported_seq":940,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:02.754967+0000","last_change":"2024-03-28T12:42:00.141127+0000","last_active":"2024-03-28T13:50:02.754967+0000","last_peered":"2024-03-28T13:50:02.754967+0000","last_clean":"2024-03-28T13:50:02.754967+0000","last_became_active":"2024-03-28T12:42:00.140832+0000","last_became_peered":"2024-03-28T12:42:00.140832+0000","last_unstale":"2024-03-28T13:50:02.754967+0000","last_undegraded":"2024-03-28T13:50:02.754967+0000","last_fullsized":"2024-03-28T13:50:02.754967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:01:04.151858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":844,"num_write_kb":12856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'810","reported_seq":900,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.011730+0000","last_change":"2024-03-28T12:42:07.936963+0000","last_active":"2024-03-28T13:50:15.011730+0000","last_peered":"2024-03-28T13:50:15.011730+0000","last_clean":"2024-03-28T13:50:15.011730+0000","last_became_active":"2024-03-28T12:42:07.936606+0000","last_became_peered":"2024-03-28T12:42:07.936606+0000","last_unstale":"2024-03-28T13:50:15.011730+0000","last_undegraded":"2024-03-28T13:50:15.011730+0000","last_fullsized":"2024-03-28T13:50:15.011730+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:37:04.083032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":136867,"num_write":788,"num_write_kb":148031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'195","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.657441+0000","last_change":"2024-03-28T12:42:01.962855+0000","last_active":"2024-03-28T13:50:03.657441+0000","last_peered":"2024-03-28T13:50:03.657441+0000","last_clean":"2024-03-28T13:50:03.657441+0000","last_became_active":"2024-03-28T12:42:01.962546+0000","last_became_peered":"2024-03-28T12:42:01.962546+0000","last_unstale":"2024-03-28T13:50:03.657441+0000","last_undegraded":"2024-03-28T13:50:03.657441+0000","last_fullsized":"2024-03-28T13:50:03.657441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:08.429940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'1091","reported_seq":1145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.357556+0000","last_change":"2024-03-28T12:42:00.138923+0000","last_active":"2024-03-28T13:50:18.357556+0000","last_peered":"2024-03-28T13:50:18.357556+0000","last_clean":"2024-03-28T13:50:18.357556+0000","last_became_active":"2024-03-28T12:42:00.138233+0000","last_became_peered":"2024-03-28T12:42:00.138233+0000","last_unstale":"2024-03-28T13:50:18.357556+0000","last_undegraded":"2024-03-28T13:50:18.357556+0000","last_fullsized":"2024-03-28T13:50:18.357556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1091,"log_dups_size":0,"ondisk_log_size":1091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":5033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'724","reported_seq":796,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.443533+0000","last_change":"2024-03-28T12:42:07.907163+0000","last_active":"2024-03-28T13:50:14.443533+0000","last_peered":"2024-03-28T13:50:14.443533+0000","last_clean":"2024-03-28T13:50:14.443533+0000","last_became_active":"2024-03-28T12:42:07.906334+0000","last_became_peered":"2024-03-28T12:42:07.906334+0000","last_unstale":"2024-03-28T13:50:14.443533+0000","last_undegraded":"2024-03-28T13:50:14.443533+0000","last_fullsized":"2024-03-28T13:50:14.443533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:59.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":82415,"num_write":704,"num_write_kb":118989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'192","reported_seq":246,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.581520+0000","last_change":"2024-03-28T12:42:01.809232+0000","last_active":"2024-03-28T13:50:03.581520+0000","last_peered":"2024-03-28T13:50:03.581520+0000","last_clean":"2024-03-28T13:50:03.581520+0000","last_became_active":"2024-03-28T12:42:01.805284+0000","last_became_peered":"2024-03-28T12:42:01.805284+0000","last_unstale":"2024-03-28T13:50:03.581520+0000","last_undegraded":"2024-03-28T13:50:03.581520+0000","last_fullsized":"2024-03-28T13:50:03.581520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:20:54.180080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'401","reported_seq":456,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:53.953125+0000","last_change":"2024-03-28T12:42:00.147739+0000","last_active":"2024-03-28T13:49:53.953125+0000","last_peered":"2024-03-28T13:49:53.953125+0000","last_clean":"2024-03-28T13:49:53.953125+0000","last_became_active":"2024-03-28T12:42:00.147407+0000","last_became_peered":"2024-03-28T12:42:00.147407+0000","last_unstale":"2024-03-28T13:49:53.953125+0000","last_undegraded":"2024-03-28T13:49:53.953125+0000","last_fullsized":"2024-03-28T13:49:53.953125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:29.908949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'847","reported_seq":927,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.548369+0000","last_change":"2024-03-28T12:42:07.900662+0000","last_active":"2024-03-28T13:50:14.548369+0000","last_peered":"2024-03-28T13:50:14.548369+0000","last_clean":"2024-03-28T13:50:14.548369+0000","last_became_active":"2024-03-28T12:42:07.899628+0000","last_became_peered":"2024-03-28T12:42:07.899628+0000","last_unstale":"2024-03-28T13:50:14.548369+0000","last_undegraded":"2024-03-28T13:50:14.548369+0000","last_fullsized":"2024-03-28T13:50:14.548369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:31.070732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":75354,"num_write":826,"num_write_kb":110616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'214","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.587870+0000","last_change":"2024-03-28T12:42:01.967776+0000","last_active":"2024-03-28T13:50:23.587870+0000","last_peered":"2024-03-28T13:50:23.587870+0000","last_clean":"2024-03-28T13:50:23.587870+0000","last_became_active":"2024-03-28T12:42:01.964830+0000","last_became_peered":"2024-03-28T12:42:01.964830+0000","last_unstale":"2024-03-28T13:50:23.587870+0000","last_undegraded":"2024-03-28T13:50:23.587870+0000","last_fullsized":"2024-03-28T13:50:23.587870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'64","reported_seq":118,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.203686+0000","last_change":"2024-03-28T12:42:00.142326+0000","last_active":"2024-03-28T13:50:23.203686+0000","last_peered":"2024-03-28T13:50:23.203686+0000","last_clean":"2024-03-28T13:50:23.203686+0000","last_became_active":"2024-03-28T12:42:00.141602+0000","last_became_peered":"2024-03-28T12:42:00.141602+0000","last_unstale":"2024-03-28T13:50:23.203686+0000","last_undegraded":"2024-03-28T13:50:23.203686+0000","last_fullsized":"2024-03-28T13:50:23.203686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'910","reported_seq":1032,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.938964+0000","last_change":"2024-03-28T12:42:07.935882+0000","last_active":"2024-03-28T13:50:14.938964+0000","last_peered":"2024-03-28T13:50:14.938964+0000","last_clean":"2024-03-28T13:50:14.938964+0000","last_became_active":"2024-03-28T12:42:07.935525+0000","last_became_peered":"2024-03-28T12:42:07.935525+0000","last_unstale":"2024-03-28T13:50:14.938964+0000","last_undegraded":"2024-03-28T13:50:14.938964+0000","last_fullsized":"2024-03-28T13:50:14.938964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:50:31.463779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":257511,"num_write":888,"num_write_kb":259792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'811","reported_seq":911,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.444896+0000","last_change":"2024-03-28T12:42:07.882782+0000","last_active":"2024-03-28T13:50:14.444896+0000","last_peered":"2024-03-28T13:50:14.444896+0000","last_clean":"2024-03-28T13:50:14.444896+0000","last_became_active":"2024-03-28T12:42:07.881527+0000","last_became_peered":"2024-03-28T12:42:07.881527+0000","last_unstale":"2024-03-28T13:50:14.444896+0000","last_undegraded":"2024-03-28T13:50:14.444896+0000","last_fullsized":"2024-03-28T13:50:14.444896+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:55.701985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":165977,"num_write":788,"num_write_kb":136221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'216","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.626839+0000","last_change":"2024-03-28T12:42:01.958791+0000","last_active":"2024-03-28T13:50:23.626839+0000","last_peered":"2024-03-28T13:50:23.626839+0000","last_clean":"2024-03-28T13:50:23.626839+0000","last_became_active":"2024-03-28T12:42:01.957991+0000","last_became_peered":"2024-03-28T12:42:01.957991+0000","last_unstale":"2024-03-28T13:50:23.626839+0000","last_undegraded":"2024-03-28T13:50:23.626839+0000","last_fullsized":"2024-03-28T13:50:23.626839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:24.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'1719","reported_seq":1775,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:42.912733+0000","last_change":"2024-03-28T12:42:00.132942+0000","last_active":"2024-03-28T13:49:42.912733+0000","last_peered":"2024-03-28T13:49:42.912733+0000","last_clean":"2024-03-28T13:49:42.912733+0000","last_became_active":"2024-03-28T12:42:00.132663+0000","last_became_peered":"2024-03-28T12:42:00.132663+0000","last_unstale":"2024-03-28T13:49:42.912733+0000","last_undegraded":"2024-03-28T13:49:42.912733+0000","last_fullsized":"2024-03-28T13:49:42.912733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1719,"log_dups_size":0,"ondisk_log_size":1719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:04:41.612613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1652,"num_write_kb":13078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'750","reported_seq":827,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:59.767304+0000","last_change":"2024-03-28T12:42:07.901907+0000","last_active":"2024-03-28T13:49:59.767304+0000","last_peered":"2024-03-28T13:49:59.767304+0000","last_clean":"2024-03-28T13:49:59.767304+0000","last_became_active":"2024-03-28T12:42:07.901398+0000","last_became_peered":"2024-03-28T12:42:07.901398+0000","last_unstale":"2024-03-28T13:49:59.767304+0000","last_undegraded":"2024-03-28T13:49:59.767304+0000","last_fullsized":"2024-03-28T13:49:59.767304+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:49:41.408808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":90732,"num_write":732,"num_write_kb":110234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'218","reported_seq":272,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:54.353248+0000","last_change":"2024-03-28T12:42:01.811306+0000","last_active":"2024-03-28T13:49:54.353248+0000","last_peered":"2024-03-28T13:49:54.353248+0000","last_clean":"2024-03-28T13:49:54.353248+0000","last_became_active":"2024-03-28T12:42:01.810142+0000","last_became_peered":"2024-03-28T12:42:01.810142+0000","last_unstale":"2024-03-28T13:49:54.353248+0000","last_undegraded":"2024-03-28T13:49:54.353248+0000","last_fullsized":"2024-03-28T13:49:54.353248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:37:22.386341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'118","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:59.338833+0000","last_change":"2024-03-28T12:42:00.142916+0000","last_active":"2024-03-28T13:49:59.338833+0000","last_peered":"2024-03-28T13:49:59.338833+0000","last_clean":"2024-03-28T13:49:59.338833+0000","last_became_active":"2024-03-28T12:42:00.142006+0000","last_became_peered":"2024-03-28T12:42:00.142006+0000","last_unstale":"2024-03-28T13:49:59.338833+0000","last_undegraded":"2024-03-28T13:49:59.338833+0000","last_fullsized":"2024-03-28T13:49:59.338833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:01:08.734929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'739","reported_seq":794,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:23.266261+0000","last_change":"2024-03-28T12:42:00.143738+0000","last_active":"2024-03-28T13:49:23.266261+0000","last_peered":"2024-03-28T13:49:23.266261+0000","last_clean":"2024-03-28T13:49:23.266261+0000","last_became_active":"2024-03-28T12:42:00.143474+0000","last_became_peered":"2024-03-28T12:42:00.143474+0000","last_unstale":"2024-03-28T13:49:23.266261+0000","last_undegraded":"2024-03-28T13:49:23.266261+0000","last_fullsized":"2024-03-28T13:49:23.266261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:43:33.267243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":12641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'186","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.627388+0000","last_change":"2024-03-28T12:42:01.938147+0000","last_active":"2024-03-28T13:50:23.627388+0000","last_peered":"2024-03-28T13:50:23.627388+0000","last_clean":"2024-03-28T13:50:23.627388+0000","last_became_active":"2024-03-28T12:42:01.937612+0000","last_became_peered":"2024-03-28T12:42:01.937612+0000","last_unstale":"2024-03-28T13:50:23.627388+0000","last_undegraded":"2024-03-28T13:50:23.627388+0000","last_fullsized":"2024-03-28T13:50:23.627388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:31:15.643101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'736","reported_seq":808,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.442217+0000","last_change":"2024-03-28T12:42:07.870201+0000","last_active":"2024-03-28T13:50:14.442217+0000","last_peered":"2024-03-28T13:50:14.442217+0000","last_clean":"2024-03-28T13:50:14.442217+0000","last_became_active":"2024-03-28T12:42:07.869628+0000","last_became_peered":"2024-03-28T12:42:07.869628+0000","last_unstale":"2024-03-28T13:50:14.442217+0000","last_undegraded":"2024-03-28T13:50:14.442217+0000","last_fullsized":"2024-03-28T13:50:14.442217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:54:02.038788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":78605,"num_write":708,"num_write_kb":126589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'198","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:18.249461+0000","last_change":"2024-03-28T12:42:00.146260+0000","last_active":"2024-03-28T13:49:18.249461+0000","last_peered":"2024-03-28T13:49:18.249461+0000","last_clean":"2024-03-28T13:49:18.249461+0000","last_became_active":"2024-03-28T12:42:00.146052+0000","last_became_peered":"2024-03-28T12:42:00.146052+0000","last_unstale":"2024-03-28T13:49:18.249461+0000","last_undegraded":"2024-03-28T13:49:18.249461+0000","last_fullsized":"2024-03-28T13:49:18.249461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:08.118205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'206","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.514953+0000","last_change":"2024-03-28T12:42:01.966002+0000","last_active":"2024-03-28T13:50:23.514953+0000","last_peered":"2024-03-28T13:50:23.514953+0000","last_clean":"2024-03-28T13:50:23.514953+0000","last_became_active":"2024-03-28T12:42:01.965598+0000","last_became_peered":"2024-03-28T12:42:01.965598+0000","last_unstale":"2024-03-28T13:50:23.514953+0000","last_undegraded":"2024-03-28T13:50:23.514953+0000","last_fullsized":"2024-03-28T13:50:23.514953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:35:50.246850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'725","reported_seq":796,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.725373+0000","last_change":"2024-03-28T12:42:15.361649+0000","last_active":"2024-03-28T13:50:08.725373+0000","last_peered":"2024-03-28T13:50:08.725373+0000","last_clean":"2024-03-28T13:50:08.725373+0000","last_became_active":"2024-03-28T12:42:15.360743+0000","last_became_peered":"2024-03-28T12:42:15.360743+0000","last_unstale":"2024-03-28T13:50:08.725373+0000","last_undegraded":"2024-03-28T13:50:08.725373+0000","last_fullsized":"2024-03-28T13:50:08.725373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:22:55.701985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":88364,"num_write":704,"num_write_kb":127819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"29'220","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.581522+0000","last_change":"2024-03-28T12:42:01.965237+0000","last_active":"2024-03-28T13:50:23.581522+0000","last_peered":"2024-03-28T13:50:23.581522+0000","last_clean":"2024-03-28T13:50:23.581522+0000","last_became_active":"2024-03-28T12:42:01.964468+0000","last_became_peered":"2024-03-28T12:42:01.964468+0000","last_unstale":"2024-03-28T13:50:23.581522+0000","last_undegraded":"2024-03-28T13:50:23.581522+0000","last_fullsized":"2024-03-28T13:50:23.581522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:05.744451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'218","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.439522+0000","last_change":"2024-03-28T12:42:01.959553+0000","last_active":"2024-03-28T13:50:23.439522+0000","last_peered":"2024-03-28T13:50:23.439522+0000","last_clean":"2024-03-28T13:50:23.439522+0000","last_became_active":"2024-03-28T12:42:01.958333+0000","last_became_peered":"2024-03-28T12:42:01.958333+0000","last_unstale":"2024-03-28T13:50:23.439522+0000","last_undegraded":"2024-03-28T13:50:23.439522+0000","last_fullsized":"2024-03-28T13:50:23.439522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:05.744451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'227","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.422962+0000","last_change":"2024-03-28T12:42:01.805452+0000","last_active":"2024-03-28T13:50:04.422962+0000","last_peered":"2024-03-28T13:50:04.422962+0000","last_clean":"2024-03-28T13:50:04.422962+0000","last_became_active":"2024-03-28T12:42:01.805288+0000","last_became_peered":"2024-03-28T12:42:01.805288+0000","last_unstale":"2024-03-28T13:50:04.422962+0000","last_undegraded":"2024-03-28T13:50:04.422962+0000","last_fullsized":"2024-03-28T13:50:04.422962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:17:01.582670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'197","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.832771+0000","last_change":"2024-03-28T12:42:01.947234+0000","last_active":"2024-03-28T13:50:08.832771+0000","last_peered":"2024-03-28T13:50:08.832771+0000","last_clean":"2024-03-28T13:50:08.832771+0000","last_became_active":"2024-03-28T12:42:01.946859+0000","last_became_peered":"2024-03-28T12:42:01.946859+0000","last_unstale":"2024-03-28T13:50:08.832771+0000","last_undegraded":"2024-03-28T13:50:08.832771+0000","last_fullsized":"2024-03-28T13:50:08.832771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:36:05.320541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'187","reported_seq":243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.415200+0000","last_change":"2024-03-28T12:42:01.935265+0000","last_active":"2024-03-28T13:50:23.415200+0000","last_peered":"2024-03-28T13:50:23.415200+0000","last_clean":"2024-03-28T13:50:23.415200+0000","last_became_active":"2024-03-28T12:42:01.934578+0000","last_became_peered":"2024-03-28T12:42:01.934578+0000","last_unstale":"2024-03-28T13:50:23.415200+0000","last_undegraded":"2024-03-28T13:50:23.415200+0000","last_fullsized":"2024-03-28T13:50:23.415200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:24.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'208","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.405779+0000","last_change":"2024-03-28T12:42:01.946191+0000","last_active":"2024-03-28T13:50:23.405779+0000","last_peered":"2024-03-28T13:50:23.405779+0000","last_clean":"2024-03-28T13:50:23.405779+0000","last_became_active":"2024-03-28T12:42:01.945804+0000","last_became_peered":"2024-03-28T12:42:01.945804+0000","last_unstale":"2024-03-28T13:50:23.405779+0000","last_undegraded":"2024-03-28T13:50:23.405779+0000","last_fullsized":"2024-03-28T13:50:23.405779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:40.221005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'244","reported_seq":300,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.586484+0000","last_change":"2024-03-28T12:42:01.969416+0000","last_active":"2024-03-28T13:50:23.586484+0000","last_peered":"2024-03-28T13:50:23.586484+0000","last_clean":"2024-03-28T13:50:23.586484+0000","last_became_active":"2024-03-28T12:42:01.969078+0000","last_became_peered":"2024-03-28T12:42:01.969078+0000","last_unstale":"2024-03-28T13:50:23.586484+0000","last_undegraded":"2024-03-28T13:50:23.586484+0000","last_fullsized":"2024-03-28T13:50:23.586484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'193","reported_seq":250,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.894344+0000","last_change":"2024-03-28T12:42:01.958402+0000","last_active":"2024-03-28T13:50:08.894344+0000","last_peered":"2024-03-28T13:50:08.894344+0000","last_clean":"2024-03-28T13:50:08.894344+0000","last_became_active":"2024-03-28T12:42:01.958074+0000","last_became_peered":"2024-03-28T12:42:01.958074+0000","last_unstale":"2024-03-28T13:50:08.894344+0000","last_undegraded":"2024-03-28T13:50:08.894344+0000","last_fullsized":"2024-03-28T13:50:08.894344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:18:04.255456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'213","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.307568+0000","last_change":"2024-03-28T12:42:01.811823+0000","last_active":"2024-03-28T13:50:18.307568+0000","last_peered":"2024-03-28T13:50:18.307568+0000","last_clean":"2024-03-28T13:50:18.307568+0000","last_became_active":"2024-03-28T12:42:01.811548+0000","last_became_peered":"2024-03-28T12:42:01.811548+0000","last_unstale":"2024-03-28T13:50:18.307568+0000","last_undegraded":"2024-03-28T13:50:18.307568+0000","last_fullsized":"2024-03-28T13:50:18.307568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:00:51.741925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'199","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.204475+0000","last_change":"2024-03-28T12:42:01.959291+0000","last_active":"2024-03-28T13:50:04.204475+0000","last_peered":"2024-03-28T13:50:04.204475+0000","last_clean":"2024-03-28T13:50:04.204475+0000","last_became_active":"2024-03-28T12:42:01.958942+0000","last_became_peered":"2024-03-28T12:42:01.958942+0000","last_unstale":"2024-03-28T13:50:04.204475+0000","last_undegraded":"2024-03-28T13:50:04.204475+0000","last_fullsized":"2024-03-28T13:50:04.204475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:52:46.128830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'214","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.513059+0000","last_change":"2024-03-28T12:42:01.965790+0000","last_active":"2024-03-28T13:50:23.513059+0000","last_peered":"2024-03-28T13:50:23.513059+0000","last_clean":"2024-03-28T13:50:23.513059+0000","last_became_active":"2024-03-28T12:42:01.965526+0000","last_became_peered":"2024-03-28T12:42:01.965526+0000","last_unstale":"2024-03-28T13:50:23.513059+0000","last_undegraded":"2024-03-28T13:50:23.513059+0000","last_fullsized":"2024-03-28T13:50:23.513059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'216","reported_seq":272,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.621327+0000","last_change":"2024-03-28T12:42:01.960761+0000","last_active":"2024-03-28T13:50:23.621327+0000","last_peered":"2024-03-28T13:50:23.621327+0000","last_clean":"2024-03-28T13:50:23.621327+0000","last_became_active":"2024-03-28T12:42:01.960325+0000","last_became_peered":"2024-03-28T12:42:01.960325+0000","last_unstale":"2024-03-28T13:50:23.621327+0000","last_undegraded":"2024-03-28T13:50:23.621327+0000","last_fullsized":"2024-03-28T13:50:23.621327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:40.221005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'221","reported_seq":276,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.533687+0000","last_change":"2024-03-28T12:42:01.960053+0000","last_active":"2024-03-28T13:50:23.533687+0000","last_peered":"2024-03-28T13:50:23.533687+0000","last_clean":"2024-03-28T13:50:23.533687+0000","last_became_active":"2024-03-28T12:42:01.959801+0000","last_became_peered":"2024-03-28T12:42:01.959801+0000","last_unstale":"2024-03-28T13:50:23.533687+0000","last_undegraded":"2024-03-28T13:50:23.533687+0000","last_fullsized":"2024-03-28T13:50:23.533687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:22.285591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'196","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.424881+0000","last_change":"2024-03-28T12:42:01.788603+0000","last_active":"2024-03-28T13:50:04.424881+0000","last_peered":"2024-03-28T13:50:04.424881+0000","last_clean":"2024-03-28T13:50:04.424881+0000","last_became_active":"2024-03-28T12:42:01.788431+0000","last_became_peered":"2024-03-28T12:42:01.788431+0000","last_unstale":"2024-03-28T13:50:04.424881+0000","last_undegraded":"2024-03-28T13:50:04.424881+0000","last_fullsized":"2024-03-28T13:50:04.424881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:09:59.404128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'205","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.439936+0000","last_change":"2024-03-28T12:42:01.960518+0000","last_active":"2024-03-28T13:50:23.439936+0000","last_peered":"2024-03-28T13:50:23.439936+0000","last_clean":"2024-03-28T13:50:23.439936+0000","last_became_active":"2024-03-28T12:42:01.959832+0000","last_became_peered":"2024-03-28T12:42:01.959832+0000","last_unstale":"2024-03-28T13:50:23.439936+0000","last_undegraded":"2024-03-28T13:50:23.439936+0000","last_fullsized":"2024-03-28T13:50:23.439936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'198","reported_seq":253,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:09.232667+0000","last_change":"2024-03-28T12:42:01.936477+0000","last_active":"2024-03-28T13:50:09.232667+0000","last_peered":"2024-03-28T13:50:09.232667+0000","last_clean":"2024-03-28T13:50:09.232667+0000","last_became_active":"2024-03-28T12:42:01.936175+0000","last_became_peered":"2024-03-28T12:42:01.936175+0000","last_unstale":"2024-03-28T13:50:09.232667+0000","last_undegraded":"2024-03-28T13:50:09.232667+0000","last_fullsized":"2024-03-28T13:50:09.232667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:14:14.822668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'209","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.453599+0000","last_change":"2024-03-28T12:42:01.960054+0000","last_active":"2024-03-28T13:50:14.453599+0000","last_peered":"2024-03-28T13:50:14.453599+0000","last_clean":"2024-03-28T13:50:14.453599+0000","last_became_active":"2024-03-28T12:42:01.959791+0000","last_became_peered":"2024-03-28T12:42:01.959791+0000","last_unstale":"2024-03-28T13:50:14.453599+0000","last_undegraded":"2024-03-28T13:50:14.453599+0000","last_fullsized":"2024-03-28T13:50:14.453599+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:06:44.099531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'211","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:41.908840+0000","last_change":"2024-03-28T12:42:15.233310+0000","last_active":"2024-03-28T13:49:41.908840+0000","last_peered":"2024-03-28T13:49:41.908840+0000","last_clean":"2024-03-28T13:49:41.908840+0000","last_became_active":"2024-03-28T12:42:15.232678+0000","last_became_peered":"2024-03-28T12:42:15.232678+0000","last_unstale":"2024-03-28T13:49:41.908840+0000","last_undegraded":"2024-03-28T13:49:41.908840+0000","last_fullsized":"2024-03-28T13:49:41.908840+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:11:33.781054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'215","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.408861+0000","last_change":"2024-03-28T12:42:01.948602+0000","last_active":"2024-03-28T13:50:23.408861+0000","last_peered":"2024-03-28T13:50:23.408861+0000","last_clean":"2024-03-28T13:50:23.408861+0000","last_became_active":"2024-03-28T12:42:01.947869+0000","last_became_peered":"2024-03-28T12:42:01.947869+0000","last_unstale":"2024-03-28T13:50:23.408861+0000","last_undegraded":"2024-03-28T13:50:23.408861+0000","last_fullsized":"2024-03-28T13:50:23.408861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'199","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.413834+0000","last_change":"2024-03-28T12:42:01.940521+0000","last_active":"2024-03-28T13:50:23.413834+0000","last_peered":"2024-03-28T13:50:23.413834+0000","last_clean":"2024-03-28T13:50:23.413834+0000","last_became_active":"2024-03-28T12:42:01.939756+0000","last_became_peered":"2024-03-28T12:42:01.939756+0000","last_unstale":"2024-03-28T13:50:23.413834+0000","last_undegraded":"2024-03-28T13:50:23.413834+0000","last_fullsized":"2024-03-28T13:50:23.413834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:53:37.869232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'184","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.536283+0000","last_change":"2024-03-28T12:42:01.960377+0000","last_active":"2024-03-28T13:50:23.536283+0000","last_peered":"2024-03-28T13:50:23.536283+0000","last_clean":"2024-03-28T13:50:23.536283+0000","last_became_active":"2024-03-28T12:42:01.960012+0000","last_became_peered":"2024-03-28T12:42:01.960012+0000","last_unstale":"2024-03-28T13:50:23.536283+0000","last_undegraded":"2024-03-28T13:50:23.536283+0000","last_fullsized":"2024-03-28T13:50:23.536283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:19:20.801201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'189","reported_seq":242,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.533778+0000","last_change":"2024-03-28T12:42:01.937280+0000","last_active":"2024-03-28T13:50:23.533778+0000","last_peered":"2024-03-28T13:50:23.533778+0000","last_clean":"2024-03-28T13:50:23.533778+0000","last_became_active":"2024-03-28T12:42:01.936999+0000","last_became_peered":"2024-03-28T12:42:01.936999+0000","last_unstale":"2024-03-28T13:50:23.533778+0000","last_undegraded":"2024-03-28T13:50:23.533778+0000","last_fullsized":"2024-03-28T13:50:23.533778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:35:01.960186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'206","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.535427+0000","last_change":"2024-03-28T12:42:01.961991+0000","last_active":"2024-03-28T13:50:23.535427+0000","last_peered":"2024-03-28T13:50:23.535427+0000","last_clean":"2024-03-28T13:50:23.535427+0000","last_became_active":"2024-03-28T12:42:01.961694+0000","last_became_peered":"2024-03-28T12:42:01.961694+0000","last_unstale":"2024-03-28T13:50:23.535427+0000","last_undegraded":"2024-03-28T13:50:23.535427+0000","last_fullsized":"2024-03-28T13:50:23.535427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:12:20.857443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'210","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.508681+0000","last_change":"2024-03-28T12:42:01.966943+0000","last_active":"2024-03-28T13:50:23.508681+0000","last_peered":"2024-03-28T13:50:23.508681+0000","last_clean":"2024-03-28T13:50:23.508681+0000","last_became_active":"2024-03-28T12:42:01.966629+0000","last_became_peered":"2024-03-28T12:42:01.966629+0000","last_unstale":"2024-03-28T13:50:23.508681+0000","last_undegraded":"2024-03-28T13:50:23.508681+0000","last_fullsized":"2024-03-28T13:50:23.508681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'184","reported_seq":237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.547262+0000","last_change":"2024-03-28T12:42:01.934727+0000","last_active":"2024-03-28T13:50:14.547262+0000","last_peered":"2024-03-28T13:50:14.547262+0000","last_clean":"2024-03-28T13:50:14.547262+0000","last_became_active":"2024-03-28T12:42:01.934130+0000","last_became_peered":"2024-03-28T12:42:01.934130+0000","last_unstale":"2024-03-28T13:50:14.547262+0000","last_undegraded":"2024-03-28T13:50:14.547262+0000","last_fullsized":"2024-03-28T13:50:14.547262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:20:32.024373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'209","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.529985+0000","last_change":"2024-03-28T12:42:01.940164+0000","last_active":"2024-03-28T13:50:23.529985+0000","last_peered":"2024-03-28T13:50:23.529985+0000","last_clean":"2024-03-28T13:50:23.529985+0000","last_became_active":"2024-03-28T12:42:01.939962+0000","last_became_peered":"2024-03-28T12:42:01.939962+0000","last_unstale":"2024-03-28T13:50:23.529985+0000","last_undegraded":"2024-03-28T13:50:23.529985+0000","last_fullsized":"2024-03-28T13:50:23.529985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:31:15.643101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'195","reported_seq":247,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.582139+0000","last_change":"2024-03-28T12:42:01.968043+0000","last_active":"2024-03-28T13:50:23.582139+0000","last_peered":"2024-03-28T13:50:23.582139+0000","last_clean":"2024-03-28T13:50:23.582139+0000","last_became_active":"2024-03-28T12:42:01.964888+0000","last_became_peered":"2024-03-28T12:42:01.964888+0000","last_unstale":"2024-03-28T13:50:23.582139+0000","last_undegraded":"2024-03-28T13:50:23.582139+0000","last_fullsized":"2024-03-28T13:50:23.582139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'209","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.533301+0000","last_change":"2024-03-28T12:42:01.939665+0000","last_active":"2024-03-28T13:50:23.533301+0000","last_peered":"2024-03-28T13:50:23.533301+0000","last_clean":"2024-03-28T13:50:23.533301+0000","last_became_active":"2024-03-28T12:42:01.939448+0000","last_became_peered":"2024-03-28T12:42:01.939448+0000","last_unstale":"2024-03-28T13:50:23.533301+0000","last_undegraded":"2024-03-28T13:50:23.533301+0000","last_fullsized":"2024-03-28T13:50:23.533301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:39.483160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'196","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.582422+0000","last_change":"2024-03-28T12:42:01.961147+0000","last_active":"2024-03-28T13:50:23.582422+0000","last_peered":"2024-03-28T13:50:23.582422+0000","last_clean":"2024-03-28T13:50:23.582422+0000","last_became_active":"2024-03-28T12:42:01.960511+0000","last_became_peered":"2024-03-28T12:42:01.960511+0000","last_unstale":"2024-03-28T13:50:23.582422+0000","last_undegraded":"2024-03-28T13:50:23.582422+0000","last_fullsized":"2024-03-28T13:50:23.582422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'190","reported_seq":248,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:48.956383+0000","last_change":"2024-03-28T12:42:01.809029+0000","last_active":"2024-03-28T13:49:48.956383+0000","last_peered":"2024-03-28T13:49:48.956383+0000","last_clean":"2024-03-28T13:49:48.956383+0000","last_became_active":"2024-03-28T12:42:01.805168+0000","last_became_peered":"2024-03-28T12:42:01.805168+0000","last_unstale":"2024-03-28T13:49:48.956383+0000","last_undegraded":"2024-03-28T13:49:48.956383+0000","last_fullsized":"2024-03-28T13:49:48.956383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:00:10.281819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'211","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.250522+0000","last_change":"2024-03-28T12:42:01.809169+0000","last_active":"2024-03-28T13:50:04.250522+0000","last_peered":"2024-03-28T13:50:04.250522+0000","last_clean":"2024-03-28T13:50:04.250522+0000","last_became_active":"2024-03-28T12:42:01.805382+0000","last_became_peered":"2024-03-28T12:42:01.805382+0000","last_unstale":"2024-03-28T13:50:04.250522+0000","last_undegraded":"2024-03-28T13:50:04.250522+0000","last_fullsized":"2024-03-28T13:50:04.250522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:26:32.791857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'212","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.534175+0000","last_change":"2024-03-28T12:42:01.938613+0000","last_active":"2024-03-28T13:50:23.534175+0000","last_peered":"2024-03-28T13:50:23.534175+0000","last_clean":"2024-03-28T13:50:23.534175+0000","last_became_active":"2024-03-28T12:42:01.938408+0000","last_became_peered":"2024-03-28T12:42:01.938408+0000","last_unstale":"2024-03-28T13:50:23.534175+0000","last_undegraded":"2024-03-28T13:50:23.534175+0000","last_fullsized":"2024-03-28T13:50:23.534175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:36:57.708839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1106,"num_read_kb":3440531,"num_write":24390,"num_write_kb":4237056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25020,"ondisk_log_size":25020,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13087,"ondisk_log_size":13087,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":189202275,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":1437,"num_read_kb":2622,"num_write":24285,"num_write_kb":197884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":164986880,"data_stored":378403742,"data_compressed":51376166,"data_compressed_allocated":66838528,"data_compressed_original":280502272,"omap_allocated":0,"internal_metadata":0},"log_size":21571,"ondisk_log_size":21571,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66494,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510272,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99252,"kb_used_data":9836,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94272588,"statfs":{"total":96636764160,"available":96535130112,"internally_reserved":0,"allocated":10072064,"data_stored":26859525,"data_compressed":3937950,"data_compressed_allocated":4919296,"data_compressed_original":21925888,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510272,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85192,"kb_used_data":13760,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94286648,"statfs":{"total":96636764160,"available":96549527552,"internally_reserved":0,"allocated":14090240,"data_stored":32567668,"data_compressed":4547476,"data_compressed_allocated":5951488,"data_compressed_original":24629248,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510272,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127140,"kb_used_data":19676,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94244700,"statfs":{"total":96636764160,"available":96506572800,"internally_reserved":0,"allocated":20148224,"data_stored":50460553,"data_compressed":7401383,"data_compressed_allocated":9674752,"data_compressed_original":40218624,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510271,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76200,"kb_used_data":13088,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94295640,"statfs":{"total":96636764160,"available":96558735360,"internally_reserved":0,"allocated":13402112,"data_stored":33681567,"data_compressed":4660285,"data_compressed_allocated":6107136,"data_compressed_original":26583040,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510271,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120852,"kb_used_data":21708,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94250988,"statfs":{"total":96636764160,"available":96513011712,"internally_reserved":0,"allocated":22228992,"data_stored":38466913,"data_compressed":4150831,"data_compressed_allocated":5660672,"data_compressed_original":22102016,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510273,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140836,"kb_used_data":29212,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94231004,"statfs":{"total":96636764160,"available":96492548096,"internally_reserved":0,"allocated":29913088,"data_stored":67238591,"data_compressed":8806079,"data_compressed_allocated":11505664,"data_compressed_original":49045504,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542977,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":155132,"kb_used_data":33780,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94216708,"statfs":{"total":96636764160,"available":96477908992,"internally_reserved":0,"allocated":34590720,"data_stored":84015705,"data_compressed":11869280,"data_compressed_allocated":15233024,"data_compressed_original":64880640,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575680,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125892,"kb_used_data":22588,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94245948,"statfs":{"total":96636764160,"available":96507850752,"internally_reserved":0,"allocated":23130112,"data_stored":47304441,"data_compressed":6069376,"data_compressed_allocated":7876608,"data_compressed_original":32264192,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29605888,"data_stored":67112196,"data_compressed":8806079,"data_compressed_allocated":11505664,"data_compressed_original":49045504,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21856256,"data_stored":37750150,"data_compressed":4117584,"data_compressed_allocated":5615616,"data_compressed_original":21528576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13094912,"data_stored":33555172,"data_compressed":4660285,"data_compressed_allocated":6107136,"data_compressed_original":26583040,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34283520,"data_stored":83889310,"data_compressed":11869280,"data_compressed_allocated":15233024,"data_compressed_original":64880640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19841024,"data_stored":50334158,"data_compressed":7401383,"data_compressed_allocated":9674752,"data_compressed_original":40218624,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22757376,"data_stored":46587678,"data_compressed":6036129,"data_compressed_allocated":7831552,"data_compressed_original":31690752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13783040,"data_stored":32441948,"data_compressed":4547476,"data_compressed_allocated":5951488,"data_compressed_original":24629248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9764864,"data_stored":26733130,"data_compressed":3937950,"data_compressed_allocated":4919296,"data_compressed_original":21925888,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T13:50:26.250 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T13:50:26.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.434+0000 7f0d97400640 1 Processor -- start 2024-03-28T13:50:26.437 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.438+0000 7f0d97400640 1 -- start start 2024-03-28T13:50:26.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.438+0000 7f0d97400640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0d900cd200 0x7f0d9015b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:26.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.438+0000 7f0d97400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f0d90070340 0x7f0d900c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:26.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.438+0000 7f0d97400640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d9006e9e0 con 0x7f0d900cd5e0 2024-03-28T13:50:26.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.438+0000 7f0d97400640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f0d9006e790 con 0x7f0d90070340 2024-03-28T13:50:26.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.438+0000 7f0d97400640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f0d9006ecc0 con 0x7f0d900cd200 2024-03-28T13:50:26.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.438+0000 7f0d94a00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0d900cd200 0x7f0d9015b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:26.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.438+0000 7f0d94a00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0d900cd200 0x7f0d9015b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:56298/0 (socket says 172.21.15.76:56298) 2024-03-28T13:50:26.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.438+0000 7f0d94a00640 1 -- 172.21.15.76:0/3238211268 learned_addr learned my addr 172.21.15.76:0/3238211268 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:26.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.442+0000 7f0d94a00640 1 -- 172.21.15.76:0/3238211268 >> v2:172.21.15.76:3300/0 conn(0x7f0d90070340 msgr2=0x7f0d900c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:26.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.442+0000 7f0d94a00640 1 --2- 172.21.15.76:0/3238211268 >> v2:172.21.15.76:3300/0 conn(0x7f0d90070340 0x7f0d900c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:26.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.442+0000 7f0d94a00640 1 -- 172.21.15.76:0/3238211268 >> v1:172.21.15.76:6789/0 conn(0x7f0d900cd5e0 legacy=0x7f0d90157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:26.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.442+0000 7f0d94a00640 1 -- 172.21.15.76:0/3238211268 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9006efa0 con 0x7f0d900cd200 2024-03-28T13:50:26.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.446+0000 7f0d94a00640 1 --2- 172.21.15.76:0/3238211268 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d900cd200 0x7f0d9015b310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0d9006bc80 tx=0x7f0d8401c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2d9cda087314621 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:26.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.454+0000 7f0d8f400640 1 -- 172.21.15.76:0/3238211268 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d840ab5f0 con 0x7f0d900cd200 2024-03-28T13:50:26.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.454+0000 7f0d8f400640 1 -- 172.21.15.76:0/3238211268 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d840b0070 con 0x7f0d900cd200 2024-03-28T13:50:26.454 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.454+0000 7f0d8f400640 1 -- 172.21.15.76:0/3238211268 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d840ab9b0 con 0x7f0d900cd200 2024-03-28T13:50:26.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.454+0000 7f0d97400640 1 -- 172.21.15.76:0/3238211268 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d900cd200 msgr2=0x7f0d9015b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:26.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.454+0000 7f0d97400640 1 --2- 172.21.15.76:0/3238211268 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d900cd200 0x7f0d9015b310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0d9006bc80 tx=0x7f0d8401c4e0 comp rx=0 tx=0).stop 2024-03-28T13:50:26.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.454+0000 7f0d97400640 1 -- 172.21.15.76:0/3238211268 shutdown_connections 2024-03-28T13:50:26.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.454+0000 7f0d97400640 1 --2- 172.21.15.76:0/3238211268 >> v2:172.21.15.76:3300/0 conn(0x7f0d90070340 0x7f0d900c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:26.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.454+0000 7f0d97400640 1 --2- 172.21.15.76:0/3238211268 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d900cd200 0x7f0d9015b310 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:26.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.454+0000 7f0d97400640 1 -- 172.21.15.76:0/3238211268 >> 172.21.15.76:0/3238211268 conn(0x7f0d9006c6b0 msgr2=0x7f0d9006cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:26.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.454+0000 7f0d97400640 1 -- 172.21.15.76:0/3238211268 shutdown_connections 2024-03-28T13:50:26.455 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.454+0000 7f0d97400640 1 -- 172.21.15.76:0/3238211268 wait complete. 2024-03-28T13:50:26.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.454+0000 7f0d97400640 1 Processor -- start 2024-03-28T13:50:26.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.454+0000 7f0d97400640 1 -- start start 2024-03-28T13:50:26.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.458+0000 7f0d97400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0d90070340 0x7f0d9014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:26.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.458+0000 7f0d97400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d900cd200 0x7f0d90154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:26.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.458+0000 7f0d97400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d900cd5e0 0x7f0d901545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:26.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.458+0000 7f0d97400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9006c380 con 0x7f0d900cd5e0 2024-03-28T13:50:26.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.458+0000 7f0d97400640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0d900ca6b0 con 0x7f0d900cd200 2024-03-28T13:50:26.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.458+0000 7f0d97400640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9006c500 con 0x7f0d90070340 2024-03-28T13:50:26.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.458+0000 7f0d8fe00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d900cd200 0x7f0d90154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:26.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.458+0000 7f0d94a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0d90070340 0x7f0d9014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:26.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.458+0000 7f0d8fe00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d900cd200 0x7f0d90154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:56304/0 (socket says 172.21.15.76:56304) 2024-03-28T13:50:26.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.458+0000 7f0d8fe00640 1 -- 172.21.15.76:0/865525967 learned_addr learned my addr 172.21.15.76:0/865525967 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:26.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.462+0000 7f0d8fe00640 1 -- 172.21.15.76:0/865525967 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0d90070340 msgr2=0x7f0d9014fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:26.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.462+0000 7f0d8fe00640 1 --2- 172.21.15.76:0/865525967 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0d90070340 0x7f0d9014fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:26.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.462+0000 7f0d8fe00640 1 -- 172.21.15.76:0/865525967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d900cd5e0 msgr2=0x7f0d901545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:26.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.462+0000 7f0d8fe00640 1 --2- 172.21.15.76:0/865525967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d900cd5e0 0x7f0d901545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:26.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.462+0000 7f0d8fe00640 1 -- 172.21.15.76:0/865525967 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9015ab30 con 0x7f0d900cd200 2024-03-28T13:50:26.467 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.466+0000 7f0d8fe00640 1 --2- 172.21.15.76:0/865525967 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d900cd200 0x7f0d90154070 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00b3e0 tx=0x7f0d7c00b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:26.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.474+0000 7f0d8cc00640 1 -- 172.21.15.76:0/865525967 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c015020 con 0x7f0d900cd200 2024-03-28T13:50:26.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.474+0000 7f0d8cc00640 1 -- 172.21.15.76:0/865525967 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d7c011850 con 0x7f0d900cd200 2024-03-28T13:50:26.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.474+0000 7f0d8cc00640 1 -- 172.21.15.76:0/865525967 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c011c40 con 0x7f0d900cd200 2024-03-28T13:50:26.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.474+0000 7f0d97400640 1 -- 172.21.15.76:0/865525967 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9015add0 con 0x7f0d900cd200 2024-03-28T13:50:26.475 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.474+0000 7f0d97400640 1 -- 172.21.15.76:0/865525967 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d90153570 con 0x7f0d900cd200 2024-03-28T13:50:26.476 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.474+0000 7f0d97400640 1 -- 172.21.15.76:0/865525967 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d9006d640 con 0x7f0d900cd200 2024-03-28T13:50:26.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.518+0000 7f0d8cc00640 1 -- 172.21.15.76:0/865525967 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f0d7c018020 con 0x7f0d900cd200 2024-03-28T13:50:26.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.518+0000 7f0d8cc00640 1 --2- 172.21.15.76:0/865525967 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0d70068010 0x7f0d7006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:26.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.518+0000 7f0d94a00640 1 --2- 172.21.15.76:0/865525967 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0d70068010 0x7f0d7006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:26.521 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.522+0000 7f0d94a00640 1 --2- 172.21.15.76:0/865525967 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0d70068010 0x7f0d7006a4d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0d840af000 tx=0x7f0d840a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:26.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.522+0000 7f0d8cc00640 1 -- 172.21.15.76:0/865525967 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f0d7c011de0 con 0x7f0d900cd200 2024-03-28T13:50:26.826 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:26.826+0000 7f0d8cc00640 1 -- 172.21.15.76:0/865525967 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f0d7c01f020 con 0x7f0d900cd200 2024-03-28T13:50:27.028 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:27.026+0000 7f0d97400640 1 -- 172.21.15.76:0/865525967 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d900686e0 con 0x7f0d900cd200 2024-03-28T13:50:27.109 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:27.110+0000 7f0d8cc00640 1 -- 172.21.15.76:0/865525967 <== mon.1 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18798 (secure 0 0 0) 0x7f0d7c057190 con 0x7f0d900cd200 2024-03-28T13:50:27.110 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T13:50:27.110 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":29,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:42:15.156639+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T12:41:58.010965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T12:41:59.698601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-28T12:42:05.363180+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.1","mappings":[{"from":3,"to":4}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]},{"pgid":"4.d","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":5}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T13:50:27.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:27.114+0000 7f0d97400640 1 -- 172.21.15.76:0/865525967 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0d70068010 msgr2=0x7f0d7006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:27.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:27.114+0000 7f0d97400640 1 --2- 172.21.15.76:0/865525967 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0d70068010 0x7f0d7006a4d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0d840af000 tx=0x7f0d840a7000 comp rx=0 tx=0).stop 2024-03-28T13:50:27.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:27.114+0000 7f0d97400640 1 -- 172.21.15.76:0/865525967 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d900cd200 msgr2=0x7f0d90154070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:27.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:27.114+0000 7f0d97400640 1 --2- 172.21.15.76:0/865525967 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d900cd200 0x7f0d90154070 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c00b3e0 tx=0x7f0d7c00b8a0 comp rx=0 tx=0).stop 2024-03-28T13:50:27.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:27.114+0000 7f0d97400640 1 -- 172.21.15.76:0/865525967 shutdown_connections 2024-03-28T13:50:27.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:27.114+0000 7f0d97400640 1 --2- 172.21.15.76:0/865525967 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0d70068010 0x7f0d7006a4d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:27.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:27.114+0000 7f0d97400640 1 --2- 172.21.15.76:0/865525967 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0d900cd5e0 0x7f0d901545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:27.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:27.114+0000 7f0d97400640 1 --2- 172.21.15.76:0/865525967 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d900cd200 0x7f0d90154070 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:27.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:27.114+0000 7f0d97400640 1 --2- 172.21.15.76:0/865525967 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0d90070340 0x7f0d9014fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:27.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:27.114+0000 7f0d97400640 1 -- 172.21.15.76:0/865525967 >> 172.21.15.76:0/865525967 conn(0x7f0d9006c6b0 msgr2=0x7f0d900c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:27.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:27.114+0000 7f0d97400640 1 -- 172.21.15.76:0/865525967 shutdown_connections 2024-03-28T13:50:27.114 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:27.114+0000 7f0d97400640 1 -- 172.21.15.76:0/865525967 wait complete. 2024-03-28T13:50:28.134 INFO:tasks.ceph:Scrubbing osd.0 2024-03-28T13:50:28.135 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-28T13:50:28.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.298+0000 7f0bdda00640 1 Processor -- start 2024-03-28T13:50:28.301 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.298+0000 7f0bdda00640 1 -- start start 2024-03-28T13:50:28.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.302+0000 7f0bdda00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0bd81549f0 0x7f0bd80c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:28.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.302+0000 7f0bdda00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f0bd80cdeb0 0x7f0bd80ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:28.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.302+0000 7f0bdda00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bd815a7d0 con 0x7f0bd806c940 2024-03-28T13:50:28.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.302+0000 7f0bdda00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f0bd80c90d0 con 0x7f0bd80cdeb0 2024-03-28T13:50:28.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.302+0000 7f0bdda00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f0bd815aa90 con 0x7f0bd81549f0 2024-03-28T13:50:28.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.302+0000 7f0bdd000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f0bd80cdeb0 0x7f0bd80ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:28.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.302+0000 7f0bd7e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0bd81549f0 0x7f0bd80c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:28.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.302+0000 7f0bd7400640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f0bd806c940 0x7f0bd806ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:38598/0 (socket says 172.21.15.76:38598) 2024-03-28T13:50:28.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.302+0000 7f0bd7400640 1 -- 172.21.15.76:0/2552466918 learned_addr learned my addr 172.21.15.76:0/2552466918 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:50:28.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.306+0000 7f0bdd000640 1 -- 172.21.15.76:0/2552466918 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0bd81549f0 msgr2=0x7f0bd80c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:28.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.306+0000 7f0bdd000640 1 --2- 172.21.15.76:0/2552466918 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0bd81549f0 0x7f0bd80c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:28.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.306+0000 7f0bdd000640 1 -- 172.21.15.76:0/2552466918 >> v1:172.21.15.76:6789/0 conn(0x7f0bd806c940 legacy=0x7f0bd806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:28.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.306+0000 7f0bdd000640 1 -- 172.21.15.76:0/2552466918 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd815ad70 con 0x7f0bd80cdeb0 2024-03-28T13:50:28.314 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.314+0000 7f0bdd000640 1 --2- 172.21.15.76:0/2552466918 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0bd80cdeb0 0x7f0bd80ce300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009d90 tx=0x7f0bd001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830158f38eeaa2cf server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:28.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.318+0000 7f0bd6a00640 1 -- 172.21.15.76:0/2552466918 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00b2070 con 0x7f0bd80cdeb0 2024-03-28T13:50:28.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.318+0000 7f0bd6a00640 1 -- 172.21.15.76:0/2552466918 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd00a5920 con 0x7f0bd80cdeb0 2024-03-28T13:50:28.319 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.318+0000 7f0bd6a00640 1 -- 172.21.15.76:0/2552466918 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd00a5cf0 con 0x7f0bd80cdeb0 2024-03-28T13:50:28.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.318+0000 7f0bdda00640 1 -- 172.21.15.76:0/2552466918 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0bd80cdeb0 msgr2=0x7f0bd80ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:28.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.318+0000 7f0bdda00640 1 --2- 172.21.15.76:0/2552466918 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0bd80cdeb0 0x7f0bd80ce300 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009d90 tx=0x7f0bd001c970 comp rx=0 tx=0).stop 2024-03-28T13:50:28.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.318+0000 7f0bdda00640 1 -- 172.21.15.76:0/2552466918 shutdown_connections 2024-03-28T13:50:28.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.318+0000 7f0bdda00640 1 --2- 172.21.15.76:0/2552466918 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0bd80cdeb0 0x7f0bd80ce300 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:28.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.318+0000 7f0bdda00640 1 --2- 172.21.15.76:0/2552466918 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0bd81549f0 0x7f0bd80c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:28.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.318+0000 7f0bdda00640 1 -- 172.21.15.76:0/2552466918 >> 172.21.15.76:0/2552466918 conn(0x7f0bd8067330 msgr2=0x7f0bd8067740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:28.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.318+0000 7f0bdda00640 1 -- 172.21.15.76:0/2552466918 shutdown_connections 2024-03-28T13:50:28.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.318+0000 7f0bdda00640 1 -- 172.21.15.76:0/2552466918 wait complete. 2024-03-28T13:50:28.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.322+0000 7f0bdda00640 1 Processor -- start 2024-03-28T13:50:28.322 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.322+0000 7f0bdda00640 1 -- start start 2024-03-28T13:50:28.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.322+0000 7f0bdda00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0bd806c940 0x7f0bd81f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:28.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.322+0000 7f0bdda00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0bd80cdeb0 0x7f0bd81ec680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:28.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.322+0000 7f0bdda00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0bd81549f0 0x7f0bd81534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:28.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.322+0000 7f0bdda00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd8154f50 con 0x7f0bd80cdeb0 2024-03-28T13:50:28.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.322+0000 7f0bdda00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd8154dd0 con 0x7f0bd806c940 2024-03-28T13:50:28.323 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.322+0000 7f0bdda00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f0bd80c8cb0 con 0x7f0bd81549f0 2024-03-28T13:50:28.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.322+0000 7f0bd7400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0bd80cdeb0 0x7f0bd81ec680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:28.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.322+0000 7f0bd7400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0bd80cdeb0 0x7f0bd81ec680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52978/0 (socket says 172.21.15.76:52978) 2024-03-28T13:50:28.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.322+0000 7f0bdd000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0bd81549f0 0x7f0bd81534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:28.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.322+0000 7f0bd7400640 1 -- 172.21.15.76:0/3652305963 learned_addr learned my addr 172.21.15.76:0/3652305963 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:28.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.322+0000 7f0bd7e00640 1 --2- 172.21.15.76:0/3652305963 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0bd806c940 0x7f0bd81f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:28.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.326+0000 7f0bd7400640 1 -- 172.21.15.76:0/3652305963 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0bd81549f0 msgr2=0x7f0bd81534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:28.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.326+0000 7f0bd7400640 1 --2- 172.21.15.76:0/3652305963 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0bd81549f0 0x7f0bd81534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:28.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.326+0000 7f0bd7400640 1 -- 172.21.15.76:0/3652305963 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0bd806c940 msgr2=0x7f0bd81f3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:28.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.326+0000 7f0bd7400640 1 --2- 172.21.15.76:0/3652305963 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0bd806c940 0x7f0bd81f3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:28.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.326+0000 7f0bd7400640 1 -- 172.21.15.76:0/3652305963 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd814e0d0 con 0x7f0bd80cdeb0 2024-03-28T13:50:28.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.330+0000 7f0bd7400640 1 --2- 172.21.15.76:0/3652305963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0bd80cdeb0 0x7f0bd81ec680 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400c3a0 tx=0x7f0bc400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:28.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.334+0000 7f0bcfe00640 1 -- 172.21.15.76:0/3652305963 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4017070 con 0x7f0bd80cdeb0 2024-03-28T13:50:28.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.334+0000 7f0bdda00640 1 -- 172.21.15.76:0/3652305963 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd81f3120 con 0x7f0bd80cdeb0 2024-03-28T13:50:28.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.334+0000 7f0bdda00640 1 -- 172.21.15.76:0/3652305963 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd814e650 con 0x7f0bd80cdeb0 2024-03-28T13:50:28.335 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.334+0000 7f0bdda00640 1 -- 172.21.15.76:0/3652305963 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0bd81f37a0 con 0x7f0bd80cdeb0 2024-03-28T13:50:28.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.334+0000 7f0bcfe00640 1 -- 172.21.15.76:0/3652305963 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bd81f37a0 con 0x7f0bd80cdeb0 2024-03-28T13:50:28.336 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.334+0000 7f0bcfe00640 1 -- 172.21.15.76:0/3652305963 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4021060 con 0x7f0bd80cdeb0 2024-03-28T13:50:28.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.374+0000 7f0bcfe00640 1 -- 172.21.15.76:0/3652305963 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f0bc401a070 con 0x7f0bd80cdeb0 2024-03-28T13:50:28.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.374+0000 7f0bcfe00640 1 --2- 172.21.15.76:0/3652305963 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0bb8067ff0 0x7f0bb806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:28.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.374+0000 7f0bd7e00640 1 --2- 172.21.15.76:0/3652305963 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0bb8067ff0 0x7f0bb806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:28.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.374+0000 7f0bd7e00640 1 --2- 172.21.15.76:0/3652305963 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0bb8067ff0 0x7f0bb806a4b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009b60 tx=0x7f0bc8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:28.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.378+0000 7f0bcfe00640 1 -- 172.21.15.76:0/3652305963 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f0bc4054380 con 0x7f0bd80cdeb0 2024-03-28T13:50:28.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.378+0000 7f0bcfe00640 1 --2- 172.21.15.76:0/3652305963 >> [v2:172.21.15.76:6818/1923047176,v1:172.21.15.76:6819/1923047176] conn(0x7f0bb8071880 0x7f0bb8073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:28.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.378+0000 7f0bcfe00640 1 -- 172.21.15.76:0/3652305963 --> [v2:172.21.15.76:6818/1923047176,v1:172.21.15.76:6819/1923047176] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0bc4008ea0 con 0x7f0bb8071880 2024-03-28T13:50:28.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.378+0000 7f0bcfe00640 1 -- 172.21.15.76:0/3652305963 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0bc4052580 con 0x7f0bd80cdeb0 2024-03-28T13:50:28.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.382+0000 7f0bdd000640 1 --2- 172.21.15.76:0/3652305963 >> [v2:172.21.15.76:6818/1923047176,v1:172.21.15.76:6819/1923047176] conn(0x7f0bb8071880 0x7f0bb8073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:28.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.382+0000 7f0bdd000640 1 --2- 172.21.15.76:0/3652305963 >> [v2:172.21.15.76:6818/1923047176,v1:172.21.15.76:6819/1923047176] conn(0x7f0bb8071880 0x7f0bb8073d20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:28.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.382+0000 7f0bcfe00640 1 -- 172.21.15.76:0/3652305963 <== osd.0 v2:172.21.15.76:6818/1923047176 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0bc4008ea0 con 0x7f0bb8071880 2024-03-28T13:50:28.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.410+0000 7f0bdda00640 1 -- 172.21.15.76:0/3652305963 --> [v2:172.21.15.76:6818/1923047176,v1:172.21.15.76:6819/1923047176] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0bd80686e0 con 0x7f0bb8071880 2024-03-28T13:50:28.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.410+0000 7f0bcfe00640 1 -- 172.21.15.76:0/3652305963 <== osd.0 v2:172.21.15.76:6818/1923047176 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0bd80686e0 con 0x7f0bb8071880 2024-03-28T13:50:28.411 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-03-28T13:50:28.411 INFO:teuthology.orchestra.run.smithi076.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-28T13:50:28.411 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-03-28T13:50:28.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.410+0000 7f0bdda00640 1 -- 172.21.15.76:0/3652305963 >> [v2:172.21.15.76:6818/1923047176,v1:172.21.15.76:6819/1923047176] conn(0x7f0bb8071880 msgr2=0x7f0bb8073d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:28.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.410+0000 7f0bdda00640 1 --2- 172.21.15.76:0/3652305963 >> [v2:172.21.15.76:6818/1923047176,v1:172.21.15.76:6819/1923047176] conn(0x7f0bb8071880 0x7f0bb8073d20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:28.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.410+0000 7f0bdda00640 1 -- 172.21.15.76:0/3652305963 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0bb8067ff0 msgr2=0x7f0bb806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:28.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.410+0000 7f0bdda00640 1 --2- 172.21.15.76:0/3652305963 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0bb8067ff0 0x7f0bb806a4b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009b60 tx=0x7f0bc8009190 comp rx=0 tx=0).stop 2024-03-28T13:50:28.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.410+0000 7f0bdda00640 1 -- 172.21.15.76:0/3652305963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0bd80cdeb0 msgr2=0x7f0bd81ec680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:28.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.410+0000 7f0bdda00640 1 --2- 172.21.15.76:0/3652305963 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0bd80cdeb0 0x7f0bd81ec680 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400c3a0 tx=0x7f0bc400c860 comp rx=0 tx=0).stop 2024-03-28T13:50:28.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.410+0000 7f0bdd000640 1 -- 172.21.15.76:0/3652305963 reap_dead start 2024-03-28T13:50:28.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.410+0000 7f0bdda00640 1 -- 172.21.15.76:0/3652305963 shutdown_connections 2024-03-28T13:50:28.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.410+0000 7f0bdda00640 1 -- 172.21.15.76:0/3652305963 >> 172.21.15.76:0/3652305963 conn(0x7f0bd8067330 msgr2=0x7f0bd80c9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:28.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.410+0000 7f0bdda00640 1 -- 172.21.15.76:0/3652305963 shutdown_connections 2024-03-28T13:50:28.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.410+0000 7f0bdda00640 1 -- 172.21.15.76:0/3652305963 wait complete. 2024-03-28T13:50:28.434 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-28T13:50:28.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.586+0000 7fa7e0a00640 1 Processor -- start 2024-03-28T13:50:28.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.586+0000 7fa7e0a00640 1 -- start start 2024-03-28T13:50:28.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.586+0000 7fa7e0a00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fa7dc06ef50 0x7fa7dc15a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:28.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.586+0000 7fa7e0a00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7dc15b5b0 con 0x7fa7dc154af0 2024-03-28T13:50:28.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.586+0000 7fa7e0a00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7dc15ad10 con 0x7fa7dc0703c0 2024-03-28T13:50:28.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.586+0000 7fa7e0a00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fa7dc0c9e90 con 0x7fa7dc06ef50 2024-03-28T13:50:28.588 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.586+0000 7fa7db200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fa7dc06ef50 0x7fa7dc15a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:28.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.590+0000 7fa7da800640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fa7dc154af0 0x7fa7dc0ca320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:38602/0 (socket says 172.21.15.76:38602) 2024-03-28T13:50:28.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.590+0000 7fa7da800640 1 -- 172.21.15.76:0/1194921584 learned_addr learned my addr 172.21.15.76:0/1194921584 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:50:28.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.594+0000 7fa7db200640 1 -- 172.21.15.76:0/1194921584 >> v1:172.21.15.111:6789/0 conn(0x7fa7dc0703c0 legacy=0x7fa7dc0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:28.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.594+0000 7fa7db200640 1 -- 172.21.15.76:0/1194921584 >> v1:172.21.15.76:6789/0 conn(0x7fa7dc154af0 legacy=0x7fa7dc0ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:28.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.594+0000 7fa7db200640 1 -- 172.21.15.76:0/1194921584 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7dc15aff0 con 0x7fa7dc06ef50 2024-03-28T13:50:28.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.598+0000 7fa7db200640 1 --2- 172.21.15.76:0/1194921584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7dc06ef50 0x7fa7dc15a5f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009d90 tx=0x7fa7d401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77652e40c9ec6481 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:28.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.602+0000 7fa7d9400640 1 -- 172.21.15.76:0/1194921584 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d40b2070 con 0x7fa7dc06ef50 2024-03-28T13:50:28.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.602+0000 7fa7d9400640 1 -- 172.21.15.76:0/1194921584 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7d40a57f0 con 0x7fa7dc06ef50 2024-03-28T13:50:28.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.602+0000 7fa7d9400640 1 -- 172.21.15.76:0/1194921584 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d40a5bc0 con 0x7fa7dc06ef50 2024-03-28T13:50:28.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.602+0000 7fa7e0a00640 1 -- 172.21.15.76:0/1194921584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7dc06ef50 msgr2=0x7fa7dc15a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:28.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.602+0000 7fa7e0a00640 1 --2- 172.21.15.76:0/1194921584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7dc06ef50 0x7fa7dc15a5f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa7d4009d90 tx=0x7fa7d401c930 comp rx=0 tx=0).stop 2024-03-28T13:50:28.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.606+0000 7fa7e0a00640 1 -- 172.21.15.76:0/1194921584 shutdown_connections 2024-03-28T13:50:28.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.606+0000 7fa7e0a00640 1 --2- 172.21.15.76:0/1194921584 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7dc06ef50 0x7fa7dc15a5f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:28.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.606+0000 7fa7e0a00640 1 -- 172.21.15.76:0/1194921584 >> 172.21.15.76:0/1194921584 conn(0x7fa7dc073600 msgr2=0x7fa7dc070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:28.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.606+0000 7fa7e0a00640 1 -- 172.21.15.76:0/1194921584 shutdown_connections 2024-03-28T13:50:28.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.606+0000 7fa7e0a00640 1 -- 172.21.15.76:0/1194921584 wait complete. 2024-03-28T13:50:28.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.606+0000 7fa7e0a00640 1 Processor -- start 2024-03-28T13:50:28.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.606+0000 7fa7e0a00640 1 -- start start 2024-03-28T13:50:28.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.606+0000 7fa7e0a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7dc06ef50 0x7fa7dc150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:28.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.606+0000 7fa7e0a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7dc0703c0 0x7fa7dc1f7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:28.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.606+0000 7fa7e0a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7dc154af0 0x7fa7dc159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:28.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.606+0000 7fa7e0a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc0cd870 con 0x7fa7dc06ef50 2024-03-28T13:50:28.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.606+0000 7fa7e0a00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc0cd6f0 con 0x7fa7dc0703c0 2024-03-28T13:50:28.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.606+0000 7fa7e0a00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa7dc1687a0 con 0x7fa7dc154af0 2024-03-28T13:50:28.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.606+0000 7fa7da800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7dc06ef50 0x7fa7dc150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:28.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.610+0000 7fa7db200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7dc154af0 0x7fa7dc159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:28.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.610+0000 7fa7da800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7dc06ef50 0x7fa7dc150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:52996/0 (socket says 172.21.15.76:52996) 2024-03-28T13:50:28.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.610+0000 7fa7da800640 1 -- 172.21.15.76:0/353177139 learned_addr learned my addr 172.21.15.76:0/353177139 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:28.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.610+0000 7fa7da800640 1 -- 172.21.15.76:0/353177139 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7dc154af0 msgr2=0x7fa7dc159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:28.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.610+0000 7fa7da800640 1 --2- 172.21.15.76:0/353177139 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7dc154af0 0x7fa7dc159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:28.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.610+0000 7fa7da800640 1 -- 172.21.15.76:0/353177139 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7dc0703c0 msgr2=0x7fa7dc1f7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:28.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.610+0000 7fa7da800640 1 --2- 172.21.15.76:0/353177139 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7dc0703c0 0x7fa7dc1f7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:28.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.610+0000 7fa7da800640 1 -- 172.21.15.76:0/353177139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7dc151070 con 0x7fa7dc06ef50 2024-03-28T13:50:28.615 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.614+0000 7fa7da800640 1 --2- 172.21.15.76:0/353177139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7dc06ef50 0x7fa7dc150810 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00c3a0 tx=0x7fa7cc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:28.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.618+0000 7fa7d2a00640 1 -- 172.21.15.76:0/353177139 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc017070 con 0x7fa7dc06ef50 2024-03-28T13:50:28.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.618+0000 7fa7e0a00640 1 -- 172.21.15.76:0/353177139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7dc15e7f0 con 0x7fa7dc06ef50 2024-03-28T13:50:28.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.618+0000 7fa7e0a00640 1 -- 172.21.15.76:0/353177139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7dc14fdd0 con 0x7fa7dc06ef50 2024-03-28T13:50:28.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.618+0000 7fa7e0a00640 1 -- 172.21.15.76:0/353177139 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7dc0686e0 con 0x7fa7dc06ef50 2024-03-28T13:50:28.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.618+0000 7fa7d2a00640 1 -- 172.21.15.76:0/353177139 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7cc005cf0 con 0x7fa7dc06ef50 2024-03-28T13:50:28.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.618+0000 7fa7d2a00640 1 -- 172.21.15.76:0/353177139 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc021060 con 0x7fa7dc06ef50 2024-03-28T13:50:28.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.918+0000 7fa7d2a00640 1 -- 172.21.15.76:0/353177139 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fa7cc01a070 con 0x7fa7dc06ef50 2024-03-28T13:50:28.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.918+0000 7fa7d2a00640 1 --2- 172.21.15.76:0/353177139 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7bc067fc0 0x7fa7bc06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:28.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.918+0000 7fa7d9e00640 1 --2- 172.21.15.76:0/353177139 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7bc067fc0 0x7fa7bc06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:28.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.922+0000 7fa7d9e00640 1 --2- 172.21.15.76:0/353177139 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7bc067fc0 0x7fa7bc06a480 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8007fd0 tx=0x7fa7c80079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:28.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.934+0000 7fa7d2a00640 1 -- 172.21.15.76:0/353177139 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fa7cc0542b0 con 0x7fa7dc06ef50 2024-03-28T13:50:28.936 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:28.934+0000 7fa7d2a00640 1 -- 172.21.15.76:0/353177139 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fa7dc151070 con 0x7fa7dc06ef50 2024-03-28T13:50:29.176 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.174+0000 7fa7e0a00640 1 -- 172.21.15.76:0/353177139 --> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fa7dc06c490 con 0x7fa7bc067fc0 2024-03-28T13:50:29.177 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.178+0000 7fa7d2a00640 1 -- 172.21.15.76:0/353177139 <== mgr.4107 v2:172.21.15.76:6800/1313648511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa7dc06c490 con 0x7fa7bc067fc0 2024-03-28T13:50:29.177 INFO:teuthology.orchestra.run.smithi076.stderr:instructed osd(s) 0 to deep-scrub 2024-03-28T13:50:29.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.178+0000 7fa7e0a00640 1 -- 172.21.15.76:0/353177139 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7bc067fc0 msgr2=0x7fa7bc06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:29.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.178+0000 7fa7e0a00640 1 --2- 172.21.15.76:0/353177139 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7bc067fc0 0x7fa7bc06a480 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8007fd0 tx=0x7fa7c80079a0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.178+0000 7fa7e0a00640 1 -- 172.21.15.76:0/353177139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7dc06ef50 msgr2=0x7fa7dc150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:29.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.178+0000 7fa7e0a00640 1 --2- 172.21.15.76:0/353177139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7dc06ef50 0x7fa7dc150810 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00c3a0 tx=0x7fa7cc00c860 comp rx=0 tx=0).stop 2024-03-28T13:50:29.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.178+0000 7fa7e0a00640 1 -- 172.21.15.76:0/353177139 shutdown_connections 2024-03-28T13:50:29.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.178+0000 7fa7e0a00640 1 --2- 172.21.15.76:0/353177139 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fa7bc067fc0 0x7fa7bc06a480 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.178+0000 7fa7e0a00640 1 --2- 172.21.15.76:0/353177139 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa7dc154af0 0x7fa7dc159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.178+0000 7fa7e0a00640 1 --2- 172.21.15.76:0/353177139 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa7dc0703c0 0x7fa7dc1f7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.178+0000 7fa7e0a00640 1 --2- 172.21.15.76:0/353177139 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fa7dc06ef50 0x7fa7dc150810 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.178+0000 7fa7e0a00640 1 -- 172.21.15.76:0/353177139 >> 172.21.15.76:0/353177139 conn(0x7fa7dc073600 msgr2=0x7fa7dc0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:29.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.178+0000 7fa7e0a00640 1 -- 172.21.15.76:0/353177139 shutdown_connections 2024-03-28T13:50:29.180 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.178+0000 7fa7e0a00640 1 -- 172.21.15.76:0/353177139 wait complete. 2024-03-28T13:50:29.199 INFO:tasks.ceph:Scrubbing osd.1 2024-03-28T13:50:29.199 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-28T13:50:29.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.346+0000 7fb54aa00640 1 Processor -- start 2024-03-28T13:50:29.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.346+0000 7fb54aa00640 1 -- start start 2024-03-28T13:50:29.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.346+0000 7fb54aa00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fb54406c8b0 0x7fb54406ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:29.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.346+0000 7fb54aa00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb54406d340 0x7fb5440cde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:29.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.346+0000 7fb54aa00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb54415a740 con 0x7fb5441549d0 2024-03-28T13:50:29.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.346+0000 7fb54aa00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fb54415b780 con 0x7fb54406c8b0 2024-03-28T13:50:29.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.346+0000 7fb54aa00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fb5440c9180 con 0x7fb54406d340 2024-03-28T13:50:29.348 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.346+0000 7fb543400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fb54406c8b0 0x7fb54406ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:29.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.350+0000 7fb543400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fb54406c8b0 0x7fb54406ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53002/0 (socket says 172.21.15.76:53002) 2024-03-28T13:50:29.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.350+0000 7fb543400640 1 -- 172.21.15.76:0/834577280 learned_addr learned my addr 172.21.15.76:0/834577280 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:29.349 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.350+0000 7fb548a00640 1 --2- 172.21.15.76:0/834577280 >> v2:172.21.15.111:3300/0 conn(0x7fb54406d340 0x7fb5440cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:29.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.350+0000 7fb543400640 1 -- 172.21.15.76:0/834577280 >> v2:172.21.15.111:3300/0 conn(0x7fb54406d340 msgr2=0x7fb5440cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:29.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.350+0000 7fb543400640 1 --2- 172.21.15.76:0/834577280 >> v2:172.21.15.111:3300/0 conn(0x7fb54406d340 0x7fb5440cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.350+0000 7fb543400640 1 -- 172.21.15.76:0/834577280 >> v1:172.21.15.111:6789/0 conn(0x7fb5441549d0 legacy=0x7fb54415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:29.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.350+0000 7fb543400640 1 -- 172.21.15.76:0/834577280 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54415a9c0 con 0x7fb54406c8b0 2024-03-28T13:50:29.357 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.358+0000 7fb543400640 1 --2- 172.21.15.76:0/834577280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb54406c8b0 0x7fb54406ce00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb544071a00 tx=0x7fb53001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82dee4f9639becc2 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:29.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.362+0000 7fb542a00640 1 -- 172.21.15.76:0/834577280 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5300b5070 con 0x7fb54406c8b0 2024-03-28T13:50:29.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.362+0000 7fb542a00640 1 -- 172.21.15.76:0/834577280 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5300a8a10 con 0x7fb54406c8b0 2024-03-28T13:50:29.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.362+0000 7fb542a00640 1 -- 172.21.15.76:0/834577280 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5300a8de0 con 0x7fb54406c8b0 2024-03-28T13:50:29.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.362+0000 7fb54aa00640 1 -- 172.21.15.76:0/834577280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb54406c8b0 msgr2=0x7fb54406ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:29.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.362+0000 7fb54aa00640 1 --2- 172.21.15.76:0/834577280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb54406c8b0 0x7fb54406ce00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb544071a00 tx=0x7fb53001ed10 comp rx=0 tx=0).stop 2024-03-28T13:50:29.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.362+0000 7fb54aa00640 1 -- 172.21.15.76:0/834577280 shutdown_connections 2024-03-28T13:50:29.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.362+0000 7fb54aa00640 1 --2- 172.21.15.76:0/834577280 >> v2:172.21.15.111:3300/0 conn(0x7fb54406d340 0x7fb5440cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.362+0000 7fb54aa00640 1 --2- 172.21.15.76:0/834577280 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb54406c8b0 0x7fb54406ce00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.362+0000 7fb54aa00640 1 -- 172.21.15.76:0/834577280 >> 172.21.15.76:0/834577280 conn(0x7fb544067330 msgr2=0x7fb544067740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:29.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.362+0000 7fb54aa00640 1 -- 172.21.15.76:0/834577280 shutdown_connections 2024-03-28T13:50:29.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.362+0000 7fb54aa00640 1 -- 172.21.15.76:0/834577280 wait complete. 2024-03-28T13:50:29.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.366+0000 7fb54aa00640 1 Processor -- start 2024-03-28T13:50:29.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.366+0000 7fb54aa00640 1 -- start start 2024-03-28T13:50:29.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.366+0000 7fb54aa00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb54406c8b0 0x7fb5440c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:29.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.366+0000 7fb54aa00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb54406d340 0x7fb5440c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:29.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.366+0000 7fb54aa00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5441549d0 0x7fb5440c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:29.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.366+0000 7fb54aa00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb54415b260 con 0x7fb5441549d0 2024-03-28T13:50:29.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.366+0000 7fb54aa00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb54415af80 con 0x7fb54406c8b0 2024-03-28T13:50:29.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.366+0000 7fb54aa00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb544154db0 con 0x7fb54406d340 2024-03-28T13:50:29.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.366+0000 7fb548a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5441549d0 0x7fb5440c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:29.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.366+0000 7fb543e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb54406c8b0 0x7fb5440c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:29.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.366+0000 7fb543400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb54406d340 0x7fb5440c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:29.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.366+0000 7fb548a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5441549d0 0x7fb5440c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53008/0 (socket says 172.21.15.76:53008) 2024-03-28T13:50:29.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.366+0000 7fb548a00640 1 -- 172.21.15.76:0/4284232543 learned_addr learned my addr 172.21.15.76:0/4284232543 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:29.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.374+0000 7fb548a00640 1 -- 172.21.15.76:0/4284232543 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb54406d340 msgr2=0x7fb5440c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:29.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.374+0000 7fb548a00640 1 --2- 172.21.15.76:0/4284232543 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb54406d340 0x7fb5440c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.374+0000 7fb548a00640 1 -- 172.21.15.76:0/4284232543 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb54406c8b0 msgr2=0x7fb5440c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:29.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.374+0000 7fb548a00640 1 --2- 172.21.15.76:0/4284232543 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb54406c8b0 0x7fb5440c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.374+0000 7fb548a00640 1 -- 172.21.15.76:0/4284232543 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb544157d30 con 0x7fb5441549d0 2024-03-28T13:50:29.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.378+0000 7fb548a00640 1 --2- 172.21.15.76:0/4284232543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5441549d0 0x7fb5440c5c90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb53c007e30 tx=0x7fb53c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:29.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.382+0000 7fb53be00640 1 -- 172.21.15.76:0/4284232543 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c014620 con 0x7fb5441549d0 2024-03-28T13:50:29.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.382+0000 7fb53be00640 1 -- 172.21.15.76:0/4284232543 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb53c019070 con 0x7fb5441549d0 2024-03-28T13:50:29.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.382+0000 7fb53be00640 1 -- 172.21.15.76:0/4284232543 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c014a00 con 0x7fb5441549d0 2024-03-28T13:50:29.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.382+0000 7fb54aa00640 1 -- 172.21.15.76:0/4284232543 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb544157fd0 con 0x7fb5441549d0 2024-03-28T13:50:29.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.382+0000 7fb54aa00640 1 -- 172.21.15.76:0/4284232543 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5440c74c0 con 0x7fb5441549d0 2024-03-28T13:50:29.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.382+0000 7fb54aa00640 1 -- 172.21.15.76:0/4284232543 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb544068860 con 0x7fb5441549d0 2024-03-28T13:50:29.414 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.414+0000 7fb53be00640 1 -- 172.21.15.76:0/4284232543 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb53c014ba0 con 0x7fb5441549d0 2024-03-28T13:50:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.414+0000 7fb53be00640 1 --2- 172.21.15.76:0/4284232543 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb524068010 0x7fb52406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:29.416 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.414+0000 7fb543e00640 1 --2- 172.21.15.76:0/4284232543 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb524068010 0x7fb52406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:29.417 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.418+0000 7fb543e00640 1 --2- 172.21.15.76:0/4284232543 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb524068010 0x7fb52406a4d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb534001770 tx=0x7fb534009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:29.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.418+0000 7fb53be00640 1 -- 172.21.15.76:0/4284232543 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fb53c055840 con 0x7fb5441549d0 2024-03-28T13:50:29.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.418+0000 7fb53be00640 1 --2- 172.21.15.76:0/4284232543 >> [v2:172.21.15.76:6826/3991688226,v1:172.21.15.76:6827/3991688226] conn(0x7fb524071920 0x7fb524073dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:29.418 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.418+0000 7fb53be00640 1 -- 172.21.15.76:0/4284232543 --> [v2:172.21.15.76:6826/3991688226,v1:172.21.15.76:6827/3991688226] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb524074490 con 0x7fb524071920 2024-03-28T13:50:29.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.418+0000 7fb543400640 1 --2- 172.21.15.76:0/4284232543 >> [v2:172.21.15.76:6826/3991688226,v1:172.21.15.76:6827/3991688226] conn(0x7fb524071920 0x7fb524073dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:29.419 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.418+0000 7fb543400640 1 --2- 172.21.15.76:0/4284232543 >> [v2:172.21.15.76:6826/3991688226,v1:172.21.15.76:6827/3991688226] conn(0x7fb524071920 0x7fb524073dc0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:29.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.418+0000 7fb53be00640 1 -- 172.21.15.76:0/4284232543 <== osd.1 v2:172.21.15.76:6826/3991688226 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb524074490 con 0x7fb524071920 2024-03-28T13:50:29.420 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.422+0000 7fb53be00640 1 -- 172.21.15.76:0/4284232543 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb53c053a40 con 0x7fb5441549d0 2024-03-28T13:50:29.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.438+0000 7fb54aa00640 1 -- 172.21.15.76:0/4284232543 --> [v2:172.21.15.76:6826/3991688226,v1:172.21.15.76:6827/3991688226] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb54406c670 con 0x7fb524071920 2024-03-28T13:50:29.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.438+0000 7fb53be00640 1 -- 172.21.15.76:0/4284232543 <== osd.1 v2:172.21.15.76:6826/3991688226 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb54406c670 con 0x7fb524071920 2024-03-28T13:50:29.439 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-03-28T13:50:29.439 INFO:teuthology.orchestra.run.smithi076.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-28T13:50:29.439 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-03-28T13:50:29.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.438+0000 7fb54aa00640 1 -- 172.21.15.76:0/4284232543 >> [v2:172.21.15.76:6826/3991688226,v1:172.21.15.76:6827/3991688226] conn(0x7fb524071920 msgr2=0x7fb524073dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:29.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.438+0000 7fb54aa00640 1 --2- 172.21.15.76:0/4284232543 >> [v2:172.21.15.76:6826/3991688226,v1:172.21.15.76:6827/3991688226] conn(0x7fb524071920 0x7fb524073dc0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.440 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.438+0000 7fb54aa00640 1 -- 172.21.15.76:0/4284232543 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb524068010 msgr2=0x7fb52406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:29.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.438+0000 7fb54aa00640 1 --2- 172.21.15.76:0/4284232543 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb524068010 0x7fb52406a4d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb534001770 tx=0x7fb534009040 comp rx=0 tx=0).stop 2024-03-28T13:50:29.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.438+0000 7fb54aa00640 1 -- 172.21.15.76:0/4284232543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5441549d0 msgr2=0x7fb5440c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:29.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.438+0000 7fb54aa00640 1 --2- 172.21.15.76:0/4284232543 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb5441549d0 0x7fb5440c5c90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb53c007e30 tx=0x7fb53c00e4b0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.438+0000 7fb548a00640 1 -- 172.21.15.76:0/4284232543 reap_dead start 2024-03-28T13:50:29.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.438+0000 7fb54aa00640 1 -- 172.21.15.76:0/4284232543 shutdown_connections 2024-03-28T13:50:29.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.438+0000 7fb54aa00640 1 -- 172.21.15.76:0/4284232543 >> 172.21.15.76:0/4284232543 conn(0x7fb544067330 msgr2=0x7fb54415c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:29.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.438+0000 7fb54aa00640 1 -- 172.21.15.76:0/4284232543 shutdown_connections 2024-03-28T13:50:29.441 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.438+0000 7fb54aa00640 1 -- 172.21.15.76:0/4284232543 wait complete. 2024-03-28T13:50:29.462 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-28T13:50:29.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.618+0000 7f7253c00640 1 Processor -- start 2024-03-28T13:50:29.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.618+0000 7f7253c00640 1 -- start start 2024-03-28T13:50:29.621 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.622+0000 7f7253c00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f724c0cea30 0x7f724c071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:29.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.622+0000 7f7253c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f724c072240 0x7f724c0cab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:29.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.622+0000 7f7253c00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f724c158680 con 0x7f724c152800 2024-03-28T13:50:29.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.622+0000 7f7253c00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f724c159550 con 0x7f724c0cea30 2024-03-28T13:50:29.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.622+0000 7f7253c00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f724c0cee60 con 0x7f724c072240 2024-03-28T13:50:29.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.622+0000 7f724be00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f724c0cea30 0x7f724c071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.622+0000 7f7251c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f724c072240 0x7f724c0cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.622+0000 7f7251200640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f724c152800 0x7f724c0c97e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:49860/0 (socket says 172.21.15.76:49860) 2024-03-28T13:50:29.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.622+0000 7f7251200640 1 -- 172.21.15.76:0/1420868222 learned_addr learned my addr 172.21.15.76:0/1420868222 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:50:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.626+0000 7f724be00640 1 -- 172.21.15.76:0/1420868222 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f724c072240 msgr2=0x7f724c0cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.626+0000 7f724be00640 1 --2- 172.21.15.76:0/1420868222 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f724c072240 0x7f724c0cab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.625 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.626+0000 7f724be00640 1 -- 172.21.15.76:0/1420868222 >> v1:172.21.15.111:6789/0 conn(0x7f724c152800 legacy=0x7f724c0c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:29.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.626+0000 7f724be00640 1 -- 172.21.15.76:0/1420868222 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f724c158940 con 0x7f724c0cea30 2024-03-28T13:50:29.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.630+0000 7f724be00640 1 --2- 172.21.15.76:0/1420868222 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c0cea30 0x7f724c071d00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f72380097c0 tx=0x7f723801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f710ea6515ae34 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:29.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.634+0000 7f724b400640 1 -- 172.21.15.76:0/1420868222 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72380aa600 con 0x7f724c0cea30 2024-03-28T13:50:29.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.638+0000 7f724b400640 1 -- 172.21.15.76:0/1420868222 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72380af070 con 0x7f724c0cea30 2024-03-28T13:50:29.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.638+0000 7f724b400640 1 -- 172.21.15.76:0/1420868222 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72380aa9c0 con 0x7f724c0cea30 2024-03-28T13:50:29.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.638+0000 7f7253c00640 1 -- 172.21.15.76:0/1420868222 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c0cea30 msgr2=0x7f724c071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:29.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.638+0000 7f7253c00640 1 --2- 172.21.15.76:0/1420868222 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c0cea30 0x7f724c071d00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f72380097c0 tx=0x7f723801c4a0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.638+0000 7f7253c00640 1 -- 172.21.15.76:0/1420868222 shutdown_connections 2024-03-28T13:50:29.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.638+0000 7f7253c00640 1 --2- 172.21.15.76:0/1420868222 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f724c072240 0x7f724c0cab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.638+0000 7f7253c00640 1 --2- 172.21.15.76:0/1420868222 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c0cea30 0x7f724c071d00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.638+0000 7f7253c00640 1 -- 172.21.15.76:0/1420868222 >> 172.21.15.76:0/1420868222 conn(0x7f724c071540 msgr2=0x7f724c070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:29.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.638+0000 7f7253c00640 1 -- 172.21.15.76:0/1420868222 shutdown_connections 2024-03-28T13:50:29.639 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.638+0000 7f7253c00640 1 -- 172.21.15.76:0/1420868222 wait complete. 2024-03-28T13:50:29.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.638+0000 7f7253c00640 1 Processor -- start 2024-03-28T13:50:29.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.638+0000 7f7253c00640 1 -- start start 2024-03-28T13:50:29.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.642+0000 7f7253c00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f724c072240 0x7f724c0b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:29.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.642+0000 7f7253c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c0cea30 0x7f724c0cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:29.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.642+0000 7f7253c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f724c152800 0x7f724c0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:29.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.642+0000 7f7253c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f724c0c8d00 con 0x7f724c0cea30 2024-03-28T13:50:29.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.642+0000 7f7253c00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f724c0cb4d0 con 0x7f724c072240 2024-03-28T13:50:29.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.642+0000 7f7253c00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f724c152be0 con 0x7f724c152800 2024-03-28T13:50:29.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.642+0000 7f724be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c0cea30 0x7f724c0cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:29.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.642+0000 7f7251c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f724c152800 0x7f724c0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:29.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.642+0000 7f724be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c0cea30 0x7f724c0cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53032/0 (socket says 172.21.15.76:53032) 2024-03-28T13:50:29.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.642+0000 7f724be00640 1 -- 172.21.15.76:0/3036924204 learned_addr learned my addr 172.21.15.76:0/3036924204 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:29.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.642+0000 7f7251200640 1 --2- 172.21.15.76:0/3036924204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f724c072240 0x7f724c0b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:29.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.646+0000 7f724be00640 1 -- 172.21.15.76:0/3036924204 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f724c152800 msgr2=0x7f724c0cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:29.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.646+0000 7f724be00640 1 --2- 172.21.15.76:0/3036924204 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f724c152800 0x7f724c0cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.646+0000 7f724be00640 1 -- 172.21.15.76:0/3036924204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f724c072240 msgr2=0x7f724c0b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:29.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.646+0000 7f724be00640 1 --2- 172.21.15.76:0/3036924204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f724c072240 0x7f724c0b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:29.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.646+0000 7f724be00640 1 -- 172.21.15.76:0/3036924204 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f724c156950 con 0x7f724c0cea30 2024-03-28T13:50:29.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.650+0000 7f724be00640 1 --2- 172.21.15.76:0/3036924204 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c0cea30 0x7f724c0cc020 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f72380ac040 tx=0x7f723801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:29.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.650+0000 7f7248c00640 1 -- 172.21.15.76:0/3036924204 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72380be610 con 0x7f724c0cea30 2024-03-28T13:50:29.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.650+0000 7f7253c00640 1 -- 172.21.15.76:0/3036924204 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f724c0cda90 con 0x7f724c0cea30 2024-03-28T13:50:29.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.650+0000 7f7253c00640 1 -- 172.21.15.76:0/3036924204 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f724c0ce260 con 0x7f724c0cea30 2024-03-28T13:50:29.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.654+0000 7f7248c00640 1 -- 172.21.15.76:0/3036924204 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72380be7b0 con 0x7f724c0cea30 2024-03-28T13:50:29.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.654+0000 7f7253c00640 1 -- 172.21.15.76:0/3036924204 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f724c1f44c0 con 0x7f724c0cea30 2024-03-28T13:50:29.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.654+0000 7f7248c00640 1 -- 172.21.15.76:0/3036924204 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72380beb60 con 0x7f724c0cea30 2024-03-28T13:50:29.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.926+0000 7f7248c00640 1 -- 172.21.15.76:0/3036924204 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f72380bc020 con 0x7f724c0cea30 2024-03-28T13:50:29.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.926+0000 7f7248c00640 1 --2- 172.21.15.76:0/3036924204 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f722c067fc0 0x7f722c06a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:29.927 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.926+0000 7f7251200640 1 --2- 172.21.15.76:0/3036924204 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f722c067fc0 0x7f722c06a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:29.928 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.926+0000 7f7251200640 1 --2- 172.21.15.76:0/3036924204 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f722c067fc0 0x7f722c06a480 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7240000f70 tx=0x7f7240009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:29.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.938+0000 7f7248c00640 1 -- 172.21.15.76:0/3036924204 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f72380ef050 con 0x7f724c0cea30 2024-03-28T13:50:29.941 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:29.938+0000 7f7248c00640 1 -- 172.21.15.76:0/3036924204 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f724c1f44c0 con 0x7f724c0cea30 2024-03-28T13:50:30.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.134+0000 7f7253c00640 1 -- 172.21.15.76:0/3036924204 --> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f724c0686e0 con 0x7f722c067fc0 2024-03-28T13:50:30.135 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.134+0000 7f7248c00640 1 -- 172.21.15.76:0/3036924204 <== mgr.4107 v2:172.21.15.76:6800/1313648511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f724c0686e0 con 0x7f722c067fc0 2024-03-28T13:50:30.135 INFO:teuthology.orchestra.run.smithi076.stderr:instructed osd(s) 1 to deep-scrub 2024-03-28T13:50:30.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.138+0000 7f7253c00640 1 -- 172.21.15.76:0/3036924204 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f722c067fc0 msgr2=0x7f722c06a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:30.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.138+0000 7f7253c00640 1 --2- 172.21.15.76:0/3036924204 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f722c067fc0 0x7f722c06a480 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7240000f70 tx=0x7f7240009040 comp rx=0 tx=0).stop 2024-03-28T13:50:30.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.138+0000 7f7253c00640 1 -- 172.21.15.76:0/3036924204 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c0cea30 msgr2=0x7f724c0cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:30.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.138+0000 7f7253c00640 1 --2- 172.21.15.76:0/3036924204 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c0cea30 0x7f724c0cc020 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f72380ac040 tx=0x7f723801ace0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.138+0000 7f7253c00640 1 -- 172.21.15.76:0/3036924204 shutdown_connections 2024-03-28T13:50:30.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.138+0000 7f7253c00640 1 --2- 172.21.15.76:0/3036924204 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f722c067fc0 0x7f722c06a480 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.138 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.138+0000 7f7253c00640 1 --2- 172.21.15.76:0/3036924204 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f724c152800 0x7f724c0cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.138+0000 7f7253c00640 1 --2- 172.21.15.76:0/3036924204 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f724c0cea30 0x7f724c0cc020 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.138+0000 7f7253c00640 1 --2- 172.21.15.76:0/3036924204 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f724c072240 0x7f724c0b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.138+0000 7f7253c00640 1 -- 172.21.15.76:0/3036924204 >> 172.21.15.76:0/3036924204 conn(0x7f724c071540 msgr2=0x7f724c14fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:30.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.138+0000 7f7253c00640 1 -- 172.21.15.76:0/3036924204 shutdown_connections 2024-03-28T13:50:30.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.138+0000 7f7253c00640 1 -- 172.21.15.76:0/3036924204 wait complete. 2024-03-28T13:50:30.158 INFO:tasks.ceph:Scrubbing osd.2 2024-03-28T13:50:30.158 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-28T13:50:30.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.302+0000 7f80f2a00640 1 Processor -- start 2024-03-28T13:50:30.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.302+0000 7f80f2a00640 1 -- start start 2024-03-28T13:50:30.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.306+0000 7f80f2a00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f80ec154780 0x7f80ec15b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:30.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.306+0000 7f80f2a00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80ec15b690 con 0x7f80ec0c9bd0 2024-03-28T13:50:30.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.306+0000 7f80f2a00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80ec154b60 con 0x7f80ec0c8880 2024-03-28T13:50:30.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.306+0000 7f80f2a00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f80ec0c9740 con 0x7f80ec154780 2024-03-28T13:50:30.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.306+0000 7f80f0a00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f80ec0c9bd0 0x7f80ec0ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:38604/0 (socket says 172.21.15.76:38604) 2024-03-28T13:50:30.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.306+0000 7f80f0a00640 1 -- 172.21.15.76:0/464607720 learned_addr learned my addr 172.21.15.76:0/464607720 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:50:30.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.306+0000 7f80ebe00640 1 --2- 172.21.15.76:0/464607720 >> v2:172.21.15.111:3300/0 conn(0x7f80ec154780 0x7f80ec15b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:30.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.310+0000 7f80eb400640 1 -- 172.21.15.76:0/464607720 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 978936123 0 0) 0x7f80e40014a0 con 0x7f80ec0c9bd0 2024-03-28T13:50:30.310 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.310+0000 7f80eb400640 1 -- 172.21.15.76:0/464607720 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80d0003530 con 0x7f80ec0c9bd0 2024-03-28T13:50:30.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.314+0000 7f80eb400640 1 -- 172.21.15.76:0/464607720 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 929380697 0 0) 0x7f80d0003530 con 0x7f80ec0c9bd0 2024-03-28T13:50:30.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.314+0000 7f80eb400640 1 -- 172.21.15.76:0/464607720 >> v2:172.21.15.111:3300/0 conn(0x7f80ec154780 msgr2=0x7f80ec15b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:30.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.314+0000 7f80eb400640 1 --2- 172.21.15.76:0/464607720 >> v2:172.21.15.111:3300/0 conn(0x7f80ec154780 0x7f80ec15b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.314+0000 7f80eb400640 1 -- 172.21.15.76:0/464607720 >> v1:172.21.15.111:6789/0 conn(0x7f80ec0c8880 legacy=0x7f80ec0cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:30.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.314+0000 7f80eb400640 1 -- 172.21.15.76:0/464607720 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ec15dfe0 con 0x7f80ec0c9bd0 2024-03-28T13:50:30.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.314+0000 7f80eb400640 1 -- 172.21.15.76:0/464607720 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7f80e4001bd0 con 0x7f80ec0c9bd0 2024-03-28T13:50:30.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.314+0000 7f80eb400640 1 -- 172.21.15.76:0/464607720 >> v1:172.21.15.76:6789/0 conn(0x7f80ec0c9bd0 legacy=0x7f80ec0ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:30.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.314+0000 7f80eb400640 1 --2- 172.21.15.76:0/464607720 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80d00039c0 0x7f80d0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:30.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.314+0000 7f80eb400640 1 --2- 172.21.15.76:0/464607720 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80d0004810 0x7f80d0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:30.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.314+0000 7f80eb400640 1 --2- 172.21.15.76:0/464607720 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80d00051d0 0x7f80d000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:30.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.314+0000 7f80eb400640 1 -- 172.21.15.76:0/464607720 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec0c9740 con 0x7f80d00039c0 2024-03-28T13:50:30.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.314+0000 7f80eb400640 1 -- 172.21.15.76:0/464607720 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f80d000c080 con 0x7f80d00051d0 2024-03-28T13:50:30.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.314+0000 7f80eb400640 1 -- 172.21.15.76:0/464607720 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f80d000c280 con 0x7f80d0004810 2024-03-28T13:50:30.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.318+0000 7f80e3e00640 1 --2- 172.21.15.76:0/464607720 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80d0004810 0x7f80d0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:30.317 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.318+0000 7f80ebe00640 1 --2- 172.21.15.76:0/464607720 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80d00039c0 0x7f80d0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:30.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.318+0000 7f80ebe00640 1 -- 172.21.15.76:0/464607720 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80d0004810 msgr2=0x7f80d0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:30.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.318+0000 7f80ebe00640 1 --2- 172.21.15.76:0/464607720 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80d0004810 0x7f80d0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.318+0000 7f80ebe00640 1 -- 172.21.15.76:0/464607720 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80d00051d0 msgr2=0x7f80d000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:30.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.318+0000 7f80ebe00640 1 --2- 172.21.15.76:0/464607720 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80d00051d0 0x7f80d000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.318+0000 7f80ebe00640 1 -- 172.21.15.76:0/464607720 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ec15dfe0 con 0x7f80d00039c0 2024-03-28T13:50:30.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.318+0000 7f80f0a00640 1 -- 172.21.15.76:0/464607720 reap_dead start 2024-03-28T13:50:30.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.322+0000 7f80ebe00640 1 --2- 172.21.15.76:0/464607720 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80d00039c0 0x7f80d0003de0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009ae0 tx=0x7f80dc01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7428c4bf70789d40 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:30.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.326+0000 7f80eb400640 1 -- 172.21.15.76:0/464607720 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0b2070 con 0x7f80d00039c0 2024-03-28T13:50:30.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.326+0000 7f80eb400640 1 -- 172.21.15.76:0/464607720 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80dc0a56a0 con 0x7f80d00039c0 2024-03-28T13:50:30.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.326+0000 7f80eb400640 1 -- 172.21.15.76:0/464607720 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0096b0 con 0x7f80d00039c0 2024-03-28T13:50:30.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.330+0000 7f80f2a00640 1 -- 172.21.15.76:0/464607720 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80d00039c0 msgr2=0x7f80d0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:30.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.330+0000 7f80f2a00640 1 --2- 172.21.15.76:0/464607720 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80d00039c0 0x7f80d0003de0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009ae0 tx=0x7f80dc01cab0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.330+0000 7f80f2a00640 1 -- 172.21.15.76:0/464607720 shutdown_connections 2024-03-28T13:50:30.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.330+0000 7f80f2a00640 1 --2- 172.21.15.76:0/464607720 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80d00039c0 0x7f80d0003de0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.330+0000 7f80f2a00640 1 -- 172.21.15.76:0/464607720 >> 172.21.15.76:0/464607720 conn(0x7f80ec06f0b0 msgr2=0x7f80ec06f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:30.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.330+0000 7f80f2a00640 1 -- 172.21.15.76:0/464607720 shutdown_connections 2024-03-28T13:50:30.330 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.330+0000 7f80f2a00640 1 -- 172.21.15.76:0/464607720 wait complete. 2024-03-28T13:50:30.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.330+0000 7f80f2a00640 1 Processor -- start 2024-03-28T13:50:30.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.330+0000 7f80f2a00640 1 -- start start 2024-03-28T13:50:30.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.330+0000 7f80f2a00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80d00039c0 0x7f80ec06b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:30.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.330+0000 7f80f2a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80ec1e6ad0 0x7f80ec1e5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:30.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.330+0000 7f80f2a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80ec1e4d80 0x7f80ec06c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:30.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.330+0000 7f80f2a00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec15e880 con 0x7f80ec1e6ad0 2024-03-28T13:50:30.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.330+0000 7f80f2a00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec15e5a0 con 0x7f80ec1e4d80 2024-03-28T13:50:30.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.330+0000 7f80f2a00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f80ec15dcc0 con 0x7f80d00039c0 2024-03-28T13:50:30.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.334+0000 7f80e3e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80ec1e6ad0 0x7f80ec1e5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:30.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.334+0000 7f80e3e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80ec1e6ad0 0x7f80ec1e5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53050/0 (socket says 172.21.15.76:53050) 2024-03-28T13:50:30.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.334+0000 7f80e3e00640 1 -- 172.21.15.76:0/3025474955 learned_addr learned my addr 172.21.15.76:0/3025474955 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:30.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.334+0000 7f80ebe00640 1 --2- 172.21.15.76:0/3025474955 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80d00039c0 0x7f80ec06b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:30.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.334+0000 7f80f0a00640 1 --2- 172.21.15.76:0/3025474955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80ec1e4d80 0x7f80ec06c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:30.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.338+0000 7f80e3e00640 1 -- 172.21.15.76:0/3025474955 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80d00039c0 msgr2=0x7f80ec06b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:30.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.338+0000 7f80e3e00640 1 --2- 172.21.15.76:0/3025474955 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80d00039c0 0x7f80ec06b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.338+0000 7f80e3e00640 1 -- 172.21.15.76:0/3025474955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80ec1e4d80 msgr2=0x7f80ec06c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:30.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.338+0000 7f80e3e00640 1 --2- 172.21.15.76:0/3025474955 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80ec1e4d80 0x7f80ec06c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.338+0000 7f80e3e00640 1 -- 172.21.15.76:0/3025474955 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ec0c7bc0 con 0x7f80ec1e6ad0 2024-03-28T13:50:30.339 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.338+0000 7f80e3e00640 1 --2- 172.21.15.76:0/3025474955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80ec1e6ad0 0x7f80ec1e5710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f80d400f820 tx=0x7f80d400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:30.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.342+0000 7f80e8c00640 1 -- 172.21.15.76:0/3025474955 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d40050d0 con 0x7f80ec1e6ad0 2024-03-28T13:50:30.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.342+0000 7f80e8c00640 1 -- 172.21.15.76:0/3025474955 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d4018070 con 0x7f80ec1e6ad0 2024-03-28T13:50:30.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.342+0000 7f80e8c00640 1 -- 172.21.15.76:0/3025474955 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d400d730 con 0x7f80ec1e6ad0 2024-03-28T13:50:30.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.342+0000 7f80f2a00640 1 -- 172.21.15.76:0/3025474955 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80ec06bd70 con 0x7f80ec1e6ad0 2024-03-28T13:50:30.343 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.342+0000 7f80f2a00640 1 -- 172.21.15.76:0/3025474955 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80ec1f40d0 con 0x7f80ec1e6ad0 2024-03-28T13:50:30.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.342+0000 7f80f2a00640 1 -- 172.21.15.76:0/3025474955 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f80ec1f4d50 con 0x7f80ec1e6ad0 2024-03-28T13:50:30.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.362+0000 7f80e8c00640 1 -- 172.21.15.76:0/3025474955 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f80d400d8d0 con 0x7f80ec1e6ad0 2024-03-28T13:50:30.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.366+0000 7f80e8c00640 1 --2- 172.21.15.76:0/3025474955 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f80c8068040 0x7f80c806a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:30.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.366+0000 7f80ebe00640 1 --2- 172.21.15.76:0/3025474955 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f80c8068040 0x7f80c806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.366+0000 7f80e8c00640 1 -- 172.21.15.76:0/3025474955 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f80d4054e70 con 0x7f80ec1e6ad0 2024-03-28T13:50:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.366+0000 7f80ebe00640 1 --2- 172.21.15.76:0/3025474955 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f80c8068040 0x7f80c806a500 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0af000 tx=0x7f80dc0046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.366+0000 7f80e8c00640 1 --2- 172.21.15.76:0/3025474955 >> [v2:172.21.15.76:6802/2048416202,v1:172.21.15.76:6803/2048416202] conn(0x7f80c8071a50 0x7f80c8073ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.366+0000 7f80e8c00640 1 -- 172.21.15.76:0/3025474955 --> [v2:172.21.15.76:6802/2048416202,v1:172.21.15.76:6803/2048416202] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80d4004e50 con 0x7f80c8071a50 2024-03-28T13:50:30.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.366+0000 7f80e8c00640 1 -- 172.21.15.76:0/3025474955 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f80d4053070 con 0x7f80ec1e6ad0 2024-03-28T13:50:30.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.366+0000 7f80f0a00640 1 --2- 172.21.15.76:0/3025474955 >> [v2:172.21.15.76:6802/2048416202,v1:172.21.15.76:6803/2048416202] conn(0x7f80c8071a50 0x7f80c8073ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:30.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.366+0000 7f80f0a00640 1 --2- 172.21.15.76:0/3025474955 >> [v2:172.21.15.76:6802/2048416202,v1:172.21.15.76:6803/2048416202] conn(0x7f80c8071a50 0x7f80c8073ef0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:30.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.370+0000 7f80e8c00640 1 -- 172.21.15.76:0/3025474955 <== osd.2 v2:172.21.15.76:6802/2048416202 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f80d4004e50 con 0x7f80c8071a50 2024-03-28T13:50:30.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.382+0000 7f80f2a00640 1 -- 172.21.15.76:0/3025474955 --> [v2:172.21.15.76:6802/2048416202,v1:172.21.15.76:6803/2048416202] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f80ec068860 con 0x7f80c8071a50 2024-03-28T13:50:30.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.382+0000 7f80e8c00640 1 -- 172.21.15.76:0/3025474955 <== osd.2 v2:172.21.15.76:6802/2048416202 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f80ec068860 con 0x7f80c8071a50 2024-03-28T13:50:30.383 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-03-28T13:50:30.383 INFO:teuthology.orchestra.run.smithi076.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-28T13:50:30.383 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-03-28T13:50:30.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.382+0000 7f80f2a00640 1 -- 172.21.15.76:0/3025474955 >> [v2:172.21.15.76:6802/2048416202,v1:172.21.15.76:6803/2048416202] conn(0x7f80c8071a50 msgr2=0x7f80c8073ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:30.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.382+0000 7f80f2a00640 1 --2- 172.21.15.76:0/3025474955 >> [v2:172.21.15.76:6802/2048416202,v1:172.21.15.76:6803/2048416202] conn(0x7f80c8071a50 0x7f80c8073ef0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.384 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.382+0000 7f80f2a00640 1 -- 172.21.15.76:0/3025474955 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f80c8068040 msgr2=0x7f80c806a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:30.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.382+0000 7f80f2a00640 1 --2- 172.21.15.76:0/3025474955 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f80c8068040 0x7f80c806a500 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0af000 tx=0x7f80dc0046d0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.382+0000 7f80f2a00640 1 -- 172.21.15.76:0/3025474955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80ec1e6ad0 msgr2=0x7f80ec1e5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:30.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.382+0000 7f80f2a00640 1 --2- 172.21.15.76:0/3025474955 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f80ec1e6ad0 0x7f80ec1e5710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f80d400f820 tx=0x7f80d400fce0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.382+0000 7f80f0a00640 1 -- 172.21.15.76:0/3025474955 reap_dead start 2024-03-28T13:50:30.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.382+0000 7f80f2a00640 1 -- 172.21.15.76:0/3025474955 shutdown_connections 2024-03-28T13:50:30.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.382+0000 7f80f2a00640 1 -- 172.21.15.76:0/3025474955 >> 172.21.15.76:0/3025474955 conn(0x7f80ec06f0b0 msgr2=0x7f80ec14f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:30.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.382+0000 7f80f2a00640 1 -- 172.21.15.76:0/3025474955 shutdown_connections 2024-03-28T13:50:30.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.382+0000 7f80f2a00640 1 -- 172.21.15.76:0/3025474955 wait complete. 2024-03-28T13:50:30.402 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-28T13:50:30.583 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.582+0000 7f2665000640 1 Processor -- start 2024-03-28T13:50:30.584 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.582+0000 7f2665000640 1 -- start start 2024-03-28T13:50:30.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.582+0000 7f2665000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f2660152800 0x7f26600cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:30.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.582+0000 7f2665000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f26600c97e0 0x7f2660071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:30.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.586+0000 7f2665000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2660072240 0x7f26600cab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:30.585 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.586+0000 7f2665000640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f2660159550 con 0x7f2660152800 2024-03-28T13:50:30.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.586+0000 7f2665000640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f2660158680 con 0x7f26600c97e0 2024-03-28T13:50:30.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.586+0000 7f2665000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2660158940 con 0x7f2660072240 2024-03-28T13:50:30.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.586+0000 7f265de00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f2660152800 0x7f26600cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:30.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.586+0000 7f265de00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f2660152800 0x7f26600cea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53060/0 (socket says 172.21.15.76:53060) 2024-03-28T13:50:30.586 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.586+0000 7f265de00640 1 -- 172.21.15.76:0/1229450235 learned_addr learned my addr 172.21.15.76:0/1229450235 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:30.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.590+0000 7f265de00640 1 -- 172.21.15.76:0/1229450235 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2660072240 msgr2=0x7f26600cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:30.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.590+0000 7f265de00640 1 --2- 172.21.15.76:0/1229450235 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2660072240 0x7f26600cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.590+0000 7f265de00640 1 -- 172.21.15.76:0/1229450235 >> v2:172.21.15.111:3300/0 conn(0x7f26600c97e0 msgr2=0x7f2660071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:30.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.590+0000 7f265de00640 1 --2- 172.21.15.76:0/1229450235 >> v2:172.21.15.111:3300/0 conn(0x7f26600c97e0 0x7f2660071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.589 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.590+0000 7f265de00640 1 -- 172.21.15.76:0/1229450235 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2660158c20 con 0x7f2660152800 2024-03-28T13:50:30.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.594+0000 7f265de00640 1 --2- 172.21.15.76:0/1229450235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2660152800 0x7f26600cea30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f26600c9030 tx=0x7f265001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8de4c4dd154ee3 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:30.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.598+0000 7f265ca00640 1 -- 172.21.15.76:0/1229450235 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26500a6040 con 0x7f2660152800 2024-03-28T13:50:30.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.598+0000 7f265ca00640 1 -- 172.21.15.76:0/1229450235 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26500af070 con 0x7f2660152800 2024-03-28T13:50:30.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.598+0000 7f265ca00640 1 -- 172.21.15.76:0/1229450235 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26500aa860 con 0x7f2660152800 2024-03-28T13:50:30.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.598+0000 7f2665000640 1 -- 172.21.15.76:0/1229450235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2660152800 msgr2=0x7f26600cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:30.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.598+0000 7f2665000640 1 --2- 172.21.15.76:0/1229450235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2660152800 0x7f26600cea30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f26600c9030 tx=0x7f265001c520 comp rx=0 tx=0).stop 2024-03-28T13:50:30.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.598+0000 7f2665000640 1 -- 172.21.15.76:0/1229450235 shutdown_connections 2024-03-28T13:50:30.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.598+0000 7f2665000640 1 --2- 172.21.15.76:0/1229450235 >> v2:172.21.15.111:3300/0 conn(0x7f26600c97e0 0x7f2660071d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.598+0000 7f2665000640 1 --2- 172.21.15.76:0/1229450235 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2660072240 0x7f26600cab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.598+0000 7f2665000640 1 --2- 172.21.15.76:0/1229450235 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2660152800 0x7f26600cea30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.598+0000 7f2665000640 1 -- 172.21.15.76:0/1229450235 >> 172.21.15.76:0/1229450235 conn(0x7f2660071540 msgr2=0x7f2660070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:30.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.598+0000 7f2665000640 1 -- 172.21.15.76:0/1229450235 shutdown_connections 2024-03-28T13:50:30.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.598+0000 7f2665000640 1 -- 172.21.15.76:0/1229450235 wait complete. 2024-03-28T13:50:30.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.602+0000 7f2665000640 1 Processor -- start 2024-03-28T13:50:30.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.602+0000 7f2665000640 1 -- start start 2024-03-28T13:50:30.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.602+0000 7f2665000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2660072240 0x7f26601f3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:30.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.602+0000 7f2665000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26600c97e0 0x7f26600b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:30.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.602+0000 7f2665000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2660152800 0x7f266014b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:30.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.602+0000 7f2665000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f26600c9c10 con 0x7f2660072240 2024-03-28T13:50:30.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.602+0000 7f2665000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f26600c8d00 con 0x7f26600c97e0 2024-03-28T13:50:30.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.602+0000 7f2665000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f26600c9d90 con 0x7f2660152800 2024-03-28T13:50:30.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.602+0000 7f265de00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2660072240 0x7f26601f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:30.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.602+0000 7f265de00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2660072240 0x7f26601f3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53070/0 (socket says 172.21.15.76:53070) 2024-03-28T13:50:30.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.602+0000 7f265de00640 1 -- 172.21.15.76:0/1301062602 learned_addr learned my addr 172.21.15.76:0/1301062602 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:30.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.606+0000 7f265de00640 1 -- 172.21.15.76:0/1301062602 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2660152800 msgr2=0x7f266014b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:30.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.606+0000 7f265de00640 1 --2- 172.21.15.76:0/1301062602 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2660152800 0x7f266014b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.606+0000 7f265de00640 1 -- 172.21.15.76:0/1301062602 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26600c97e0 msgr2=0x7f26600b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:30.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.606+0000 7f265de00640 1 --2- 172.21.15.76:0/1301062602 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26600c97e0 0x7f26600b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:30.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.606+0000 7f265de00640 1 -- 172.21.15.76:0/1301062602 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26600ce0e0 con 0x7f2660072240 2024-03-28T13:50:30.610 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.610+0000 7f265de00640 1 --2- 172.21.15.76:0/1301062602 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2660072240 0x7f26601f3490 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f265001abd0 tx=0x7f265001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:30.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.618+0000 7f2656000640 1 -- 172.21.15.76:0/1301062602 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26500bd5f0 con 0x7f2660072240 2024-03-28T13:50:30.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.618+0000 7f2656000640 1 -- 172.21.15.76:0/1301062602 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26500bd790 con 0x7f2660072240 2024-03-28T13:50:30.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.618+0000 7f2656000640 1 -- 172.21.15.76:0/1301062602 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26500bdb40 con 0x7f2660072240 2024-03-28T13:50:30.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.618+0000 7f2665000640 1 -- 172.21.15.76:0/1301062602 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26600cdb20 con 0x7f2660072240 2024-03-28T13:50:30.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.618+0000 7f2665000640 1 -- 172.21.15.76:0/1301062602 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2660150cf0 con 0x7f2660072240 2024-03-28T13:50:30.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.618+0000 7f2665000640 1 -- 172.21.15.76:0/1301062602 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26600686e0 con 0x7f2660072240 2024-03-28T13:50:30.647 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.646+0000 7f2656000640 1 -- 172.21.15.76:0/1301062602 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f26500c8420 con 0x7f2660072240 2024-03-28T13:50:30.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.646+0000 7f2656000640 1 --2- 172.21.15.76:0/1301062602 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2640067fc0 0x7f264006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:30.648 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.646+0000 7f265d400640 1 --2- 172.21.15.76:0/1301062602 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2640067fc0 0x7f264006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:30.649 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.650+0000 7f265d400640 1 --2- 172.21.15.76:0/1301062602 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2640067fc0 0x7f264006a480 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2660162490 tx=0x7f264c006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:30.654 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.654+0000 7f2656000640 1 -- 172.21.15.76:0/1301062602 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f26500ef4f0 con 0x7f2660072240 2024-03-28T13:50:30.926 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:30.926+0000 7f2656000640 1 -- 172.21.15.76:0/1301062602 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f2650016110 con 0x7f2660072240 2024-03-28T13:50:31.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.158+0000 7f2665000640 1 -- 172.21.15.76:0/1301062602 --> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f2660161f00 con 0x7f2640067fc0 2024-03-28T13:50:31.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.162+0000 7f2656000640 1 -- 172.21.15.76:0/1301062602 <== mgr.4107 v2:172.21.15.76:6800/1313648511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2660161f00 con 0x7f2640067fc0 2024-03-28T13:50:31.162 INFO:teuthology.orchestra.run.smithi076.stderr:instructed osd(s) 2 to deep-scrub 2024-03-28T13:50:31.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.162+0000 7f2665000640 1 -- 172.21.15.76:0/1301062602 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2640067fc0 msgr2=0x7f264006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:31.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.162+0000 7f2665000640 1 --2- 172.21.15.76:0/1301062602 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2640067fc0 0x7f264006a480 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2660162490 tx=0x7f264c006ca0 comp rx=0 tx=0).stop 2024-03-28T13:50:31.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.162+0000 7f2665000640 1 -- 172.21.15.76:0/1301062602 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2660072240 msgr2=0x7f26601f3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:31.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.162+0000 7f2665000640 1 --2- 172.21.15.76:0/1301062602 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2660072240 0x7f26601f3490 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f265001abd0 tx=0x7f265001ad60 comp rx=0 tx=0).stop 2024-03-28T13:50:31.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.166+0000 7f2665000640 1 -- 172.21.15.76:0/1301062602 shutdown_connections 2024-03-28T13:50:31.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.166+0000 7f2665000640 1 --2- 172.21.15.76:0/1301062602 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f2640067fc0 0x7f264006a480 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:31.166 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.166+0000 7f2665000640 1 --2- 172.21.15.76:0/1301062602 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2660152800 0x7f266014b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:31.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.166+0000 7f2665000640 1 --2- 172.21.15.76:0/1301062602 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f26600c97e0 0x7f26600b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:31.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.166+0000 7f2665000640 1 --2- 172.21.15.76:0/1301062602 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f2660072240 0x7f26601f3490 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:31.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.166+0000 7f2665000640 1 -- 172.21.15.76:0/1301062602 >> 172.21.15.76:0/1301062602 conn(0x7f2660071540 msgr2=0x7f2660162700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:31.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.166+0000 7f2665000640 1 -- 172.21.15.76:0/1301062602 shutdown_connections 2024-03-28T13:50:31.167 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.166+0000 7f2665000640 1 -- 172.21.15.76:0/1301062602 wait complete. 2024-03-28T13:50:31.196 INFO:tasks.ceph:Scrubbing osd.3 2024-03-28T13:50:31.197 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-28T13:50:31.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.342+0000 7f4665e00640 1 Processor -- start 2024-03-28T13:50:31.344 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.342+0000 7f4665e00640 1 -- start start 2024-03-28T13:50:31.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.346+0000 7f4665e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f4660154bf0 0x7f466006b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:31.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.346+0000 7f4665e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f466006f310 0x7f466015dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:31.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.346+0000 7f4665e00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f466006c4c0 con 0x7f466006ef30 2024-03-28T13:50:31.345 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.346+0000 7f4665e00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f466015a820 con 0x7f466006f310 2024-03-28T13:50:31.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.346+0000 7f4665e00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f466006bf00 con 0x7f4660154bf0 2024-03-28T13:50:31.346 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.346+0000 7f4665400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f466006f310 0x7f466015dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:31.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.346+0000 7f4665400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f466006f310 0x7f466015dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53078/0 (socket says 172.21.15.76:53078) 2024-03-28T13:50:31.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.346+0000 7f4665400640 1 -- 172.21.15.76:0/951803138 learned_addr learned my addr 172.21.15.76:0/951803138 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:31.347 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.346+0000 7f465fe00640 1 --2- 172.21.15.76:0/951803138 >> v2:172.21.15.111:3300/0 conn(0x7f4660154bf0 0x7f466006b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:31.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.350+0000 7f4665400640 1 -- 172.21.15.76:0/951803138 >> v2:172.21.15.111:3300/0 conn(0x7f4660154bf0 msgr2=0x7f466006b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:31.350 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.350+0000 7f4665400640 1 --2- 172.21.15.76:0/951803138 >> v2:172.21.15.111:3300/0 conn(0x7f4660154bf0 0x7f466006b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:31.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.350+0000 7f4665400640 1 -- 172.21.15.76:0/951803138 >> v1:172.21.15.111:6789/0 conn(0x7f466006ef30 legacy=0x7f46601544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:31.351 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.350+0000 7f4665400640 1 -- 172.21.15.76:0/951803138 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466006c1e0 con 0x7f466006f310 2024-03-28T13:50:31.355 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.354+0000 7f4665400640 1 --2- 172.21.15.76:0/951803138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f466006f310 0x7f466015dbf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f46600cab80 tx=0x7f465801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29ae338c30f5268 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:31.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.358+0000 7f465f400640 1 -- 172.21.15.76:0/951803138 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46580b4070 con 0x7f466006f310 2024-03-28T13:50:31.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.358+0000 7f465f400640 1 -- 172.21.15.76:0/951803138 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46580af400 con 0x7f466006f310 2024-03-28T13:50:31.360 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.358+0000 7f465f400640 1 -- 172.21.15.76:0/951803138 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46580af7d0 con 0x7f466006f310 2024-03-28T13:50:31.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.362+0000 7f4665e00640 1 -- 172.21.15.76:0/951803138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f466006f310 msgr2=0x7f466015dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:31.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.362+0000 7f4665e00640 1 --2- 172.21.15.76:0/951803138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f466006f310 0x7f466015dbf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f46600cab80 tx=0x7f465801f1e0 comp rx=0 tx=0).stop 2024-03-28T13:50:31.361 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.362+0000 7f4665e00640 1 -- 172.21.15.76:0/951803138 shutdown_connections 2024-03-28T13:50:31.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.362+0000 7f4665e00640 1 --2- 172.21.15.76:0/951803138 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f466006f310 0x7f466015dbf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:31.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.362+0000 7f4665e00640 1 --2- 172.21.15.76:0/951803138 >> v2:172.21.15.111:3300/0 conn(0x7f4660154bf0 0x7f466006b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:31.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.362+0000 7f4665e00640 1 -- 172.21.15.76:0/951803138 >> 172.21.15.76:0/951803138 conn(0x7f4660073650 msgr2=0x7f466006c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:31.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.362+0000 7f4665e00640 1 -- 172.21.15.76:0/951803138 shutdown_connections 2024-03-28T13:50:31.362 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.362+0000 7f4665e00640 1 -- 172.21.15.76:0/951803138 wait complete. 2024-03-28T13:50:31.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.362+0000 7f4665e00640 1 Processor -- start 2024-03-28T13:50:31.363 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.362+0000 7f4665e00640 1 -- start start 2024-03-28T13:50:31.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.362+0000 7f4665e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f466006ef30 0x7f46600caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:31.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.362+0000 7f4665e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f466006f310 0x7f46601f1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:31.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.362+0000 7f4665e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4660154bf0 0x7f46600c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:31.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.362+0000 7f4665e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f46600b2250 con 0x7f4660154bf0 2024-03-28T13:50:31.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.362+0000 7f4665e00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f466015ada0 con 0x7f466006ef30 2024-03-28T13:50:31.365 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.362+0000 7f4665e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f46600b23d0 con 0x7f466006f310 2024-03-28T13:50:31.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.366+0000 7f4665400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4660154bf0 0x7f46600c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:31.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.366+0000 7f4665400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4660154bf0 0x7f46600c61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53086/0 (socket says 172.21.15.76:53086) 2024-03-28T13:50:31.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.366+0000 7f4665400640 1 -- 172.21.15.76:0/426663023 learned_addr learned my addr 172.21.15.76:0/426663023 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:31.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.366+0000 7f465fe00640 1 --2- 172.21.15.76:0/426663023 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f466006f310 0x7f46601f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:31.367 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.366+0000 7f4664a00640 1 --2- 172.21.15.76:0/426663023 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f466006ef30 0x7f46600caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:31.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.370+0000 7f4665400640 1 -- 172.21.15.76:0/426663023 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f466006f310 msgr2=0x7f46601f1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:31.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.370+0000 7f4665400640 1 --2- 172.21.15.76:0/426663023 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f466006f310 0x7f46601f1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:31.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.370+0000 7f4665400640 1 -- 172.21.15.76:0/426663023 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f466006ef30 msgr2=0x7f46600caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:31.369 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.370+0000 7f4665400640 1 --2- 172.21.15.76:0/426663023 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f466006ef30 0x7f46600caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:31.370 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.370+0000 7f4665400640 1 -- 172.21.15.76:0/426663023 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46601f0620 con 0x7f4660154bf0 2024-03-28T13:50:31.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.370+0000 7f4665400640 1 --2- 172.21.15.76:0/426663023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4660154bf0 0x7f46600c61b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f46580b2040 tx=0x7f465801bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:31.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.374+0000 7f465cc00640 1 -- 172.21.15.76:0/426663023 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46580c0070 con 0x7f4660154bf0 2024-03-28T13:50:31.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.378+0000 7f465cc00640 1 -- 172.21.15.76:0/426663023 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46580afcc0 con 0x7f4660154bf0 2024-03-28T13:50:31.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.378+0000 7f4665e00640 1 -- 172.21.15.76:0/426663023 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46600c5b20 con 0x7f4660154bf0 2024-03-28T13:50:31.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.378+0000 7f465cc00640 1 -- 172.21.15.76:0/426663023 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46580b4040 con 0x7f4660154bf0 2024-03-28T13:50:31.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.378+0000 7f4665e00640 1 -- 172.21.15.76:0/426663023 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46601f0b70 con 0x7f4660154bf0 2024-03-28T13:50:31.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.378+0000 7f4665e00640 1 -- 172.21.15.76:0/426663023 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46600686e0 con 0x7f4660154bf0 2024-03-28T13:50:31.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.398+0000 7f465cc00640 1 -- 172.21.15.76:0/426663023 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f46580c3070 con 0x7f4660154bf0 2024-03-28T13:50:31.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.398+0000 7f465cc00640 1 --2- 172.21.15.76:0/426663023 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f4640068010 0x7f464006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:31.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.398+0000 7f4664a00640 1 --2- 172.21.15.76:0/426663023 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f4640068010 0x7f464006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:31.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.398+0000 7f4664a00640 1 --2- 172.21.15.76:0/426663023 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f4640068010 0x7f464006a4d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4654001810 tx=0x7f4654009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:31.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.402+0000 7f465cc00640 1 -- 172.21.15.76:0/426663023 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f46580f2190 con 0x7f4660154bf0 2024-03-28T13:50:31.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.402+0000 7f465cc00640 1 --2- 172.21.15.76:0/426663023 >> [v2:172.21.15.76:6810/2409656853,v1:172.21.15.76:6811/2409656853] conn(0x7f46400719b0 0x7f4640073e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:31.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.402+0000 7f465cc00640 1 -- 172.21.15.76:0/426663023 --> [v2:172.21.15.76:6810/2409656853,v1:172.21.15.76:6811/2409656853] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46580ade50 con 0x7f46400719b0 2024-03-28T13:50:31.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.402+0000 7f465cc00640 1 -- 172.21.15.76:0/426663023 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f46580f0390 con 0x7f4660154bf0 2024-03-28T13:50:31.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.402+0000 7f465fe00640 1 --2- 172.21.15.76:0/426663023 >> [v2:172.21.15.76:6810/2409656853,v1:172.21.15.76:6811/2409656853] conn(0x7f46400719b0 0x7f4640073e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:31.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.402+0000 7f465fe00640 1 --2- 172.21.15.76:0/426663023 >> [v2:172.21.15.76:6810/2409656853,v1:172.21.15.76:6811/2409656853] conn(0x7f46400719b0 0x7f4640073e50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:31.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.402+0000 7f465cc00640 1 -- 172.21.15.76:0/426663023 <== osd.3 v2:172.21.15.76:6810/2409656853 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f46580ade50 con 0x7f46400719b0 2024-03-28T13:50:31.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.430+0000 7f4665e00640 1 -- 172.21.15.76:0/426663023 --> [v2:172.21.15.76:6810/2409656853,v1:172.21.15.76:6811/2409656853] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f466014a1f0 con 0x7f46400719b0 2024-03-28T13:50:31.432 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.430+0000 7f465cc00640 1 -- 172.21.15.76:0/426663023 <== osd.3 v2:172.21.15.76:6810/2409656853 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f466014a1f0 con 0x7f46400719b0 2024-03-28T13:50:31.432 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-03-28T13:50:31.433 INFO:teuthology.orchestra.run.smithi076.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-28T13:50:31.433 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-03-28T13:50:31.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.434+0000 7f4665e00640 1 -- 172.21.15.76:0/426663023 >> [v2:172.21.15.76:6810/2409656853,v1:172.21.15.76:6811/2409656853] conn(0x7f46400719b0 msgr2=0x7f4640073e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:31.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.434+0000 7f4665e00640 1 --2- 172.21.15.76:0/426663023 >> [v2:172.21.15.76:6810/2409656853,v1:172.21.15.76:6811/2409656853] conn(0x7f46400719b0 0x7f4640073e50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:31.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.434+0000 7f4665e00640 1 -- 172.21.15.76:0/426663023 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f4640068010 msgr2=0x7f464006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:31.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.434+0000 7f4665e00640 1 --2- 172.21.15.76:0/426663023 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f4640068010 0x7f464006a4d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4654001810 tx=0x7f4654009040 comp rx=0 tx=0).stop 2024-03-28T13:50:31.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.434+0000 7f4665e00640 1 -- 172.21.15.76:0/426663023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4660154bf0 msgr2=0x7f46600c61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:31.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.434+0000 7f4665e00640 1 --2- 172.21.15.76:0/426663023 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f4660154bf0 0x7f46600c61b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f46580b2040 tx=0x7f465801bf80 comp rx=0 tx=0).stop 2024-03-28T13:50:31.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.434+0000 7f4665400640 1 -- 172.21.15.76:0/426663023 reap_dead start 2024-03-28T13:50:31.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.434+0000 7f4665e00640 1 -- 172.21.15.76:0/426663023 shutdown_connections 2024-03-28T13:50:31.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.434+0000 7f4665e00640 1 -- 172.21.15.76:0/426663023 >> 172.21.15.76:0/426663023 conn(0x7f4660073650 msgr2=0x7f46600c76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:31.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.434+0000 7f4665e00640 1 -- 172.21.15.76:0/426663023 shutdown_connections 2024-03-28T13:50:31.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.434+0000 7f4665e00640 1 -- 172.21.15.76:0/426663023 wait complete. 2024-03-28T13:50:31.455 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-28T13:50:31.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.602+0000 7f0498200640 1 Processor -- start 2024-03-28T13:50:31.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.602+0000 7f0498200640 1 -- start start 2024-03-28T13:50:31.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.606+0000 7f0498200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f04900c9a70 0x7f04900c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:31.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.606+0000 7f0498200640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f049006ee50 0x7f049015e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:31.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.606+0000 7f0498200640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04900c3b10 con 0x7f0490070080 2024-03-28T13:50:31.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.606+0000 7f0498200640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f04900c3db0 con 0x7f049006ee50 2024-03-28T13:50:31.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.606+0000 7f0498200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f0490154e90 con 0x7f04900c9a70 2024-03-28T13:50:31.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.606+0000 7f0494e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f049006ee50 0x7f049015e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:31.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.606+0000 7f0495800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f04900c9a70 0x7f04900c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:31.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.606+0000 7f0495800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f04900c9a70 0x7f04900c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:42388/0 (socket says 172.21.15.76:42388) 2024-03-28T13:50:31.607 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.606+0000 7f0495800640 1 -- 172.21.15.76:0/4221773572 learned_addr learned my addr 172.21.15.76:0/4221773572 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:31.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.610+0000 7f0494e00640 1 -- 172.21.15.76:0/4221773572 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f04900c9a70 msgr2=0x7f04900c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:31.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.610+0000 7f0494e00640 1 --2- 172.21.15.76:0/4221773572 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f04900c9a70 0x7f04900c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:31.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.610+0000 7f0494e00640 1 -- 172.21.15.76:0/4221773572 >> v1:172.21.15.111:6789/0 conn(0x7f0490070080 legacy=0x7f049006b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:31.612 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.610+0000 7f0494e00640 1 -- 172.21.15.76:0/4221773572 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049006f5e0 con 0x7f049006ee50 2024-03-28T13:50:31.616 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.614+0000 7f0494e00640 1 --2- 172.21.15.76:0/4221773572 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f049006ee50 0x7f049015e5b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f047c0097c0 tx=0x7f047c01c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=268140b7457b04b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:31.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.626+0000 7f048fe00640 1 -- 172.21.15.76:0/4221773572 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c0b0070 con 0x7f049006ee50 2024-03-28T13:50:31.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.626+0000 7f048fe00640 1 -- 172.21.15.76:0/4221773572 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f047c0ab600 con 0x7f049006ee50 2024-03-28T13:50:31.626 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.626+0000 7f048fe00640 1 -- 172.21.15.76:0/4221773572 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c0ab9d0 con 0x7f049006ee50 2024-03-28T13:50:31.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.626+0000 7f0498200640 1 -- 172.21.15.76:0/4221773572 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f049006ee50 msgr2=0x7f049015e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:31.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.626+0000 7f0498200640 1 --2- 172.21.15.76:0/4221773572 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f049006ee50 0x7f049015e5b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f047c0097c0 tx=0x7f047c01c460 comp rx=0 tx=0).stop 2024-03-28T13:50:31.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.626+0000 7f0498200640 1 -- 172.21.15.76:0/4221773572 shutdown_connections 2024-03-28T13:50:31.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.626+0000 7f0498200640 1 --2- 172.21.15.76:0/4221773572 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f049006ee50 0x7f049015e5b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:31.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.626+0000 7f0498200640 1 --2- 172.21.15.76:0/4221773572 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f04900c9a70 0x7f04900c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:31.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.626+0000 7f0498200640 1 -- 172.21.15.76:0/4221773572 >> 172.21.15.76:0/4221773572 conn(0x7f0490070ca0 msgr2=0x7f04900710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:31.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.626+0000 7f0498200640 1 -- 172.21.15.76:0/4221773572 shutdown_connections 2024-03-28T13:50:31.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.626+0000 7f0498200640 1 -- 172.21.15.76:0/4221773572 wait complete. 2024-03-28T13:50:31.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.626+0000 7f0498200640 1 Processor -- start 2024-03-28T13:50:31.628 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.626+0000 7f0498200640 1 -- start start 2024-03-28T13:50:31.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.630+0000 7f0498200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f049006ee50 0x7f0490156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:31.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.630+0000 7f0498200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0490070080 0x7f0490155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:31.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.630+0000 7f0498200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04900c9a70 0x7f0490145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:31.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.630+0000 7f0498200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f04900c81c0 con 0x7f0490070080 2024-03-28T13:50:31.629 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.630+0000 7f0498200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f04900c8040 con 0x7f04900c9a70 2024-03-28T13:50:31.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.630+0000 7f0498200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f04901683a0 con 0x7f049006ee50 2024-03-28T13:50:31.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.630+0000 7f0495800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f049006ee50 0x7f0490156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:31.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.630+0000 7f0494e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0490070080 0x7f0490155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:31.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.630+0000 7f0496200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04900c9a70 0x7f0490145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:31.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.630+0000 7f0494e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0490070080 0x7f0490155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53092/0 (socket says 172.21.15.76:53092) 2024-03-28T13:50:31.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.630+0000 7f0494e00640 1 -- 172.21.15.76:0/130338799 learned_addr learned my addr 172.21.15.76:0/130338799 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:31.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.634+0000 7f0494e00640 1 -- 172.21.15.76:0/130338799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f049006ee50 msgr2=0x7f0490156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:31.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.634+0000 7f0494e00640 1 --2- 172.21.15.76:0/130338799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f049006ee50 0x7f0490156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:31.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.634+0000 7f0494e00640 1 -- 172.21.15.76:0/130338799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04900c9a70 msgr2=0x7f0490145610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:31.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.634+0000 7f0494e00640 1 --2- 172.21.15.76:0/130338799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04900c9a70 0x7f0490145610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:31.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.634+0000 7f0494e00640 1 -- 172.21.15.76:0/130338799 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0490142270 con 0x7f0490070080 2024-03-28T13:50:31.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.634+0000 7f0494e00640 1 --2- 172.21.15.76:0/130338799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0490070080 0x7f0490155a30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f047c0ae040 tx=0x7f047c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:31.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.638+0000 7f048d600640 1 -- 172.21.15.76:0/130338799 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c0ba070 con 0x7f0490070080 2024-03-28T13:50:31.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.638+0000 7f048d600640 1 -- 172.21.15.76:0/130338799 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f047c0b43f0 con 0x7f0490070080 2024-03-28T13:50:31.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.638+0000 7f048d600640 1 -- 172.21.15.76:0/130338799 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c0b0040 con 0x7f0490070080 2024-03-28T13:50:31.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.638+0000 7f0498200640 1 -- 172.21.15.76:0/130338799 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0490142510 con 0x7f0490070080 2024-03-28T13:50:31.640 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.638+0000 7f0498200640 1 -- 172.21.15.76:0/130338799 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04900c5c10 con 0x7f0490070080 2024-03-28T13:50:31.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.642+0000 7f0498200640 1 -- 172.21.15.76:0/130338799 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04900686e0 con 0x7f0490070080 2024-03-28T13:50:31.660 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.658+0000 7f048d600640 1 -- 172.21.15.76:0/130338799 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f047c0b47c0 con 0x7f0490070080 2024-03-28T13:50:31.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.662+0000 7f048d600640 1 --2- 172.21.15.76:0/130338799 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0470067fc0 0x7f047006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:31.661 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.662+0000 7f0495800640 1 --2- 172.21.15.76:0/130338799 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0470067fc0 0x7f047006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:31.662 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.662+0000 7f0495800640 1 --2- 172.21.15.76:0/130338799 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0470067fc0 0x7f047006a480 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0484009ab0 tx=0x7f0484009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:31.664 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.662+0000 7f048d600640 1 -- 172.21.15.76:0/130338799 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f047c0edc20 con 0x7f0490070080 2024-03-28T13:50:31.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:31.930+0000 7f048d600640 1 -- 172.21.15.76:0/130338799 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f047c0c3020 con 0x7f0490070080 2024-03-28T13:50:32.178 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.178+0000 7f0498200640 1 -- 172.21.15.76:0/130338799 --> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f04900c5770 con 0x7f0470067fc0 2024-03-28T13:50:32.179 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.178+0000 7f048d600640 1 -- 172.21.15.76:0/130338799 <== mgr.4107 v2:172.21.15.76:6800/1313648511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0484011a00 con 0x7f0470067fc0 2024-03-28T13:50:32.179 INFO:teuthology.orchestra.run.smithi076.stderr:instructed osd(s) 3 to deep-scrub 2024-03-28T13:50:32.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.182+0000 7f0498200640 1 -- 172.21.15.76:0/130338799 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0470067fc0 msgr2=0x7f047006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:32.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.182+0000 7f0498200640 1 --2- 172.21.15.76:0/130338799 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0470067fc0 0x7f047006a480 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0484009ab0 tx=0x7f0484009240 comp rx=0 tx=0).stop 2024-03-28T13:50:32.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.182+0000 7f0498200640 1 -- 172.21.15.76:0/130338799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0490070080 msgr2=0x7f0490155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:32.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.182+0000 7f0498200640 1 --2- 172.21.15.76:0/130338799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0490070080 0x7f0490155a30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f047c0ae040 tx=0x7f047c019200 comp rx=0 tx=0).stop 2024-03-28T13:50:32.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.182+0000 7f0498200640 1 -- 172.21.15.76:0/130338799 shutdown_connections 2024-03-28T13:50:32.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.182+0000 7f0498200640 1 --2- 172.21.15.76:0/130338799 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0470067fc0 0x7f047006a480 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:32.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.182+0000 7f0498200640 1 --2- 172.21.15.76:0/130338799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04900c9a70 0x7f0490145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:32.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.182+0000 7f0498200640 1 --2- 172.21.15.76:0/130338799 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f0490070080 0x7f0490155a30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:32.183 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.182+0000 7f0498200640 1 --2- 172.21.15.76:0/130338799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f049006ee50 0x7f0490156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:32.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.182+0000 7f0498200640 1 -- 172.21.15.76:0/130338799 >> 172.21.15.76:0/130338799 conn(0x7f0490070ca0 msgr2=0x7f0490071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:32.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.182+0000 7f0498200640 1 -- 172.21.15.76:0/130338799 shutdown_connections 2024-03-28T13:50:32.184 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.182+0000 7f0498200640 1 -- 172.21.15.76:0/130338799 wait complete. 2024-03-28T13:50:32.213 INFO:tasks.ceph:Scrubbing osd.4 2024-03-28T13:50:32.213 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-28T13:50:32.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.370+0000 7f0890400640 1 Processor -- start 2024-03-28T13:50:32.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.370+0000 7f0890400640 1 -- start start 2024-03-28T13:50:32.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.370+0000 7f0890400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f08881528b0 0x7f08880c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:32.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.370+0000 7f0890400640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f088806dbe0 con 0x7f088806eeb0 2024-03-28T13:50:32.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.370+0000 7f0890400640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f088806dea0 con 0x7f0888072150 2024-03-28T13:50:32.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.370+0000 7f0890400640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f08880c7860 con 0x7f08881528b0 2024-03-28T13:50:32.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.374+0000 7f088e400640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f0888072150 0x7f088806e300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:49908/0 (socket says 172.21.15.76:49908) 2024-03-28T13:50:32.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.374+0000 7f088e400640 1 -- 172.21.15.76:0/2462914337 learned_addr learned my addr 172.21.15.76:0/2462914337 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:50:32.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.374+0000 7f088da00640 1 --2- 172.21.15.76:0/2462914337 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f08881528b0 0x7f08880c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:32.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.374+0000 7f0887e00640 1 -- 172.21.15.76:0/2462914337 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1530359967 0 0) 0x7f088806dbe0 con 0x7f088806eeb0 2024-03-28T13:50:32.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.374+0000 7f0887e00640 1 -- 172.21.15.76:0/2462914337 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0870003530 con 0x7f088806eeb0 2024-03-28T13:50:32.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.378+0000 7f088da00640 1 -- 172.21.15.76:0/2462914337 >> v1:172.21.15.111:6789/0 conn(0x7f0888072150 legacy=0x7f088806e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:32.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.378+0000 7f088da00640 1 -- 172.21.15.76:0/2462914337 >> v1:172.21.15.76:6789/0 conn(0x7f088806eeb0 legacy=0x7f0888159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:32.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.378+0000 7f088da00640 1 -- 172.21.15.76:0/2462914337 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08880c6f30 con 0x7f08881528b0 2024-03-28T13:50:32.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.382+0000 7f088da00640 1 --2- 172.21.15.76:0/2462914337 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f08881528b0 0x7f08880c7cf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f087c0097f0 tx=0x7f087c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b21ef304535050b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:32.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.390+0000 7f0887e00640 1 -- 172.21.15.76:0/2462914337 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c0aa610 con 0x7f08881528b0 2024-03-28T13:50:32.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.390+0000 7f0887e00640 1 -- 172.21.15.76:0/2462914337 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087c0af070 con 0x7f08881528b0 2024-03-28T13:50:32.391 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.390+0000 7f0887e00640 1 -- 172.21.15.76:0/2462914337 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c0aa9d0 con 0x7f08881528b0 2024-03-28T13:50:32.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.390+0000 7f0890400640 1 -- 172.21.15.76:0/2462914337 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f08881528b0 msgr2=0x7f08880c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:32.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.390+0000 7f0890400640 1 --2- 172.21.15.76:0/2462914337 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f08881528b0 0x7f08880c7cf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f087c0097f0 tx=0x7f087c01c4b0 comp rx=0 tx=0).stop 2024-03-28T13:50:32.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.390+0000 7f0890400640 1 -- 172.21.15.76:0/2462914337 shutdown_connections 2024-03-28T13:50:32.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.390+0000 7f0890400640 1 --2- 172.21.15.76:0/2462914337 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f08881528b0 0x7f08880c7cf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:32.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.390+0000 7f0890400640 1 -- 172.21.15.76:0/2462914337 >> 172.21.15.76:0/2462914337 conn(0x7f08880c8ad0 msgr2=0x7f08880c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:32.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.390+0000 7f0890400640 1 -- 172.21.15.76:0/2462914337 shutdown_connections 2024-03-28T13:50:32.392 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.390+0000 7f0890400640 1 -- 172.21.15.76:0/2462914337 wait complete. 2024-03-28T13:50:32.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.394+0000 7f0890400640 1 Processor -- start 2024-03-28T13:50:32.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.394+0000 7f0890400640 1 -- start start 2024-03-28T13:50:32.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.394+0000 7f0890400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f088806eeb0 0x7f08880c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:32.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.394+0000 7f0890400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0888072150 0x7f088814e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:32.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.394+0000 7f0890400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f08881528b0 0x7f088814eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:32.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.394+0000 7f0890400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f088806d940 con 0x7f088806eeb0 2024-03-28T13:50:32.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.394+0000 7f0890400640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f088806d7c0 con 0x7f08881528b0 2024-03-28T13:50:32.396 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.394+0000 7f0890400640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f088806ea10 con 0x7f0888072150 2024-03-28T13:50:32.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.398+0000 7f088da00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f088806eeb0 0x7f08880c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:32.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.398+0000 7f088e400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f08881528b0 0x7f088814eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:32.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.398+0000 7f088da00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f088806eeb0 0x7f08880c4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:53096/0 (socket says 172.21.15.76:53096) 2024-03-28T13:50:32.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.398+0000 7f088da00640 1 -- 172.21.15.76:0/4039063865 learned_addr learned my addr 172.21.15.76:0/4039063865 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:32.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.398+0000 7f088d000640 1 --2- 172.21.15.76:0/4039063865 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0888072150 0x7f088814e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:32.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.402+0000 7f088da00640 1 -- 172.21.15.76:0/4039063865 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0888072150 msgr2=0x7f088814e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:32.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.402+0000 7f088da00640 1 --2- 172.21.15.76:0/4039063865 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0888072150 0x7f088814e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:32.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.402+0000 7f088da00640 1 -- 172.21.15.76:0/4039063865 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f08881528b0 msgr2=0x7f088814eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:32.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.402+0000 7f088da00640 1 --2- 172.21.15.76:0/4039063865 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f08881528b0 0x7f088814eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:32.403 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.402+0000 7f088da00640 1 -- 172.21.15.76:0/4039063865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0888150950 con 0x7f088806eeb0 2024-03-28T13:50:32.406 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.406+0000 7f088da00640 1 --2- 172.21.15.76:0/4039063865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f088806eeb0 0x7f08880c4b70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f087c01a0e0 tx=0x7f087c019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:32.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.410+0000 7f0885600640 1 -- 172.21.15.76:0/4039063865 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c0aabb0 con 0x7f088806eeb0 2024-03-28T13:50:32.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.410+0000 7f0885600640 1 -- 172.21.15.76:0/4039063865 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087c0aad90 con 0x7f088806eeb0 2024-03-28T13:50:32.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.410+0000 7f0885600640 1 -- 172.21.15.76:0/4039063865 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c0be690 con 0x7f088806eeb0 2024-03-28T13:50:32.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.410+0000 7f0890400640 1 -- 172.21.15.76:0/4039063865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0888150c30 con 0x7f088806eeb0 2024-03-28T13:50:32.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.410+0000 7f0890400640 1 -- 172.21.15.76:0/4039063865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0888150650 con 0x7f088806eeb0 2024-03-28T13:50:32.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.410+0000 7f0890400640 1 -- 172.21.15.76:0/4039063865 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0888068860 con 0x7f088806eeb0 2024-03-28T13:50:32.443 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.442+0000 7f0885600640 1 -- 172.21.15.76:0/4039063865 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f087c0c73f0 con 0x7f088806eeb0 2024-03-28T13:50:32.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.442+0000 7f0885600640 1 --2- 172.21.15.76:0/4039063865 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0868068010 0x7f086806a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:32.444 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.442+0000 7f088d000640 1 --2- 172.21.15.76:0/4039063865 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0868068010 0x7f086806a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:32.445 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.446+0000 7f088d000640 1 --2- 172.21.15.76:0/4039063865 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0868068010 0x7f086806a4d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f08880c31d0 tx=0x7f0874009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:32.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.450+0000 7f0885600640 1 -- 172.21.15.76:0/4039063865 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f087c0ef140 con 0x7f088806eeb0 2024-03-28T13:50:32.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.450+0000 7f0885600640 1 --2- 172.21.15.76:0/4039063865 >> [v2:172.21.15.111:6808/3817953131,v1:172.21.15.111:6810/3817953131] conn(0x7f08680719a0 0x7f0868073e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:32.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.450+0000 7f0885600640 1 -- 172.21.15.76:0/4039063865 --> [v2:172.21.15.111:6808/3817953131,v1:172.21.15.111:6810/3817953131] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0868074510 con 0x7f08680719a0 2024-03-28T13:50:32.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.450+0000 7f0885600640 1 -- 172.21.15.76:0/4039063865 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f087c0ed340 con 0x7f088806eeb0 2024-03-28T13:50:32.450 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.450+0000 7f088e400640 1 --2- 172.21.15.76:0/4039063865 >> [v2:172.21.15.111:6808/3817953131,v1:172.21.15.111:6810/3817953131] conn(0x7f08680719a0 0x7f0868073e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:32.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.450+0000 7f088e400640 1 --2- 172.21.15.76:0/4039063865 >> [v2:172.21.15.111:6808/3817953131,v1:172.21.15.111:6810/3817953131] conn(0x7f08680719a0 0x7f0868073e40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:32.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.450+0000 7f0885600640 1 -- 172.21.15.76:0/4039063865 <== osd.4 v2:172.21.15.111:6808/3817953131 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0868074510 con 0x7f08680719a0 2024-03-28T13:50:32.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.466+0000 7f0890400640 1 -- 172.21.15.76:0/4039063865 --> [v2:172.21.15.111:6808/3817953131,v1:172.21.15.111:6810/3817953131] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f088806e0e0 con 0x7f08680719a0 2024-03-28T13:50:32.466 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.466+0000 7f0885600640 1 -- 172.21.15.76:0/4039063865 <== osd.4 v2:172.21.15.111:6808/3817953131 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f088806e0e0 con 0x7f08680719a0 2024-03-28T13:50:32.467 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-03-28T13:50:32.467 INFO:teuthology.orchestra.run.smithi076.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-28T13:50:32.467 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-03-28T13:50:32.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.466+0000 7f0890400640 1 -- 172.21.15.76:0/4039063865 >> [v2:172.21.15.111:6808/3817953131,v1:172.21.15.111:6810/3817953131] conn(0x7f08680719a0 msgr2=0x7f0868073e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:32.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.466+0000 7f0890400640 1 --2- 172.21.15.76:0/4039063865 >> [v2:172.21.15.111:6808/3817953131,v1:172.21.15.111:6810/3817953131] conn(0x7f08680719a0 0x7f0868073e40 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:32.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.466+0000 7f0890400640 1 -- 172.21.15.76:0/4039063865 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0868068010 msgr2=0x7f086806a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:32.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.466+0000 7f0890400640 1 --2- 172.21.15.76:0/4039063865 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f0868068010 0x7f086806a4d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f08880c31d0 tx=0x7f0874009040 comp rx=0 tx=0).stop 2024-03-28T13:50:32.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.466+0000 7f0890400640 1 -- 172.21.15.76:0/4039063865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f088806eeb0 msgr2=0x7f08880c4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:32.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.466+0000 7f0890400640 1 --2- 172.21.15.76:0/4039063865 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f088806eeb0 0x7f08880c4b70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f087c01a0e0 tx=0x7f087c019250 comp rx=0 tx=0).stop 2024-03-28T13:50:32.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.466+0000 7f088e400640 1 -- 172.21.15.76:0/4039063865 reap_dead start 2024-03-28T13:50:32.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.466+0000 7f0890400640 1 -- 172.21.15.76:0/4039063865 shutdown_connections 2024-03-28T13:50:32.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.466+0000 7f0890400640 1 -- 172.21.15.76:0/4039063865 >> 172.21.15.76:0/4039063865 conn(0x7f08880c8ad0 msgr2=0x7f08880ca660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:32.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.466+0000 7f0890400640 1 -- 172.21.15.76:0/4039063865 shutdown_connections 2024-03-28T13:50:32.468 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.466+0000 7f0890400640 1 -- 172.21.15.76:0/4039063865 wait complete. 2024-03-28T13:50:32.493 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-28T13:50:32.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.706+0000 7ff671000640 1 Processor -- start 2024-03-28T13:50:32.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.706+0000 7ff671000640 1 -- start start 2024-03-28T13:50:32.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.710+0000 7ff671000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff66c0cab80 0x7ff66c0cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:32.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.710+0000 7ff671000640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff66c158680 con 0x7ff66c0cea30 2024-03-28T13:50:32.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.710+0000 7ff671000640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff66c0cb4f0 con 0x7ff66c152800 2024-03-28T13:50:32.709 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.710+0000 7ff671000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff66c159550 con 0x7ff66c0cab80 2024-03-28T13:50:32.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.710+0000 7ff669400640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7ff66c0cea30 0x7ff66c071d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:38608/0 (socket says 172.21.15.76:38608) 2024-03-28T13:50:32.710 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.710+0000 7ff669400640 1 -- 172.21.15.76:0/3220657956 learned_addr learned my addr 172.21.15.76:0/3220657956 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:50:32.711 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.710+0000 7ff66a800640 1 --2- 172.21.15.76:0/3220657956 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff66c0cab80 0x7ff66c0cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:32.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.714+0000 7ff668a00640 1 -- 172.21.15.76:0/3220657956 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766346355 0 0) 0x7ff66c158680 con 0x7ff66c0cea30 2024-03-28T13:50:32.714 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.714+0000 7ff668a00640 1 -- 172.21.15.76:0/3220657956 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff650003530 con 0x7ff66c0cea30 2024-03-28T13:50:32.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.718+0000 7ff668a00640 1 -- 172.21.15.76:0/3220657956 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1203500419 0 0) 0x7ff650003530 con 0x7ff66c0cea30 2024-03-28T13:50:32.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.718+0000 7ff668a00640 1 -- 172.21.15.76:0/3220657956 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff66c0cab80 msgr2=0x7ff66c0cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:32.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.718+0000 7ff668a00640 1 --2- 172.21.15.76:0/3220657956 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff66c0cab80 0x7ff66c0cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:32.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.718+0000 7ff668a00640 1 -- 172.21.15.76:0/3220657956 >> v1:172.21.15.111:6789/0 conn(0x7ff66c152800 legacy=0x7ff66c0c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:32.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.718+0000 7ff668a00640 1 -- 172.21.15.76:0/3220657956 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66c158940 con 0x7ff66c0cea30 2024-03-28T13:50:32.718 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.718+0000 7ff668a00640 1 -- 172.21.15.76:0/3220657956 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7ff6580016a0 con 0x7ff66c0cea30 2024-03-28T13:50:32.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.718+0000 7ff668a00640 1 -- 172.21.15.76:0/3220657956 >> v1:172.21.15.76:6789/0 conn(0x7ff66c0cea30 legacy=0x7ff66c071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:32.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.718+0000 7ff668a00640 1 --2- 172.21.15.76:0/3220657956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff650003a60 0x7ff650003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:32.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.718+0000 7ff668a00640 1 --2- 172.21.15.76:0/3220657956 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff66c0cab80 0x7ff650004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:32.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.718+0000 7ff668a00640 1 --2- 172.21.15.76:0/3220657956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff650004d50 0x7ff6500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:32.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.718+0000 7ff668a00640 1 -- 172.21.15.76:0/3220657956 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff65000bb60 con 0x7ff650004d50 2024-03-28T13:50:32.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.718+0000 7ff668a00640 1 -- 172.21.15.76:0/3220657956 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff65000bce0 con 0x7ff650003a60 2024-03-28T13:50:32.719 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.718+0000 7ff668a00640 1 -- 172.21.15.76:0/3220657956 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff65000bee0 con 0x7ff66c0cab80 2024-03-28T13:50:32.720 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.718+0000 7ff66a800640 1 --2- 172.21.15.76:0/3220657956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff650004d50 0x7ff6500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:32.723 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.722+0000 7ff669e00640 1 --2- 172.21.15.76:0/3220657956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff650003a60 0x7ff650003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:32.724 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.726+0000 7ff669400640 1 --2- 172.21.15.76:0/3220657956 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff66c0cab80 0x7ff650004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:32.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.726+0000 7ff66a800640 1 -- 172.21.15.76:0/3220657956 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff66c0cab80 msgr2=0x7ff650004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:32.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.726+0000 7ff66a800640 1 --2- 172.21.15.76:0/3220657956 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff66c0cab80 0x7ff650004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:32.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.726+0000 7ff66a800640 1 -- 172.21.15.76:0/3220657956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff650003a60 msgr2=0x7ff650003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:32.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.726+0000 7ff66a800640 1 --2- 172.21.15.76:0/3220657956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff650003a60 0x7ff650003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:32.726 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.726+0000 7ff66a800640 1 -- 172.21.15.76:0/3220657956 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff650003530 con 0x7ff650004d50 2024-03-28T13:50:32.731 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.730+0000 7ff66a800640 1 --2- 172.21.15.76:0/3220657956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff650004d50 0x7ff6500051d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff664009f90 tx=0x7ff66401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b95972f85d1bdb server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:32.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.734+0000 7ff668a00640 1 -- 172.21.15.76:0/3220657956 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6640b2070 con 0x7ff650004d50 2024-03-28T13:50:32.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.734+0000 7ff668a00640 1 -- 172.21.15.76:0/3220657956 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6640a5c50 con 0x7ff650004d50 2024-03-28T13:50:32.736 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.734+0000 7ff668a00640 1 -- 172.21.15.76:0/3220657956 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff664009c10 con 0x7ff650004d50 2024-03-28T13:50:32.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.738+0000 7ff671000640 1 -- 172.21.15.76:0/3220657956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff650004d50 msgr2=0x7ff6500051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:32.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.738+0000 7ff671000640 1 --2- 172.21.15.76:0/3220657956 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff650004d50 0x7ff6500051d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff664009f90 tx=0x7ff66401cc40 comp rx=0 tx=0).stop 2024-03-28T13:50:32.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.738+0000 7ff66a800640 1 -- 172.21.15.76:0/3220657956 reap_dead start 2024-03-28T13:50:32.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.738+0000 7ff671000640 1 -- 172.21.15.76:0/3220657956 shutdown_connections 2024-03-28T13:50:32.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.738+0000 7ff671000640 1 -- 172.21.15.76:0/3220657956 >> 172.21.15.76:0/3220657956 conn(0x7ff66c071540 msgr2=0x7ff66c070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:32.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.738+0000 7ff671000640 1 -- 172.21.15.76:0/3220657956 shutdown_connections 2024-03-28T13:50:32.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.738+0000 7ff671000640 1 -- 172.21.15.76:0/3220657956 wait complete. 2024-03-28T13:50:32.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.738+0000 7ff671000640 1 Processor -- start 2024-03-28T13:50:32.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.738+0000 7ff671000640 1 -- start start 2024-03-28T13:50:32.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.742+0000 7ff671000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff650004d50 0x7ff66c15aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:32.741 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.742+0000 7ff671000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff66c159840 0x7ff66c1f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:32.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.742+0000 7ff671000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff66c06db10 0x7ff66c14d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:32.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.742+0000 7ff671000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff66c158f00 con 0x7ff66c159840 2024-03-28T13:50:32.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.742+0000 7ff671000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff66c0cee60 con 0x7ff650004d50 2024-03-28T13:50:32.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.742+0000 7ff671000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff66c1591e0 con 0x7ff66c06db10 2024-03-28T13:50:32.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.742+0000 7ff669e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff650004d50 0x7ff66c15aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:32.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.742+0000 7ff669400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff66c159840 0x7ff66c1f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:32.743 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.742+0000 7ff669e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff650004d50 0x7ff66c15aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:56420/0 (socket says 172.21.15.76:56420) 2024-03-28T13:50:32.743 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.742+0000 7ff669e00640 1 -- 172.21.15.76:0/454662247 learned_addr learned my addr 172.21.15.76:0/454662247 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:32.743 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.742+0000 7ff66a800640 1 --2- 172.21.15.76:0/454662247 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff66c06db10 0x7ff66c14d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:32.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.746+0000 7ff669400640 1 -- 172.21.15.76:0/454662247 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff66c06db10 msgr2=0x7ff66c14d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:32.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.746+0000 7ff669400640 1 --2- 172.21.15.76:0/454662247 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff66c06db10 0x7ff66c14d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:32.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.746+0000 7ff669400640 1 -- 172.21.15.76:0/454662247 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff650004d50 msgr2=0x7ff66c15aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:32.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.746+0000 7ff669400640 1 --2- 172.21.15.76:0/454662247 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff650004d50 0x7ff66c15aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:32.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.746+0000 7ff669400640 1 -- 172.21.15.76:0/454662247 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66c1f0c00 con 0x7ff66c159840 2024-03-28T13:50:32.749 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.750+0000 7ff669400640 1 --2- 172.21.15.76:0/454662247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff66c159840 0x7ff66c1f06c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff65800e7e0 tx=0x7ff65800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:32.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.754+0000 7ff662000640 1 -- 172.21.15.76:0/454662247 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65800c6c0 con 0x7ff66c159840 2024-03-28T13:50:32.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.754+0000 7ff662000640 1 -- 172.21.15.76:0/454662247 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff658018070 con 0x7ff66c159840 2024-03-28T13:50:32.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.754+0000 7ff662000640 1 -- 172.21.15.76:0/454662247 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65800cac0 con 0x7ff66c159840 2024-03-28T13:50:32.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.754+0000 7ff671000640 1 -- 172.21.15.76:0/454662247 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff66c1f33b0 con 0x7ff66c159840 2024-03-28T13:50:32.754 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.754+0000 7ff671000640 1 -- 172.21.15.76:0/454662247 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff66c06e380 con 0x7ff66c159840 2024-03-28T13:50:32.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.754+0000 7ff671000640 1 -- 172.21.15.76:0/454662247 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff66c0686e0 con 0x7ff66c159840 2024-03-28T13:50:32.782 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.782+0000 7ff662000640 1 -- 172.21.15.76:0/454662247 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff65800cc60 con 0x7ff66c159840 2024-03-28T13:50:32.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.782+0000 7ff662000640 1 --2- 172.21.15.76:0/454662247 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff64c068040 0x7ff64c06a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:32.783 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.782+0000 7ff669e00640 1 --2- 172.21.15.76:0/454662247 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff64c068040 0x7ff64c06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:32.784 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.782+0000 7ff669e00640 1 --2- 172.21.15.76:0/454662247 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff64c068040 0x7ff64c06a500 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff65c001060 tx=0x7ff65c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:32.788 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:32.786+0000 7ff662000640 1 -- 172.21.15.76:0/454662247 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7ff658054bd0 con 0x7ff66c159840 2024-03-28T13:50:33.147 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.146+0000 7ff662000640 1 -- 172.21.15.76:0/454662247 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ff66c1f0c00 con 0x7ff66c159840 2024-03-28T13:50:33.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.326+0000 7ff671000640 1 -- 172.21.15.76:0/454662247 --> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7ff66c14cd50 con 0x7ff64c068040 2024-03-28T13:50:33.325 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.326+0000 7ff662000640 1 -- 172.21.15.76:0/454662247 <== mgr.4107 v2:172.21.15.76:6800/1313648511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff66c14cd50 con 0x7ff64c068040 2024-03-28T13:50:33.326 INFO:teuthology.orchestra.run.smithi076.stderr:instructed osd(s) 4 to deep-scrub 2024-03-28T13:50:33.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.326+0000 7ff671000640 1 -- 172.21.15.76:0/454662247 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff64c068040 msgr2=0x7ff64c06a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:33.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.326+0000 7ff671000640 1 --2- 172.21.15.76:0/454662247 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff64c068040 0x7ff64c06a500 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff65c001060 tx=0x7ff65c009040 comp rx=0 tx=0).stop 2024-03-28T13:50:33.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.326+0000 7ff671000640 1 -- 172.21.15.76:0/454662247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff66c159840 msgr2=0x7ff66c1f06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:33.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.326+0000 7ff671000640 1 --2- 172.21.15.76:0/454662247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff66c159840 0x7ff66c1f06c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff65800e7e0 tx=0x7ff65800eca0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.326+0000 7ff671000640 1 -- 172.21.15.76:0/454662247 shutdown_connections 2024-03-28T13:50:33.328 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.326+0000 7ff671000640 1 --2- 172.21.15.76:0/454662247 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff64c068040 0x7ff64c06a500 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.326+0000 7ff671000640 1 --2- 172.21.15.76:0/454662247 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff66c06db10 0x7ff66c14d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.326+0000 7ff671000640 1 --2- 172.21.15.76:0/454662247 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff66c159840 0x7ff66c1f06c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.326+0000 7ff671000640 1 --2- 172.21.15.76:0/454662247 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff650004d50 0x7ff66c15aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.326+0000 7ff671000640 1 -- 172.21.15.76:0/454662247 >> 172.21.15.76:0/454662247 conn(0x7ff66c071540 msgr2=0x7ff66c14f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:33.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.326+0000 7ff671000640 1 -- 172.21.15.76:0/454662247 shutdown_connections 2024-03-28T13:50:33.329 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.326+0000 7ff671000640 1 -- 172.21.15.76:0/454662247 wait complete. 2024-03-28T13:50:33.357 INFO:tasks.ceph:Scrubbing osd.5 2024-03-28T13:50:33.357 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-28T13:50:33.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.514+0000 7f89a6800640 1 Processor -- start 2024-03-28T13:50:33.517 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.518+0000 7f89a6800640 1 -- start start 2024-03-28T13:50:33.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.518+0000 7f89a6800640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f89a015c630 0x7f89a00c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:33.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.518+0000 7f89a6800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89a0158fe0 0x7f89a00c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:33.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.518+0000 7f89a6800640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a0152c90 con 0x7f89a01528b0 2024-03-28T13:50:33.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.518+0000 7f89a6800640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f89a015c1a0 con 0x7f89a015c630 2024-03-28T13:50:33.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.518+0000 7f89a6800640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f89a00c74f0 con 0x7f89a0158fe0 2024-03-28T13:50:33.518 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.518+0000 7f89a5400640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f89a01528b0 0x7f89a006edb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:43674/0 (socket says 172.21.15.76:43674) 2024-03-28T13:50:33.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.518+0000 7f89a5400640 1 -- 172.21.15.76:0/3469857998 learned_addr learned my addr 172.21.15.76:0/3469857998 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:50:33.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.518+0000 7f89a4a00640 1 --2- 172.21.15.76:0/3469857998 >> v2:172.21.15.76:3300/0 conn(0x7f89a015c630 0x7f89a00c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:33.519 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.518+0000 7f89a5e00640 1 --2- 172.21.15.76:0/3469857998 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89a0158fe0 0x7f89a00c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:33.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.522+0000 7f89a5e00640 1 -- 172.21.15.76:0/3469857998 >> v2:172.21.15.76:3300/0 conn(0x7f89a015c630 msgr2=0x7f89a00c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:33.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.522+0000 7f89a5e00640 1 --2- 172.21.15.76:0/3469857998 >> v2:172.21.15.76:3300/0 conn(0x7f89a015c630 0x7f89a00c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.522+0000 7f89a5e00640 1 -- 172.21.15.76:0/3469857998 >> v1:172.21.15.111:6789/0 conn(0x7f89a01528b0 legacy=0x7f89a006edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:33.522 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.522+0000 7f89a5e00640 1 -- 172.21.15.76:0/3469857998 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a00ca9e0 con 0x7f89a0158fe0 2024-03-28T13:50:33.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.526+0000 7f89a5e00640 1 --2- 172.21.15.76:0/3469857998 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89a0158fe0 0x7f89a00c98b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8998009d90 tx=0x7f899801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebdeec1641434470 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:33.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.534+0000 7f899fe00640 1 -- 172.21.15.76:0/3469857998 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89980b2070 con 0x7f89a0158fe0 2024-03-28T13:50:33.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.534+0000 7f899fe00640 1 -- 172.21.15.76:0/3469857998 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89980a58b0 con 0x7f89a0158fe0 2024-03-28T13:50:33.533 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.534+0000 7f899fe00640 1 -- 172.21.15.76:0/3469857998 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89980a5c80 con 0x7f89a0158fe0 2024-03-28T13:50:33.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.534+0000 7f89a6800640 1 -- 172.21.15.76:0/3469857998 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89a0158fe0 msgr2=0x7f89a00c98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:33.534 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.534+0000 7f89a6800640 1 --2- 172.21.15.76:0/3469857998 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89a0158fe0 0x7f89a00c98b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8998009d90 tx=0x7f899801c8e0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.534+0000 7f89a6800640 1 -- 172.21.15.76:0/3469857998 shutdown_connections 2024-03-28T13:50:33.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.534+0000 7f89a6800640 1 --2- 172.21.15.76:0/3469857998 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89a0158fe0 0x7f89a00c98b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.534+0000 7f89a6800640 1 --2- 172.21.15.76:0/3469857998 >> v2:172.21.15.76:3300/0 conn(0x7f89a015c630 0x7f89a00c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.534+0000 7f89a6800640 1 -- 172.21.15.76:0/3469857998 >> 172.21.15.76:0/3469857998 conn(0x7f89a0070b90 msgr2=0x7f89a0070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:33.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.534+0000 7f89a6800640 1 -- 172.21.15.76:0/3469857998 shutdown_connections 2024-03-28T13:50:33.535 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.534+0000 7f89a6800640 1 -- 172.21.15.76:0/3469857998 wait complete. 2024-03-28T13:50:33.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.538+0000 7f89a6800640 1 Processor -- start 2024-03-28T13:50:33.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.538+0000 7f89a6800640 1 -- start start 2024-03-28T13:50:33.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.538+0000 7f89a6800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89a01528b0 0x7f89a014a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:33.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.538+0000 7f89a6800640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f89a0158fe0 0x7f89a0148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:33.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.538+0000 7f89a6800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89a015c630 0x7f89a0148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:33.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.538+0000 7f89a6800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f89a006fe30 con 0x7f89a01528b0 2024-03-28T13:50:33.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.538+0000 7f89a6800640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f89a00ca200 con 0x7f89a0158fe0 2024-03-28T13:50:33.539 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.538+0000 7f89a6800640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f89a015bb90 con 0x7f89a015c630 2024-03-28T13:50:33.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.538+0000 7f89a5400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89a01528b0 0x7f89a014a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:33.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.538+0000 7f89a5e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89a015c630 0x7f89a0148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:33.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.538+0000 7f89a4a00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f89a0158fe0 0x7f89a0148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:33.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.538+0000 7f89a5e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89a015c630 0x7f89a0148760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:57888/0 (socket says 172.21.15.76:57888) 2024-03-28T13:50:33.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.538+0000 7f89a5e00640 1 -- 172.21.15.76:0/988095462 learned_addr learned my addr 172.21.15.76:0/988095462 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:33.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.542+0000 7f89a5e00640 1 -- 172.21.15.76:0/988095462 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f89a0158fe0 msgr2=0x7f89a0148220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:33.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.542+0000 7f89a5e00640 1 --2- 172.21.15.76:0/988095462 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f89a0158fe0 0x7f89a0148220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.542+0000 7f89a5e00640 1 -- 172.21.15.76:0/988095462 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89a01528b0 msgr2=0x7f89a014a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:33.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.542+0000 7f89a5e00640 1 --2- 172.21.15.76:0/988095462 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f89a01528b0 0x7f89a014a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.542+0000 7f89a5e00640 1 -- 172.21.15.76:0/988095462 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a0145700 con 0x7f89a015c630 2024-03-28T13:50:33.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.546+0000 7f89a5e00640 1 --2- 172.21.15.76:0/988095462 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89a015c630 0x7f89a0148760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f89980b0040 tx=0x7f8998019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:33.551 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.550+0000 7f899d600640 1 -- 172.21.15.76:0/988095462 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89980b2050 con 0x7f89a015c630 2024-03-28T13:50:33.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.550+0000 7f899d600640 1 -- 172.21.15.76:0/988095462 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89980be070 con 0x7f89a015c630 2024-03-28T13:50:33.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.550+0000 7f899d600640 1 -- 172.21.15.76:0/988095462 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89980ad850 con 0x7f89a015c630 2024-03-28T13:50:33.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.550+0000 7f89a6800640 1 -- 172.21.15.76:0/988095462 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a0149930 con 0x7f89a015c630 2024-03-28T13:50:33.552 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.550+0000 7f89a6800640 1 -- 172.21.15.76:0/988095462 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a0145420 con 0x7f89a015c630 2024-03-28T13:50:33.553 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.554+0000 7f89a6800640 1 -- 172.21.15.76:0/988095462 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f89a0145210 con 0x7f89a015c630 2024-03-28T13:50:33.597 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.598+0000 7f899d600640 1 -- 172.21.15.76:0/988095462 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f89980ad9f0 con 0x7f89a015c630 2024-03-28T13:50:33.598 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.598+0000 7f899d600640 1 --2- 172.21.15.76:0/988095462 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8980068040 0x7f898006a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:33.599 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.598+0000 7f89a5400640 1 --2- 172.21.15.76:0/988095462 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8980068040 0x7f898006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:33.600 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.598+0000 7f89a5400640 1 --2- 172.21.15.76:0/988095462 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8980068040 0x7f898006a500 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8994000f70 tx=0x7f8994007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:33.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.602+0000 7f899d600640 1 -- 172.21.15.76:0/988095462 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f89980eff00 con 0x7f89a015c630 2024-03-28T13:50:33.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.602+0000 7f899d600640 1 --2- 172.21.15.76:0/988095462 >> [v2:172.21.15.111:6800/189114011,v1:172.21.15.111:6801/189114011] conn(0x7f8980071950 0x7f8980073df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:33.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.602+0000 7f899d600640 1 -- 172.21.15.76:0/988095462 --> [v2:172.21.15.111:6800/189114011,v1:172.21.15.111:6801/189114011] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f89800744c0 con 0x7f8980071950 2024-03-28T13:50:33.603 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.602+0000 7f899d600640 1 -- 172.21.15.76:0/988095462 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f89980ee100 con 0x7f89a015c630 2024-03-28T13:50:33.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.602+0000 7f89a4a00640 1 --2- 172.21.15.76:0/988095462 >> [v2:172.21.15.111:6800/189114011,v1:172.21.15.111:6801/189114011] conn(0x7f8980071950 0x7f8980073df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:33.604 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.602+0000 7f89a4a00640 1 --2- 172.21.15.76:0/988095462 >> [v2:172.21.15.111:6800/189114011,v1:172.21.15.111:6801/189114011] conn(0x7f8980071950 0x7f8980073df0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:33.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.606+0000 7f899d600640 1 -- 172.21.15.76:0/988095462 <== osd.5 v2:172.21.15.111:6800/189114011 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f89800744c0 con 0x7f8980071950 2024-03-28T13:50:33.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.634+0000 7f89a6800640 1 -- 172.21.15.76:0/988095462 --> [v2:172.21.15.111:6800/189114011,v1:172.21.15.111:6801/189114011] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f89a0068df0 con 0x7f8980071950 2024-03-28T13:50:33.634 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.634+0000 7f899d600640 1 -- 172.21.15.76:0/988095462 <== osd.5 v2:172.21.15.111:6800/189114011 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f89a0068df0 con 0x7f8980071950 2024-03-28T13:50:33.634 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-03-28T13:50:33.634 INFO:teuthology.orchestra.run.smithi076.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-28T13:50:33.634 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-03-28T13:50:33.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.634+0000 7f89a6800640 1 -- 172.21.15.76:0/988095462 >> [v2:172.21.15.111:6800/189114011,v1:172.21.15.111:6801/189114011] conn(0x7f8980071950 msgr2=0x7f8980073df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:33.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.634+0000 7f89a6800640 1 --2- 172.21.15.76:0/988095462 >> [v2:172.21.15.111:6800/189114011,v1:172.21.15.111:6801/189114011] conn(0x7f8980071950 0x7f8980073df0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.634+0000 7f89a6800640 1 -- 172.21.15.76:0/988095462 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8980068040 msgr2=0x7f898006a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:33.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.634+0000 7f89a6800640 1 --2- 172.21.15.76:0/988095462 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f8980068040 0x7f898006a500 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8994000f70 tx=0x7f8994007e90 comp rx=0 tx=0).stop 2024-03-28T13:50:33.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.634+0000 7f89a6800640 1 -- 172.21.15.76:0/988095462 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89a015c630 msgr2=0x7f89a0148760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:33.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.634+0000 7f89a6800640 1 --2- 172.21.15.76:0/988095462 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f89a015c630 0x7f89a0148760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f89980b0040 tx=0x7f8998019680 comp rx=0 tx=0).stop 2024-03-28T13:50:33.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.634+0000 7f89a5e00640 1 -- 172.21.15.76:0/988095462 reap_dead start 2024-03-28T13:50:33.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.634+0000 7f89a6800640 1 -- 172.21.15.76:0/988095462 shutdown_connections 2024-03-28T13:50:33.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.634+0000 7f89a6800640 1 -- 172.21.15.76:0/988095462 >> 172.21.15.76:0/988095462 conn(0x7f89a0070b90 msgr2=0x7f89a00c76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:33.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.634+0000 7f89a6800640 1 -- 172.21.15.76:0/988095462 shutdown_connections 2024-03-28T13:50:33.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.634+0000 7f89a6800640 1 -- 172.21.15.76:0/988095462 wait complete. 2024-03-28T13:50:33.654 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-28T13:50:33.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.798+0000 7f6b45800640 1 Processor -- start 2024-03-28T13:50:33.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.798+0000 7f6b45800640 1 -- start start 2024-03-28T13:50:33.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.798+0000 7f6b45800640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6b40154af0 0x7f6b4015a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:33.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.798+0000 7f6b45800640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f6b4006ef50 0x7f6b400ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:33.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.798+0000 7f6b45800640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b4015b5b0 con 0x7f6b400703c0 2024-03-28T13:50:33.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.798+0000 7f6b45800640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f6b400c9e90 con 0x7f6b4006ef50 2024-03-28T13:50:33.800 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.798+0000 7f6b45800640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f6b4015ad10 con 0x7f6b40154af0 2024-03-28T13:50:33.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.802+0000 7f6b44e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f6b4006ef50 0x7f6b400ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:33.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.802+0000 7f6b44e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f6b4006ef50 0x7f6b400ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37028/0 (socket says 172.21.15.76:37028) 2024-03-28T13:50:33.801 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.802+0000 7f6b44e00640 1 -- 172.21.15.76:0/3499279444 learned_addr learned my addr 172.21.15.76:0/3499279444 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:33.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.802+0000 7f6b3fe00640 1 --2- 172.21.15.76:0/3499279444 >> v2:172.21.15.111:3300/0 conn(0x7f6b40154af0 0x7f6b4015a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:33.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.802+0000 7f6b44e00640 1 -- 172.21.15.76:0/3499279444 >> v2:172.21.15.111:3300/0 conn(0x7f6b40154af0 msgr2=0x7f6b4015a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:33.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.802+0000 7f6b44e00640 1 --2- 172.21.15.76:0/3499279444 >> v2:172.21.15.111:3300/0 conn(0x7f6b40154af0 0x7f6b4015a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.802+0000 7f6b44e00640 1 -- 172.21.15.76:0/3499279444 >> v1:172.21.15.111:6789/0 conn(0x7f6b400703c0 legacy=0x7f6b400ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:33.804 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.802+0000 7f6b44e00640 1 -- 172.21.15.76:0/3499279444 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4015aff0 con 0x7f6b4006ef50 2024-03-28T13:50:33.810 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.810+0000 7f6b44e00640 1 --2- 172.21.15.76:0/3499279444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b4006ef50 0x7f6b400ccfe0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6b40073e00 tx=0x7f6b3801c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbf9be2122b68df server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:33.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.814+0000 7f6b3ea00640 1 -- 172.21.15.76:0/3499279444 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b380ac020 con 0x7f6b4006ef50 2024-03-28T13:50:33.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.814+0000 7f6b3ea00640 1 -- 172.21.15.76:0/3499279444 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b380a64a0 con 0x7f6b4006ef50 2024-03-28T13:50:33.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.814+0000 7f6b3ea00640 1 -- 172.21.15.76:0/3499279444 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b380a6870 con 0x7f6b4006ef50 2024-03-28T13:50:33.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.814+0000 7f6b45800640 1 -- 172.21.15.76:0/3499279444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b4006ef50 msgr2=0x7f6b400ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:33.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.814+0000 7f6b45800640 1 --2- 172.21.15.76:0/3499279444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b4006ef50 0x7f6b400ccfe0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6b40073e00 tx=0x7f6b3801c7d0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.814+0000 7f6b45800640 1 -- 172.21.15.76:0/3499279444 shutdown_connections 2024-03-28T13:50:33.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.814+0000 7f6b45800640 1 --2- 172.21.15.76:0/3499279444 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b4006ef50 0x7f6b400ccfe0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.814+0000 7f6b45800640 1 --2- 172.21.15.76:0/3499279444 >> v2:172.21.15.111:3300/0 conn(0x7f6b40154af0 0x7f6b4015a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.814+0000 7f6b45800640 1 -- 172.21.15.76:0/3499279444 >> 172.21.15.76:0/3499279444 conn(0x7f6b40073600 msgr2=0x7f6b40070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:33.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.814+0000 7f6b45800640 1 -- 172.21.15.76:0/3499279444 shutdown_connections 2024-03-28T13:50:33.816 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.814+0000 7f6b45800640 1 -- 172.21.15.76:0/3499279444 wait complete. 2024-03-28T13:50:33.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.818+0000 7f6b45800640 1 Processor -- start 2024-03-28T13:50:33.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.818+0000 7f6b45800640 1 -- start start 2024-03-28T13:50:33.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.818+0000 7f6b45800640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b4006ef50 0x7f6b40159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:33.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.818+0000 7f6b45800640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b400703c0 0x7f6b40157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:33.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.818+0000 7f6b45800640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b40154af0 0x7f6b40157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:33.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.818+0000 7f6b45800640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f6b40167910 con 0x7f6b400703c0 2024-03-28T13:50:33.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.818+0000 7f6b45800640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6b40167790 con 0x7f6b4006ef50 2024-03-28T13:50:33.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.818+0000 7f6b45800640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6b40167a90 con 0x7f6b40154af0 2024-03-28T13:50:33.819 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.818+0000 7f6b3f400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b400703c0 0x7f6b40157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:33.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.818+0000 7f6b3fe00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b4006ef50 0x7f6b40159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:33.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.818+0000 7f6b3f400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b400703c0 0x7f6b40157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37044/0 (socket says 172.21.15.76:37044) 2024-03-28T13:50:33.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.818+0000 7f6b3f400640 1 -- 172.21.15.76:0/858986811 learned_addr learned my addr 172.21.15.76:0/858986811 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:33.820 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.818+0000 7f6b44e00640 1 --2- 172.21.15.76:0/858986811 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b40154af0 0x7f6b40157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:33.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.822+0000 7f6b3f400640 1 -- 172.21.15.76:0/858986811 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b40154af0 msgr2=0x7f6b40157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:33.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.822+0000 7f6b3f400640 1 --2- 172.21.15.76:0/858986811 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b40154af0 0x7f6b40157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.822+0000 7f6b3f400640 1 -- 172.21.15.76:0/858986811 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b4006ef50 msgr2=0x7f6b40159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:33.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.822+0000 7f6b3f400640 1 --2- 172.21.15.76:0/858986811 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b4006ef50 0x7f6b40159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:33.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.822+0000 7f6b3f400640 1 -- 172.21.15.76:0/858986811 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b40158400 con 0x7f6b400703c0 2024-03-28T13:50:33.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.826+0000 7f6b3f400640 1 --2- 172.21.15.76:0/858986811 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b400703c0 0x7f6b40157350 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c00c450 tx=0x7f6b2c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:33.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.830+0000 7f6b37e00640 1 -- 172.21.15.76:0/858986811 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c011790 con 0x7f6b400703c0 2024-03-28T13:50:33.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.830+0000 7f6b37e00640 1 -- 172.21.15.76:0/858986811 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b2c017070 con 0x7f6b400703c0 2024-03-28T13:50:33.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.830+0000 7f6b37e00640 1 -- 172.21.15.76:0/858986811 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c011b90 con 0x7f6b400703c0 2024-03-28T13:50:33.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.830+0000 7f6b45800640 1 -- 172.21.15.76:0/858986811 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b401562f0 con 0x7f6b400703c0 2024-03-28T13:50:33.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.830+0000 7f6b45800640 1 -- 172.21.15.76:0/858986811 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b40156870 con 0x7f6b400703c0 2024-03-28T13:50:33.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.830+0000 7f6b45800640 1 -- 172.21.15.76:0/858986811 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b400686e0 con 0x7f6b400703c0 2024-03-28T13:50:33.863 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.862+0000 7f6b37e00640 1 -- 172.21.15.76:0/858986811 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f6b2c011d30 con 0x7f6b400703c0 2024-03-28T13:50:33.864 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.862+0000 7f6b37e00640 1 --2- 172.21.15.76:0/858986811 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6b20068040 0x7f6b2006a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:33.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.866+0000 7f6b3fe00640 1 --2- 172.21.15.76:0/858986811 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6b20068040 0x7f6b2006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:33.865 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:33.866+0000 7f6b3fe00640 1 --2- 172.21.15.76:0/858986811 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6b20068040 0x7f6b2006a500 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6b300079c0 tx=0x7f6b30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:34.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.146+0000 7f6b37e00640 1 -- 172.21.15.76:0/858986811 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f6b2c054ed0 con 0x7f6b400703c0 2024-03-28T13:50:34.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.146+0000 7f6b37e00640 1 -- 172.21.15.76:0/858986811 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f6b2c056e30 con 0x7f6b400703c0 2024-03-28T13:50:34.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.314+0000 7f6b45800640 1 -- 172.21.15.76:0/858986811 --> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f6b4006c490 con 0x7f6b20068040 2024-03-28T13:50:34.316 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.314+0000 7f6b37e00640 1 -- 172.21.15.76:0/858986811 <== mgr.4107 v2:172.21.15.76:6800/1313648511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6b4006c490 con 0x7f6b20068040 2024-03-28T13:50:34.316 INFO:teuthology.orchestra.run.smithi076.stderr:instructed osd(s) 5 to deep-scrub 2024-03-28T13:50:34.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.318+0000 7f6b45800640 1 -- 172.21.15.76:0/858986811 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6b20068040 msgr2=0x7f6b2006a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:34.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.318+0000 7f6b45800640 1 --2- 172.21.15.76:0/858986811 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6b20068040 0x7f6b2006a500 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6b300079c0 tx=0x7f6b30008040 comp rx=0 tx=0).stop 2024-03-28T13:50:34.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.318+0000 7f6b45800640 1 -- 172.21.15.76:0/858986811 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b400703c0 msgr2=0x7f6b40157350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:34.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.318+0000 7f6b45800640 1 --2- 172.21.15.76:0/858986811 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b400703c0 0x7f6b40157350 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c00c450 tx=0x7f6b2c00c910 comp rx=0 tx=0).stop 2024-03-28T13:50:34.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.318+0000 7f6b45800640 1 -- 172.21.15.76:0/858986811 shutdown_connections 2024-03-28T13:50:34.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.318+0000 7f6b45800640 1 --2- 172.21.15.76:0/858986811 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6b20068040 0x7f6b2006a500 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:34.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.318+0000 7f6b45800640 1 --2- 172.21.15.76:0/858986811 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b40154af0 0x7f6b40157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:34.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.318+0000 7f6b45800640 1 --2- 172.21.15.76:0/858986811 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6b400703c0 0x7f6b40157350 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:34.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.318+0000 7f6b45800640 1 --2- 172.21.15.76:0/858986811 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b4006ef50 0x7f6b40159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:34.320 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.318+0000 7f6b45800640 1 -- 172.21.15.76:0/858986811 >> 172.21.15.76:0/858986811 conn(0x7f6b40073600 msgr2=0x7f6b40158dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:34.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.318+0000 7f6b45800640 1 -- 172.21.15.76:0/858986811 shutdown_connections 2024-03-28T13:50:34.321 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.318+0000 7f6b45800640 1 -- 172.21.15.76:0/858986811 wait complete. 2024-03-28T13:50:34.340 INFO:tasks.ceph:Scrubbing osd.6 2024-03-28T13:50:34.341 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-28T13:50:34.523 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.522+0000 7f31e8c00640 1 Processor -- start 2024-03-28T13:50:34.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.522+0000 7f31e8c00640 1 -- start start 2024-03-28T13:50:34.524 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.522+0000 7f31e8c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f31e4151950 0x7f31e406e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:34.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.522+0000 7f31e8c00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f31e40c7900 0x7f31e406ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:34.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.522+0000 7f31e8c00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e40c2a40 con 0x7f31e40c93a0 2024-03-28T13:50:34.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.522+0000 7f31e8c00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f31e40c2d20 con 0x7f31e40c7900 2024-03-28T13:50:34.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.522+0000 7f31e8c00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f31e40c81f0 con 0x7f31e4151950 2024-03-28T13:50:34.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.526+0000 7f31e2a00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f31e40c7900 0x7f31e406ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:34.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.526+0000 7f31e2a00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f31e40c7900 0x7f31e406ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37060/0 (socket says 172.21.15.76:37060) 2024-03-28T13:50:34.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.526+0000 7f31e2a00640 1 -- 172.21.15.76:0/2809213259 learned_addr learned my addr 172.21.15.76:0/2809213259 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:34.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.530+0000 7f31e2a00640 1 -- 172.21.15.76:0/2809213259 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f31e4151950 msgr2=0x7f31e406e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:34.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.530+0000 7f31e2a00640 1 --2- 172.21.15.76:0/2809213259 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f31e4151950 0x7f31e406e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:34.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.530+0000 7f31e2a00640 1 -- 172.21.15.76:0/2809213259 >> v1:172.21.15.76:6789/0 conn(0x7f31e40c93a0 legacy=0x7f31e4157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:34.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.530+0000 7f31e2a00640 1 -- 172.21.15.76:0/2809213259 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e40c84d0 con 0x7f31e40c7900 2024-03-28T13:50:34.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.538+0000 7f31e2a00640 1 --2- 172.21.15.76:0/2809213259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31e40c7900 0x7f31e406ed90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f31d000bb10 tx=0x7f31d0021420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4976b43afb6dca server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:34.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.542+0000 7f31e2000640 1 -- 172.21.15.76:0/2809213259 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d00b6070 con 0x7f31e40c7900 2024-03-28T13:50:34.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.542+0000 7f31e2000640 1 -- 172.21.15.76:0/2809213259 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d00b1600 con 0x7f31e40c7900 2024-03-28T13:50:34.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.542+0000 7f31e2000640 1 -- 172.21.15.76:0/2809213259 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d00b19d0 con 0x7f31e40c7900 2024-03-28T13:50:34.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.542+0000 7f31e8c00640 1 -- 172.21.15.76:0/2809213259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31e40c7900 msgr2=0x7f31e406ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:34.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.542+0000 7f31e8c00640 1 --2- 172.21.15.76:0/2809213259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31e40c7900 0x7f31e406ed90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f31d000bb10 tx=0x7f31d0021420 comp rx=0 tx=0).stop 2024-03-28T13:50:34.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.542+0000 7f31e8c00640 1 -- 172.21.15.76:0/2809213259 shutdown_connections 2024-03-28T13:50:34.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.542+0000 7f31e8c00640 1 --2- 172.21.15.76:0/2809213259 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31e40c7900 0x7f31e406ed90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:34.543 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.542+0000 7f31e8c00640 1 --2- 172.21.15.76:0/2809213259 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f31e4151950 0x7f31e406e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:34.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.542+0000 7f31e8c00640 1 -- 172.21.15.76:0/2809213259 >> 172.21.15.76:0/2809213259 conn(0x7f31e40c9a00 msgr2=0x7f31e40c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:34.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.542+0000 7f31e8c00640 1 -- 172.21.15.76:0/2809213259 shutdown_connections 2024-03-28T13:50:34.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.542+0000 7f31e8c00640 1 -- 172.21.15.76:0/2809213259 wait complete. 2024-03-28T13:50:34.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.546+0000 7f31e8c00640 1 Processor -- start 2024-03-28T13:50:34.546 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.546+0000 7f31e8c00640 1 -- start start 2024-03-28T13:50:34.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.546+0000 7f31e8c00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31e40c7900 0x7f31e414ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:34.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.546+0000 7f31e8c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31e40c93a0 0x7f31e41f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:34.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.546+0000 7f31e8c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f31e4151950 0x7f31e41f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:34.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.546+0000 7f31e8c00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f31e4157d00 con 0x7f31e40c93a0 2024-03-28T13:50:34.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.546+0000 7f31e8c00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f31e4157b80 con 0x7f31e40c7900 2024-03-28T13:50:34.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.546+0000 7f31e8c00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f31e4157e80 con 0x7f31e4151950 2024-03-28T13:50:34.548 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.546+0000 7f31e2a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31e40c93a0 0x7f31e41f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:34.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.550+0000 7f31e2a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31e40c93a0 0x7f31e41f2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37068/0 (socket says 172.21.15.76:37068) 2024-03-28T13:50:34.550 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.550+0000 7f31e2a00640 1 -- 172.21.15.76:0/3370896417 learned_addr learned my addr 172.21.15.76:0/3370896417 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:34.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.554+0000 7f31e2a00640 1 -- 172.21.15.76:0/3370896417 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f31e4151950 msgr2=0x7f31e41f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:34.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.554+0000 7f31e2a00640 1 --2- 172.21.15.76:0/3370896417 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f31e4151950 0x7f31e41f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:34.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.554+0000 7f31e2a00640 1 -- 172.21.15.76:0/3370896417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31e40c7900 msgr2=0x7f31e414ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:34.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.554+0000 7f31e2a00640 1 --2- 172.21.15.76:0/3370896417 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f31e40c7900 0x7f31e414ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:34.555 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.554+0000 7f31e2a00640 1 -- 172.21.15.76:0/3370896417 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e4151fd0 con 0x7f31e40c93a0 2024-03-28T13:50:34.558 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.558+0000 7f31e2a00640 1 --2- 172.21.15.76:0/3370896417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31e40c93a0 0x7f31e41f2a80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f31d001f050 tx=0x7f31d001fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:34.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.562+0000 7f31db400640 1 -- 172.21.15.76:0/3370896417 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d00b6040 con 0x7f31e40c93a0 2024-03-28T13:50:34.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.562+0000 7f31db400640 1 -- 172.21.15.76:0/3370896417 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d00c1070 con 0x7f31e40c93a0 2024-03-28T13:50:34.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.562+0000 7f31e8c00640 1 -- 172.21.15.76:0/3370896417 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e40c5090 con 0x7f31e40c93a0 2024-03-28T13:50:34.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.562+0000 7f31db400640 1 -- 172.21.15.76:0/3370896417 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d00bc660 con 0x7f31e40c93a0 2024-03-28T13:50:34.563 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.562+0000 7f31e8c00640 1 -- 172.21.15.76:0/3370896417 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e41f1fa0 con 0x7f31e40c93a0 2024-03-28T13:50:34.564 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.562+0000 7f31e8c00640 1 -- 172.21.15.76:0/3370896417 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f31bc001040 con 0x7f31e40c93a0 2024-03-28T13:50:34.606 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.606+0000 7f31db400640 1 -- 172.21.15.76:0/3370896417 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f31d00bc800 con 0x7f31e40c93a0 2024-03-28T13:50:34.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.606+0000 7f31db400640 1 --2- 172.21.15.76:0/3370896417 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f31c4067ff0 0x7f31c406a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:34.608 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.606+0000 7f31e3400640 1 --2- 172.21.15.76:0/3370896417 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f31c4067ff0 0x7f31c406a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:34.609 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.610+0000 7f31e3400640 1 --2- 172.21.15.76:0/3370896417 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f31c4067ff0 0x7f31c406a4b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009690 tx=0x7f31d4006c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:34.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.610+0000 7f31db400640 1 -- 172.21.15.76:0/3370896417 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f31d00f33b0 con 0x7f31e40c93a0 2024-03-28T13:50:34.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.610+0000 7f31db400640 1 --2- 172.21.15.76:0/3370896417 >> [v2:172.21.15.111:6824/4275101548,v1:172.21.15.111:6825/4275101548] conn(0x7f31c4071900 0x7f31c4073da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:34.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.610+0000 7f31db400640 1 -- 172.21.15.76:0/3370896417 --> [v2:172.21.15.111:6824/4275101548,v1:172.21.15.111:6825/4275101548] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f31d00b1600 con 0x7f31c4071900 2024-03-28T13:50:34.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.610+0000 7f31db400640 1 -- 172.21.15.76:0/3370896417 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f31d00f15b0 con 0x7f31e40c93a0 2024-03-28T13:50:34.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.610+0000 7f31e3e00640 1 --2- 172.21.15.76:0/3370896417 >> [v2:172.21.15.111:6824/4275101548,v1:172.21.15.111:6825/4275101548] conn(0x7f31c4071900 0x7f31c4073da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:34.613 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.610+0000 7f31e3e00640 1 --2- 172.21.15.76:0/3370896417 >> [v2:172.21.15.111:6824/4275101548,v1:172.21.15.111:6825/4275101548] conn(0x7f31c4071900 0x7f31c4073da0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:34.614 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.614+0000 7f31db400640 1 -- 172.21.15.76:0/3370896417 <== osd.6 v2:172.21.15.111:6824/4275101548 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f31d00b1600 con 0x7f31c4071900 2024-03-28T13:50:34.641 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.642+0000 7f31e8c00640 1 -- 172.21.15.76:0/3370896417 --> [v2:172.21.15.111:6824/4275101548,v1:172.21.15.111:6825/4275101548] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f31bc002e40 con 0x7f31c4071900 2024-03-28T13:50:34.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.642+0000 7f31db400640 1 -- 172.21.15.76:0/3370896417 <== osd.6 v2:172.21.15.111:6824/4275101548 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f31bc002e40 con 0x7f31c4071900 2024-03-28T13:50:34.642 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-03-28T13:50:34.642 INFO:teuthology.orchestra.run.smithi076.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-28T13:50:34.642 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-03-28T13:50:34.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.642+0000 7f31e8c00640 1 -- 172.21.15.76:0/3370896417 >> [v2:172.21.15.111:6824/4275101548,v1:172.21.15.111:6825/4275101548] conn(0x7f31c4071900 msgr2=0x7f31c4073da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:34.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.642+0000 7f31e8c00640 1 --2- 172.21.15.76:0/3370896417 >> [v2:172.21.15.111:6824/4275101548,v1:172.21.15.111:6825/4275101548] conn(0x7f31c4071900 0x7f31c4073da0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:34.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.642+0000 7f31e8c00640 1 -- 172.21.15.76:0/3370896417 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f31c4067ff0 msgr2=0x7f31c406a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:34.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.642+0000 7f31e8c00640 1 --2- 172.21.15.76:0/3370896417 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f31c4067ff0 0x7f31c406a4b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009690 tx=0x7f31d4006c00 comp rx=0 tx=0).stop 2024-03-28T13:50:34.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.642+0000 7f31e8c00640 1 -- 172.21.15.76:0/3370896417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31e40c93a0 msgr2=0x7f31e41f2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:34.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.642+0000 7f31e8c00640 1 --2- 172.21.15.76:0/3370896417 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f31e40c93a0 0x7f31e41f2a80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f31d001f050 tx=0x7f31d001fc60 comp rx=0 tx=0).stop 2024-03-28T13:50:34.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.642+0000 7f31e3e00640 1 -- 172.21.15.76:0/3370896417 reap_dead start 2024-03-28T13:50:34.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.642+0000 7f31e8c00640 1 -- 172.21.15.76:0/3370896417 shutdown_connections 2024-03-28T13:50:34.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.642+0000 7f31e8c00640 1 -- 172.21.15.76:0/3370896417 >> 172.21.15.76:0/3370896417 conn(0x7f31e40c9a00 msgr2=0x7f31e406b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:34.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.642+0000 7f31e8c00640 1 -- 172.21.15.76:0/3370896417 shutdown_connections 2024-03-28T13:50:34.644 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.642+0000 7f31e8c00640 1 -- 172.21.15.76:0/3370896417 wait complete. 2024-03-28T13:50:34.666 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-28T13:50:34.811 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.810+0000 7fbc5f200640 1 Processor -- start 2024-03-28T13:50:34.812 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.810+0000 7fbc5f200640 1 -- start start 2024-03-28T13:50:34.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.814+0000 7fbc5f200640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbc60154af0 0x7fbc6015a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:34.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.814+0000 7fbc5f200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fbc600703c0 0x7fbc600ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:34.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.814+0000 7fbc5f200640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc6015b5b0 con 0x7fbc6006ef50 2024-03-28T13:50:34.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.814+0000 7fbc5f200640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fbc600c9e90 con 0x7fbc600703c0 2024-03-28T13:50:34.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.814+0000 7fbc5f200640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fbc6015ad10 con 0x7fbc60154af0 2024-03-28T13:50:34.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.814+0000 7fbc5de00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbc60154af0 0x7fbc6015a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:34.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.814+0000 7fbc5de00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbc60154af0 0x7fbc6015a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:33792/0 (socket says 172.21.15.76:33792) 2024-03-28T13:50:34.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.814+0000 7fbc5de00640 1 -- 172.21.15.76:0/3404307909 learned_addr learned my addr 172.21.15.76:0/3404307909 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:34.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.818+0000 7fbc5de00640 1 -- 172.21.15.76:0/3404307909 >> v2:172.21.15.76:3300/0 conn(0x7fbc600703c0 msgr2=0x7fbc600ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:34.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.818+0000 7fbc5de00640 1 --2- 172.21.15.76:0/3404307909 >> v2:172.21.15.76:3300/0 conn(0x7fbc600703c0 0x7fbc600ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:34.817 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.818+0000 7fbc5de00640 1 -- 172.21.15.76:0/3404307909 >> v1:172.21.15.76:6789/0 conn(0x7fbc6006ef50 legacy=0x7fbc600ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:34.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.818+0000 7fbc5de00640 1 -- 172.21.15.76:0/3404307909 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6015aff0 con 0x7fbc60154af0 2024-03-28T13:50:34.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.822+0000 7fbc5de00640 1 --2- 172.21.15.76:0/3404307909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc60154af0 0x7fbc6015a5f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbc60073e00 tx=0x7fbc5001c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fd174cae1510c90 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:34.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.826+0000 7fbc5ca00640 1 -- 172.21.15.76:0/3404307909 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc500b0070 con 0x7fbc60154af0 2024-03-28T13:50:34.828 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.826+0000 7fbc5ca00640 1 -- 172.21.15.76:0/3404307909 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc500ab600 con 0x7fbc60154af0 2024-03-28T13:50:34.829 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.826+0000 7fbc5ca00640 1 -- 172.21.15.76:0/3404307909 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc500ab9d0 con 0x7fbc60154af0 2024-03-28T13:50:34.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.830+0000 7fbc5f200640 1 -- 172.21.15.76:0/3404307909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc60154af0 msgr2=0x7fbc6015a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:34.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.830+0000 7fbc5f200640 1 --2- 172.21.15.76:0/3404307909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc60154af0 0x7fbc6015a5f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbc60073e00 tx=0x7fbc5001c300 comp rx=0 tx=0).stop 2024-03-28T13:50:34.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.830+0000 7fbc5f200640 1 -- 172.21.15.76:0/3404307909 shutdown_connections 2024-03-28T13:50:34.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.830+0000 7fbc5f200640 1 --2- 172.21.15.76:0/3404307909 >> v2:172.21.15.76:3300/0 conn(0x7fbc600703c0 0x7fbc600ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:34.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.830+0000 7fbc5f200640 1 --2- 172.21.15.76:0/3404307909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc60154af0 0x7fbc6015a5f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:34.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.830+0000 7fbc5f200640 1 -- 172.21.15.76:0/3404307909 >> 172.21.15.76:0/3404307909 conn(0x7fbc60073600 msgr2=0x7fbc60070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:34.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.830+0000 7fbc5f200640 1 -- 172.21.15.76:0/3404307909 shutdown_connections 2024-03-28T13:50:34.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.830+0000 7fbc5f200640 1 -- 172.21.15.76:0/3404307909 wait complete. 2024-03-28T13:50:34.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.830+0000 7fbc5f200640 1 Processor -- start 2024-03-28T13:50:34.832 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.830+0000 7fbc5f200640 1 -- start start 2024-03-28T13:50:34.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.834+0000 7fbc5f200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc6006ef50 0x7fbc6014da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:34.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.834+0000 7fbc5f200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc600703c0 0x7fbc6014b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:34.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.834+0000 7fbc5f200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc60154af0 0x7fbc60147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:34.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.834+0000 7fbc5f200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fbc600c7bd0 con 0x7fbc600703c0 2024-03-28T13:50:34.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.834+0000 7fbc5f200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbc600c7a50 con 0x7fbc6006ef50 2024-03-28T13:50:34.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.834+0000 7fbc5f200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fbc600cd6f0 con 0x7fbc60154af0 2024-03-28T13:50:34.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.834+0000 7fbc5de00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc6006ef50 0x7fbc6014da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:34.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.834+0000 7fbc5de00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc6006ef50 0x7fbc6014da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:33806/0 (socket says 172.21.15.76:33806) 2024-03-28T13:50:34.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.834+0000 7fbc5de00640 1 -- 172.21.15.76:0/4026513880 learned_addr learned my addr 172.21.15.76:0/4026513880 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:34.835 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.834+0000 7fbc5e800640 1 --2- 172.21.15.76:0/4026513880 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc60154af0 0x7fbc60147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:34.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.838+0000 7fbc5de00640 1 -- 172.21.15.76:0/4026513880 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc60154af0 msgr2=0x7fbc60147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:34.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.838+0000 7fbc5de00640 1 --2- 172.21.15.76:0/4026513880 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc60154af0 0x7fbc60147bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:34.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.838+0000 7fbc5de00640 1 -- 172.21.15.76:0/4026513880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc600703c0 msgr2=0x7fbc6014b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:34.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.838+0000 7fbc5de00640 1 --2- 172.21.15.76:0/4026513880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc600703c0 0x7fbc6014b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:34.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.838+0000 7fbc5de00640 1 -- 172.21.15.76:0/4026513880 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6014e570 con 0x7fbc6006ef50 2024-03-28T13:50:34.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.842+0000 7fbc5de00640 1 --2- 172.21.15.76:0/4026513880 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc6006ef50 0x7fbc6014da00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbc500ae040 tx=0x7fbc5001ab40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:34.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.850+0000 7fbc56000640 1 -- 172.21.15.76:0/4026513880 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc500b0040 con 0x7fbc6006ef50 2024-03-28T13:50:34.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.850+0000 7fbc5f200640 1 -- 172.21.15.76:0/4026513880 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc601f7490 con 0x7fbc6006ef50 2024-03-28T13:50:34.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.850+0000 7fbc5f200640 1 -- 172.21.15.76:0/4026513880 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc6014d720 con 0x7fbc6006ef50 2024-03-28T13:50:34.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.850+0000 7fbc56000640 1 -- 172.21.15.76:0/4026513880 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc500bc070 con 0x7fbc6006ef50 2024-03-28T13:50:34.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.850+0000 7fbc5f200640 1 -- 172.21.15.76:0/4026513880 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc600686e0 con 0x7fbc6006ef50 2024-03-28T13:50:34.850 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:34.850+0000 7fbc56000640 1 -- 172.21.15.76:0/4026513880 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc500b6620 con 0x7fbc6006ef50 2024-03-28T13:50:35.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.142+0000 7fbc56000640 1 -- 172.21.15.76:0/4026513880 <== mon.1 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fbc500b67c0 con 0x7fbc6006ef50 2024-03-28T13:50:35.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.142+0000 7fbc56000640 1 --2- 172.21.15.76:0/4026513880 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbc40067fc0 0x7fbc4006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:35.144 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.142+0000 7fbc5d400640 1 --2- 172.21.15.76:0/4026513880 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbc40067fc0 0x7fbc4006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:35.145 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.146+0000 7fbc5d400640 1 --2- 172.21.15.76:0/4026513880 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbc40067fc0 0x7fbc4006a480 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbc6014c270 tx=0x7fbc4c006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:35.149 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.150+0000 7fbc56000640 1 -- 172.21.15.76:0/4026513880 <== mon.1 v2:172.21.15.111:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fbc500ef560 con 0x7fbc6006ef50 2024-03-28T13:50:35.165 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.166+0000 7fbc56000640 1 -- 172.21.15.76:0/4026513880 <== mon.1 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fbc6015b5b0 con 0x7fbc6006ef50 2024-03-28T13:50:35.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.338+0000 7fbc5f200640 1 -- 172.21.15.76:0/4026513880 --> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fbc6006c490 con 0x7fbc40067fc0 2024-03-28T13:50:35.337 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.338+0000 7fbc56000640 1 -- 172.21.15.76:0/4026513880 <== mgr.4107 v2:172.21.15.76:6800/1313648511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbc6006c490 con 0x7fbc40067fc0 2024-03-28T13:50:35.338 INFO:teuthology.orchestra.run.smithi076.stderr:instructed osd(s) 6 to deep-scrub 2024-03-28T13:50:35.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.338+0000 7fbc5f200640 1 -- 172.21.15.76:0/4026513880 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbc40067fc0 msgr2=0x7fbc4006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:35.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.338+0000 7fbc5f200640 1 --2- 172.21.15.76:0/4026513880 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbc40067fc0 0x7fbc4006a480 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbc6014c270 tx=0x7fbc4c006ca0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.338+0000 7fbc5f200640 1 -- 172.21.15.76:0/4026513880 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc6006ef50 msgr2=0x7fbc6014da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:35.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.338+0000 7fbc5f200640 1 --2- 172.21.15.76:0/4026513880 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc6006ef50 0x7fbc6014da00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbc500ae040 tx=0x7fbc5001ab40 comp rx=0 tx=0).stop 2024-03-28T13:50:35.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.338+0000 7fbc5f200640 1 -- 172.21.15.76:0/4026513880 shutdown_connections 2024-03-28T13:50:35.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.338+0000 7fbc5f200640 1 --2- 172.21.15.76:0/4026513880 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fbc40067fc0 0x7fbc4006a480 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.338+0000 7fbc5f200640 1 --2- 172.21.15.76:0/4026513880 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc60154af0 0x7fbc60147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.338+0000 7fbc5f200640 1 --2- 172.21.15.76:0/4026513880 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fbc600703c0 0x7fbc6014b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.338+0000 7fbc5f200640 1 --2- 172.21.15.76:0/4026513880 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc6006ef50 0x7fbc6014da00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.338+0000 7fbc5f200640 1 -- 172.21.15.76:0/4026513880 >> 172.21.15.76:0/4026513880 conn(0x7fbc60073600 msgr2=0x7fbc600cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:35.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.338+0000 7fbc5f200640 1 -- 172.21.15.76:0/4026513880 shutdown_connections 2024-03-28T13:50:35.340 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.338+0000 7fbc5f200640 1 -- 172.21.15.76:0/4026513880 wait complete. 2024-03-28T13:50:35.360 INFO:tasks.ceph:Scrubbing osd.7 2024-03-28T13:50:35.360 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-28T13:50:35.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.506+0000 7f6744e00640 1 Processor -- start 2024-03-28T13:50:35.508 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.506+0000 7f6744e00640 1 -- start start 2024-03-28T13:50:35.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.510+0000 7f6744e00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6740152570 0x7f67400c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:35.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.510+0000 7f6744e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f67400c8310 0x7f674006bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:35.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.510+0000 7f6744e00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67400ca6a0 con 0x7f6740152950 2024-03-28T13:50:35.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.510+0000 7f6744e00640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f67401592e0 con 0x7f67400c8310 2024-03-28T13:50:35.509 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.510+0000 7f6744e00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f6740158410 con 0x7f6740152570 2024-03-28T13:50:35.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.510+0000 7f673fe00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f67400c8310 0x7f674006bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:35.510 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.510+0000 7f673fe00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f67400c8310 0x7f674006bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37100/0 (socket says 172.21.15.76:37100) 2024-03-28T13:50:35.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.510+0000 7f673fe00640 1 -- 172.21.15.76:0/2849387673 learned_addr learned my addr 172.21.15.76:0/2849387673 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:35.511 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.510+0000 7f673f400640 1 --2- 172.21.15.76:0/2849387673 >> v2:172.21.15.111:3300/0 conn(0x7f6740152570 0x7f67400c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:35.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.514+0000 7f673fe00640 1 -- 172.21.15.76:0/2849387673 >> v2:172.21.15.111:3300/0 conn(0x7f6740152570 msgr2=0x7f67400c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:35.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.514+0000 7f673fe00640 1 --2- 172.21.15.76:0/2849387673 >> v2:172.21.15.111:3300/0 conn(0x7f6740152570 0x7f67400c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.514+0000 7f673fe00640 1 -- 172.21.15.76:0/2849387673 >> v1:172.21.15.111:6789/0 conn(0x7f6740152950 legacy=0x7f674006b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:35.514 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.514+0000 7f673fe00640 1 -- 172.21.15.76:0/2849387673 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67401586d0 con 0x7f67400c8310 2024-03-28T13:50:35.520 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.518+0000 7f673fe00640 1 --2- 172.21.15.76:0/2849387673 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f67400c8310 0x7f674006bcb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f674004f9f0 tx=0x7f673801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52db5534303f244 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:35.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.522+0000 7f673e000640 1 -- 172.21.15.76:0/2849387673 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67380a57d0 con 0x7f67400c8310 2024-03-28T13:50:35.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.522+0000 7f673e000640 1 -- 172.21.15.76:0/2849387673 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67380a5970 con 0x7f67400c8310 2024-03-28T13:50:35.525 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.522+0000 7f673e000640 1 -- 172.21.15.76:0/2849387673 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67380a5d40 con 0x7f67400c8310 2024-03-28T13:50:35.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.526+0000 7f6744e00640 1 -- 172.21.15.76:0/2849387673 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f67400c8310 msgr2=0x7f674006bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:35.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.526+0000 7f6744e00640 1 --2- 172.21.15.76:0/2849387673 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f67400c8310 0x7f674006bcb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f674004f9f0 tx=0x7f673801c9f0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.526 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.526+0000 7f6744e00640 1 -- 172.21.15.76:0/2849387673 shutdown_connections 2024-03-28T13:50:35.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.526+0000 7f6744e00640 1 --2- 172.21.15.76:0/2849387673 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f67400c8310 0x7f674006bcb0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.526+0000 7f6744e00640 1 --2- 172.21.15.76:0/2849387673 >> v2:172.21.15.111:3300/0 conn(0x7f6740152570 0x7f67400c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.526+0000 7f6744e00640 1 -- 172.21.15.76:0/2849387673 >> 172.21.15.76:0/2849387673 conn(0x7f67400c9a00 msgr2=0x7f67400c9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:35.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.526+0000 7f6744e00640 1 -- 172.21.15.76:0/2849387673 shutdown_connections 2024-03-28T13:50:35.527 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.526+0000 7f6744e00640 1 -- 172.21.15.76:0/2849387673 wait complete. 2024-03-28T13:50:35.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.526+0000 7f6744e00640 1 Processor -- start 2024-03-28T13:50:35.528 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.526+0000 7f6744e00640 1 -- start start 2024-03-28T13:50:35.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.530+0000 7f6744e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f67400c8310 0x7f67401f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:35.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.530+0000 7f6744e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6740152570 0x7f67401f4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:35.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.530+0000 7f6744e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6740152950 0x7f6740161f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:35.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.530+0000 7f6744e00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f67401655b0 con 0x7f6740152570 2024-03-28T13:50:35.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.530+0000 7f6744e00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f67400c93a0 con 0x7f6740152950 2024-03-28T13:50:35.530 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.530+0000 7f6744e00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6740165730 con 0x7f67400c8310 2024-03-28T13:50:35.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.530+0000 7f673ea00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6740152570 0x7f67401f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:35.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.530+0000 7f673ea00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6740152570 0x7f67401f4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37104/0 (socket says 172.21.15.76:37104) 2024-03-28T13:50:35.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.530+0000 7f673fe00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6740152950 0x7f6740161f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:35.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.530+0000 7f673ea00640 1 -- 172.21.15.76:0/964016177 learned_addr learned my addr 172.21.15.76:0/964016177 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:35.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.530+0000 7f673f400640 1 --2- 172.21.15.76:0/964016177 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f67400c8310 0x7f67401f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:35.536 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.534+0000 7f673ea00640 1 -- 172.21.15.76:0/964016177 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f67400c8310 msgr2=0x7f67401f40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:35.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.534+0000 7f673ea00640 1 --2- 172.21.15.76:0/964016177 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f67400c8310 0x7f67401f40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.534+0000 7f673ea00640 1 -- 172.21.15.76:0/964016177 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6740152950 msgr2=0x7f6740161f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:35.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.534+0000 7f673ea00640 1 --2- 172.21.15.76:0/964016177 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6740152950 0x7f6740161f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.537 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.534+0000 7f673ea00640 1 -- 172.21.15.76:0/964016177 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6740145950 con 0x7f6740152570 2024-03-28T13:50:35.540 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.538+0000 7f673ea00640 1 --2- 172.21.15.76:0/964016177 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6740152570 0x7f67401f4630 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f672c00c3c0 tx=0x7f672c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:35.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.542+0000 7f6737400640 1 -- 172.21.15.76:0/964016177 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c017070 con 0x7f6740152570 2024-03-28T13:50:35.544 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.542+0000 7f6737400640 1 -- 172.21.15.76:0/964016177 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f672c0052f0 con 0x7f6740152570 2024-03-28T13:50:35.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.542+0000 7f6744e00640 1 -- 172.21.15.76:0/964016177 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67401f4c10 con 0x7f6740152570 2024-03-28T13:50:35.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.542+0000 7f6737400640 1 -- 172.21.15.76:0/964016177 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c003860 con 0x7f6740152570 2024-03-28T13:50:35.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.542+0000 7f6744e00640 1 -- 172.21.15.76:0/964016177 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6740141e10 con 0x7f6740152570 2024-03-28T13:50:35.545 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.546+0000 7f6744e00640 1 -- 172.21.15.76:0/964016177 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f67400c28b0 con 0x7f6740152570 2024-03-28T13:50:35.572 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.570+0000 7f6737400640 1 -- 172.21.15.76:0/964016177 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f672c01a070 con 0x7f6740152570 2024-03-28T13:50:35.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.574+0000 7f6737400640 1 --2- 172.21.15.76:0/964016177 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6720068010 0x7f672006a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:35.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.574+0000 7f6737400640 1 -- 172.21.15.76:0/964016177 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f672c086280 con 0x7f6740152570 2024-03-28T13:50:35.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.574+0000 7f673f400640 1 --2- 172.21.15.76:0/964016177 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6720068010 0x7f672006a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:35.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.574+0000 7f6737400640 1 --2- 172.21.15.76:0/964016177 >> [v2:172.21.15.111:6809/1094587541,v1:172.21.15.111:6811/1094587541] conn(0x7f67200719a0 0x7f6720073e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:35.574 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.574+0000 7f6737400640 1 -- 172.21.15.76:0/964016177 --> [v2:172.21.15.111:6809/1094587541,v1:172.21.15.111:6811/1094587541] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f672c01ee50 con 0x7f67200719a0 2024-03-28T13:50:35.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.574+0000 7f673fe00640 1 --2- 172.21.15.76:0/964016177 >> [v2:172.21.15.111:6809/1094587541,v1:172.21.15.111:6811/1094587541] conn(0x7f67200719a0 0x7f6720073e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:35.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.574+0000 7f673f400640 1 --2- 172.21.15.76:0/964016177 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6720068010 0x7f672006a4d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6730007a60 tx=0x7f6730008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:35.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.574+0000 7f6737400640 1 -- 172.21.15.76:0/964016177 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f672c0522e0 con 0x7f6740152570 2024-03-28T13:50:35.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.574+0000 7f673fe00640 1 --2- 172.21.15.76:0/964016177 >> [v2:172.21.15.111:6809/1094587541,v1:172.21.15.111:6811/1094587541] conn(0x7f67200719a0 0x7f6720073e40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:35.577 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.578+0000 7f6737400640 1 -- 172.21.15.76:0/964016177 <== osd.7 v2:172.21.15.111:6809/1094587541 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f672c01ee50 con 0x7f67200719a0 2024-03-28T13:50:35.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.590+0000 7f6744e00640 1 -- 172.21.15.76:0/964016177 --> [v2:172.21.15.111:6809/1094587541,v1:172.21.15.111:6811/1094587541] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6740068df0 con 0x7f67200719a0 2024-03-28T13:50:35.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.590+0000 7f6737400640 1 -- 172.21.15.76:0/964016177 <== osd.7 v2:172.21.15.111:6809/1094587541 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6740068df0 con 0x7f67200719a0 2024-03-28T13:50:35.592 INFO:teuthology.orchestra.run.smithi076.stdout:{ 2024-03-28T13:50:35.593 INFO:teuthology.orchestra.run.smithi076.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-28T13:50:35.593 INFO:teuthology.orchestra.run.smithi076.stdout:} 2024-03-28T13:50:35.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.590+0000 7f6744e00640 1 -- 172.21.15.76:0/964016177 >> [v2:172.21.15.111:6809/1094587541,v1:172.21.15.111:6811/1094587541] conn(0x7f67200719a0 msgr2=0x7f6720073e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:35.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.590+0000 7f6744e00640 1 --2- 172.21.15.76:0/964016177 >> [v2:172.21.15.111:6809/1094587541,v1:172.21.15.111:6811/1094587541] conn(0x7f67200719a0 0x7f6720073e40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.594+0000 7f6744e00640 1 -- 172.21.15.76:0/964016177 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6720068010 msgr2=0x7f672006a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:35.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.594+0000 7f6744e00640 1 --2- 172.21.15.76:0/964016177 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f6720068010 0x7f672006a4d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6730007a60 tx=0x7f6730008040 comp rx=0 tx=0).stop 2024-03-28T13:50:35.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.594+0000 7f6744e00640 1 -- 172.21.15.76:0/964016177 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6740152570 msgr2=0x7f67401f4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:35.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.594+0000 7f6744e00640 1 --2- 172.21.15.76:0/964016177 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f6740152570 0x7f67401f4630 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f672c00c3c0 tx=0x7f672c00c880 comp rx=0 tx=0).stop 2024-03-28T13:50:35.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.594+0000 7f673fe00640 1 -- 172.21.15.76:0/964016177 reap_dead start 2024-03-28T13:50:35.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.594+0000 7f6744e00640 1 -- 172.21.15.76:0/964016177 shutdown_connections 2024-03-28T13:50:35.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.594+0000 7f6744e00640 1 -- 172.21.15.76:0/964016177 >> 172.21.15.76:0/964016177 conn(0x7f67400c9a00 msgr2=0x7f67400c75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:35.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.594+0000 7f6744e00640 1 -- 172.21.15.76:0/964016177 shutdown_connections 2024-03-28T13:50:35.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.594+0000 7f6744e00640 1 -- 172.21.15.76:0/964016177 wait complete. 2024-03-28T13:50:35.615 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-28T13:50:35.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.814+0000 7f84a2000640 1 Processor -- start 2024-03-28T13:50:35.813 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.814+0000 7f84a2000640 1 -- start start 2024-03-28T13:50:35.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.814+0000 7f84a2000640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f849c06ee50 0x7f849c0c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:35.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.814+0000 7f84a2000640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f849c0c3b10 con 0x7f849c0c9a70 2024-03-28T13:50:35.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.814+0000 7f84a2000640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f849c0c3db0 con 0x7f849c070080 2024-03-28T13:50:35.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.814+0000 7f84a2000640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f849c154e90 con 0x7f849c06ee50 2024-03-28T13:50:35.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.814+0000 7f849b400640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f849c0c9a70 0x7f849c15e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:46604/0 (socket says 172.21.15.76:46604) 2024-03-28T13:50:35.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.814+0000 7f849b400640 1 -- 172.21.15.76:0/1351746991 learned_addr learned my addr 172.21.15.76:0/1351746991 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:50:35.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.814+0000 7f849aa00640 1 --2- 172.21.15.76:0/1351746991 >> v2:172.21.15.111:3300/0 conn(0x7f849c06ee50 0x7f849c0c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:35.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.818+0000 7f849a000640 1 -- 172.21.15.76:0/1351746991 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2794862466 0 0) 0x7f849c0c3b10 con 0x7f849c0c9a70 2024-03-28T13:50:35.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.818+0000 7f849a000640 1 -- 172.21.15.76:0/1351746991 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8480003530 con 0x7f849c0c9a70 2024-03-28T13:50:35.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.822+0000 7f849a000640 1 -- 172.21.15.76:0/1351746991 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3720287477 0 0) 0x7f8480003530 con 0x7f849c0c9a70 2024-03-28T13:50:35.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.822+0000 7f849a000640 1 -- 172.21.15.76:0/1351746991 >> v2:172.21.15.111:3300/0 conn(0x7f849c06ee50 msgr2=0x7f849c0c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:35.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.822+0000 7f849a000640 1 --2- 172.21.15.76:0/1351746991 >> v2:172.21.15.111:3300/0 conn(0x7f849c06ee50 0x7f849c0c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.822+0000 7f849a000640 1 -- 172.21.15.76:0/1351746991 >> v1:172.21.15.111:6789/0 conn(0x7f849c070080 legacy=0x7f849c165380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:35.823 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.822+0000 7f849a000640 1 -- 172.21.15.76:0/1351746991 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849c06f5e0 con 0x7f849c0c9a70 2024-03-28T13:50:35.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.822+0000 7f849a000640 1 -- 172.21.15.76:0/1351746991 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7f848c001680 con 0x7f849c0c9a70 2024-03-28T13:50:35.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.822+0000 7f849a000640 1 -- 172.21.15.76:0/1351746991 >> v1:172.21.15.76:6789/0 conn(0x7f849c0c9a70 legacy=0x7f849c15e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:35.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.822+0000 7f849a000640 1 --2- 172.21.15.76:0/1351746991 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8480003a80 0x7f8480003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:35.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.822+0000 7f849a000640 1 --2- 172.21.15.76:0/1351746991 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8480004810 0x7f8480004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:35.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.822+0000 7f849a000640 1 --2- 172.21.15.76:0/1351746991 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8480005220 0x7f848000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:35.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.822+0000 7f849a000640 1 -- 172.21.15.76:0/1351746991 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f849c154e90 con 0x7f8480005220 2024-03-28T13:50:35.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.822+0000 7f849a000640 1 -- 172.21.15.76:0/1351746991 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f848000c150 con 0x7f8480003a80 2024-03-28T13:50:35.824 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.822+0000 7f849a000640 1 -- 172.21.15.76:0/1351746991 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f848000c350 con 0x7f8480004810 2024-03-28T13:50:35.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.822+0000 7f849be00640 1 --2- 172.21.15.76:0/1351746991 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8480005220 0x7f848000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:35.825 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.822+0000 7f849aa00640 1 --2- 172.21.15.76:0/1351746991 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8480004810 0x7f8480004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:35.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.830+0000 7f849be00640 1 -- 172.21.15.76:0/1351746991 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8480004810 msgr2=0x7f8480004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:35.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.830+0000 7f849be00640 1 --2- 172.21.15.76:0/1351746991 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8480004810 0x7f8480004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.830+0000 7f849be00640 1 -- 172.21.15.76:0/1351746991 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8480003a80 msgr2=0x7f8480003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:35.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.830+0000 7f849be00640 1 --2- 172.21.15.76:0/1351746991 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8480003a80 0x7f8480003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.831 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.830+0000 7f849be00640 1 -- 172.21.15.76:0/1351746991 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8480003530 con 0x7f8480005220 2024-03-28T13:50:35.833 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.834+0000 7f849be00640 1 -- 172.21.15.76:0/1351746991 reap_dead start 2024-03-28T13:50:35.834 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.834+0000 7f849be00640 1 --2- 172.21.15.76:0/1351746991 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8480005220 0x7f848000b9d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8494001e50 tx=0x7f849401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19092f4cf009d26 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:35.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.838+0000 7f849a000640 1 -- 172.21.15.76:0/1351746991 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8494001a70 con 0x7f8480005220 2024-03-28T13:50:35.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.838+0000 7f849a000640 1 -- 172.21.15.76:0/1351746991 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8494003ba0 con 0x7f8480005220 2024-03-28T13:50:35.838 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.838+0000 7f849a000640 1 -- 172.21.15.76:0/1351746991 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8494005020 con 0x7f8480005220 2024-03-28T13:50:35.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.838+0000 7f84a2000640 1 -- 172.21.15.76:0/1351746991 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8480005220 msgr2=0x7f848000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:35.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.838+0000 7f84a2000640 1 --2- 172.21.15.76:0/1351746991 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8480005220 0x7f848000b9d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8494001e50 tx=0x7f849401c760 comp rx=0 tx=0).stop 2024-03-28T13:50:35.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.838+0000 7f84a2000640 1 -- 172.21.15.76:0/1351746991 shutdown_connections 2024-03-28T13:50:35.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.838+0000 7f84a2000640 1 --2- 172.21.15.76:0/1351746991 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f8480005220 0x7f848000b9d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.838+0000 7f84a2000640 1 -- 172.21.15.76:0/1351746991 >> 172.21.15.76:0/1351746991 conn(0x7f849c070ca0 msgr2=0x7f849c0710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:35.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.838+0000 7f84a2000640 1 -- 172.21.15.76:0/1351746991 shutdown_connections 2024-03-28T13:50:35.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.838+0000 7f84a2000640 1 -- 172.21.15.76:0/1351746991 wait complete. 2024-03-28T13:50:35.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.842+0000 7f84a2000640 1 Processor -- start 2024-03-28T13:50:35.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.842+0000 7f84a2000640 1 -- start start 2024-03-28T13:50:35.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.842+0000 7f84a2000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8480005220 0x7f849c1f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:35.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.842+0000 7f84a2000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f849c1e6bf0 0x7f849c1e79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:35.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.842+0000 7f84a2000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f849c0c3030 0x7f849c14a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:35.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.842+0000 7f84a2000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f849c06e870 con 0x7f849c1e6bf0 2024-03-28T13:50:35.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.842+0000 7f84a2000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f849c0c3990 con 0x7f8480005220 2024-03-28T13:50:35.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.842+0000 7f84a2000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f849c06fba0 con 0x7f849c0c3030 2024-03-28T13:50:35.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.842+0000 7f849be00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f849c0c3030 0x7f849c14a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:35.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.842+0000 7f849aa00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f849c1e6bf0 0x7f849c1e79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:35.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.842+0000 7f849b400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8480005220 0x7f849c1f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:35.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.842+0000 7f849be00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f849c0c3030 0x7f849c14a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:57958/0 (socket says 172.21.15.76:57958) 2024-03-28T13:50:35.843 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.842+0000 7f849be00640 1 -- 172.21.15.76:0/2168417108 learned_addr learned my addr 172.21.15.76:0/2168417108 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:35.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.850+0000 7f849aa00640 1 -- 172.21.15.76:0/2168417108 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f849c0c3030 msgr2=0x7f849c14a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:35.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.850+0000 7f849aa00640 1 --2- 172.21.15.76:0/2168417108 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f849c0c3030 0x7f849c14a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.850+0000 7f849aa00640 1 -- 172.21.15.76:0/2168417108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8480005220 msgr2=0x7f849c1f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:35.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.850+0000 7f849aa00640 1 --2- 172.21.15.76:0/2168417108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8480005220 0x7f849c1f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:35.849 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.850+0000 7f849aa00640 1 -- 172.21.15.76:0/2168417108 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849c15c7d0 con 0x7f849c1e6bf0 2024-03-28T13:50:35.852 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.850+0000 7f849aa00640 1 --2- 172.21.15.76:0/2168417108 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f849c1e6bf0 0x7f849c1e79f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8488011990 tx=0x7f8488011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:35.856 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.854+0000 7f8493400640 1 -- 172.21.15.76:0/2168417108 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848800fa30 con 0x7f849c1e6bf0 2024-03-28T13:50:35.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.854+0000 7f8493400640 1 -- 172.21.15.76:0/2168417108 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f848800fbd0 con 0x7f849c1e6bf0 2024-03-28T13:50:35.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.854+0000 7f8493400640 1 -- 172.21.15.76:0/2168417108 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8488014440 con 0x7f849c1e6bf0 2024-03-28T13:50:35.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.854+0000 7f84a2000640 1 -- 172.21.15.76:0/2168417108 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849c1e7f30 con 0x7f849c1e6bf0 2024-03-28T13:50:35.857 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.858+0000 7f84a2000640 1 -- 172.21.15.76:0/2168417108 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f849c1e5f20 con 0x7f849c1e6bf0 2024-03-28T13:50:35.858 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.858+0000 7f84a2000640 1 -- 172.21.15.76:0/2168417108 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f849c0686e0 con 0x7f849c1e6bf0 2024-03-28T13:50:35.879 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.878+0000 7f8493400640 1 -- 172.21.15.76:0/2168417108 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f8488012040 con 0x7f849c1e6bf0 2024-03-28T13:50:35.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.878+0000 7f8493400640 1 --2- 172.21.15.76:0/2168417108 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f847c068010 0x7f847c06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:35.880 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.878+0000 7f849b400640 1 --2- 172.21.15.76:0/2168417108 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f847c068010 0x7f847c06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:35.881 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:35.882+0000 7f849b400640 1 --2- 172.21.15.76:0/2168417108 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f847c068010 0x7f847c06a4d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f848c001ec0 tx=0x7f848c000f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:36.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.186+0000 7f8493400640 1 -- 172.21.15.76:0/2168417108 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f8488054e50 con 0x7f849c1e6bf0 2024-03-28T13:50:36.188 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.186+0000 7f8493400640 1 -- 172.21.15.76:0/2168417108 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f849c15c7d0 con 0x7f849c1e6bf0 2024-03-28T13:50:36.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.490+0000 7f84a2000640 1 -- 172.21.15.76:0/2168417108 --> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f849c06f320 con 0x7f847c068010 2024-03-28T13:50:36.492 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.490+0000 7f8493400640 1 -- 172.21.15.76:0/2168417108 <== mgr.4107 v2:172.21.15.76:6800/1313648511 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f849c06f320 con 0x7f847c068010 2024-03-28T13:50:36.492 INFO:teuthology.orchestra.run.smithi076.stderr:instructed osd(s) 7 to deep-scrub 2024-03-28T13:50:36.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.494+0000 7f84a2000640 1 -- 172.21.15.76:0/2168417108 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f847c068010 msgr2=0x7f847c06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:36.496 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.494+0000 7f84a2000640 1 --2- 172.21.15.76:0/2168417108 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f847c068010 0x7f847c06a4d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f848c001ec0 tx=0x7f848c000f90 comp rx=0 tx=0).stop 2024-03-28T13:50:36.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.494+0000 7f84a2000640 1 -- 172.21.15.76:0/2168417108 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f849c1e6bf0 msgr2=0x7f849c1e79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:36.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.494+0000 7f84a2000640 1 --2- 172.21.15.76:0/2168417108 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f849c1e6bf0 0x7f849c1e79f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8488011990 tx=0x7f8488011d90 comp rx=0 tx=0).stop 2024-03-28T13:50:36.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.494+0000 7f84a2000640 1 -- 172.21.15.76:0/2168417108 shutdown_connections 2024-03-28T13:50:36.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.494+0000 7f84a2000640 1 --2- 172.21.15.76:0/2168417108 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f847c068010 0x7f847c06a4d0 secure :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f848c001ec0 tx=0x7f848c000f90 comp rx=0 tx=0).stop 2024-03-28T13:50:36.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.494+0000 7f84a2000640 1 --2- 172.21.15.76:0/2168417108 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f849c0c3030 0x7f849c14a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:36.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.494+0000 7f84a2000640 1 --2- 172.21.15.76:0/2168417108 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f849c1e6bf0 0x7f849c1e79f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:36.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.494+0000 7f84a2000640 1 --2- 172.21.15.76:0/2168417108 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8480005220 0x7f849c1f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:36.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.494+0000 7f84a2000640 1 -- 172.21.15.76:0/2168417108 >> 172.21.15.76:0/2168417108 conn(0x7f849c070ca0 msgr2=0x7f849c0ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:36.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.494+0000 7f84a2000640 1 -- 172.21.15.76:0/2168417108 shutdown_connections 2024-03-28T13:50:36.497 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.494+0000 7f84a2000640 1 -- 172.21.15.76:0/2168417108 wait complete. 2024-03-28T13:50:36.516 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T13:50:36.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.674+0000 7f7e4b200640 1 Processor -- start 2024-03-28T13:50:36.674 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.674+0000 7f7e4b200640 1 -- start start 2024-03-28T13:50:36.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.674+0000 7f7e4b200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e4c06f780 0x7f7e4c06ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:36.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.674+0000 7f7e4b200640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e4c158f90 con 0x7f7e4c06ef40 2024-03-28T13:50:36.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.674+0000 7f7e4b200640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e4c159270 con 0x7f7e4c152690 2024-03-28T13:50:36.676 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.674+0000 7f7e4b200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7e4c0c86c0 con 0x7f7e4c06f780 2024-03-28T13:50:36.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.682+0000 7f7e43e00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e4c06f780 0x7f7e4c06ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:36.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.682+0000 7f7e4a800640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f7e4c06ef40 0x7f7e4c158400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:46612/0 (socket says 172.21.15.76:46612) 2024-03-28T13:50:36.684 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.682+0000 7f7e4a800640 1 -- 172.21.15.76:0/3279616509 learned_addr learned my addr 172.21.15.76:0/3279616509 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:50:36.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.702+0000 7f7e43e00640 1 -- 172.21.15.76:0/3279616509 >> v1:172.21.15.111:6789/0 conn(0x7f7e4c152690 legacy=0x7f7e4c0c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:36.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.702+0000 7f7e43e00640 1 -- 172.21.15.76:0/3279616509 >> v1:172.21.15.76:6789/0 conn(0x7f7e4c06ef40 legacy=0x7f7e4c158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:36.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.702+0000 7f7e43e00640 1 -- 172.21.15.76:0/3279616509 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4c15b9f0 con 0x7f7e4c06f780 2024-03-28T13:50:36.786 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.786+0000 7f7e43e00640 1 --2- 172.21.15.76:0/3279616509 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e4c06f780 0x7f7e4c06ea00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7e340097f0 tx=0x7f7e3401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ce1994d8aa9baa6 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:36.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.794+0000 7f7e49400640 1 -- 172.21.15.76:0/3279616509 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e340b5070 con 0x7f7e4c06f780 2024-03-28T13:50:36.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.794+0000 7f7e49400640 1 -- 172.21.15.76:0/3279616509 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e340a8990 con 0x7f7e4c06f780 2024-03-28T13:50:36.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.794+0000 7f7e49400640 1 -- 172.21.15.76:0/3279616509 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e340a8d60 con 0x7f7e4c06f780 2024-03-28T13:50:36.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.794+0000 7f7e4b200640 1 -- 172.21.15.76:0/3279616509 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e4c06f780 msgr2=0x7f7e4c06ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:36.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.794+0000 7f7e4b200640 1 --2- 172.21.15.76:0/3279616509 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e4c06f780 0x7f7e4c06ea00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7e340097f0 tx=0x7f7e3401ec90 comp rx=0 tx=0).stop 2024-03-28T13:50:36.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.794+0000 7f7e4b200640 1 -- 172.21.15.76:0/3279616509 shutdown_connections 2024-03-28T13:50:36.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.794+0000 7f7e4b200640 1 --2- 172.21.15.76:0/3279616509 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e4c06f780 0x7f7e4c06ea00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:36.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.794+0000 7f7e4b200640 1 -- 172.21.15.76:0/3279616509 >> 172.21.15.76:0/3279616509 conn(0x7f7e4c070c10 msgr2=0x7f7e4c071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:36.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.794+0000 7f7e4b200640 1 -- 172.21.15.76:0/3279616509 shutdown_connections 2024-03-28T13:50:36.795 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.794+0000 7f7e4b200640 1 -- 172.21.15.76:0/3279616509 wait complete. 2024-03-28T13:50:36.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.798+0000 7f7e4b200640 1 Processor -- start 2024-03-28T13:50:36.797 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.798+0000 7f7e4b200640 1 -- start start 2024-03-28T13:50:36.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.798+0000 7f7e4b200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e4c06ef40 0x7f7e4c14fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:36.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.798+0000 7f7e4b200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e4c06f780 0x7f7e4c14e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:36.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.798+0000 7f7e4b200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e4c152690 0x7f7e4c14e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:36.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.798+0000 7f7e4b200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c15bfb0 con 0x7f7e4c06f780 2024-03-28T13:50:36.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.798+0000 7f7e4b200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4c15c320 con 0x7f7e4c06ef40 2024-03-28T13:50:36.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.798+0000 7f7e4b200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7e4c152a70 con 0x7f7e4c152690 2024-03-28T13:50:36.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.798+0000 7f7e43e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e4c06f780 0x7f7e4c14e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:36.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.798+0000 7f7e43e00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e4c06f780 0x7f7e4c14e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:37144/0 (socket says 172.21.15.76:37144) 2024-03-28T13:50:36.799 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.798+0000 7f7e43e00640 1 -- 172.21.15.76:0/1963342325 learned_addr learned my addr 172.21.15.76:0/1963342325 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:36.802 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.802+0000 7f7e4a800640 1 --2- 172.21.15.76:0/1963342325 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e4c152690 0x7f7e4c14e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:36.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.802+0000 7f7e43e00640 1 -- 172.21.15.76:0/1963342325 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e4c152690 msgr2=0x7f7e4c14e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:36.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.802+0000 7f7e43e00640 1 --2- 172.21.15.76:0/1963342325 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e4c152690 0x7f7e4c14e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:36.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.802+0000 7f7e43e00640 1 -- 172.21.15.76:0/1963342325 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e4c06ef40 msgr2=0x7f7e4c14fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:36.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.802+0000 7f7e43e00640 1 --2- 172.21.15.76:0/1963342325 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e4c06ef40 0x7f7e4c14fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:36.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.802+0000 7f7e43e00640 1 -- 172.21.15.76:0/1963342325 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e4c157200 con 0x7f7e4c06f780 2024-03-28T13:50:36.803 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.802+0000 7f7e4a800640 1 --2- 172.21.15.76:0/1963342325 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e4c152690 0x7f7e4c14e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-28T13:50:36.808 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.806+0000 7f7e43e00640 1 --2- 172.21.15.76:0/1963342325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e4c06f780 0x7f7e4c14e080 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7e340097f0 tx=0x7f7e3401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:36.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.814+0000 7f7e42000640 1 -- 172.21.15.76:0/1963342325 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e340b5040 con 0x7f7e4c06f780 2024-03-28T13:50:36.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.814+0000 7f7e42000640 1 -- 172.21.15.76:0/1963342325 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e340c0070 con 0x7f7e4c06f780 2024-03-28T13:50:36.814 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.814+0000 7f7e42000640 1 -- 172.21.15.76:0/1963342325 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e340b0b60 con 0x7f7e4c06f780 2024-03-28T13:50:36.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.814+0000 7f7e4b200640 1 -- 172.21.15.76:0/1963342325 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e4c1574e0 con 0x7f7e4c06f780 2024-03-28T13:50:36.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.814+0000 7f7e4b200640 1 -- 172.21.15.76:0/1963342325 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e4c157aa0 con 0x7f7e4c06f780 2024-03-28T13:50:36.815 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.814+0000 7f7e4b200640 1 -- 172.21.15.76:0/1963342325 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e4c068df0 con 0x7f7e4c06f780 2024-03-28T13:50:36.839 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.838+0000 7f7e42000640 1 -- 172.21.15.76:0/1963342325 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f7e340b0d00 con 0x7f7e4c06f780 2024-03-28T13:50:36.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.838+0000 7f7e42000640 1 --2- 172.21.15.76:0/1963342325 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7e28068040 0x7f7e2806a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:36.840 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.838+0000 7f7e49e00640 1 --2- 172.21.15.76:0/1963342325 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7e28068040 0x7f7e2806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:36.841 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.842+0000 7f7e49e00640 1 --2- 172.21.15.76:0/1963342325 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7e28068040 0x7f7e2806a500 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009650 tx=0x7f7e3c006bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:36.842 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:36.842+0000 7f7e42000640 1 -- 172.21.15.76:0/1963342325 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f7e340f2800 con 0x7f7e4c06f780 2024-03-28T13:50:37.111 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:37.110+0000 7f7e42000640 1 -- 172.21.15.76:0/1963342325 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f7e340187f0 con 0x7f7e4c06f780 2024-03-28T13:50:37.307 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:37.306+0000 7f7e4b200640 1 -- 172.21.15.76:0/1963342325 --> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7e4c06f560 con 0x7f7e28068040 2024-03-28T13:50:37.324 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:37.322+0000 7f7e42000640 1 -- 172.21.15.76:0/1963342325 <== mgr.4107 v2:172.21.15.76:6800/1313648511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332433 (secure 0 0 0) 0x7f7e4c06f560 con 0x7f7e28068040 2024-03-28T13:50:37.328 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T13:50:37.330 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-03-28T13:50:37.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:37.330+0000 7f7e4b200640 1 -- 172.21.15.76:0/1963342325 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7e28068040 msgr2=0x7f7e2806a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:37.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:37.330+0000 7f7e4b200640 1 --2- 172.21.15.76:0/1963342325 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7e28068040 0x7f7e2806a500 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c009650 tx=0x7f7e3c006bb0 comp rx=0 tx=0).stop 2024-03-28T13:50:37.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:37.330+0000 7f7e4b200640 1 -- 172.21.15.76:0/1963342325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e4c06f780 msgr2=0x7f7e4c14e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:37.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:37.330+0000 7f7e4b200640 1 --2- 172.21.15.76:0/1963342325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e4c06f780 0x7f7e4c14e080 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7e340097f0 tx=0x7f7e3401ba30 comp rx=0 tx=0).stop 2024-03-28T13:50:37.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:37.330+0000 7f7e4b200640 1 -- 172.21.15.76:0/1963342325 shutdown_connections 2024-03-28T13:50:37.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:37.330+0000 7f7e4b200640 1 --2- 172.21.15.76:0/1963342325 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f7e28068040 0x7f7e2806a500 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:37.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:37.330+0000 7f7e4b200640 1 --2- 172.21.15.76:0/1963342325 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e4c152690 0x7f7e4c14e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:37.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:37.330+0000 7f7e4b200640 1 --2- 172.21.15.76:0/1963342325 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f7e4c06f780 0x7f7e4c14e080 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:37.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:37.330+0000 7f7e4b200640 1 --2- 172.21.15.76:0/1963342325 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e4c06ef40 0x7f7e4c14fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:37.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:37.330+0000 7f7e4b200640 1 -- 172.21.15.76:0/1963342325 >> 172.21.15.76:0/1963342325 conn(0x7f7e4c070c10 msgr2=0x7f7e4c0b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:37.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:37.330+0000 7f7e4b200640 1 -- 172.21.15.76:0/1963342325 shutdown_connections 2024-03-28T13:50:37.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:37.330+0000 7f7e4b200640 1 -- 172.21.15.76:0/1963342325 wait complete. 2024-03-28T13:50:37.351 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":2101,"stamp":"2024-03-28T13:50:36.036681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":189794063,"num_objects":145,"num_object_clones":0,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":2659,"num_read_kb":3443253,"num_write":48837,"num_write_kb":4437360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":59994,"ondisk_log_size":59994,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":934656,"kb_used_data":163648,"kb_used_omap":12,"kb_used_meta":770931,"kb_avail":754040064,"statfs":{"total":773094113280,"available":772137025536,"internally_reserved":0,"allocated":167575552,"data_stored":380599286,"data_compressed":51442660,"data_compressed_allocated":66928640,"data_compressed_original":281649152,"omap_allocated":12752,"internal_metadata":789433904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":18067,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002924"},"pg_stats":[{"pgid":"2.1f","version":"29'319","reported_seq":380,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.203049+0000","last_change":"2024-03-28T12:42:00.080769+0000","last_active":"2024-03-28T13:50:23.203049+0000","last_peered":"2024-03-28T13:50:23.203049+0000","last_clean":"2024-03-28T13:50:23.203049+0000","last_became_active":"2024-03-28T12:42:00.079900+0000","last_became_peered":"2024-03-28T12:42:00.079900+0000","last_unstale":"2024-03-28T13:50:23.203049+0000","last_undegraded":"2024-03-28T13:50:23.203049+0000","last_fullsized":"2024-03-28T13:50:23.203049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":8322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'203","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.418650+0000","last_change":"2024-03-28T12:42:01.960244+0000","last_active":"2024-03-28T13:50:23.418650+0000","last_peered":"2024-03-28T13:50:23.418650+0000","last_clean":"2024-03-28T13:50:23.418650+0000","last_became_active":"2024-03-28T12:42:01.959408+0000","last_became_peered":"2024-03-28T12:42:01.959408+0000","last_unstale":"2024-03-28T13:50:23.418650+0000","last_undegraded":"2024-03-28T13:50:23.418650+0000","last_fullsized":"2024-03-28T13:50:23.418650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:00:51.741925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'806","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.626553+0000","last_change":"2024-03-28T12:42:07.880943+0000","last_active":"2024-03-28T13:50:14.626553+0000","last_peered":"2024-03-28T13:50:14.626553+0000","last_clean":"2024-03-28T13:50:14.626553+0000","last_became_active":"2024-03-28T12:42:07.880354+0000","last_became_peered":"2024-03-28T12:42:07.880354+0000","last_unstale":"2024-03-28T13:50:14.626553+0000","last_undegraded":"2024-03-28T13:50:14.626553+0000","last_fullsized":"2024-03-28T13:50:14.626553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:39.078379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":120104,"num_write":790,"num_write_kb":143940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'158","reported_seq":220,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:13.417457+0000","last_change":"2024-03-28T12:42:00.138569+0000","last_active":"2024-03-28T13:49:13.417457+0000","last_peered":"2024-03-28T13:49:13.417457+0000","last_clean":"2024-03-28T13:49:13.417457+0000","last_became_active":"2024-03-28T12:42:00.137978+0000","last_became_peered":"2024-03-28T12:42:00.137978+0000","last_unstale":"2024-03-28T13:49:13.417457+0000","last_undegraded":"2024-03-28T13:49:13.417457+0000","last_fullsized":"2024-03-28T13:49:13.417457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:38:28.575778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'187","reported_seq":245,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.447692+0000","last_change":"2024-03-28T12:42:01.958236+0000","last_active":"2024-03-28T13:50:23.447692+0000","last_peered":"2024-03-28T13:50:23.447692+0000","last_clean":"2024-03-28T13:50:23.447692+0000","last_became_active":"2024-03-28T12:42:01.957875+0000","last_became_peered":"2024-03-28T12:42:01.957875+0000","last_unstale":"2024-03-28T13:50:23.447692+0000","last_undegraded":"2024-03-28T13:50:23.447692+0000","last_fullsized":"2024-03-28T13:50:23.447692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:48:52.933175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'798","reported_seq":903,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.302901+0000","last_change":"2024-03-28T12:42:07.905799+0000","last_active":"2024-03-28T13:50:18.302901+0000","last_peered":"2024-03-28T13:50:18.302901+0000","last_clean":"2024-03-28T13:50:18.302901+0000","last_became_active":"2024-03-28T12:42:07.905350+0000","last_became_peered":"2024-03-28T12:42:07.905350+0000","last_unstale":"2024-03-28T13:50:18.302901+0000","last_undegraded":"2024-03-28T13:50:18.302901+0000","last_fullsized":"2024-03-28T13:50:18.302901+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":162211,"num_write":782,"num_write_kb":177125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1182","reported_seq":1237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.481741+0000","last_change":"2024-03-28T12:42:00.150272+0000","last_active":"2024-03-28T13:50:04.481741+0000","last_peered":"2024-03-28T13:50:04.481741+0000","last_clean":"2024-03-28T13:50:04.481741+0000","last_became_active":"2024-03-28T12:42:00.148367+0000","last_became_peered":"2024-03-28T12:42:00.148367+0000","last_unstale":"2024-03-28T13:50:04.481741+0000","last_undegraded":"2024-03-28T13:50:04.481741+0000","last_fullsized":"2024-03-28T13:50:04.481741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1182,"log_dups_size":0,"ondisk_log_size":1182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1357,"num_write_kb":12879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'189","reported_seq":249,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:33.668838+0000","last_change":"2024-03-28T13:50:33.668875+0000","last_active":"2024-03-28T13:50:33.668838+0000","last_peered":"2024-03-28T13:50:33.668838+0000","last_clean":"2024-03-28T13:50:33.668838+0000","last_became_active":"2024-03-28T12:42:01.964817+0000","last_became_peered":"2024-03-28T12:42:01.964817+0000","last_unstale":"2024-03-28T13:50:33.668838+0000","last_undegraded":"2024-03-28T13:50:33.668838+0000","last_fullsized":"2024-03-28T13:50:33.668838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'189","last_scrub_stamp":"2024-03-28T13:50:33.668747+0000","last_deep_scrub":"29'189","last_deep_scrub_stamp":"2024-03-28T13:50:33.668747+0000","last_clean_scrub_stamp":"2024-03-28T13:50:33.668747+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:56:28.828088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'762","reported_seq":840,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.621595+0000","last_change":"2024-03-28T12:42:07.906794+0000","last_active":"2024-03-28T13:50:14.621595+0000","last_peered":"2024-03-28T13:50:14.621595+0000","last_clean":"2024-03-28T13:50:14.621595+0000","last_became_active":"2024-03-28T12:42:07.905522+0000","last_became_peered":"2024-03-28T12:42:07.905522+0000","last_unstale":"2024-03-28T13:50:14.621595+0000","last_undegraded":"2024-03-28T13:50:14.621595+0000","last_fullsized":"2024-03-28T13:50:14.621595+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":115606,"num_write":742,"num_write_kb":142838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'844","reported_seq":899,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.516916+0000","last_change":"2024-03-28T12:42:00.149947+0000","last_active":"2024-03-28T13:50:14.516916+0000","last_peered":"2024-03-28T13:50:14.516916+0000","last_clean":"2024-03-28T13:50:14.516916+0000","last_became_active":"2024-03-28T12:42:00.148446+0000","last_became_peered":"2024-03-28T12:42:00.148446+0000","last_unstale":"2024-03-28T13:50:14.516916+0000","last_undegraded":"2024-03-28T13:50:14.516916+0000","last_fullsized":"2024-03-28T13:50:14.516916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'204","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:32.345331+0000","last_change":"2024-03-28T13:50:32.345371+0000","last_active":"2024-03-28T13:50:32.345331+0000","last_peered":"2024-03-28T13:50:32.345331+0000","last_clean":"2024-03-28T13:50:32.345331+0000","last_became_active":"2024-03-28T12:42:01.935231+0000","last_became_peered":"2024-03-28T12:42:01.935231+0000","last_unstale":"2024-03-28T13:50:32.345331+0000","last_undegraded":"2024-03-28T13:50:32.345331+0000","last_fullsized":"2024-03-28T13:50:32.345331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'204","last_scrub_stamp":"2024-03-28T13:50:32.345223+0000","last_deep_scrub":"29'204","last_deep_scrub_stamp":"2024-03-28T13:50:32.345223+0000","last_clean_scrub_stamp":"2024-03-28T13:50:32.345223+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:54:25.717170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'756","reported_seq":819,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.105167+0000","last_change":"2024-03-28T12:42:07.904616+0000","last_active":"2024-03-28T13:50:15.105167+0000","last_peered":"2024-03-28T13:50:15.105167+0000","last_clean":"2024-03-28T13:50:15.105167+0000","last_became_active":"2024-03-28T12:42:07.904240+0000","last_became_peered":"2024-03-28T12:42:07.904240+0000","last_unstale":"2024-03-28T13:50:15.105167+0000","last_undegraded":"2024-03-28T13:50:15.105167+0000","last_fullsized":"2024-03-28T13:50:15.105167+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":42901,"num_write":735,"num_write_kb":89492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'215","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.449653+0000","last_change":"2024-03-28T12:42:01.963116+0000","last_active":"2024-03-28T13:50:23.449653+0000","last_peered":"2024-03-28T13:50:23.449653+0000","last_clean":"2024-03-28T13:50:23.449653+0000","last_became_active":"2024-03-28T12:42:01.962885+0000","last_became_peered":"2024-03-28T12:42:01.962885+0000","last_unstale":"2024-03-28T13:50:23.449653+0000","last_undegraded":"2024-03-28T13:50:23.449653+0000","last_fullsized":"2024-03-28T13:50:23.449653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'621","reported_seq":680,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:32.911473+0000","last_change":"2024-03-28T12:42:00.134353+0000","last_active":"2024-03-28T13:49:32.911473+0000","last_peered":"2024-03-28T13:49:32.911473+0000","last_clean":"2024-03-28T13:49:32.911473+0000","last_became_active":"2024-03-28T12:42:00.133880+0000","last_became_peered":"2024-03-28T12:42:00.133880+0000","last_unstale":"2024-03-28T13:49:32.911473+0000","last_undegraded":"2024-03-28T13:49:32.911473+0000","last_fullsized":"2024-03-28T13:49:32.911473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":12550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'827","reported_seq":933,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.457020+0000","last_change":"2024-03-28T12:42:15.238142+0000","last_active":"2024-03-28T13:50:04.457020+0000","last_peered":"2024-03-28T13:50:04.457020+0000","last_clean":"2024-03-28T13:50:04.457020+0000","last_became_active":"2024-03-28T12:42:15.237739+0000","last_became_peered":"2024-03-28T12:42:15.237739+0000","last_unstale":"2024-03-28T13:50:04.457020+0000","last_undegraded":"2024-03-28T13:50:04.457020+0000","last_fullsized":"2024-03-28T13:50:04.457020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":166655,"num_write":808,"num_write_kb":213920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'211","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.430106+0000","last_change":"2024-03-28T12:42:01.948688+0000","last_active":"2024-03-28T13:50:23.430106+0000","last_peered":"2024-03-28T13:50:23.430106+0000","last_clean":"2024-03-28T13:50:23.430106+0000","last_became_active":"2024-03-28T12:42:01.948049+0000","last_became_peered":"2024-03-28T12:42:01.948049+0000","last_unstale":"2024-03-28T13:50:23.430106+0000","last_undegraded":"2024-03-28T13:50:23.430106+0000","last_fullsized":"2024-03-28T13:50:23.430106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:30.948883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'877","reported_seq":935,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.735570+0000","last_change":"2024-03-28T12:42:00.139208+0000","last_active":"2024-03-28T13:50:23.735570+0000","last_peered":"2024-03-28T13:50:23.735570+0000","last_clean":"2024-03-28T13:50:23.735570+0000","last_became_active":"2024-03-28T12:42:00.138264+0000","last_became_peered":"2024-03-28T12:42:00.138264+0000","last_unstale":"2024-03-28T13:50:23.735570+0000","last_undegraded":"2024-03-28T13:50:23.735570+0000","last_fullsized":"2024-03-28T13:50:23.735570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7273697,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":7596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'824","reported_seq":899,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.159476+0000","last_change":"2024-03-28T12:42:07.941636+0000","last_active":"2024-03-28T13:50:15.159476+0000","last_peered":"2024-03-28T13:50:15.159476+0000","last_clean":"2024-03-28T13:50:15.159476+0000","last_became_active":"2024-03-28T12:42:07.941114+0000","last_became_peered":"2024-03-28T12:42:07.941114+0000","last_unstale":"2024-03-28T13:50:15.159476+0000","last_undegraded":"2024-03-28T13:50:15.159476+0000","last_fullsized":"2024-03-28T13:50:15.159476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":77884,"num_write":800,"num_write_kb":72822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'207","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:34.120957+0000","last_change":"2024-03-28T13:50:34.121015+0000","last_active":"2024-03-28T13:50:34.120957+0000","last_peered":"2024-03-28T13:50:34.120957+0000","last_clean":"2024-03-28T13:50:34.120957+0000","last_became_active":"2024-03-28T12:42:01.946576+0000","last_became_peered":"2024-03-28T12:42:01.946576+0000","last_unstale":"2024-03-28T13:50:34.120957+0000","last_undegraded":"2024-03-28T13:50:34.120957+0000","last_fullsized":"2024-03-28T13:50:34.120957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'207","last_scrub_stamp":"2024-03-28T13:50:34.120791+0000","last_deep_scrub":"29'207","last_deep_scrub_stamp":"2024-03-28T13:50:34.120791+0000","last_clean_scrub_stamp":"2024-03-28T13:50:34.120791+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:41:57.223387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'258","reported_seq":318,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:13.531059+0000","last_change":"2024-03-28T12:42:00.142804+0000","last_active":"2024-03-28T13:49:13.531059+0000","last_peered":"2024-03-28T13:49:13.531059+0000","last_clean":"2024-03-28T13:49:13.531059+0000","last_became_active":"2024-03-28T12:42:00.142063+0000","last_became_peered":"2024-03-28T12:42:00.142063+0000","last_unstale":"2024-03-28T13:49:13.531059+0000","last_undegraded":"2024-03-28T13:49:13.531059+0000","last_fullsized":"2024-03-28T13:49:13.531059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'752","reported_seq":836,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.513787+0000","last_change":"2024-03-28T12:42:15.234431+0000","last_active":"2024-03-28T13:50:14.513787+0000","last_peered":"2024-03-28T13:50:14.513787+0000","last_clean":"2024-03-28T13:50:14.513787+0000","last_became_active":"2024-03-28T12:42:15.232928+0000","last_became_peered":"2024-03-28T12:42:15.232928+0000","last_unstale":"2024-03-28T13:50:14.513787+0000","last_undegraded":"2024-03-28T13:50:14.513787+0000","last_fullsized":"2024-03-28T13:50:14.513787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:05:19.841176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":85819,"num_write":731,"num_write_kb":97778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,5],"acting":[7,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'222","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.438411+0000","last_change":"2024-03-28T12:42:01.787457+0000","last_active":"2024-03-28T13:50:23.438411+0000","last_peered":"2024-03-28T13:50:23.438411+0000","last_clean":"2024-03-28T13:50:23.438411+0000","last_became_active":"2024-03-28T12:42:01.787253+0000","last_became_peered":"2024-03-28T12:42:01.787253+0000","last_unstale":"2024-03-28T13:50:23.438411+0000","last_undegraded":"2024-03-28T13:50:23.438411+0000","last_fullsized":"2024-03-28T13:50:23.438411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'773","reported_seq":840,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:32.609650+0000","last_change":"2024-03-28T13:50:32.609699+0000","last_active":"2024-03-28T13:50:32.609650+0000","last_peered":"2024-03-28T13:50:32.609650+0000","last_clean":"2024-03-28T13:50:32.609650+0000","last_became_active":"2024-03-28T12:42:00.146394+0000","last_became_peered":"2024-03-28T12:42:00.146394+0000","last_unstale":"2024-03-28T13:50:32.609650+0000","last_undegraded":"2024-03-28T13:50:32.609650+0000","last_fullsized":"2024-03-28T13:50:32.609650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'773","last_scrub_stamp":"2024-03-28T13:50:32.609569+0000","last_deep_scrub":"29'773","last_deep_scrub_stamp":"2024-03-28T13:50:32.609569+0000","last_clean_scrub_stamp":"2024-03-28T13:50:32.609569+0000","objects_scrubbed":2,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:42:39.755490+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'732","reported_seq":813,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.344644+0000","last_change":"2024-03-28T12:42:07.906623+0000","last_active":"2024-03-28T13:50:18.344644+0000","last_peered":"2024-03-28T13:50:18.344644+0000","last_clean":"2024-03-28T13:50:18.344644+0000","last_became_active":"2024-03-28T12:42:07.906233+0000","last_became_peered":"2024-03-28T12:42:07.906233+0000","last_unstale":"2024-03-28T13:50:18.344644+0000","last_undegraded":"2024-03-28T13:50:18.344644+0000","last_fullsized":"2024-03-28T13:50:18.344644+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":108609,"num_write":711,"num_write_kb":134735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'225","reported_seq":283,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.626612+0000","last_change":"2024-03-28T12:42:01.946498+0000","last_active":"2024-03-28T13:50:23.626612+0000","last_peered":"2024-03-28T13:50:23.626612+0000","last_clean":"2024-03-28T13:50:23.626612+0000","last_became_active":"2024-03-28T12:42:01.946087+0000","last_became_peered":"2024-03-28T12:42:01.946087+0000","last_unstale":"2024-03-28T13:50:23.626612+0000","last_undegraded":"2024-03-28T13:50:23.626612+0000","last_fullsized":"2024-03-28T13:50:23.626612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'253","reported_seq":313,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.352970+0000","last_change":"2024-03-28T12:42:00.143860+0000","last_active":"2024-03-28T13:50:18.352970+0000","last_peered":"2024-03-28T13:50:18.352970+0000","last_clean":"2024-03-28T13:50:18.352970+0000","last_became_active":"2024-03-28T12:42:00.143537+0000","last_became_peered":"2024-03-28T12:42:00.143537+0000","last_unstale":"2024-03-28T13:50:18.352970+0000","last_undegraded":"2024-03-28T13:50:18.352970+0000","last_fullsized":"2024-03-28T13:50:18.352970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":4185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'820","reported_seq":929,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.023371+0000","last_change":"2024-03-28T12:42:15.365975+0000","last_active":"2024-03-28T13:50:15.023371+0000","last_peered":"2024-03-28T13:50:15.023371+0000","last_clean":"2024-03-28T13:50:15.023371+0000","last_became_active":"2024-03-28T12:42:15.365535+0000","last_became_peered":"2024-03-28T12:42:15.365535+0000","last_unstale":"2024-03-28T13:50:15.023371+0000","last_undegraded":"2024-03-28T13:50:15.023371+0000","last_fullsized":"2024-03-28T13:50:15.023371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":174138,"num_write":805,"num_write_kb":205369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,1],"acting":[2,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'175","reported_seq":233,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.626521+0000","last_change":"2024-03-28T12:42:01.802128+0000","last_active":"2024-03-28T13:50:23.626521+0000","last_peered":"2024-03-28T13:50:23.626521+0000","last_clean":"2024-03-28T13:50:23.626521+0000","last_became_active":"2024-03-28T12:42:01.801492+0000","last_became_peered":"2024-03-28T12:42:01.801492+0000","last_unstale":"2024-03-28T13:50:23.626521+0000","last_undegraded":"2024-03-28T13:50:23.626521+0000","last_fullsized":"2024-03-28T13:50:23.626521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'3007","reported_seq":3067,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.581010+0000","last_change":"2024-03-28T12:42:00.145914+0000","last_active":"2024-03-28T13:50:23.581010+0000","last_peered":"2024-03-28T13:50:23.581010+0000","last_clean":"2024-03-28T13:50:23.581010+0000","last_became_active":"2024-03-28T12:42:00.145638+0000","last_became_peered":"2024-03-28T12:42:00.145638+0000","last_unstale":"2024-03-28T13:50:23.581010+0000","last_undegraded":"2024-03-28T13:50:23.581010+0000","last_fullsized":"2024-03-28T13:50:23.581010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":3007,"log_dups_size":0,"ondisk_log_size":3007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6735,"num_write_kb":3814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'791","reported_seq":866,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:29.296014+0000","last_change":"2024-03-28T12:42:07.882697+0000","last_active":"2024-03-28T13:50:29.296014+0000","last_peered":"2024-03-28T13:50:29.296014+0000","last_clean":"2024-03-28T13:50:29.296014+0000","last_became_active":"2024-03-28T12:42:07.881730+0000","last_became_peered":"2024-03-28T12:42:07.881730+0000","last_unstale":"2024-03-28T13:50:29.296014+0000","last_undegraded":"2024-03-28T13:50:29.296014+0000","last_fullsized":"2024-03-28T13:50:29.296014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":64976,"num_write":766,"num_write_kb":85207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'204","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.411132+0000","last_change":"2024-03-28T12:42:01.810914+0000","last_active":"2024-03-28T13:50:23.411132+0000","last_peered":"2024-03-28T13:50:23.411132+0000","last_clean":"2024-03-28T13:50:23.411132+0000","last_became_active":"2024-03-28T12:42:01.810207+0000","last_became_peered":"2024-03-28T12:42:01.810207+0000","last_unstale":"2024-03-28T13:50:23.411132+0000","last_undegraded":"2024-03-28T13:50:23.411132+0000","last_fullsized":"2024-03-28T13:50:23.411132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:15:32.704186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'669","reported_seq":730,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.458493+0000","last_change":"2024-03-28T12:42:00.078402+0000","last_active":"2024-03-28T13:50:04.458493+0000","last_peered":"2024-03-28T13:50:04.458493+0000","last_clean":"2024-03-28T13:50:04.458493+0000","last_became_active":"2024-03-28T12:42:00.077988+0000","last_became_peered":"2024-03-28T12:42:00.077988+0000","last_unstale":"2024-03-28T13:50:04.458493+0000","last_undegraded":"2024-03-28T13:50:04.458493+0000","last_fullsized":"2024-03-28T13:50:04.458493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":8525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'762","reported_seq":849,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.824806+0000","last_change":"2024-03-28T12:42:07.936419+0000","last_active":"2024-03-28T13:50:08.824806+0000","last_peered":"2024-03-28T13:50:08.824806+0000","last_clean":"2024-03-28T13:50:08.824806+0000","last_became_active":"2024-03-28T12:42:07.935820+0000","last_became_peered":"2024-03-28T12:42:07.935820+0000","last_unstale":"2024-03-28T13:50:08.824806+0000","last_undegraded":"2024-03-28T13:50:08.824806+0000","last_fullsized":"2024-03-28T13:50:08.824806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:35:08.334379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":124547,"num_write":741,"num_write_kb":143298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'211","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.581380+0000","last_change":"2024-03-28T12:42:01.968887+0000","last_active":"2024-03-28T13:50:23.581380+0000","last_peered":"2024-03-28T13:50:23.581380+0000","last_clean":"2024-03-28T13:50:23.581380+0000","last_became_active":"2024-03-28T12:42:01.965491+0000","last_became_peered":"2024-03-28T12:42:01.965491+0000","last_unstale":"2024-03-28T13:50:23.581380+0000","last_undegraded":"2024-03-28T13:50:23.581380+0000","last_fullsized":"2024-03-28T13:50:23.581380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'378","reported_seq":438,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:48:53.431765+0000","last_change":"2024-03-28T12:42:00.135482+0000","last_active":"2024-03-28T13:48:53.431765+0000","last_peered":"2024-03-28T13:48:53.431765+0000","last_clean":"2024-03-28T13:48:53.431765+0000","last_became_active":"2024-03-28T12:42:00.132939+0000","last_became_peered":"2024-03-28T12:42:00.132939+0000","last_unstale":"2024-03-28T13:48:53.431765+0000","last_undegraded":"2024-03-28T13:48:53.431765+0000","last_fullsized":"2024-03-28T13:48:53.431765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:31:41.407157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'754","reported_seq":812,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.841272+0000","last_change":"2024-03-28T12:42:07.865644+0000","last_active":"2024-03-28T13:50:08.841272+0000","last_peered":"2024-03-28T13:50:08.841272+0000","last_clean":"2024-03-28T13:50:08.841272+0000","last_became_active":"2024-03-28T12:42:07.864804+0000","last_became_peered":"2024-03-28T12:42:07.864804+0000","last_unstale":"2024-03-28T13:50:08.841272+0000","last_undegraded":"2024-03-28T13:50:08.841272+0000","last_fullsized":"2024-03-28T13:50:08.841272+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:23:28.659784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":19361,"num_write":730,"num_write_kb":84308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'202","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.535381+0000","last_change":"2024-03-28T12:42:01.966222+0000","last_active":"2024-03-28T13:50:23.535381+0000","last_peered":"2024-03-28T13:50:23.535381+0000","last_clean":"2024-03-28T13:50:23.535381+0000","last_became_active":"2024-03-28T12:42:01.962305+0000","last_became_peered":"2024-03-28T12:42:01.962305+0000","last_unstale":"2024-03-28T13:50:23.535381+0000","last_undegraded":"2024-03-28T13:50:23.535381+0000","last_fullsized":"2024-03-28T13:50:23.535381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'900","reported_seq":961,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.206101+0000","last_change":"2024-03-28T12:42:00.137406+0000","last_active":"2024-03-28T13:50:23.206101+0000","last_peered":"2024-03-28T13:50:23.206101+0000","last_clean":"2024-03-28T13:50:23.206101+0000","last_became_active":"2024-03-28T12:42:00.137086+0000","last_became_peered":"2024-03-28T12:42:00.137086+0000","last_unstale":"2024-03-28T13:50:23.206101+0000","last_undegraded":"2024-03-28T13:50:23.206101+0000","last_fullsized":"2024-03-28T13:50:23.206101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389591,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":833,"num_write_kb":8592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'738","reported_seq":816,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.304618+0000","last_change":"2024-03-28T12:42:07.940726+0000","last_active":"2024-03-28T13:50:18.304618+0000","last_peered":"2024-03-28T13:50:18.304618+0000","last_clean":"2024-03-28T13:50:18.304618+0000","last_became_active":"2024-03-28T12:42:07.939926+0000","last_became_peered":"2024-03-28T12:42:07.939926+0000","last_unstale":"2024-03-28T13:50:18.304618+0000","last_undegraded":"2024-03-28T13:50:18.304618+0000","last_fullsized":"2024-03-28T13:50:18.304618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:45.857353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":104657,"num_write":715,"num_write_kb":183622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'211","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.418735+0000","last_change":"2024-03-28T12:42:01.949510+0000","last_active":"2024-03-28T13:50:23.418735+0000","last_peered":"2024-03-28T13:50:23.418735+0000","last_clean":"2024-03-28T13:50:23.418735+0000","last_became_active":"2024-03-28T12:42:01.949046+0000","last_became_peered":"2024-03-28T12:42:01.949046+0000","last_unstale":"2024-03-28T13:50:23.418735+0000","last_undegraded":"2024-03-28T13:50:23.418735+0000","last_fullsized":"2024-03-28T13:50:23.418735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:50:04.915302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1505","reported_seq":3000,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.444907+0000","last_change":"2024-03-28T12:42:00.150734+0000","last_active":"2024-03-28T13:50:23.444907+0000","last_peered":"2024-03-28T13:50:23.444907+0000","last_clean":"2024-03-28T13:50:23.444907+0000","last_became_active":"2024-03-28T12:42:00.150209+0000","last_became_peered":"2024-03-28T12:42:00.150209+0000","last_unstale":"2024-03-28T13:50:23.444907+0000","last_undegraded":"2024-03-28T13:50:23.444907+0000","last_fullsized":"2024-03-28T13:50:23.444907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1505,"log_dups_size":0,"ondisk_log_size":1505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:01:08.734929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1566364,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1437,"num_read_kb":2622,"num_write":1444,"num_write_kb":2626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'706","reported_seq":785,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.371808+0000","last_change":"2024-03-28T12:42:07.935974+0000","last_active":"2024-03-28T13:50:14.371808+0000","last_peered":"2024-03-28T13:50:14.371808+0000","last_clean":"2024-03-28T13:50:14.371808+0000","last_became_active":"2024-03-28T12:42:07.935342+0000","last_became_peered":"2024-03-28T12:42:07.935342+0000","last_unstale":"2024-03-28T13:50:14.371808+0000","last_undegraded":"2024-03-28T13:50:14.371808+0000","last_fullsized":"2024-03-28T13:50:14.371808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:53:21.970094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":64573,"num_write":698,"num_write_kb":72611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'198","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.410134+0000","last_change":"2024-03-28T12:42:01.961701+0000","last_active":"2024-03-28T13:50:23.410134+0000","last_peered":"2024-03-28T13:50:23.410134+0000","last_clean":"2024-03-28T13:50:23.410134+0000","last_became_active":"2024-03-28T12:42:01.961228+0000","last_became_peered":"2024-03-28T12:42:01.961228+0000","last_unstale":"2024-03-28T13:50:23.410134+0000","last_undegraded":"2024-03-28T13:50:23.410134+0000","last_fullsized":"2024-03-28T13:50:23.410134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:06:12.514421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'517","reported_seq":580,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:22.916526+0000","last_change":"2024-03-28T12:42:00.069398+0000","last_active":"2024-03-28T13:50:22.916526+0000","last_peered":"2024-03-28T13:50:22.916526+0000","last_clean":"2024-03-28T13:50:22.916526+0000","last_became_active":"2024-03-28T12:42:00.069134+0000","last_became_peered":"2024-03-28T12:42:00.069134+0000","last_unstale":"2024-03-28T13:50:22.916526+0000","last_undegraded":"2024-03-28T13:50:22.916526+0000","last_fullsized":"2024-03-28T13:50:22.916526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":460,"num_write_kb":12504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'872","reported_seq":971,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.109378+0000","last_change":"2024-03-28T12:42:15.365776+0000","last_active":"2024-03-28T13:50:15.109378+0000","last_peered":"2024-03-28T13:50:15.109378+0000","last_clean":"2024-03-28T13:50:15.109378+0000","last_became_active":"2024-03-28T12:42:15.364496+0000","last_became_peered":"2024-03-28T12:42:15.364496+0000","last_unstale":"2024-03-28T13:50:15.109378+0000","last_undegraded":"2024-03-28T13:50:15.109378+0000","last_fullsized":"2024-03-28T13:50:15.109378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:22:09.948471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":158824,"num_write":857,"num_write_kb":176540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'188","reported_seq":247,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.619898+0000","last_change":"2024-03-28T12:42:01.959210+0000","last_active":"2024-03-28T13:50:23.619898+0000","last_peered":"2024-03-28T13:50:23.619898+0000","last_clean":"2024-03-28T13:50:23.619898+0000","last_became_active":"2024-03-28T12:42:01.958117+0000","last_became_peered":"2024-03-28T12:42:01.958117+0000","last_unstale":"2024-03-28T13:50:23.619898+0000","last_undegraded":"2024-03-28T13:50:23.619898+0000","last_fullsized":"2024-03-28T13:50:23.619898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'274","reported_seq":335,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.611142+0000","last_change":"2024-03-28T12:42:00.134120+0000","last_active":"2024-03-28T13:50:14.611142+0000","last_peered":"2024-03-28T13:50:14.611142+0000","last_clean":"2024-03-28T13:50:14.611142+0000","last_became_active":"2024-03-28T12:42:00.133540+0000","last_became_peered":"2024-03-28T12:42:00.133540+0000","last_unstale":"2024-03-28T13:50:14.611142+0000","last_undegraded":"2024-03-28T13:50:14.611142+0000","last_fullsized":"2024-03-28T13:50:14.611142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":227,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:30.763843+0000","last_change":"2024-03-28T13:50:30.763892+0000","last_active":"2024-03-28T13:50:30.763843+0000","last_peered":"2024-03-28T13:50:30.763843+0000","last_clean":"2024-03-28T13:50:30.763843+0000","last_became_active":"2024-03-28T12:41:26.700338+0000","last_became_peered":"2024-03-28T12:41:26.700338+0000","last_unstale":"2024-03-28T13:50:30.763843+0000","last_undegraded":"2024-03-28T13:50:30.763843+0000","last_fullsized":"2024-03-28T13:50:30.763843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-03-28T13:50:30.763743+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-03-28T13:50:30.763743+0000","last_clean_scrub_stamp":"2024-03-28T13:50:30.763743+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:47:39.284116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'778","reported_seq":855,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.043247+0000","last_change":"2024-03-28T12:42:07.938384+0000","last_active":"2024-03-28T13:50:15.043247+0000","last_peered":"2024-03-28T13:50:15.043247+0000","last_clean":"2024-03-28T13:50:15.043247+0000","last_became_active":"2024-03-28T12:42:07.937553+0000","last_became_peered":"2024-03-28T12:42:07.937553+0000","last_unstale":"2024-03-28T13:50:15.043247+0000","last_undegraded":"2024-03-28T13:50:15.043247+0000","last_fullsized":"2024-03-28T13:50:15.043247+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":72658,"num_write":755,"num_write_kb":105142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'211","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.452187+0000","last_change":"2024-03-28T12:42:01.960107+0000","last_active":"2024-03-28T13:50:23.452187+0000","last_peered":"2024-03-28T13:50:23.452187+0000","last_clean":"2024-03-28T13:50:23.452187+0000","last_became_active":"2024-03-28T12:42:01.959809+0000","last_became_peered":"2024-03-28T12:42:01.959809+0000","last_unstale":"2024-03-28T13:50:23.452187+0000","last_undegraded":"2024-03-28T13:50:23.452187+0000","last_fullsized":"2024-03-28T13:50:23.452187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'368","reported_seq":425,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.797733+0000","last_change":"2024-03-28T12:42:00.144133+0000","last_active":"2024-03-28T13:50:08.797733+0000","last_peered":"2024-03-28T13:50:08.797733+0000","last_clean":"2024-03-28T13:50:08.797733+0000","last_became_active":"2024-03-28T12:42:00.143460+0000","last_became_peered":"2024-03-28T12:42:00.143460+0000","last_unstale":"2024-03-28T13:50:08.797733+0000","last_undegraded":"2024-03-28T13:50:08.797733+0000","last_fullsized":"2024-03-28T13:50:08.797733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195869,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'802","reported_seq":888,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.130256+0000","last_change":"2024-03-28T12:42:07.902848+0000","last_active":"2024-03-28T13:50:15.130256+0000","last_peered":"2024-03-28T13:50:15.130256+0000","last_clean":"2024-03-28T13:50:15.130256+0000","last_became_active":"2024-03-28T12:42:07.902428+0000","last_became_peered":"2024-03-28T12:42:07.902428+0000","last_unstale":"2024-03-28T13:50:15.130256+0000","last_undegraded":"2024-03-28T13:50:15.130256+0000","last_fullsized":"2024-03-28T13:50:15.130256+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":87583,"num_write":773,"num_write_kb":126746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'226","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.533784+0000","last_change":"2024-03-28T12:42:01.950786+0000","last_active":"2024-03-28T13:50:23.533784+0000","last_peered":"2024-03-28T13:50:23.533784+0000","last_clean":"2024-03-28T13:50:23.533784+0000","last_became_active":"2024-03-28T12:42:01.950592+0000","last_became_peered":"2024-03-28T12:42:01.950592+0000","last_unstale":"2024-03-28T13:50:23.533784+0000","last_undegraded":"2024-03-28T13:50:23.533784+0000","last_fullsized":"2024-03-28T13:50:23.533784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'817","reported_seq":875,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:18.008064+0000","last_change":"2024-03-28T12:42:00.148307+0000","last_active":"2024-03-28T13:49:18.008064+0000","last_peered":"2024-03-28T13:49:18.008064+0000","last_clean":"2024-03-28T13:49:18.008064+0000","last_became_active":"2024-03-28T12:42:00.139237+0000","last_became_peered":"2024-03-28T12:42:00.139237+0000","last_unstale":"2024-03-28T13:49:18.008064+0000","last_undegraded":"2024-03-28T13:49:18.008064+0000","last_fullsized":"2024-03-28T13:49:18.008064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:43:33.699843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":4460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'797","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.417907+0000","last_change":"2024-03-28T12:42:07.885520+0000","last_active":"2024-03-28T13:50:04.417907+0000","last_peered":"2024-03-28T13:50:04.417907+0000","last_clean":"2024-03-28T13:50:04.417907+0000","last_became_active":"2024-03-28T12:42:07.880300+0000","last_became_peered":"2024-03-28T12:42:07.880300+0000","last_unstale":"2024-03-28T13:50:04.417907+0000","last_undegraded":"2024-03-28T13:50:04.417907+0000","last_fullsized":"2024-03-28T13:50:04.417907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:17:47.670820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":105873,"num_write":776,"num_write_kb":138943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'201","reported_seq":257,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.533440+0000","last_change":"2024-03-28T12:42:01.962888+0000","last_active":"2024-03-28T13:50:23.533440+0000","last_peered":"2024-03-28T13:50:23.533440+0000","last_clean":"2024-03-28T13:50:23.533440+0000","last_became_active":"2024-03-28T12:42:01.962604+0000","last_became_peered":"2024-03-28T12:42:01.962604+0000","last_unstale":"2024-03-28T13:50:23.533440+0000","last_undegraded":"2024-03-28T13:50:23.533440+0000","last_fullsized":"2024-03-28T13:50:23.533440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'793","reported_seq":852,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:29.288062+0000","last_change":"2024-03-28T12:42:00.085372+0000","last_active":"2024-03-28T13:49:29.288062+0000","last_peered":"2024-03-28T13:49:29.288062+0000","last_clean":"2024-03-28T13:49:29.288062+0000","last_became_active":"2024-03-28T12:42:00.084866+0000","last_became_peered":"2024-03-28T12:42:00.084866+0000","last_unstale":"2024-03-28T13:49:29.288062+0000","last_undegraded":"2024-03-28T13:49:29.288062+0000","last_fullsized":"2024-03-28T13:49:29.288062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'769","reported_seq":848,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.320127+0000","last_change":"2024-03-28T12:42:07.899218+0000","last_active":"2024-03-28T13:50:18.320127+0000","last_peered":"2024-03-28T13:50:18.320127+0000","last_clean":"2024-03-28T13:50:18.320127+0000","last_became_active":"2024-03-28T12:42:07.898853+0000","last_became_peered":"2024-03-28T12:42:07.898853+0000","last_unstale":"2024-03-28T13:50:18.320127+0000","last_undegraded":"2024-03-28T13:50:18.320127+0000","last_fullsized":"2024-03-28T13:50:18.320127+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":96622,"num_write":756,"num_write_kb":72915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'187","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:33.814913+0000","last_change":"2024-03-28T13:50:33.814955+0000","last_active":"2024-03-28T13:50:33.814913+0000","last_peered":"2024-03-28T13:50:33.814913+0000","last_clean":"2024-03-28T13:50:33.814913+0000","last_became_active":"2024-03-28T12:42:01.964442+0000","last_became_peered":"2024-03-28T12:42:01.964442+0000","last_unstale":"2024-03-28T13:50:33.814913+0000","last_undegraded":"2024-03-28T13:50:33.814913+0000","last_fullsized":"2024-03-28T13:50:33.814913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'187","last_scrub_stamp":"2024-03-28T13:50:33.814786+0000","last_deep_scrub":"29'187","last_deep_scrub_stamp":"2024-03-28T13:50:33.814786+0000","last_clean_scrub_stamp":"2024-03-28T13:50:33.814786+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:17:12.873229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'907","reported_seq":965,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.983751+0000","last_change":"2024-03-28T12:42:00.153658+0000","last_active":"2024-03-28T13:50:14.983751+0000","last_peered":"2024-03-28T13:50:14.983751+0000","last_clean":"2024-03-28T13:50:14.983751+0000","last_became_active":"2024-03-28T12:42:00.153292+0000","last_became_peered":"2024-03-28T12:42:00.153292+0000","last_unstale":"2024-03-28T13:50:14.983751+0000","last_undegraded":"2024-03-28T13:50:14.983751+0000","last_fullsized":"2024-03-28T13:50:14.983751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":907,"log_dups_size":0,"ondisk_log_size":907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1005,"num_write_kb":4546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'806","reported_seq":887,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.939404+0000","last_change":"2024-03-28T12:42:07.900126+0000","last_active":"2024-03-28T13:50:14.939404+0000","last_peered":"2024-03-28T13:50:14.939404+0000","last_clean":"2024-03-28T13:50:14.939404+0000","last_became_active":"2024-03-28T12:42:07.899780+0000","last_became_peered":"2024-03-28T12:42:07.899780+0000","last_unstale":"2024-03-28T13:50:14.939404+0000","last_undegraded":"2024-03-28T13:50:14.939404+0000","last_fullsized":"2024-03-28T13:50:14.939404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":86897,"num_write":794,"num_write_kb":118337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'234","reported_seq":290,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.446536+0000","last_change":"2024-03-28T12:42:01.962221+0000","last_active":"2024-03-28T13:50:23.446536+0000","last_peered":"2024-03-28T13:50:23.446536+0000","last_clean":"2024-03-28T13:50:23.446536+0000","last_became_active":"2024-03-28T12:42:01.961938+0000","last_became_peered":"2024-03-28T12:42:01.961938+0000","last_unstale":"2024-03-28T13:50:23.446536+0000","last_undegraded":"2024-03-28T13:50:23.446536+0000","last_fullsized":"2024-03-28T13:50:23.446536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'477","reported_seq":535,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.626422+0000","last_change":"2024-03-28T12:42:00.132287+0000","last_active":"2024-03-28T13:50:23.626422+0000","last_peered":"2024-03-28T13:50:23.626422+0000","last_clean":"2024-03-28T13:50:23.626422+0000","last_became_active":"2024-03-28T12:42:00.131064+0000","last_became_peered":"2024-03-28T12:42:00.131064+0000","last_unstale":"2024-03-28T13:50:23.626422+0000","last_undegraded":"2024-03-28T13:50:23.626422+0000","last_fullsized":"2024-03-28T13:50:23.626422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":8385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'776","reported_seq":858,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:08.958070+0000","last_change":"2024-03-28T12:42:07.887453+0000","last_active":"2024-03-28T13:50:08.958070+0000","last_peered":"2024-03-28T13:50:08.958070+0000","last_clean":"2024-03-28T13:50:08.958070+0000","last_became_active":"2024-03-28T12:42:07.886685+0000","last_became_peered":"2024-03-28T12:42:07.886685+0000","last_unstale":"2024-03-28T13:50:08.958070+0000","last_undegraded":"2024-03-28T13:50:08.958070+0000","last_fullsized":"2024-03-28T13:50:08.958070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:10:05.778321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":115085,"num_write":757,"num_write_kb":114512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'216","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:32.710688+0000","last_change":"2024-03-28T13:50:32.710726+0000","last_active":"2024-03-28T13:50:32.710688+0000","last_peered":"2024-03-28T13:50:32.710688+0000","last_clean":"2024-03-28T13:50:32.710688+0000","last_became_active":"2024-03-28T12:42:01.960102+0000","last_became_peered":"2024-03-28T12:42:01.960102+0000","last_unstale":"2024-03-28T13:50:32.710688+0000","last_undegraded":"2024-03-28T13:50:32.710688+0000","last_fullsized":"2024-03-28T13:50:32.710688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'216","last_scrub_stamp":"2024-03-28T13:50:32.710580+0000","last_deep_scrub":"29'216","last_deep_scrub_stamp":"2024-03-28T13:50:32.710580+0000","last_clean_scrub_stamp":"2024-03-28T13:50:32.710580+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:43:35.159119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'67","reported_seq":132,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:31.598221+0000","last_change":"2024-03-28T13:50:31.598267+0000","last_active":"2024-03-28T13:50:31.598221+0000","last_peered":"2024-03-28T13:50:31.598221+0000","last_clean":"2024-03-28T13:50:31.598221+0000","last_became_active":"2024-03-28T12:42:00.144572+0000","last_became_peered":"2024-03-28T12:42:00.144572+0000","last_unstale":"2024-03-28T13:50:31.598221+0000","last_undegraded":"2024-03-28T13:50:31.598221+0000","last_fullsized":"2024-03-28T13:50:31.598221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'67","last_scrub_stamp":"2024-03-28T13:50:31.598128+0000","last_deep_scrub":"29'67","last_deep_scrub_stamp":"2024-03-28T13:50:31.598128+0000","last_clean_scrub_stamp":"2024-03-28T13:50:31.598128+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:26:32.514801+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'777","reported_seq":838,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:03.732192+0000","last_change":"2024-03-28T12:42:07.885727+0000","last_active":"2024-03-28T13:50:03.732192+0000","last_peered":"2024-03-28T13:50:03.732192+0000","last_clean":"2024-03-28T13:50:03.732192+0000","last_became_active":"2024-03-28T12:42:07.884760+0000","last_became_peered":"2024-03-28T12:42:07.884760+0000","last_unstale":"2024-03-28T13:50:03.732192+0000","last_undegraded":"2024-03-28T13:50:03.732192+0000","last_fullsized":"2024-03-28T13:50:03.732192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:44:45.171876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":41596,"num_write":756,"num_write_kb":91419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'203","reported_seq":259,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.451542+0000","last_change":"2024-03-28T12:42:01.936371+0000","last_active":"2024-03-28T13:50:23.451542+0000","last_peered":"2024-03-28T13:50:23.451542+0000","last_clean":"2024-03-28T13:50:23.451542+0000","last_became_active":"2024-03-28T12:42:01.936080+0000","last_became_peered":"2024-03-28T12:42:01.936080+0000","last_unstale":"2024-03-28T13:50:23.451542+0000","last_undegraded":"2024-03-28T13:50:23.451542+0000","last_fullsized":"2024-03-28T13:50:23.451542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'56","reported_seq":114,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.352587+0000","last_change":"2024-03-28T12:42:00.139149+0000","last_active":"2024-03-28T13:50:18.352587+0000","last_peered":"2024-03-28T13:50:18.352587+0000","last_clean":"2024-03-28T13:50:18.352587+0000","last_became_active":"2024-03-28T12:42:00.138555+0000","last_became_peered":"2024-03-28T12:42:00.138555+0000","last_unstale":"2024-03-28T13:50:18.352587+0000","last_undegraded":"2024-03-28T13:50:18.352587+0000","last_fullsized":"2024-03-28T13:50:18.352587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'757","reported_seq":858,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:09.340082+0000","last_change":"2024-03-28T12:42:07.940362+0000","last_active":"2024-03-28T13:50:09.340082+0000","last_peered":"2024-03-28T13:50:09.340082+0000","last_clean":"2024-03-28T13:50:09.340082+0000","last_became_active":"2024-03-28T12:42:07.939396+0000","last_became_peered":"2024-03-28T12:42:07.939396+0000","last_unstale":"2024-03-28T13:50:09.340082+0000","last_undegraded":"2024-03-28T13:50:09.340082+0000","last_fullsized":"2024-03-28T13:50:09.340082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:34:59.598434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":181074,"num_write":742,"num_write_kb":169009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'212","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.410111+0000","last_change":"2024-03-28T12:42:01.800361+0000","last_active":"2024-03-28T13:50:23.410111+0000","last_peered":"2024-03-28T13:50:23.410111+0000","last_clean":"2024-03-28T13:50:23.410111+0000","last_became_active":"2024-03-28T12:42:01.799594+0000","last_became_peered":"2024-03-28T12:42:01.799594+0000","last_unstale":"2024-03-28T13:50:23.410111+0000","last_undegraded":"2024-03-28T13:50:23.410111+0000","last_fullsized":"2024-03-28T13:50:23.410111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:10:35.775033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'343","reported_seq":398,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:23.356856+0000","last_change":"2024-03-28T12:42:00.143501+0000","last_active":"2024-03-28T13:49:23.356856+0000","last_peered":"2024-03-28T13:49:23.356856+0000","last_clean":"2024-03-28T13:49:23.356856+0000","last_became_active":"2024-03-28T12:42:00.142913+0000","last_became_peered":"2024-03-28T12:42:00.142913+0000","last_unstale":"2024-03-28T13:49:23.356856+0000","last_undegraded":"2024-03-28T13:49:23.356856+0000","last_fullsized":"2024-03-28T13:49:23.356856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:23:33.697490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":8326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'745","reported_seq":820,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.948694+0000","last_change":"2024-03-28T12:42:07.938687+0000","last_active":"2024-03-28T13:50:14.948694+0000","last_peered":"2024-03-28T13:50:14.948694+0000","last_clean":"2024-03-28T13:50:14.948694+0000","last_became_active":"2024-03-28T12:42:07.938081+0000","last_became_peered":"2024-03-28T12:42:07.938081+0000","last_unstale":"2024-03-28T13:50:14.948694+0000","last_undegraded":"2024-03-28T13:50:14.948694+0000","last_fullsized":"2024-03-28T13:50:14.948694+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":86453,"num_write":732,"num_write_kb":138137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'202","reported_seq":256,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.533717+0000","last_change":"2024-03-28T12:42:01.938516+0000","last_active":"2024-03-28T13:50:23.533717+0000","last_peered":"2024-03-28T13:50:23.533717+0000","last_clean":"2024-03-28T13:50:23.533717+0000","last_became_active":"2024-03-28T12:42:01.938251+0000","last_became_peered":"2024-03-28T12:42:01.938251+0000","last_unstale":"2024-03-28T13:50:23.533717+0000","last_undegraded":"2024-03-28T13:50:23.533717+0000","last_fullsized":"2024-03-28T13:50:23.533717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'891","reported_seq":956,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:31.831440+0000","last_change":"2024-03-28T13:50:31.831475+0000","last_active":"2024-03-28T13:50:31.831440+0000","last_peered":"2024-03-28T13:50:31.831440+0000","last_clean":"2024-03-28T13:50:31.831440+0000","last_became_active":"2024-03-28T12:42:00.140832+0000","last_became_peered":"2024-03-28T12:42:00.140832+0000","last_unstale":"2024-03-28T13:50:31.831440+0000","last_undegraded":"2024-03-28T13:50:31.831440+0000","last_fullsized":"2024-03-28T13:50:31.831440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'891","last_scrub_stamp":"2024-03-28T13:50:31.831379+0000","last_deep_scrub":"29'891","last_deep_scrub_stamp":"2024-03-28T13:50:31.831379+0000","last_clean_scrub_stamp":"2024-03-28T13:50:31.831379+0000","objects_scrubbed":8,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:36:22.487878+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":844,"num_write_kb":12856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'810","reported_seq":901,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:15.151866+0000","last_change":"2024-03-28T12:42:07.936963+0000","last_active":"2024-03-28T13:50:15.151866+0000","last_peered":"2024-03-28T13:50:15.151866+0000","last_clean":"2024-03-28T13:50:15.151866+0000","last_became_active":"2024-03-28T12:42:07.936606+0000","last_became_peered":"2024-03-28T12:42:07.936606+0000","last_unstale":"2024-03-28T13:50:15.151866+0000","last_undegraded":"2024-03-28T13:50:15.151866+0000","last_fullsized":"2024-03-28T13:50:15.151866+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":136867,"num_write":788,"num_write_kb":148031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'206","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.448368+0000","last_change":"2024-03-28T12:42:01.962855+0000","last_active":"2024-03-28T13:50:23.448368+0000","last_peered":"2024-03-28T13:50:23.448368+0000","last_clean":"2024-03-28T13:50:23.448368+0000","last_became_active":"2024-03-28T12:42:01.962546+0000","last_became_peered":"2024-03-28T12:42:01.962546+0000","last_unstale":"2024-03-28T13:50:23.448368+0000","last_undegraded":"2024-03-28T13:50:23.448368+0000","last_fullsized":"2024-03-28T13:50:23.448368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'1091","reported_seq":1145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.357556+0000","last_change":"2024-03-28T12:42:00.138923+0000","last_active":"2024-03-28T13:50:18.357556+0000","last_peered":"2024-03-28T13:50:18.357556+0000","last_clean":"2024-03-28T13:50:18.357556+0000","last_became_active":"2024-03-28T12:42:00.138233+0000","last_became_peered":"2024-03-28T12:42:00.138233+0000","last_unstale":"2024-03-28T13:50:18.357556+0000","last_undegraded":"2024-03-28T13:50:18.357556+0000","last_fullsized":"2024-03-28T13:50:18.357556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1091,"log_dups_size":0,"ondisk_log_size":1091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:55:26.271084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":5033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'724","reported_seq":797,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.676532+0000","last_change":"2024-03-28T12:42:07.907163+0000","last_active":"2024-03-28T13:50:14.676532+0000","last_peered":"2024-03-28T13:50:14.676532+0000","last_clean":"2024-03-28T13:50:14.676532+0000","last_became_active":"2024-03-28T12:42:07.906334+0000","last_became_peered":"2024-03-28T12:42:07.906334+0000","last_unstale":"2024-03-28T13:50:14.676532+0000","last_undegraded":"2024-03-28T13:50:14.676532+0000","last_fullsized":"2024-03-28T13:50:14.676532+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":82415,"num_write":704,"num_write_kb":118989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'201","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.433103+0000","last_change":"2024-03-28T12:42:01.809232+0000","last_active":"2024-03-28T13:50:23.433103+0000","last_peered":"2024-03-28T13:50:23.433103+0000","last_clean":"2024-03-28T13:50:23.433103+0000","last_became_active":"2024-03-28T12:42:01.805284+0000","last_became_peered":"2024-03-28T12:42:01.805284+0000","last_unstale":"2024-03-28T13:50:23.433103+0000","last_undegraded":"2024-03-28T13:50:23.433103+0000","last_fullsized":"2024-03-28T13:50:23.433103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:20:54.180080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'404","reported_seq":468,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:33.602958+0000","last_change":"2024-03-28T13:50:33.603011+0000","last_active":"2024-03-28T13:50:33.602958+0000","last_peered":"2024-03-28T13:50:33.602958+0000","last_clean":"2024-03-28T13:50:33.602958+0000","last_became_active":"2024-03-28T12:42:00.147407+0000","last_became_peered":"2024-03-28T12:42:00.147407+0000","last_unstale":"2024-03-28T13:50:33.602958+0000","last_undegraded":"2024-03-28T13:50:33.602958+0000","last_fullsized":"2024-03-28T13:50:33.602958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'404","last_scrub_stamp":"2024-03-28T13:50:33.602852+0000","last_deep_scrub":"29'404","last_deep_scrub_stamp":"2024-03-28T13:50:33.602852+0000","last_clean_scrub_stamp":"2024-03-28T13:50:33.602852+0000","objects_scrubbed":3,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:18:00.280941+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'847","reported_seq":927,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.548369+0000","last_change":"2024-03-28T12:42:07.900662+0000","last_active":"2024-03-28T13:50:14.548369+0000","last_peered":"2024-03-28T13:50:14.548369+0000","last_clean":"2024-03-28T13:50:14.548369+0000","last_became_active":"2024-03-28T12:42:07.899628+0000","last_became_peered":"2024-03-28T12:42:07.899628+0000","last_unstale":"2024-03-28T13:50:14.548369+0000","last_undegraded":"2024-03-28T13:50:14.548369+0000","last_fullsized":"2024-03-28T13:50:14.548369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:31.070732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":75354,"num_write":826,"num_write_kb":110616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'214","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.588682+0000","last_change":"2024-03-28T12:42:01.967776+0000","last_active":"2024-03-28T13:50:23.588682+0000","last_peered":"2024-03-28T13:50:23.588682+0000","last_clean":"2024-03-28T13:50:23.588682+0000","last_became_active":"2024-03-28T12:42:01.964830+0000","last_became_peered":"2024-03-28T12:42:01.964830+0000","last_unstale":"2024-03-28T13:50:23.588682+0000","last_undegraded":"2024-03-28T13:50:23.588682+0000","last_fullsized":"2024-03-28T13:50:23.588682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'65","reported_seq":128,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:31.736787+0000","last_change":"2024-03-28T13:50:31.736833+0000","last_active":"2024-03-28T13:50:31.736787+0000","last_peered":"2024-03-28T13:50:31.736787+0000","last_clean":"2024-03-28T13:50:31.736787+0000","last_became_active":"2024-03-28T12:42:00.141602+0000","last_became_peered":"2024-03-28T12:42:00.141602+0000","last_unstale":"2024-03-28T13:50:31.736787+0000","last_undegraded":"2024-03-28T13:50:31.736787+0000","last_fullsized":"2024-03-28T13:50:31.736787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'65","last_scrub_stamp":"2024-03-28T13:50:31.736685+0000","last_deep_scrub":"29'65","last_deep_scrub_stamp":"2024-03-28T13:50:31.736685+0000","last_clean_scrub_stamp":"2024-03-28T13:50:31.736685+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:26:31.273470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'910","reported_seq":1033,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.967758+0000","last_change":"2024-03-28T12:42:07.935882+0000","last_active":"2024-03-28T13:50:14.967758+0000","last_peered":"2024-03-28T13:50:14.967758+0000","last_clean":"2024-03-28T13:50:14.967758+0000","last_became_active":"2024-03-28T12:42:07.935525+0000","last_became_peered":"2024-03-28T12:42:07.935525+0000","last_unstale":"2024-03-28T13:50:14.967758+0000","last_undegraded":"2024-03-28T13:50:14.967758+0000","last_fullsized":"2024-03-28T13:50:14.967758+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":257511,"num_write":888,"num_write_kb":259792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'811","reported_seq":913,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:29.296076+0000","last_change":"2024-03-28T12:42:07.882782+0000","last_active":"2024-03-28T13:50:29.296076+0000","last_peered":"2024-03-28T13:50:29.296076+0000","last_clean":"2024-03-28T13:50:29.296076+0000","last_became_active":"2024-03-28T12:42:07.881527+0000","last_became_peered":"2024-03-28T12:42:07.881527+0000","last_unstale":"2024-03-28T13:50:29.296076+0000","last_undegraded":"2024-03-28T13:50:29.296076+0000","last_fullsized":"2024-03-28T13:50:29.296076+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":165977,"num_write":788,"num_write_kb":136221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'216","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.627914+0000","last_change":"2024-03-28T12:42:01.958791+0000","last_active":"2024-03-28T13:50:23.627914+0000","last_peered":"2024-03-28T13:50:23.627914+0000","last_clean":"2024-03-28T13:50:23.627914+0000","last_became_active":"2024-03-28T12:42:01.957991+0000","last_became_peered":"2024-03-28T12:42:01.957991+0000","last_unstale":"2024-03-28T13:50:23.627914+0000","last_undegraded":"2024-03-28T13:50:23.627914+0000","last_fullsized":"2024-03-28T13:50:23.627914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'1719","reported_seq":1776,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.344054+0000","last_change":"2024-03-28T12:42:00.132942+0000","last_active":"2024-03-28T13:50:18.344054+0000","last_peered":"2024-03-28T13:50:18.344054+0000","last_clean":"2024-03-28T13:50:18.344054+0000","last_became_active":"2024-03-28T12:42:00.132663+0000","last_became_peered":"2024-03-28T12:42:00.132663+0000","last_unstale":"2024-03-28T13:50:18.344054+0000","last_undegraded":"2024-03-28T13:50:18.344054+0000","last_fullsized":"2024-03-28T13:50:18.344054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":1719,"log_dups_size":0,"ondisk_log_size":1719,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1652,"num_write_kb":13078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'750","reported_seq":828,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:04.457246+0000","last_change":"2024-03-28T12:42:07.901907+0000","last_active":"2024-03-28T13:50:04.457246+0000","last_peered":"2024-03-28T13:50:04.457246+0000","last_clean":"2024-03-28T13:50:04.457246+0000","last_became_active":"2024-03-28T12:42:07.901398+0000","last_became_peered":"2024-03-28T12:42:07.901398+0000","last_unstale":"2024-03-28T13:50:04.457246+0000","last_undegraded":"2024-03-28T13:50:04.457246+0000","last_fullsized":"2024-03-28T13:50:04.457246+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":90732,"num_write":732,"num_write_kb":110234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'226","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.439514+0000","last_change":"2024-03-28T12:42:01.811306+0000","last_active":"2024-03-28T13:50:23.439514+0000","last_peered":"2024-03-28T13:50:23.439514+0000","last_clean":"2024-03-28T13:50:23.439514+0000","last_became_active":"2024-03-28T12:42:01.810142+0000","last_became_peered":"2024-03-28T12:42:01.810142+0000","last_unstale":"2024-03-28T13:50:23.439514+0000","last_undegraded":"2024-03-28T13:50:23.439514+0000","last_fullsized":"2024-03-28T13:50:23.439514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:37:22.386341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'118","reported_seq":173,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:59.338833+0000","last_change":"2024-03-28T12:42:00.142916+0000","last_active":"2024-03-28T13:49:59.338833+0000","last_peered":"2024-03-28T13:49:59.338833+0000","last_clean":"2024-03-28T13:49:59.338833+0000","last_became_active":"2024-03-28T12:42:00.142006+0000","last_became_peered":"2024-03-28T12:42:00.142006+0000","last_unstale":"2024-03-28T13:49:59.338833+0000","last_undegraded":"2024-03-28T13:49:59.338833+0000","last_fullsized":"2024-03-28T13:49:59.338833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:01:08.734929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'739","reported_seq":795,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:32.911451+0000","last_change":"2024-03-28T12:42:00.143738+0000","last_active":"2024-03-28T13:49:32.911451+0000","last_peered":"2024-03-28T13:49:32.911451+0000","last_clean":"2024-03-28T13:49:32.911451+0000","last_became_active":"2024-03-28T12:42:00.143474+0000","last_became_peered":"2024-03-28T12:42:00.143474+0000","last_unstale":"2024-03-28T13:49:32.911451+0000","last_undegraded":"2024-03-28T13:49:32.911451+0000","last_fullsized":"2024-03-28T13:49:32.911451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":12641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'186","reported_seq":240,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.628125+0000","last_change":"2024-03-28T12:42:01.938147+0000","last_active":"2024-03-28T13:50:23.628125+0000","last_peered":"2024-03-28T13:50:23.628125+0000","last_clean":"2024-03-28T13:50:23.628125+0000","last_became_active":"2024-03-28T12:42:01.937612+0000","last_became_peered":"2024-03-28T12:42:01.937612+0000","last_unstale":"2024-03-28T13:50:23.628125+0000","last_undegraded":"2024-03-28T13:50:23.628125+0000","last_fullsized":"2024-03-28T13:50:23.628125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'736","reported_seq":809,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:18.316614+0000","last_change":"2024-03-28T12:42:07.870201+0000","last_active":"2024-03-28T13:50:18.316614+0000","last_peered":"2024-03-28T13:50:18.316614+0000","last_clean":"2024-03-28T13:50:18.316614+0000","last_became_active":"2024-03-28T12:42:07.869628+0000","last_became_peered":"2024-03-28T12:42:07.869628+0000","last_unstale":"2024-03-28T13:50:18.316614+0000","last_undegraded":"2024-03-28T13:50:18.316614+0000","last_fullsized":"2024-03-28T13:50:18.316614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":78605,"num_write":708,"num_write_kb":126589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'199","reported_seq":254,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:49:31.906997+0000","last_change":"2024-03-28T12:42:00.146260+0000","last_active":"2024-03-28T13:49:31.906997+0000","last_peered":"2024-03-28T13:49:31.906997+0000","last_clean":"2024-03-28T13:49:31.906997+0000","last_became_active":"2024-03-28T12:42:00.146052+0000","last_became_peered":"2024-03-28T12:42:00.146052+0000","last_unstale":"2024-03-28T13:49:31.906997+0000","last_undegraded":"2024-03-28T13:49:31.906997+0000","last_fullsized":"2024-03-28T13:49:31.906997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:58.890317+0000","last_clean_scrub_stamp":"2024-03-28T12:41:58.890317+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:03:08.118205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195321,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'206","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.515054+0000","last_change":"2024-03-28T12:42:01.966002+0000","last_active":"2024-03-28T13:50:23.515054+0000","last_peered":"2024-03-28T13:50:23.515054+0000","last_clean":"2024-03-28T13:50:23.515054+0000","last_became_active":"2024-03-28T12:42:01.965598+0000","last_became_peered":"2024-03-28T12:42:01.965598+0000","last_unstale":"2024-03-28T13:50:23.515054+0000","last_undegraded":"2024-03-28T13:50:23.515054+0000","last_fullsized":"2024-03-28T13:50:23.515054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'725","reported_seq":797,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:14.394815+0000","last_change":"2024-03-28T12:42:15.361649+0000","last_active":"2024-03-28T13:50:14.394815+0000","last_peered":"2024-03-28T13:50:14.394815+0000","last_clean":"2024-03-28T13:50:14.394815+0000","last_became_active":"2024-03-28T12:42:15.360743+0000","last_became_peered":"2024-03-28T12:42:15.360743+0000","last_unstale":"2024-03-28T13:50:14.394815+0000","last_undegraded":"2024-03-28T13:50:14.394815+0000","last_fullsized":"2024-03-28T13:50:14.394815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:42:06.304443+0000","last_clean_scrub_stamp":"2024-03-28T12:42:06.304443+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":88364,"num_write":704,"num_write_kb":127819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"29'220","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.582031+0000","last_change":"2024-03-28T12:42:01.965237+0000","last_active":"2024-03-28T13:50:23.582031+0000","last_peered":"2024-03-28T13:50:23.582031+0000","last_clean":"2024-03-28T13:50:23.582031+0000","last_became_active":"2024-03-28T12:42:01.964468+0000","last_became_peered":"2024-03-28T12:42:01.964468+0000","last_unstale":"2024-03-28T13:50:23.582031+0000","last_undegraded":"2024-03-28T13:50:23.582031+0000","last_fullsized":"2024-03-28T13:50:23.582031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'218","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.439522+0000","last_change":"2024-03-28T12:42:01.959553+0000","last_active":"2024-03-28T13:50:23.439522+0000","last_peered":"2024-03-28T13:50:23.439522+0000","last_clean":"2024-03-28T13:50:23.439522+0000","last_became_active":"2024-03-28T12:42:01.958333+0000","last_became_peered":"2024-03-28T12:42:01.958333+0000","last_unstale":"2024-03-28T13:50:23.439522+0000","last_undegraded":"2024-03-28T13:50:23.439522+0000","last_fullsized":"2024-03-28T13:50:23.439522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T13:02:05.744451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'235","reported_seq":294,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.446850+0000","last_change":"2024-03-28T12:42:01.805452+0000","last_active":"2024-03-28T13:50:23.446850+0000","last_peered":"2024-03-28T13:50:23.446850+0000","last_clean":"2024-03-28T13:50:23.446850+0000","last_became_active":"2024-03-28T12:42:01.805288+0000","last_became_peered":"2024-03-28T12:42:01.805288+0000","last_unstale":"2024-03-28T13:50:23.446850+0000","last_undegraded":"2024-03-28T13:50:23.446850+0000","last_fullsized":"2024-03-28T13:50:23.446850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'204","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.433898+0000","last_change":"2024-03-28T12:42:01.947234+0000","last_active":"2024-03-28T13:50:23.433898+0000","last_peered":"2024-03-28T13:50:23.433898+0000","last_clean":"2024-03-28T13:50:23.433898+0000","last_became_active":"2024-03-28T12:42:01.946859+0000","last_became_peered":"2024-03-28T12:42:01.946859+0000","last_unstale":"2024-03-28T13:50:23.433898+0000","last_undegraded":"2024-03-28T13:50:23.433898+0000","last_fullsized":"2024-03-28T13:50:23.433898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:36:05.320541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'187","reported_seq":243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.415200+0000","last_change":"2024-03-28T12:42:01.935265+0000","last_active":"2024-03-28T13:50:23.415200+0000","last_peered":"2024-03-28T13:50:23.415200+0000","last_clean":"2024-03-28T13:50:23.415200+0000","last_became_active":"2024-03-28T12:42:01.934578+0000","last_became_peered":"2024-03-28T12:42:01.934578+0000","last_unstale":"2024-03-28T13:50:23.415200+0000","last_undegraded":"2024-03-28T13:50:23.415200+0000","last_fullsized":"2024-03-28T13:50:23.415200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:56:24.696539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'208","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.405779+0000","last_change":"2024-03-28T12:42:01.946191+0000","last_active":"2024-03-28T13:50:23.405779+0000","last_peered":"2024-03-28T13:50:23.405779+0000","last_clean":"2024-03-28T13:50:23.405779+0000","last_became_active":"2024-03-28T12:42:01.945804+0000","last_became_peered":"2024-03-28T12:42:01.945804+0000","last_unstale":"2024-03-28T13:50:23.405779+0000","last_undegraded":"2024-03-28T13:50:23.405779+0000","last_fullsized":"2024-03-28T13:50:23.405779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:40.221005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'244","reported_seq":301,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.587746+0000","last_change":"2024-03-28T12:42:01.969416+0000","last_active":"2024-03-28T13:50:23.587746+0000","last_peered":"2024-03-28T13:50:23.587746+0000","last_clean":"2024-03-28T13:50:23.587746+0000","last_became_active":"2024-03-28T12:42:01.969078+0000","last_became_peered":"2024-03-28T12:42:01.969078+0000","last_unstale":"2024-03-28T13:50:23.587746+0000","last_undegraded":"2024-03-28T13:50:23.587746+0000","last_fullsized":"2024-03-28T13:50:23.587746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'195","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.422701+0000","last_change":"2024-03-28T12:42:01.958402+0000","last_active":"2024-03-28T13:50:23.422701+0000","last_peered":"2024-03-28T13:50:23.422701+0000","last_clean":"2024-03-28T13:50:23.422701+0000","last_became_active":"2024-03-28T12:42:01.958074+0000","last_became_peered":"2024-03-28T12:42:01.958074+0000","last_unstale":"2024-03-28T13:50:23.422701+0000","last_undegraded":"2024-03-28T13:50:23.422701+0000","last_fullsized":"2024-03-28T13:50:23.422701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:18:04.255456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'219","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.444751+0000","last_change":"2024-03-28T12:42:01.811823+0000","last_active":"2024-03-28T13:50:23.444751+0000","last_peered":"2024-03-28T13:50:23.444751+0000","last_clean":"2024-03-28T13:50:23.444751+0000","last_became_active":"2024-03-28T12:42:01.811548+0000","last_became_peered":"2024-03-28T12:42:01.811548+0000","last_unstale":"2024-03-28T13:50:23.444751+0000","last_undegraded":"2024-03-28T13:50:23.444751+0000","last_fullsized":"2024-03-28T13:50:23.444751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'207","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.434358+0000","last_change":"2024-03-28T12:42:01.959291+0000","last_active":"2024-03-28T13:50:23.434358+0000","last_peered":"2024-03-28T13:50:23.434358+0000","last_clean":"2024-03-28T13:50:23.434358+0000","last_became_active":"2024-03-28T12:42:01.958942+0000","last_became_peered":"2024-03-28T12:42:01.958942+0000","last_unstale":"2024-03-28T13:50:23.434358+0000","last_undegraded":"2024-03-28T13:50:23.434358+0000","last_fullsized":"2024-03-28T13:50:23.434358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:52:46.128830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'214","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.513149+0000","last_change":"2024-03-28T12:42:01.965790+0000","last_active":"2024-03-28T13:50:23.513149+0000","last_peered":"2024-03-28T13:50:23.513149+0000","last_clean":"2024-03-28T13:50:23.513149+0000","last_became_active":"2024-03-28T12:42:01.965526+0000","last_became_peered":"2024-03-28T12:42:01.965526+0000","last_unstale":"2024-03-28T13:50:23.513149+0000","last_undegraded":"2024-03-28T13:50:23.513149+0000","last_fullsized":"2024-03-28T13:50:23.513149+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'216","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.625672+0000","last_change":"2024-03-28T12:42:01.960761+0000","last_active":"2024-03-28T13:50:23.625672+0000","last_peered":"2024-03-28T13:50:23.625672+0000","last_clean":"2024-03-28T13:50:23.625672+0000","last_became_active":"2024-03-28T12:42:01.960325+0000","last_became_peered":"2024-03-28T12:42:01.960325+0000","last_unstale":"2024-03-28T13:50:23.625672+0000","last_undegraded":"2024-03-28T13:50:23.625672+0000","last_fullsized":"2024-03-28T13:50:23.625672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'221","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.536266+0000","last_change":"2024-03-28T12:42:01.960053+0000","last_active":"2024-03-28T13:50:23.536266+0000","last_peered":"2024-03-28T13:50:23.536266+0000","last_clean":"2024-03-28T13:50:23.536266+0000","last_became_active":"2024-03-28T12:42:01.959801+0000","last_became_peered":"2024-03-28T12:42:01.959801+0000","last_unstale":"2024-03-28T13:50:23.536266+0000","last_undegraded":"2024-03-28T13:50:23.536266+0000","last_fullsized":"2024-03-28T13:50:23.536266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'203","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.450611+0000","last_change":"2024-03-28T12:42:01.788603+0000","last_active":"2024-03-28T13:50:23.450611+0000","last_peered":"2024-03-28T13:50:23.450611+0000","last_clean":"2024-03-28T13:50:23.450611+0000","last_became_active":"2024-03-28T12:42:01.788431+0000","last_became_peered":"2024-03-28T12:42:01.788431+0000","last_unstale":"2024-03-28T13:50:23.450611+0000","last_undegraded":"2024-03-28T13:50:23.450611+0000","last_fullsized":"2024-03-28T13:50:23.450611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'205","reported_seq":258,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.439936+0000","last_change":"2024-03-28T12:42:01.960518+0000","last_active":"2024-03-28T13:50:23.439936+0000","last_peered":"2024-03-28T13:50:23.439936+0000","last_clean":"2024-03-28T13:50:23.439936+0000","last_became_active":"2024-03-28T12:42:01.959832+0000","last_became_peered":"2024-03-28T12:42:01.959832+0000","last_unstale":"2024-03-28T13:50:23.439936+0000","last_undegraded":"2024-03-28T13:50:23.439936+0000","last_fullsized":"2024-03-28T13:50:23.439936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:37:55.564839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'206","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.451435+0000","last_change":"2024-03-28T12:42:01.936477+0000","last_active":"2024-03-28T13:50:23.451435+0000","last_peered":"2024-03-28T13:50:23.451435+0000","last_clean":"2024-03-28T13:50:23.451435+0000","last_became_active":"2024-03-28T12:42:01.936175+0000","last_became_peered":"2024-03-28T12:42:01.936175+0000","last_unstale":"2024-03-28T13:50:23.451435+0000","last_undegraded":"2024-03-28T13:50:23.451435+0000","last_fullsized":"2024-03-28T13:50:23.451435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'218","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.447573+0000","last_change":"2024-03-28T12:42:01.960054+0000","last_active":"2024-03-28T13:50:23.447573+0000","last_peered":"2024-03-28T13:50:23.447573+0000","last_clean":"2024-03-28T13:50:23.447573+0000","last_became_active":"2024-03-28T12:42:01.959791+0000","last_became_peered":"2024-03-28T12:42:01.959791+0000","last_unstale":"2024-03-28T13:50:23.447573+0000","last_undegraded":"2024-03-28T13:50:23.447573+0000","last_fullsized":"2024-03-28T13:50:23.447573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'218","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.422102+0000","last_change":"2024-03-28T12:42:15.233310+0000","last_active":"2024-03-28T13:50:23.422102+0000","last_peered":"2024-03-28T13:50:23.422102+0000","last_clean":"2024-03-28T13:50:23.422102+0000","last_became_active":"2024-03-28T12:42:15.232678+0000","last_became_peered":"2024-03-28T12:42:15.232678+0000","last_unstale":"2024-03-28T13:50:23.422102+0000","last_undegraded":"2024-03-28T13:50:23.422102+0000","last_fullsized":"2024-03-28T13:50:23.422102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:11:33.781054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'215","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.408861+0000","last_change":"2024-03-28T12:42:01.948602+0000","last_active":"2024-03-28T13:50:23.408861+0000","last_peered":"2024-03-28T13:50:23.408861+0000","last_clean":"2024-03-28T13:50:23.408861+0000","last_became_active":"2024-03-28T12:42:01.947869+0000","last_became_peered":"2024-03-28T12:42:01.947869+0000","last_unstale":"2024-03-28T13:50:23.408861+0000","last_undegraded":"2024-03-28T13:50:23.408861+0000","last_fullsized":"2024-03-28T13:50:23.408861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:13:39.203484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'199","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.413834+0000","last_change":"2024-03-28T12:42:01.940521+0000","last_active":"2024-03-28T13:50:23.413834+0000","last_peered":"2024-03-28T13:50:23.413834+0000","last_clean":"2024-03-28T13:50:23.413834+0000","last_became_active":"2024-03-28T12:42:01.939756+0000","last_became_peered":"2024-03-28T12:42:01.939756+0000","last_unstale":"2024-03-28T13:50:23.413834+0000","last_undegraded":"2024-03-28T13:50:23.413834+0000","last_fullsized":"2024-03-28T13:50:23.413834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:53:37.869232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'184","reported_seq":238,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.536388+0000","last_change":"2024-03-28T12:42:01.960377+0000","last_active":"2024-03-28T13:50:23.536388+0000","last_peered":"2024-03-28T13:50:23.536388+0000","last_clean":"2024-03-28T13:50:23.536388+0000","last_became_active":"2024-03-28T12:42:01.960012+0000","last_became_peered":"2024-03-28T12:42:01.960012+0000","last_unstale":"2024-03-28T13:50:23.536388+0000","last_undegraded":"2024-03-28T13:50:23.536388+0000","last_fullsized":"2024-03-28T13:50:23.536388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'189","reported_seq":243,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.533867+0000","last_change":"2024-03-28T12:42:01.937280+0000","last_active":"2024-03-28T13:50:23.533867+0000","last_peered":"2024-03-28T13:50:23.533867+0000","last_clean":"2024-03-28T13:50:23.533867+0000","last_became_active":"2024-03-28T12:42:01.936999+0000","last_became_peered":"2024-03-28T12:42:01.936999+0000","last_unstale":"2024-03-28T13:50:23.533867+0000","last_undegraded":"2024-03-28T13:50:23.533867+0000","last_fullsized":"2024-03-28T13:50:23.533867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'206","reported_seq":260,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.535527+0000","last_change":"2024-03-28T12:42:01.961991+0000","last_active":"2024-03-28T13:50:23.535527+0000","last_peered":"2024-03-28T13:50:23.535527+0000","last_clean":"2024-03-28T13:50:23.535527+0000","last_became_active":"2024-03-28T12:42:01.961694+0000","last_became_peered":"2024-03-28T12:42:01.961694+0000","last_unstale":"2024-03-28T13:50:23.535527+0000","last_undegraded":"2024-03-28T13:50:23.535527+0000","last_fullsized":"2024-03-28T13:50:23.535527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'210","reported_seq":263,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.510242+0000","last_change":"2024-03-28T12:42:01.966943+0000","last_active":"2024-03-28T13:50:23.510242+0000","last_peered":"2024-03-28T13:50:23.510242+0000","last_clean":"2024-03-28T13:50:23.510242+0000","last_became_active":"2024-03-28T12:42:01.966629+0000","last_became_peered":"2024-03-28T12:42:01.966629+0000","last_unstale":"2024-03-28T13:50:23.510242+0000","last_undegraded":"2024-03-28T13:50:23.510242+0000","last_fullsized":"2024-03-28T13:50:23.510242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'193","reported_seq":246,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.445169+0000","last_change":"2024-03-28T12:42:01.934727+0000","last_active":"2024-03-28T13:50:23.445169+0000","last_peered":"2024-03-28T13:50:23.445169+0000","last_clean":"2024-03-28T13:50:23.445169+0000","last_became_active":"2024-03-28T12:42:01.934130+0000","last_became_peered":"2024-03-28T12:42:01.934130+0000","last_unstale":"2024-03-28T13:50:23.445169+0000","last_undegraded":"2024-03-28T13:50:23.445169+0000","last_fullsized":"2024-03-28T13:50:23.445169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:20:32.024373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'209","reported_seq":262,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.531042+0000","last_change":"2024-03-28T12:42:01.940164+0000","last_active":"2024-03-28T13:50:23.531042+0000","last_peered":"2024-03-28T13:50:23.531042+0000","last_clean":"2024-03-28T13:50:23.531042+0000","last_became_active":"2024-03-28T12:42:01.939962+0000","last_became_peered":"2024-03-28T12:42:01.939962+0000","last_unstale":"2024-03-28T13:50:23.531042+0000","last_undegraded":"2024-03-28T13:50:23.531042+0000","last_fullsized":"2024-03-28T13:50:23.531042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'195","reported_seq":248,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.582206+0000","last_change":"2024-03-28T12:42:01.968043+0000","last_active":"2024-03-28T13:50:23.582206+0000","last_peered":"2024-03-28T13:50:23.582206+0000","last_clean":"2024-03-28T13:50:23.582206+0000","last_became_active":"2024-03-28T12:42:01.964888+0000","last_became_peered":"2024-03-28T12:42:01.964888+0000","last_unstale":"2024-03-28T13:50:23.582206+0000","last_undegraded":"2024-03-28T13:50:23.582206+0000","last_fullsized":"2024-03-28T13:50:23.582206+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'209","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:29.531549+0000","last_change":"2024-03-28T13:50:29.531590+0000","last_active":"2024-03-28T13:50:29.531549+0000","last_peered":"2024-03-28T13:50:29.531549+0000","last_clean":"2024-03-28T13:50:29.531549+0000","last_became_active":"2024-03-28T12:42:01.939448+0000","last_became_peered":"2024-03-28T12:42:01.939448+0000","last_unstale":"2024-03-28T13:50:29.531549+0000","last_undegraded":"2024-03-28T13:50:29.531549+0000","last_fullsized":"2024-03-28T13:50:29.531549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'209","last_scrub_stamp":"2024-03-28T13:50:29.531432+0000","last_deep_scrub":"29'209","last_deep_scrub_stamp":"2024-03-28T13:50:29.531432+0000","last_clean_scrub_stamp":"2024-03-28T13:50:29.531432+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:17:08.589875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'196","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:32.821491+0000","last_change":"2024-03-28T13:50:32.821512+0000","last_active":"2024-03-28T13:50:32.821491+0000","last_peered":"2024-03-28T13:50:32.821491+0000","last_clean":"2024-03-28T13:50:32.821491+0000","last_became_active":"2024-03-28T12:42:01.960511+0000","last_became_peered":"2024-03-28T12:42:01.960511+0000","last_unstale":"2024-03-28T13:50:32.821491+0000","last_undegraded":"2024-03-28T13:50:32.821491+0000","last_fullsized":"2024-03-28T13:50:32.821491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'196","last_scrub_stamp":"2024-03-28T13:50:32.821421+0000","last_deep_scrub":"29'196","last_deep_scrub_stamp":"2024-03-28T13:50:32.821421+0000","last_clean_scrub_stamp":"2024-03-28T13:50:32.821421+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:41:55.924017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'197","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.444623+0000","last_change":"2024-03-28T12:42:01.809029+0000","last_active":"2024-03-28T13:50:23.444623+0000","last_peered":"2024-03-28T13:50:23.444623+0000","last_clean":"2024-03-28T13:50:23.444623+0000","last_became_active":"2024-03-28T12:42:01.805168+0000","last_became_peered":"2024-03-28T12:42:01.805168+0000","last_unstale":"2024-03-28T13:50:23.444623+0000","last_undegraded":"2024-03-28T13:50:23.444623+0000","last_fullsized":"2024-03-28T13:50:23.444623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:00:10.281819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'215","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:23.417946+0000","last_change":"2024-03-28T12:42:01.809169+0000","last_active":"2024-03-28T13:50:23.417946+0000","last_peered":"2024-03-28T13:50:23.417946+0000","last_clean":"2024-03-28T13:50:23.417946+0000","last_became_active":"2024-03-28T12:42:01.805382+0000","last_became_peered":"2024-03-28T12:42:01.805382+0000","last_unstale":"2024-03-28T13:50:23.417946+0000","last_undegraded":"2024-03-28T13:50:23.417946+0000","last_fullsized":"2024-03-28T13:50:23.417946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-28T12:41:59.930250+0000","last_clean_scrub_stamp":"2024-03-28T12:41:59.930250+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:26:32.791857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'212","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:30.575959+0000","last_change":"2024-03-28T13:50:30.575994+0000","last_active":"2024-03-28T13:50:30.575959+0000","last_peered":"2024-03-28T13:50:30.575959+0000","last_clean":"2024-03-28T13:50:30.575959+0000","last_became_active":"2024-03-28T12:42:01.938408+0000","last_became_peered":"2024-03-28T12:42:01.938408+0000","last_unstale":"2024-03-28T13:50:30.575959+0000","last_undegraded":"2024-03-28T13:50:30.575959+0000","last_fullsized":"2024-03-28T13:50:30.575959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'212","last_scrub_stamp":"2024-03-28T13:50:30.575871+0000","last_deep_scrub":"29'212","last_deep_scrub_stamp":"2024-03-28T13:50:30.575871+0000","last_clean_scrub_stamp":"2024-03-28T13:50:30.575871+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:39:23.839134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1106,"num_read_kb":3440531,"num_write":24390,"num_write_kb":4237056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25020,"ondisk_log_size":25020,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13266,"ondisk_log_size":13266,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":189203695,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":1437,"num_read_kb":2622,"num_write":24288,"num_write_kb":197888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":164986880,"data_stored":378407390,"data_compressed":51376166,"data_compressed_allocated":66838528,"data_compressed_original":280502272,"omap_allocated":0,"internal_metadata":0},"log_size":21589,"ondisk_log_size":21589,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66494,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510274,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99252,"kb_used_data":9836,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94272588,"statfs":{"total":96636764160,"available":96535130112,"internally_reserved":0,"allocated":10072064,"data_stored":26859525,"data_compressed":3937950,"data_compressed_allocated":4919296,"data_compressed_original":21925888,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510274,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85192,"kb_used_data":13760,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94286648,"statfs":{"total":96636764160,"available":96549527552,"internally_reserved":0,"allocated":14090240,"data_stored":32569481,"data_compressed":4547476,"data_compressed_allocated":5951488,"data_compressed_original":24629248,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510274,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127140,"kb_used_data":19676,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94244700,"statfs":{"total":96636764160,"available":96506572800,"internally_reserved":0,"allocated":20148224,"data_stored":50460553,"data_compressed":7401383,"data_compressed_allocated":9674752,"data_compressed_original":40218624,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510273,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80360,"kb_used_data":13088,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94291480,"statfs":{"total":96636764160,"available":96554475520,"internally_reserved":0,"allocated":13402112,"data_stored":33681567,"data_compressed":4660285,"data_compressed_allocated":6107136,"data_compressed_original":26583040,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510273,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120852,"kb_used_data":21708,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94250988,"statfs":{"total":96636764160,"available":96513011712,"internally_reserved":0,"allocated":22228992,"data_stored":38466913,"data_compressed":4150831,"data_compressed_allocated":5660672,"data_compressed_original":22102016,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510275,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140836,"kb_used_data":29212,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":94231004,"statfs":{"total":96636764160,"available":96492548096,"internally_reserved":0,"allocated":29913088,"data_stored":67238591,"data_compressed":8806079,"data_compressed_allocated":11505664,"data_compressed_original":49045504,"omap_allocated":1595,"internal_metadata":114293189},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542979,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":155132,"kb_used_data":33780,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94216708,"statfs":{"total":96636764160,"available":96477908992,"internally_reserved":0,"allocated":34590720,"data_stored":84015987,"data_compressed":11869280,"data_compressed_allocated":15233024,"data_compressed_original":64880640,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575682,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125892,"kb_used_data":22588,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94245948,"statfs":{"total":96636764160,"available":96507850752,"internally_reserved":0,"allocated":23130112,"data_stored":47306669,"data_compressed":6069376,"data_compressed_allocated":7876608,"data_compressed_original":32264192,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29605888,"data_stored":67112196,"data_compressed":8806079,"data_compressed_allocated":11505664,"data_compressed_original":49045504,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21856256,"data_stored":37750150,"data_compressed":4117584,"data_compressed_allocated":5615616,"data_compressed_original":21528576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13094912,"data_stored":33555172,"data_compressed":4660285,"data_compressed_allocated":6107136,"data_compressed_original":26583040,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34283520,"data_stored":83889592,"data_compressed":11869280,"data_compressed_allocated":15233024,"data_compressed_original":64880640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19841024,"data_stored":50334158,"data_compressed":7401383,"data_compressed_allocated":9674752,"data_compressed_original":40218624,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22757376,"data_stored":46589906,"data_compressed":6036129,"data_compressed_allocated":7831552,"data_compressed_original":31690752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13783040,"data_stored":32443086,"data_compressed":4547476,"data_compressed_allocated":5951488,"data_compressed_original":24629248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9764864,"data_stored":26733130,"data_compressed":3937950,"data_compressed_allocated":4919296,"data_compressed_original":21925888,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T13:50:37.359 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.359 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.359 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.359 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.359 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.359 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.359 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.360 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.360 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.360 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.360 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.360 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.360 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.360 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.360 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.360 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.361 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.361 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.361 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.361 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.361 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.361 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.361 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.361 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.361 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.361 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.362 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.362 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.362 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.362 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.362 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.362 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.362 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.362 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.362 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.362 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.363 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.363 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.363 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.363 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.363 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.363 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.363 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.363 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.363 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.363 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.364 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.364 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.364 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.364 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.364 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.364 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.364 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.364 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.364 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.365 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.365 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.365 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.365 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.365 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.365 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.365 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.365 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.365 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.366 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.366 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.366 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.366 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.366 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.366 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.366 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.366 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.366 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.367 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.367 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.367 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.367 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.367 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.367 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.367 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.367 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.367 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.367 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.368 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-03-28T12:41:58.890317+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=58, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.368 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.368 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-28T12:42:06.304443+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=42, tm_sec=6, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.368 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.368 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.368 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.368 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.368 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.368 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.368 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.369 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.369 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.369 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.369 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.369 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.369 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.369 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.369 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.369 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.369 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.370 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.370 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.370 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.370 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.370 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.370 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.370 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.370 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.370 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.370 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.371 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.371 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-28T12:41:59.930250+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=12, tm_min=41, tm_sec=59, tm_wday=3, tm_yday=88, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=28, tm_hour=13, tm_min=50, tm_sec=27, tm_wday=3, tm_yday=88, tm_isdst=0) 2024-03-28T13:50:37.371 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-28T13:50:52.765 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:50:52.769 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:50:57.372 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-28T13:50:57.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.566+0000 7fb08a000640 1 Processor -- start 2024-03-28T13:50:57.569 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.566+0000 7fb08a000640 1 -- start start 2024-03-28T13:50:57.571 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.570+0000 7fb08a000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fb08406fbc0 0x7fb08406baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:57.571 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.570+0000 7fb08a000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb08406ffa0 0x7fb08406ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:57.571 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.570+0000 7fb08a000640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb08406f5b0 con 0x7fb0841521d0 2024-03-28T13:50:57.571 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.570+0000 7fb08a000640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fb084158400 con 0x7fb08406fbc0 2024-03-28T13:50:57.571 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.570+0000 7fb08a000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb0841586c0 con 0x7fb08406ffa0 2024-03-28T13:50:57.575 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.574+0000 7fb088c00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fb08406fbc0 0x7fb08406baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:57.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.574+0000 7fb088c00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fb08406fbc0 0x7fb08406baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33326/0 (socket says 172.21.15.76:33326) 2024-03-28T13:50:57.576 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.574+0000 7fb088c00640 1 -- 172.21.15.76:0/1485618620 learned_addr learned my addr 172.21.15.76:0/1485618620 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:57.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.578+0000 7fb088c00640 1 -- 172.21.15.76:0/1485618620 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb08406ffa0 msgr2=0x7fb08406ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:57.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.578+0000 7fb088c00640 1 --2- 172.21.15.76:0/1485618620 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb08406ffa0 0x7fb08406ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:57.580 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.578+0000 7fb088c00640 1 -- 172.21.15.76:0/1485618620 >> v1:172.21.15.76:6789/0 conn(0x7fb0841521d0 legacy=0x7fb0840c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:57.581 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.578+0000 7fb088c00640 1 -- 172.21.15.76:0/1485618620 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0841589a0 con 0x7fb08406fbc0 2024-03-28T13:50:57.587 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.586+0000 7fb088c00640 1 --2- 172.21.15.76:0/1485618620 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08406fbc0 0x7fb08406baf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb078009870 tx=0x7fb07801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da8b498e72edf4d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:57.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.590+0000 7fb083400640 1 -- 172.21.15.76:0/1485618620 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0780b5070 con 0x7fb08406fbc0 2024-03-28T13:50:57.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.590+0000 7fb083400640 1 -- 172.21.15.76:0/1485618620 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0780a89d0 con 0x7fb08406fbc0 2024-03-28T13:50:57.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.590+0000 7fb083400640 1 -- 172.21.15.76:0/1485618620 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0780a8da0 con 0x7fb08406fbc0 2024-03-28T13:50:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.590+0000 7fb08a000640 1 -- 172.21.15.76:0/1485618620 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08406fbc0 msgr2=0x7fb08406baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.590+0000 7fb08a000640 1 --2- 172.21.15.76:0/1485618620 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08406fbc0 0x7fb08406baf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb078009870 tx=0x7fb07801ed10 comp rx=0 tx=0).stop 2024-03-28T13:50:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.590+0000 7fb08a000640 1 -- 172.21.15.76:0/1485618620 shutdown_connections 2024-03-28T13:50:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.590+0000 7fb08a000640 1 --2- 172.21.15.76:0/1485618620 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb08406ffa0 0x7fb08406ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.590+0000 7fb08a000640 1 --2- 172.21.15.76:0/1485618620 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08406fbc0 0x7fb08406baf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.590+0000 7fb08a000640 1 -- 172.21.15.76:0/1485618620 >> 172.21.15.76:0/1485618620 conn(0x7fb084073670 msgr2=0x7fb084070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.590+0000 7fb08a000640 1 -- 172.21.15.76:0/1485618620 shutdown_connections 2024-03-28T13:50:57.592 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.590+0000 7fb08a000640 1 -- 172.21.15.76:0/1485618620 wait complete. 2024-03-28T13:50:57.593 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.594+0000 7fb08a000640 1 Processor -- start 2024-03-28T13:50:57.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.594+0000 7fb08a000640 1 -- start start 2024-03-28T13:50:57.594 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.594+0000 7fb08a000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08406fbc0 0x7fb0841f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:57.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.594+0000 7fb08a000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb08406ffa0 0x7fb0840cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:57.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.594+0000 7fb08a000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0841521d0 0x7fb0840c3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:57.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.594+0000 7fb08a000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb08406c030 con 0x7fb08406fbc0 2024-03-28T13:50:57.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.594+0000 7fb08a000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb084158f60 con 0x7fb0841521d0 2024-03-28T13:50:57.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.594+0000 7fb08a000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb08406f1f0 con 0x7fb08406ffa0 2024-03-28T13:50:57.595 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.594+0000 7fb088c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08406fbc0 0x7fb0841f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:57.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.594+0000 7fb088c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08406fbc0 0x7fb0841f2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33342/0 (socket says 172.21.15.76:33342) 2024-03-28T13:50:57.596 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.594+0000 7fb088c00640 1 -- 172.21.15.76:0/1053144667 learned_addr learned my addr 172.21.15.76:0/1053144667 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:57.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.602+0000 7fb088c00640 1 -- 172.21.15.76:0/1053144667 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb08406ffa0 msgr2=0x7fb0840cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:57.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.602+0000 7fb088c00640 1 --2- 172.21.15.76:0/1053144667 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb08406ffa0 0x7fb0840cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:57.601 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.602+0000 7fb088c00640 1 -- 172.21.15.76:0/1053144667 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0841521d0 msgr2=0x7fb0840c3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:57.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.602+0000 7fb088c00640 1 --2- 172.21.15.76:0/1053144667 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0841521d0 0x7fb0840c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:57.602 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.602+0000 7fb088c00640 1 -- 172.21.15.76:0/1053144667 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0840cac30 con 0x7fb08406fbc0 2024-03-28T13:50:57.605 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.606+0000 7fb088c00640 1 --2- 172.21.15.76:0/1053144667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08406fbc0 0x7fb0841f2da0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb07801c940 tx=0x7fb07801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:57.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.610+0000 7fb080c00640 1 -- 172.21.15.76:0/1053144667 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0780b5050 con 0x7fb08406fbc0 2024-03-28T13:50:57.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.610+0000 7fb080c00640 1 -- 172.21.15.76:0/1053144667 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0780bf070 con 0x7fb08406fbc0 2024-03-28T13:50:57.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.610+0000 7fb080c00640 1 -- 172.21.15.76:0/1053144667 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0780b0d10 con 0x7fb08406fbc0 2024-03-28T13:50:57.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.610+0000 7fb08a000640 1 -- 172.21.15.76:0/1053144667 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0840caf10 con 0x7fb08406fbc0 2024-03-28T13:50:57.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.610+0000 7fb08a000640 1 -- 172.21.15.76:0/1053144667 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0840cb4d0 con 0x7fb08406fbc0 2024-03-28T13:50:57.611 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.610+0000 7fb08a000640 1 -- 172.21.15.76:0/1053144667 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0840686e0 con 0x7fb08406fbc0 2024-03-28T13:50:57.893 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.894+0000 7fb080c00640 1 -- 172.21.15.76:0/1053144667 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb0780ba440 con 0x7fb08406fbc0 2024-03-28T13:50:57.894 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.894+0000 7fb080c00640 1 --2- 172.21.15.76:0/1053144667 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb064068010 0x7fb06406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:57.895 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.894+0000 7fb083e00640 1 --2- 172.21.15.76:0/1053144667 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb064068010 0x7fb06406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:57.896 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.894+0000 7fb083e00640 1 --2- 172.21.15.76:0/1053144667 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb064068010 0x7fb06406a4d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb0840c83b0 tx=0x7fb070006ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:57.906 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.906+0000 7fb080c00640 1 -- 172.21.15.76:0/1053144667 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fb0780f2960 con 0x7fb08406fbc0 2024-03-28T13:50:57.907 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:57.906+0000 7fb080c00640 1 -- 172.21.15.76:0/1053144667 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fb078018870 con 0x7fb08406fbc0 2024-03-28T13:50:58.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.142+0000 7fb08a000640 1 -- 172.21.15.76:0/1053144667 --> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb084070bf0 con 0x7fb064068010 2024-03-28T13:50:58.161 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.162+0000 7fb080c00640 1 -- 172.21.15.76:0/1053144667 <== mgr.4107 v2:172.21.15.76:6800/1313648511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335778 (secure 0 0 0) 0x7fb084070bf0 con 0x7fb064068010 2024-03-28T13:50:58.164 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T13:50:58.167 INFO:teuthology.orchestra.run.smithi076.stderr:dumped all 2024-03-28T13:50:58.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.166+0000 7fb08a000640 1 -- 172.21.15.76:0/1053144667 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb064068010 msgr2=0x7fb06406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:58.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.166+0000 7fb08a000640 1 --2- 172.21.15.76:0/1053144667 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb064068010 0x7fb06406a4d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb0840c83b0 tx=0x7fb070006ca0 comp rx=0 tx=0).stop 2024-03-28T13:50:58.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.166+0000 7fb08a000640 1 -- 172.21.15.76:0/1053144667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08406fbc0 msgr2=0x7fb0841f2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:58.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.166+0000 7fb08a000640 1 --2- 172.21.15.76:0/1053144667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08406fbc0 0x7fb0841f2da0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb07801c940 tx=0x7fb07801bab0 comp rx=0 tx=0).stop 2024-03-28T13:50:58.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.166+0000 7fb08a000640 1 -- 172.21.15.76:0/1053144667 shutdown_connections 2024-03-28T13:50:58.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.166+0000 7fb08a000640 1 --2- 172.21.15.76:0/1053144667 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb064068010 0x7fb06406a4d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:58.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.166+0000 7fb08a000640 1 --2- 172.21.15.76:0/1053144667 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0841521d0 0x7fb0840c3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:58.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.166+0000 7fb08a000640 1 --2- 172.21.15.76:0/1053144667 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb08406ffa0 0x7fb0840cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:58.168 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.166+0000 7fb08a000640 1 --2- 172.21.15.76:0/1053144667 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb08406fbc0 0x7fb0841f2da0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:58.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.166+0000 7fb08a000640 1 -- 172.21.15.76:0/1053144667 >> 172.21.15.76:0/1053144667 conn(0x7fb084073670 msgr2=0x7fb0840c4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:58.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.166+0000 7fb08a000640 1 -- 172.21.15.76:0/1053144667 shutdown_connections 2024-03-28T13:50:58.169 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.166+0000 7fb08a000640 1 -- 172.21.15.76:0/1053144667 wait complete. 2024-03-28T13:50:58.197 INFO:teuthology.orchestra.run.smithi076.stdout:{"pg_ready":true,"pg_map":{"version":2112,"stamp":"2024-03-28T13:50:58.042037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":189794063,"num_objects":145,"num_object_clones":0,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":0,"num_read":2659,"num_read_kb":3443253,"num_write":48837,"num_write_kb":4437360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":60109,"ondisk_log_size":60109,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":938816,"kb_used_data":163648,"kb_used_omap":12,"kb_used_meta":775091,"kb_avail":754035904,"statfs":{"total":773094113280,"available":772132765696,"internally_reserved":0,"allocated":167575552,"data_stored":380599286,"data_compressed":51442660,"data_compressed_allocated":66928640,"data_compressed_original":281649152,"omap_allocated":12752,"internal_metadata":793693744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002879"},"pg_stats":[{"pgid":"2.1f","version":"29'326","reported_seq":396,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:35.170451+0000","last_change":"2024-03-28T13:50:35.170451+0000","last_active":"2024-03-28T13:50:35.170451+0000","last_peered":"2024-03-28T13:50:35.170451+0000","last_clean":"2024-03-28T13:50:35.170451+0000","last_became_active":"2024-03-28T12:42:00.079900+0000","last_became_peered":"2024-03-28T12:42:00.079900+0000","last_unstale":"2024-03-28T13:50:35.170451+0000","last_undegraded":"2024-03-28T13:50:35.170451+0000","last_fullsized":"2024-03-28T13:50:35.170451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'326","last_scrub_stamp":"2024-03-28T13:50:35.170270+0000","last_deep_scrub":"29'326","last_deep_scrub_stamp":"2024-03-28T13:50:35.170270+0000","last_clean_scrub_stamp":"2024-03-28T13:50:35.170270+0000","objects_scrubbed":8,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:59:26.825779+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":8322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"29'203","reported_seq":272,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:48.883822+0000","last_change":"2024-03-28T13:50:48.883884+0000","last_active":"2024-03-28T13:50:48.883822+0000","last_peered":"2024-03-28T13:50:48.883822+0000","last_clean":"2024-03-28T13:50:48.883822+0000","last_became_active":"2024-03-28T12:42:01.959408+0000","last_became_peered":"2024-03-28T12:42:01.959408+0000","last_unstale":"2024-03-28T13:50:48.883822+0000","last_undegraded":"2024-03-28T13:50:48.883822+0000","last_fullsized":"2024-03-28T13:50:48.883822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'203","last_scrub_stamp":"2024-03-28T13:50:48.883655+0000","last_deep_scrub":"29'203","last_deep_scrub_stamp":"2024-03-28T13:50:48.883655+0000","last_clean_scrub_stamp":"2024-03-28T13:50:48.883655+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:20:58.169789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"29'806","reported_seq":896,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:42.834218+0000","last_change":"2024-03-28T13:50:42.834263+0000","last_active":"2024-03-28T13:50:42.834218+0000","last_peered":"2024-03-28T13:50:42.834218+0000","last_clean":"2024-03-28T13:50:42.834218+0000","last_became_active":"2024-03-28T12:42:07.880354+0000","last_became_peered":"2024-03-28T12:42:07.880354+0000","last_unstale":"2024-03-28T13:50:42.834218+0000","last_undegraded":"2024-03-28T13:50:42.834218+0000","last_fullsized":"2024-03-28T13:50:42.834218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'806","last_scrub_stamp":"2024-03-28T13:50:42.834094+0000","last_deep_scrub":"29'806","last_deep_scrub_stamp":"2024-03-28T13:50:42.834094+0000","last_clean_scrub_stamp":"2024-03-28T13:50:42.834094+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:17:21.892537+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":120104,"num_write":790,"num_write_kb":143940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"29'159","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:39.850512+0000","last_change":"2024-03-28T13:50:39.850560+0000","last_active":"2024-03-28T13:50:39.850512+0000","last_peered":"2024-03-28T13:50:39.850512+0000","last_clean":"2024-03-28T13:50:39.850512+0000","last_became_active":"2024-03-28T12:42:00.137978+0000","last_became_peered":"2024-03-28T12:42:00.137978+0000","last_unstale":"2024-03-28T13:50:39.850512+0000","last_undegraded":"2024-03-28T13:50:39.850512+0000","last_fullsized":"2024-03-28T13:50:39.850512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'159","last_scrub_stamp":"2024-03-28T13:50:39.850412+0000","last_deep_scrub":"29'159","last_deep_scrub_stamp":"2024-03-28T13:50:39.850412+0000","last_clean_scrub_stamp":"2024-03-28T13:50:39.850412+0000","objects_scrubbed":1,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:49:14.553631+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":110,"num_write_kb":4148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"29'187","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:36.871666+0000","last_change":"2024-03-28T13:50:36.871666+0000","last_active":"2024-03-28T13:50:36.871666+0000","last_peered":"2024-03-28T13:50:36.871666+0000","last_clean":"2024-03-28T13:50:36.871666+0000","last_became_active":"2024-03-28T12:42:01.957875+0000","last_became_peered":"2024-03-28T12:42:01.957875+0000","last_unstale":"2024-03-28T13:50:36.871666+0000","last_undegraded":"2024-03-28T13:50:36.871666+0000","last_fullsized":"2024-03-28T13:50:36.871666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'187","last_scrub_stamp":"2024-03-28T13:50:36.871490+0000","last_deep_scrub":"29'187","last_deep_scrub_stamp":"2024-03-28T13:50:36.871490+0000","last_clean_scrub_stamp":"2024-03-28T13:50:36.871490+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:11:38.955596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"29'798","reported_seq":911,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:41.774241+0000","last_change":"2024-03-28T13:50:41.774292+0000","last_active":"2024-03-28T13:50:41.774241+0000","last_peered":"2024-03-28T13:50:41.774241+0000","last_clean":"2024-03-28T13:50:41.774241+0000","last_became_active":"2024-03-28T12:42:07.905350+0000","last_became_peered":"2024-03-28T12:42:07.905350+0000","last_unstale":"2024-03-28T13:50:41.774241+0000","last_undegraded":"2024-03-28T13:50:41.774241+0000","last_fullsized":"2024-03-28T13:50:41.774241+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'798","last_scrub_stamp":"2024-03-28T13:50:41.774115+0000","last_deep_scrub":"29'798","last_deep_scrub_stamp":"2024-03-28T13:50:41.774115+0000","last_clean_scrub_stamp":"2024-03-28T13:50:41.774115+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:52:42.347335+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":162211,"num_write":782,"num_write_kb":177125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'1192","reported_seq":1255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:35.674590+0000","last_change":"2024-03-28T13:50:35.674658+0000","last_active":"2024-03-28T13:50:35.674590+0000","last_peered":"2024-03-28T13:50:35.674590+0000","last_clean":"2024-03-28T13:50:35.674590+0000","last_became_active":"2024-03-28T12:42:00.148367+0000","last_became_peered":"2024-03-28T12:42:00.148367+0000","last_unstale":"2024-03-28T13:50:35.674590+0000","last_undegraded":"2024-03-28T13:50:35.674590+0000","last_fullsized":"2024-03-28T13:50:35.674590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1192","last_scrub_stamp":"2024-03-28T13:50:35.674517+0000","last_deep_scrub":"29'1192","last_deep_scrub_stamp":"2024-03-28T13:50:35.674517+0000","last_clean_scrub_stamp":"2024-03-28T13:50:35.674517+0000","objects_scrubbed":10,"log_size":1192,"log_dups_size":0,"ondisk_log_size":1192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:06:49.761791+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1357,"num_write_kb":12879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"29'189","reported_seq":249,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:33.668838+0000","last_change":"2024-03-28T13:50:33.668875+0000","last_active":"2024-03-28T13:50:33.668838+0000","last_peered":"2024-03-28T13:50:33.668838+0000","last_clean":"2024-03-28T13:50:33.668838+0000","last_became_active":"2024-03-28T12:42:01.964817+0000","last_became_peered":"2024-03-28T12:42:01.964817+0000","last_unstale":"2024-03-28T13:50:33.668838+0000","last_undegraded":"2024-03-28T13:50:33.668838+0000","last_fullsized":"2024-03-28T13:50:33.668838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'189","last_scrub_stamp":"2024-03-28T13:50:33.668747+0000","last_deep_scrub":"29'189","last_deep_scrub_stamp":"2024-03-28T13:50:33.668747+0000","last_clean_scrub_stamp":"2024-03-28T13:50:33.668747+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:56:28.828088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"29'762","reported_seq":848,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:43.800406+0000","last_change":"2024-03-28T13:50:43.800428+0000","last_active":"2024-03-28T13:50:43.800406+0000","last_peered":"2024-03-28T13:50:43.800406+0000","last_clean":"2024-03-28T13:50:43.800406+0000","last_became_active":"2024-03-28T12:42:07.905522+0000","last_became_peered":"2024-03-28T12:42:07.905522+0000","last_unstale":"2024-03-28T13:50:43.800406+0000","last_undegraded":"2024-03-28T13:50:43.800406+0000","last_fullsized":"2024-03-28T13:50:43.800406+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'762","last_scrub_stamp":"2024-03-28T13:50:43.800337+0000","last_deep_scrub":"29'762","last_deep_scrub_stamp":"2024-03-28T13:50:43.800337+0000","last_clean_scrub_stamp":"2024-03-28T13:50:43.800337+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:48:36.885675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":115606,"num_write":742,"num_write_kb":142838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'848","reported_seq":911,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:34.622147+0000","last_change":"2024-03-28T13:50:34.622197+0000","last_active":"2024-03-28T13:50:34.622147+0000","last_peered":"2024-03-28T13:50:34.622147+0000","last_clean":"2024-03-28T13:50:34.622147+0000","last_became_active":"2024-03-28T12:42:00.148446+0000","last_became_peered":"2024-03-28T12:42:00.148446+0000","last_unstale":"2024-03-28T13:50:34.622147+0000","last_undegraded":"2024-03-28T13:50:34.622147+0000","last_fullsized":"2024-03-28T13:50:34.622147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'848","last_scrub_stamp":"2024-03-28T13:50:34.622072+0000","last_deep_scrub":"29'848","last_deep_scrub_stamp":"2024-03-28T13:50:34.622072+0000","last_clean_scrub_stamp":"2024-03-28T13:50:34.622072+0000","objects_scrubbed":4,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:54:23.470541+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":4481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"29'204","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:32.345331+0000","last_change":"2024-03-28T13:50:32.345371+0000","last_active":"2024-03-28T13:50:32.345331+0000","last_peered":"2024-03-28T13:50:32.345331+0000","last_clean":"2024-03-28T13:50:32.345331+0000","last_became_active":"2024-03-28T12:42:01.935231+0000","last_became_peered":"2024-03-28T12:42:01.935231+0000","last_unstale":"2024-03-28T13:50:32.345331+0000","last_undegraded":"2024-03-28T13:50:32.345331+0000","last_fullsized":"2024-03-28T13:50:32.345331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'204","last_scrub_stamp":"2024-03-28T13:50:32.345223+0000","last_deep_scrub":"29'204","last_deep_scrub_stamp":"2024-03-28T13:50:32.345223+0000","last_clean_scrub_stamp":"2024-03-28T13:50:32.345223+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:54:25.717170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"29'756","reported_seq":827,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:40.813319+0000","last_change":"2024-03-28T13:50:40.813362+0000","last_active":"2024-03-28T13:50:40.813319+0000","last_peered":"2024-03-28T13:50:40.813319+0000","last_clean":"2024-03-28T13:50:40.813319+0000","last_became_active":"2024-03-28T12:42:07.904240+0000","last_became_peered":"2024-03-28T12:42:07.904240+0000","last_unstale":"2024-03-28T13:50:40.813319+0000","last_undegraded":"2024-03-28T13:50:40.813319+0000","last_fullsized":"2024-03-28T13:50:40.813319+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'756","last_scrub_stamp":"2024-03-28T13:50:40.813197+0000","last_deep_scrub":"29'756","last_deep_scrub_stamp":"2024-03-28T13:50:40.813197+0000","last_clean_scrub_stamp":"2024-03-28T13:50:40.813197+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:39:49.204120+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":42901,"num_write":735,"num_write_kb":89492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"29'215","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:52.283161+0000","last_change":"2024-03-28T13:50:52.283182+0000","last_active":"2024-03-28T13:50:52.283161+0000","last_peered":"2024-03-28T13:50:52.283161+0000","last_clean":"2024-03-28T13:50:52.283161+0000","last_became_active":"2024-03-28T12:42:01.962885+0000","last_became_peered":"2024-03-28T12:42:01.962885+0000","last_unstale":"2024-03-28T13:50:52.283161+0000","last_undegraded":"2024-03-28T13:50:52.283161+0000","last_fullsized":"2024-03-28T13:50:52.283161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'215","last_scrub_stamp":"2024-03-28T13:50:52.283097+0000","last_deep_scrub":"29'215","last_deep_scrub_stamp":"2024-03-28T13:50:52.283097+0000","last_clean_scrub_stamp":"2024-03-28T13:50:52.283097+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:46:01.463951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'626","reported_seq":693,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:46.271010+0000","last_change":"2024-03-28T13:50:46.271069+0000","last_active":"2024-03-28T13:50:46.271010+0000","last_peered":"2024-03-28T13:50:46.271010+0000","last_clean":"2024-03-28T13:50:46.271010+0000","last_became_active":"2024-03-28T12:42:00.133880+0000","last_became_peered":"2024-03-28T12:42:00.133880+0000","last_unstale":"2024-03-28T13:50:46.271010+0000","last_undegraded":"2024-03-28T13:50:46.271010+0000","last_fullsized":"2024-03-28T13:50:46.271010+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'626","last_scrub_stamp":"2024-03-28T13:50:46.270904+0000","last_deep_scrub":"29'626","last_deep_scrub_stamp":"2024-03-28T13:50:46.270904+0000","last_clean_scrub_stamp":"2024-03-28T13:50:46.270904+0000","objects_scrubbed":5,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:11:09.157026+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":562,"num_write_kb":12550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"29'827","reported_seq":941,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:57.264484+0000","last_change":"2024-03-28T13:50:57.264531+0000","last_active":"2024-03-28T13:50:57.264484+0000","last_peered":"2024-03-28T13:50:57.264484+0000","last_clean":"2024-03-28T13:50:57.264484+0000","last_became_active":"2024-03-28T12:42:15.237739+0000","last_became_peered":"2024-03-28T12:42:15.237739+0000","last_unstale":"2024-03-28T13:50:57.264484+0000","last_undegraded":"2024-03-28T13:50:57.264484+0000","last_fullsized":"2024-03-28T13:50:57.264484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'827","last_scrub_stamp":"2024-03-28T13:50:57.264358+0000","last_deep_scrub":"29'827","last_deep_scrub_stamp":"2024-03-28T13:50:57.264358+0000","last_clean_scrub_stamp":"2024-03-28T13:50:57.264358+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:30:50.946769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":166655,"num_write":808,"num_write_kb":213920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"29'211","reported_seq":274,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:39.794211+0000","last_change":"2024-03-28T13:50:39.794348+0000","last_active":"2024-03-28T13:50:39.794211+0000","last_peered":"2024-03-28T13:50:39.794211+0000","last_clean":"2024-03-28T13:50:39.794211+0000","last_became_active":"2024-03-28T12:42:01.948049+0000","last_became_peered":"2024-03-28T12:42:01.948049+0000","last_unstale":"2024-03-28T13:50:39.794211+0000","last_undegraded":"2024-03-28T13:50:39.794211+0000","last_fullsized":"2024-03-28T13:50:39.794211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'211","last_scrub_stamp":"2024-03-28T13:50:39.794011+0000","last_deep_scrub":"29'211","last_deep_scrub_stamp":"2024-03-28T13:50:39.794011+0000","last_clean_scrub_stamp":"2024-03-28T13:50:39.794011+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:53:41.707341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"29'880","reported_seq":947,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:35.594774+0000","last_change":"2024-03-28T13:50:35.594806+0000","last_active":"2024-03-28T13:50:35.594774+0000","last_peered":"2024-03-28T13:50:35.594774+0000","last_clean":"2024-03-28T13:50:35.594774+0000","last_became_active":"2024-03-28T12:42:00.138264+0000","last_became_peered":"2024-03-28T12:42:00.138264+0000","last_unstale":"2024-03-28T13:50:35.594774+0000","last_undegraded":"2024-03-28T13:50:35.594774+0000","last_fullsized":"2024-03-28T13:50:35.594774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'880","last_scrub_stamp":"2024-03-28T13:50:35.594712+0000","last_deep_scrub":"29'880","last_deep_scrub_stamp":"2024-03-28T13:50:35.594712+0000","last_clean_scrub_stamp":"2024-03-28T13:50:35.594712+0000","objects_scrubbed":4,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:58:52.657491+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7273697,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1195,"num_write_kb":7596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"29'824","reported_seq":907,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:46.572972+0000","last_change":"2024-03-28T13:50:46.573018+0000","last_active":"2024-03-28T13:50:46.572972+0000","last_peered":"2024-03-28T13:50:46.572972+0000","last_clean":"2024-03-28T13:50:46.572972+0000","last_became_active":"2024-03-28T12:42:07.941114+0000","last_became_peered":"2024-03-28T12:42:07.941114+0000","last_unstale":"2024-03-28T13:50:46.572972+0000","last_undegraded":"2024-03-28T13:50:46.572972+0000","last_fullsized":"2024-03-28T13:50:46.572972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'824","last_scrub_stamp":"2024-03-28T13:50:46.572853+0000","last_deep_scrub":"29'824","last_deep_scrub_stamp":"2024-03-28T13:50:46.572853+0000","last_clean_scrub_stamp":"2024-03-28T13:50:46.572853+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:28:31.454167+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":77884,"num_write":800,"num_write_kb":72822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'207","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:34.120957+0000","last_change":"2024-03-28T13:50:34.121015+0000","last_active":"2024-03-28T13:50:34.120957+0000","last_peered":"2024-03-28T13:50:34.120957+0000","last_clean":"2024-03-28T13:50:34.120957+0000","last_became_active":"2024-03-28T12:42:01.946576+0000","last_became_peered":"2024-03-28T12:42:01.946576+0000","last_unstale":"2024-03-28T13:50:34.120957+0000","last_undegraded":"2024-03-28T13:50:34.120957+0000","last_fullsized":"2024-03-28T13:50:34.120957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'207","last_scrub_stamp":"2024-03-28T13:50:34.120791+0000","last_deep_scrub":"29'207","last_deep_scrub_stamp":"2024-03-28T13:50:34.120791+0000","last_clean_scrub_stamp":"2024-03-28T13:50:34.120791+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:41:57.223387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"29'263","reported_seq":331,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:38.147854+0000","last_change":"2024-03-28T13:50:38.148019+0000","last_active":"2024-03-28T13:50:38.147854+0000","last_peered":"2024-03-28T13:50:38.147854+0000","last_clean":"2024-03-28T13:50:38.147854+0000","last_became_active":"2024-03-28T12:42:00.142063+0000","last_became_peered":"2024-03-28T12:42:00.142063+0000","last_unstale":"2024-03-28T13:50:38.147854+0000","last_undegraded":"2024-03-28T13:50:38.147854+0000","last_fullsized":"2024-03-28T13:50:38.147854+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'263","last_scrub_stamp":"2024-03-28T13:50:38.147656+0000","last_deep_scrub":"29'263","last_deep_scrub_stamp":"2024-03-28T13:50:38.147656+0000","last_clean_scrub_stamp":"2024-03-28T13:50:38.147656+0000","objects_scrubbed":5,"log_size":263,"log_dups_size":0,"ondisk_log_size":263,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:42:45.293577+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":205,"num_write_kb":4193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'752","reported_seq":845,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:44.796659+0000","last_change":"2024-03-28T13:50:44.796779+0000","last_active":"2024-03-28T13:50:44.796659+0000","last_peered":"2024-03-28T13:50:44.796659+0000","last_clean":"2024-03-28T13:50:44.796659+0000","last_became_active":"2024-03-28T12:42:15.232928+0000","last_became_peered":"2024-03-28T12:42:15.232928+0000","last_unstale":"2024-03-28T13:50:44.796659+0000","last_undegraded":"2024-03-28T13:50:44.796659+0000","last_fullsized":"2024-03-28T13:50:44.796659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'752","last_scrub_stamp":"2024-03-28T13:50:44.796420+0000","last_deep_scrub":"29'752","last_deep_scrub_stamp":"2024-03-28T13:50:44.796420+0000","last_clean_scrub_stamp":"2024-03-28T13:50:44.796420+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:22:53.870285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":85819,"num_write":731,"num_write_kb":97778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,5],"acting":[7,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"29'222","reported_seq":288,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:39.274641+0000","last_change":"2024-03-28T13:50:39.274685+0000","last_active":"2024-03-28T13:50:39.274641+0000","last_peered":"2024-03-28T13:50:39.274641+0000","last_clean":"2024-03-28T13:50:39.274641+0000","last_became_active":"2024-03-28T12:42:01.787253+0000","last_became_peered":"2024-03-28T12:42:01.787253+0000","last_unstale":"2024-03-28T13:50:39.274641+0000","last_undegraded":"2024-03-28T13:50:39.274641+0000","last_fullsized":"2024-03-28T13:50:39.274641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'222","last_scrub_stamp":"2024-03-28T13:50:39.274523+0000","last_deep_scrub":"29'222","last_deep_scrub_stamp":"2024-03-28T13:50:39.274523+0000","last_clean_scrub_stamp":"2024-03-28T13:50:39.274523+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:57:05.456675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"29'773","reported_seq":840,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:32.609650+0000","last_change":"2024-03-28T13:50:32.609699+0000","last_active":"2024-03-28T13:50:32.609650+0000","last_peered":"2024-03-28T13:50:32.609650+0000","last_clean":"2024-03-28T13:50:32.609650+0000","last_became_active":"2024-03-28T12:42:00.146394+0000","last_became_peered":"2024-03-28T12:42:00.146394+0000","last_unstale":"2024-03-28T13:50:32.609650+0000","last_undegraded":"2024-03-28T13:50:32.609650+0000","last_fullsized":"2024-03-28T13:50:32.609650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'773","last_scrub_stamp":"2024-03-28T13:50:32.609569+0000","last_deep_scrub":"29'773","last_deep_scrub_stamp":"2024-03-28T13:50:32.609569+0000","last_clean_scrub_stamp":"2024-03-28T13:50:32.609569+0000","objects_scrubbed":2,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:42:39.755490+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":4437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"29'732","reported_seq":821,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:42.800398+0000","last_change":"2024-03-28T13:50:42.800421+0000","last_active":"2024-03-28T13:50:42.800398+0000","last_peered":"2024-03-28T13:50:42.800398+0000","last_clean":"2024-03-28T13:50:42.800398+0000","last_became_active":"2024-03-28T12:42:07.906233+0000","last_became_peered":"2024-03-28T12:42:07.906233+0000","last_unstale":"2024-03-28T13:50:42.800398+0000","last_undegraded":"2024-03-28T13:50:42.800398+0000","last_fullsized":"2024-03-28T13:50:42.800398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'732","last_scrub_stamp":"2024-03-28T13:50:42.800325+0000","last_deep_scrub":"29'732","last_deep_scrub_stamp":"2024-03-28T13:50:42.800325+0000","last_clean_scrub_stamp":"2024-03-28T13:50:42.800325+0000","objects_scrubbed":0,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:58:57.123159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":108609,"num_write":711,"num_write_kb":134735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"29'225","reported_seq":291,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:42.151056+0000","last_change":"2024-03-28T13:50:42.151099+0000","last_active":"2024-03-28T13:50:42.151056+0000","last_peered":"2024-03-28T13:50:42.151056+0000","last_clean":"2024-03-28T13:50:42.151056+0000","last_became_active":"2024-03-28T12:42:01.946087+0000","last_became_peered":"2024-03-28T12:42:01.946087+0000","last_unstale":"2024-03-28T13:50:42.151056+0000","last_undegraded":"2024-03-28T13:50:42.151056+0000","last_fullsized":"2024-03-28T13:50:42.151056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'225","last_scrub_stamp":"2024-03-28T13:50:42.150945+0000","last_deep_scrub":"29'225","last_deep_scrub_stamp":"2024-03-28T13:50:42.150945+0000","last_clean_scrub_stamp":"2024-03-28T13:50:42.150945+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:39:50.541868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'258","reported_seq":326,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:41.265617+0000","last_change":"2024-03-28T13:50:41.265671+0000","last_active":"2024-03-28T13:50:41.265617+0000","last_peered":"2024-03-28T13:50:41.265617+0000","last_clean":"2024-03-28T13:50:41.265617+0000","last_became_active":"2024-03-28T12:42:00.143537+0000","last_became_peered":"2024-03-28T12:42:00.143537+0000","last_unstale":"2024-03-28T13:50:41.265617+0000","last_undegraded":"2024-03-28T13:50:41.265617+0000","last_fullsized":"2024-03-28T13:50:41.265617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'258","last_scrub_stamp":"2024-03-28T13:50:41.265500+0000","last_deep_scrub":"29'258","last_deep_scrub_stamp":"2024-03-28T13:50:41.265500+0000","last_clean_scrub_stamp":"2024-03-28T13:50:41.265500+0000","objects_scrubbed":5,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:39:53.239311+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":4185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"29'820","reported_seq":938,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:46.770717+0000","last_change":"2024-03-28T13:50:46.770717+0000","last_active":"2024-03-28T13:50:46.770717+0000","last_peered":"2024-03-28T13:50:46.770717+0000","last_clean":"2024-03-28T13:50:46.770717+0000","last_became_active":"2024-03-28T12:42:15.365535+0000","last_became_peered":"2024-03-28T12:42:15.365535+0000","last_unstale":"2024-03-28T13:50:46.770717+0000","last_undegraded":"2024-03-28T13:50:46.770717+0000","last_fullsized":"2024-03-28T13:50:46.770717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'820","last_scrub_stamp":"2024-03-28T13:50:46.770558+0000","last_deep_scrub":"29'820","last_deep_scrub_stamp":"2024-03-28T13:50:46.770558+0000","last_clean_scrub_stamp":"2024-03-28T13:50:46.770558+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:08:29.730767+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":174138,"num_write":805,"num_write_kb":205369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,1],"acting":[2,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"29'175","reported_seq":241,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:40.176693+0000","last_change":"2024-03-28T13:50:40.176715+0000","last_active":"2024-03-28T13:50:40.176693+0000","last_peered":"2024-03-28T13:50:40.176693+0000","last_clean":"2024-03-28T13:50:40.176693+0000","last_became_active":"2024-03-28T12:42:01.801492+0000","last_became_peered":"2024-03-28T12:42:01.801492+0000","last_unstale":"2024-03-28T13:50:40.176693+0000","last_undegraded":"2024-03-28T13:50:40.176693+0000","last_fullsized":"2024-03-28T13:50:40.176693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'175","last_scrub_stamp":"2024-03-28T13:50:40.176591+0000","last_deep_scrub":"29'175","last_deep_scrub_stamp":"2024-03-28T13:50:40.176591+0000","last_clean_scrub_stamp":"2024-03-28T13:50:40.176591+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:54:29.025060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'3010","reported_seq":3078,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:39.190887+0000","last_change":"2024-03-28T13:50:39.190945+0000","last_active":"2024-03-28T13:50:39.190887+0000","last_peered":"2024-03-28T13:50:39.190887+0000","last_clean":"2024-03-28T13:50:39.190887+0000","last_became_active":"2024-03-28T12:42:00.145638+0000","last_became_peered":"2024-03-28T12:42:00.145638+0000","last_unstale":"2024-03-28T13:50:39.190887+0000","last_undegraded":"2024-03-28T13:50:39.190887+0000","last_fullsized":"2024-03-28T13:50:39.190887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3010","last_scrub_stamp":"2024-03-28T13:50:39.190784+0000","last_deep_scrub":"29'3010","last_deep_scrub_stamp":"2024-03-28T13:50:39.190784+0000","last_clean_scrub_stamp":"2024-03-28T13:50:39.190784+0000","objects_scrubbed":4,"log_size":3010,"log_dups_size":0,"ondisk_log_size":3010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:18:05.868873+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6735,"num_write_kb":3814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"29'791","reported_seq":874,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:47.026913+0000","last_change":"2024-03-28T13:50:47.027051+0000","last_active":"2024-03-28T13:50:47.026913+0000","last_peered":"2024-03-28T13:50:47.026913+0000","last_clean":"2024-03-28T13:50:47.026913+0000","last_became_active":"2024-03-28T12:42:07.881730+0000","last_became_peered":"2024-03-28T12:42:07.881730+0000","last_unstale":"2024-03-28T13:50:47.026913+0000","last_undegraded":"2024-03-28T13:50:47.026913+0000","last_fullsized":"2024-03-28T13:50:47.026913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'791","last_scrub_stamp":"2024-03-28T13:50:47.026695+0000","last_deep_scrub":"29'791","last_deep_scrub_stamp":"2024-03-28T13:50:47.026695+0000","last_clean_scrub_stamp":"2024-03-28T13:50:47.026695+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:11:47.793890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":64976,"num_write":766,"num_write_kb":85207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"29'204","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:39.580695+0000","last_change":"2024-03-28T13:50:39.580695+0000","last_active":"2024-03-28T13:50:39.580695+0000","last_peered":"2024-03-28T13:50:39.580695+0000","last_clean":"2024-03-28T13:50:39.580695+0000","last_became_active":"2024-03-28T12:42:01.810207+0000","last_became_peered":"2024-03-28T12:42:01.810207+0000","last_unstale":"2024-03-28T13:50:39.580695+0000","last_undegraded":"2024-03-28T13:50:39.580695+0000","last_fullsized":"2024-03-28T13:50:39.580695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'204","last_scrub_stamp":"2024-03-28T13:50:39.580381+0000","last_deep_scrub":"29'204","last_deep_scrub_stamp":"2024-03-28T13:50:39.580381+0000","last_clean_scrub_stamp":"2024-03-28T13:50:39.580381+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:42:33.438892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'674","reported_seq":743,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:43.337423+0000","last_change":"2024-03-28T13:50:43.337476+0000","last_active":"2024-03-28T13:50:43.337423+0000","last_peered":"2024-03-28T13:50:43.337423+0000","last_clean":"2024-03-28T13:50:43.337423+0000","last_became_active":"2024-03-28T12:42:00.077988+0000","last_became_peered":"2024-03-28T12:42:00.077988+0000","last_unstale":"2024-03-28T13:50:43.337423+0000","last_undegraded":"2024-03-28T13:50:43.337423+0000","last_fullsized":"2024-03-28T13:50:43.337423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'674","last_scrub_stamp":"2024-03-28T13:50:43.337325+0000","last_deep_scrub":"29'674","last_deep_scrub_stamp":"2024-03-28T13:50:43.337325+0000","last_clean_scrub_stamp":"2024-03-28T13:50:43.337325+0000","objects_scrubbed":5,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:40:07.426746+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":609,"num_write_kb":8525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"29'762","reported_seq":859,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:47.617429+0000","last_change":"2024-03-28T13:50:47.617429+0000","last_active":"2024-03-28T13:50:47.617429+0000","last_peered":"2024-03-28T13:50:47.617429+0000","last_clean":"2024-03-28T13:50:47.617429+0000","last_became_active":"2024-03-28T12:42:07.935820+0000","last_became_peered":"2024-03-28T12:42:07.935820+0000","last_unstale":"2024-03-28T13:50:47.617429+0000","last_undegraded":"2024-03-28T13:50:47.617429+0000","last_fullsized":"2024-03-28T13:50:47.617429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'762","last_scrub_stamp":"2024-03-28T13:50:47.617274+0000","last_deep_scrub":"29'762","last_deep_scrub_stamp":"2024-03-28T13:50:47.617274+0000","last_clean_scrub_stamp":"2024-03-28T13:50:47.617274+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:59:01.940108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":124547,"num_write":741,"num_write_kb":143298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"29'211","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:37.784295+0000","last_change":"2024-03-28T13:50:37.784336+0000","last_active":"2024-03-28T13:50:37.784295+0000","last_peered":"2024-03-28T13:50:37.784295+0000","last_clean":"2024-03-28T13:50:37.784295+0000","last_became_active":"2024-03-28T12:42:01.965491+0000","last_became_peered":"2024-03-28T12:42:01.965491+0000","last_unstale":"2024-03-28T13:50:37.784295+0000","last_undegraded":"2024-03-28T13:50:37.784295+0000","last_fullsized":"2024-03-28T13:50:37.784295+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'211","last_scrub_stamp":"2024-03-28T13:50:37.784196+0000","last_deep_scrub":"29'211","last_deep_scrub_stamp":"2024-03-28T13:50:37.784196+0000","last_clean_scrub_stamp":"2024-03-28T13:50:37.784196+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:18:04.462285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"29'379","reported_seq":449,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:38.880299+0000","last_change":"2024-03-28T13:50:38.880299+0000","last_active":"2024-03-28T13:50:38.880299+0000","last_peered":"2024-03-28T13:50:38.880299+0000","last_clean":"2024-03-28T13:50:38.880299+0000","last_became_active":"2024-03-28T12:42:00.132939+0000","last_became_peered":"2024-03-28T12:42:00.132939+0000","last_unstale":"2024-03-28T13:50:38.880299+0000","last_undegraded":"2024-03-28T13:50:38.880299+0000","last_fullsized":"2024-03-28T13:50:38.880299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'379","last_scrub_stamp":"2024-03-28T13:50:38.880132+0000","last_deep_scrub":"29'379","last_deep_scrub_stamp":"2024-03-28T13:50:38.880132+0000","last_clean_scrub_stamp":"2024-03-28T13:50:38.880132+0000","objects_scrubbed":1,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:04:35.172470+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'754","reported_seq":822,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:45.630508+0000","last_change":"2024-03-28T13:50:45.630508+0000","last_active":"2024-03-28T13:50:45.630508+0000","last_peered":"2024-03-28T13:50:45.630508+0000","last_clean":"2024-03-28T13:50:45.630508+0000","last_became_active":"2024-03-28T12:42:07.864804+0000","last_became_peered":"2024-03-28T12:42:07.864804+0000","last_unstale":"2024-03-28T13:50:45.630508+0000","last_undegraded":"2024-03-28T13:50:45.630508+0000","last_fullsized":"2024-03-28T13:50:45.630508+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'754","last_scrub_stamp":"2024-03-28T13:50:45.630177+0000","last_deep_scrub":"29'754","last_deep_scrub_stamp":"2024-03-28T13:50:45.630177+0000","last_clean_scrub_stamp":"2024-03-28T13:50:45.630177+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:17:57.349218+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":19361,"num_write":730,"num_write_kb":84308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"29'202","reported_seq":269,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:45.570707+0000","last_change":"2024-03-28T13:50:45.570707+0000","last_active":"2024-03-28T13:50:45.570707+0000","last_peered":"2024-03-28T13:50:45.570707+0000","last_clean":"2024-03-28T13:50:45.570707+0000","last_became_active":"2024-03-28T12:42:01.962305+0000","last_became_peered":"2024-03-28T12:42:01.962305+0000","last_unstale":"2024-03-28T13:50:45.570707+0000","last_undegraded":"2024-03-28T13:50:45.570707+0000","last_fullsized":"2024-03-28T13:50:45.570707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'202","last_scrub_stamp":"2024-03-28T13:50:45.570617+0000","last_deep_scrub":"29'202","last_deep_scrub_stamp":"2024-03-28T13:50:45.570617+0000","last_clean_scrub_stamp":"2024-03-28T13:50:45.570617+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:22:56.444524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"29'903","reported_seq":973,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:47.221828+0000","last_change":"2024-03-28T13:50:47.221828+0000","last_active":"2024-03-28T13:50:47.221828+0000","last_peered":"2024-03-28T13:50:47.221828+0000","last_clean":"2024-03-28T13:50:47.221828+0000","last_became_active":"2024-03-28T12:42:00.137086+0000","last_became_peered":"2024-03-28T12:42:00.137086+0000","last_unstale":"2024-03-28T13:50:47.221828+0000","last_undegraded":"2024-03-28T13:50:47.221828+0000","last_fullsized":"2024-03-28T13:50:47.221828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'903","last_scrub_stamp":"2024-03-28T13:50:47.221739+0000","last_deep_scrub":"29'903","last_deep_scrub_stamp":"2024-03-28T13:50:47.221739+0000","last_clean_scrub_stamp":"2024-03-28T13:50:47.221739+0000","objects_scrubbed":4,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:02:15.244985+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389591,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":833,"num_write_kb":8592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'738","reported_seq":826,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:49.606555+0000","last_change":"2024-03-28T13:50:49.606555+0000","last_active":"2024-03-28T13:50:49.606555+0000","last_peered":"2024-03-28T13:50:49.606555+0000","last_clean":"2024-03-28T13:50:49.606555+0000","last_became_active":"2024-03-28T12:42:07.939926+0000","last_became_peered":"2024-03-28T12:42:07.939926+0000","last_unstale":"2024-03-28T13:50:49.606555+0000","last_undegraded":"2024-03-28T13:50:49.606555+0000","last_fullsized":"2024-03-28T13:50:49.606555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'738","last_scrub_stamp":"2024-03-28T13:50:49.606316+0000","last_deep_scrub":"29'738","last_deep_scrub_stamp":"2024-03-28T13:50:49.606316+0000","last_clean_scrub_stamp":"2024-03-28T13:50:49.606316+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:21:54.356707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":104657,"num_write":715,"num_write_kb":183622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"29'211","reported_seq":280,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:34.847647+0000","last_change":"2024-03-28T13:50:34.847685+0000","last_active":"2024-03-28T13:50:34.847647+0000","last_peered":"2024-03-28T13:50:34.847647+0000","last_clean":"2024-03-28T13:50:34.847647+0000","last_became_active":"2024-03-28T12:42:01.949046+0000","last_became_peered":"2024-03-28T12:42:01.949046+0000","last_unstale":"2024-03-28T13:50:34.847647+0000","last_undegraded":"2024-03-28T13:50:34.847647+0000","last_fullsized":"2024-03-28T13:50:34.847647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'211","last_scrub_stamp":"2024-03-28T13:50:34.847563+0000","last_deep_scrub":"29'211","last_deep_scrub_stamp":"2024-03-28T13:50:34.847563+0000","last_clean_scrub_stamp":"2024-03-28T13:50:34.847563+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:31:07.040827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1507","reported_seq":3012,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:38.849395+0000","last_change":"2024-03-28T13:50:38.849395+0000","last_active":"2024-03-28T13:50:38.849395+0000","last_peered":"2024-03-28T13:50:38.849395+0000","last_clean":"2024-03-28T13:50:38.849395+0000","last_became_active":"2024-03-28T12:42:00.150209+0000","last_became_peered":"2024-03-28T12:42:00.150209+0000","last_unstale":"2024-03-28T13:50:38.849395+0000","last_undegraded":"2024-03-28T13:50:38.849395+0000","last_fullsized":"2024-03-28T13:50:38.849395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1507","last_scrub_stamp":"2024-03-28T13:50:38.849238+0000","last_deep_scrub":"29'1507","last_deep_scrub_stamp":"2024-03-28T13:50:38.849238+0000","last_clean_scrub_stamp":"2024-03-28T13:50:38.849238+0000","objects_scrubbed":4,"log_size":1507,"log_dups_size":0,"ondisk_log_size":1507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:56:21.630343+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1566364,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1437,"num_read_kb":2622,"num_write":1444,"num_write_kb":2626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"29'706","reported_seq":794,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:46.658288+0000","last_change":"2024-03-28T13:50:46.658351+0000","last_active":"2024-03-28T13:50:46.658288+0000","last_peered":"2024-03-28T13:50:46.658288+0000","last_clean":"2024-03-28T13:50:46.658288+0000","last_became_active":"2024-03-28T12:42:07.935342+0000","last_became_peered":"2024-03-28T12:42:07.935342+0000","last_unstale":"2024-03-28T13:50:46.658288+0000","last_undegraded":"2024-03-28T13:50:46.658288+0000","last_fullsized":"2024-03-28T13:50:46.658288+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'706","last_scrub_stamp":"2024-03-28T13:50:46.658114+0000","last_deep_scrub":"29'706","last_deep_scrub_stamp":"2024-03-28T13:50:46.658114+0000","last_clean_scrub_stamp":"2024-03-28T13:50:46.658114+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:28:29.671466+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":64573,"num_write":698,"num_write_kb":72611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"29'198","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:44.620928+0000","last_change":"2024-03-28T13:50:44.620928+0000","last_active":"2024-03-28T13:50:44.620928+0000","last_peered":"2024-03-28T13:50:44.620928+0000","last_clean":"2024-03-28T13:50:44.620928+0000","last_became_active":"2024-03-28T12:42:01.961228+0000","last_became_peered":"2024-03-28T12:42:01.961228+0000","last_unstale":"2024-03-28T13:50:44.620928+0000","last_undegraded":"2024-03-28T13:50:44.620928+0000","last_fullsized":"2024-03-28T13:50:44.620928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'198","last_scrub_stamp":"2024-03-28T13:50:44.620711+0000","last_deep_scrub":"29'198","last_deep_scrub_stamp":"2024-03-28T13:50:44.620711+0000","last_clean_scrub_stamp":"2024-03-28T13:50:44.620711+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:06:58.707985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'521","reported_seq":592,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:42.318729+0000","last_change":"2024-03-28T13:50:42.318777+0000","last_active":"2024-03-28T13:50:42.318729+0000","last_peered":"2024-03-28T13:50:42.318729+0000","last_clean":"2024-03-28T13:50:42.318729+0000","last_became_active":"2024-03-28T12:42:00.069134+0000","last_became_peered":"2024-03-28T12:42:00.069134+0000","last_unstale":"2024-03-28T13:50:42.318729+0000","last_undegraded":"2024-03-28T13:50:42.318729+0000","last_fullsized":"2024-03-28T13:50:42.318729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'521","last_scrub_stamp":"2024-03-28T13:50:42.318637+0000","last_deep_scrub":"29'521","last_deep_scrub_stamp":"2024-03-28T13:50:42.318637+0000","last_clean_scrub_stamp":"2024-03-28T13:50:42.318637+0000","objects_scrubbed":4,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:33:44.831690+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":460,"num_write_kb":12504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"29'872","reported_seq":980,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:53.942751+0000","last_change":"2024-03-28T13:50:53.942811+0000","last_active":"2024-03-28T13:50:53.942751+0000","last_peered":"2024-03-28T13:50:53.942751+0000","last_clean":"2024-03-28T13:50:53.942751+0000","last_became_active":"2024-03-28T12:42:15.364496+0000","last_became_peered":"2024-03-28T12:42:15.364496+0000","last_unstale":"2024-03-28T13:50:53.942751+0000","last_undegraded":"2024-03-28T13:50:53.942751+0000","last_fullsized":"2024-03-28T13:50:53.942751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'872","last_scrub_stamp":"2024-03-28T13:50:53.942588+0000","last_deep_scrub":"29'872","last_deep_scrub_stamp":"2024-03-28T13:50:53.942588+0000","last_clean_scrub_stamp":"2024-03-28T13:50:53.942588+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:58:25.422824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":158824,"num_write":857,"num_write_kb":176540,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,6,1],"acting":[5,0,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"29'188","reported_seq":256,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:44.090443+0000","last_change":"2024-03-28T13:50:44.090443+0000","last_active":"2024-03-28T13:50:44.090443+0000","last_peered":"2024-03-28T13:50:44.090443+0000","last_clean":"2024-03-28T13:50:44.090443+0000","last_became_active":"2024-03-28T12:42:01.958117+0000","last_became_peered":"2024-03-28T12:42:01.958117+0000","last_unstale":"2024-03-28T13:50:44.090443+0000","last_undegraded":"2024-03-28T13:50:44.090443+0000","last_fullsized":"2024-03-28T13:50:44.090443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'188","last_scrub_stamp":"2024-03-28T13:50:44.090232+0000","last_deep_scrub":"29'188","last_deep_scrub_stamp":"2024-03-28T13:50:44.090232+0000","last_clean_scrub_stamp":"2024-03-28T13:50:44.090232+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:58:58.413066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"29'280","reported_seq":350,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:45.295465+0000","last_change":"2024-03-28T13:50:45.295465+0000","last_active":"2024-03-28T13:50:45.295465+0000","last_peered":"2024-03-28T13:50:45.295465+0000","last_clean":"2024-03-28T13:50:45.295465+0000","last_became_active":"2024-03-28T12:42:00.133540+0000","last_became_peered":"2024-03-28T12:42:00.133540+0000","last_unstale":"2024-03-28T13:50:45.295465+0000","last_undegraded":"2024-03-28T13:50:45.295465+0000","last_fullsized":"2024-03-28T13:50:45.295465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'280","last_scrub_stamp":"2024-03-28T13:50:45.295373+0000","last_deep_scrub":"29'280","last_deep_scrub_stamp":"2024-03-28T13:50:45.295373+0000","last_clean_scrub_stamp":"2024-03-28T13:50:45.295373+0000","objects_scrubbed":6,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:36:32.995254+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":227,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:30.763843+0000","last_change":"2024-03-28T13:50:30.763892+0000","last_active":"2024-03-28T13:50:30.763843+0000","last_peered":"2024-03-28T13:50:30.763843+0000","last_clean":"2024-03-28T13:50:30.763843+0000","last_became_active":"2024-03-28T12:41:26.700338+0000","last_became_peered":"2024-03-28T12:41:26.700338+0000","last_unstale":"2024-03-28T13:50:30.763843+0000","last_undegraded":"2024-03-28T13:50:30.763843+0000","last_fullsized":"2024-03-28T13:50:30.763843+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-03-28T13:50:30.763743+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-03-28T13:50:30.763743+0000","last_clean_scrub_stamp":"2024-03-28T13:50:30.763743+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:47:39.284116+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'778","reported_seq":863,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:55.277051+0000","last_change":"2024-03-28T13:50:55.277074+0000","last_active":"2024-03-28T13:50:55.277051+0000","last_peered":"2024-03-28T13:50:55.277051+0000","last_clean":"2024-03-28T13:50:55.277051+0000","last_became_active":"2024-03-28T12:42:07.937553+0000","last_became_peered":"2024-03-28T12:42:07.937553+0000","last_unstale":"2024-03-28T13:50:55.277051+0000","last_undegraded":"2024-03-28T13:50:55.277051+0000","last_fullsized":"2024-03-28T13:50:55.277051+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'778","last_scrub_stamp":"2024-03-28T13:50:55.276973+0000","last_deep_scrub":"29'778","last_deep_scrub_stamp":"2024-03-28T13:50:55.276973+0000","last_clean_scrub_stamp":"2024-03-28T13:50:55.276973+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:35:22.325753+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":72658,"num_write":755,"num_write_kb":105142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"29'211","reported_seq":276,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:40.230778+0000","last_change":"2024-03-28T13:50:40.230818+0000","last_active":"2024-03-28T13:50:40.230778+0000","last_peered":"2024-03-28T13:50:40.230778+0000","last_clean":"2024-03-28T13:50:40.230778+0000","last_became_active":"2024-03-28T12:42:01.959809+0000","last_became_peered":"2024-03-28T12:42:01.959809+0000","last_unstale":"2024-03-28T13:50:40.230778+0000","last_undegraded":"2024-03-28T13:50:40.230778+0000","last_fullsized":"2024-03-28T13:50:40.230778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'211","last_scrub_stamp":"2024-03-28T13:50:40.230703+0000","last_deep_scrub":"29'211","last_deep_scrub_stamp":"2024-03-28T13:50:40.230703+0000","last_clean_scrub_stamp":"2024-03-28T13:50:40.230703+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:59:20.011270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"29'371","reported_seq":437,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:37.661296+0000","last_change":"2024-03-28T13:50:37.661348+0000","last_active":"2024-03-28T13:50:37.661296+0000","last_peered":"2024-03-28T13:50:37.661296+0000","last_clean":"2024-03-28T13:50:37.661296+0000","last_became_active":"2024-03-28T12:42:00.143460+0000","last_became_peered":"2024-03-28T12:42:00.143460+0000","last_unstale":"2024-03-28T13:50:37.661296+0000","last_undegraded":"2024-03-28T13:50:37.661296+0000","last_fullsized":"2024-03-28T13:50:37.661296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'371","last_scrub_stamp":"2024-03-28T13:50:37.661188+0000","last_deep_scrub":"29'371","last_deep_scrub_stamp":"2024-03-28T13:50:37.661188+0000","last_clean_scrub_stamp":"2024-03-28T13:50:37.661188+0000","objects_scrubbed":4,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:42:00.763783+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195869,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":4241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"29'802","reported_seq":896,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:39.804336+0000","last_change":"2024-03-28T13:50:39.804377+0000","last_active":"2024-03-28T13:50:39.804336+0000","last_peered":"2024-03-28T13:50:39.804336+0000","last_clean":"2024-03-28T13:50:39.804336+0000","last_became_active":"2024-03-28T12:42:07.902428+0000","last_became_peered":"2024-03-28T12:42:07.902428+0000","last_unstale":"2024-03-28T13:50:39.804336+0000","last_undegraded":"2024-03-28T13:50:39.804336+0000","last_fullsized":"2024-03-28T13:50:39.804336+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'802","last_scrub_stamp":"2024-03-28T13:50:39.804224+0000","last_deep_scrub":"29'802","last_deep_scrub_stamp":"2024-03-28T13:50:39.804224+0000","last_clean_scrub_stamp":"2024-03-28T13:50:39.804224+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:06:53.891498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":87583,"num_write":773,"num_write_kb":126746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'226","reported_seq":290,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:40.585334+0000","last_change":"2024-03-28T13:50:40.585373+0000","last_active":"2024-03-28T13:50:40.585334+0000","last_peered":"2024-03-28T13:50:40.585334+0000","last_clean":"2024-03-28T13:50:40.585334+0000","last_became_active":"2024-03-28T12:42:01.950592+0000","last_became_peered":"2024-03-28T12:42:01.950592+0000","last_unstale":"2024-03-28T13:50:40.585334+0000","last_undegraded":"2024-03-28T13:50:40.585334+0000","last_fullsized":"2024-03-28T13:50:40.585334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'226","last_scrub_stamp":"2024-03-28T13:50:40.585263+0000","last_deep_scrub":"29'226","last_deep_scrub_stamp":"2024-03-28T13:50:40.585263+0000","last_clean_scrub_stamp":"2024-03-28T13:50:40.585263+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:21:45.335653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'819","reported_seq":886,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:41.903345+0000","last_change":"2024-03-28T13:50:41.903393+0000","last_active":"2024-03-28T13:50:41.903345+0000","last_peered":"2024-03-28T13:50:41.903345+0000","last_clean":"2024-03-28T13:50:41.903345+0000","last_became_active":"2024-03-28T12:42:00.139237+0000","last_became_peered":"2024-03-28T12:42:00.139237+0000","last_unstale":"2024-03-28T13:50:41.903345+0000","last_undegraded":"2024-03-28T13:50:41.903345+0000","last_fullsized":"2024-03-28T13:50:41.903345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'819","last_scrub_stamp":"2024-03-28T13:50:41.903247+0000","last_deep_scrub":"29'819","last_deep_scrub_stamp":"2024-03-28T13:50:41.903247+0000","last_clean_scrub_stamp":"2024-03-28T13:50:41.903247+0000","objects_scrubbed":2,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:09:01.387326+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":4460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'797","reported_seq":896,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:49.915293+0000","last_change":"2024-03-28T13:50:49.915338+0000","last_active":"2024-03-28T13:50:49.915293+0000","last_peered":"2024-03-28T13:50:49.915293+0000","last_clean":"2024-03-28T13:50:49.915293+0000","last_became_active":"2024-03-28T12:42:07.880300+0000","last_became_peered":"2024-03-28T12:42:07.880300+0000","last_unstale":"2024-03-28T13:50:49.915293+0000","last_undegraded":"2024-03-28T13:50:49.915293+0000","last_fullsized":"2024-03-28T13:50:49.915293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'797","last_scrub_stamp":"2024-03-28T13:50:49.915168+0000","last_deep_scrub":"29'797","last_deep_scrub_stamp":"2024-03-28T13:50:49.915168+0000","last_clean_scrub_stamp":"2024-03-28T13:50:49.915168+0000","objects_scrubbed":0,"log_size":797,"log_dups_size":0,"ondisk_log_size":797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:40:14.004589+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":105873,"num_write":776,"num_write_kb":138943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"29'201","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:44.571215+0000","last_change":"2024-03-28T13:50:44.571236+0000","last_active":"2024-03-28T13:50:44.571215+0000","last_peered":"2024-03-28T13:50:44.571215+0000","last_clean":"2024-03-28T13:50:44.571215+0000","last_became_active":"2024-03-28T12:42:01.962604+0000","last_became_peered":"2024-03-28T12:42:01.962604+0000","last_unstale":"2024-03-28T13:50:44.571215+0000","last_undegraded":"2024-03-28T13:50:44.571215+0000","last_fullsized":"2024-03-28T13:50:44.571215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'201","last_scrub_stamp":"2024-03-28T13:50:44.571144+0000","last_deep_scrub":"29'201","last_deep_scrub_stamp":"2024-03-28T13:50:44.571144+0000","last_clean_scrub_stamp":"2024-03-28T13:50:44.571144+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:56:15.590537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'796","reported_seq":863,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:36.191773+0000","last_change":"2024-03-28T13:50:36.191831+0000","last_active":"2024-03-28T13:50:36.191773+0000","last_peered":"2024-03-28T13:50:36.191773+0000","last_clean":"2024-03-28T13:50:36.191773+0000","last_became_active":"2024-03-28T12:42:00.084866+0000","last_became_peered":"2024-03-28T12:42:00.084866+0000","last_unstale":"2024-03-28T13:50:36.191773+0000","last_undegraded":"2024-03-28T13:50:36.191773+0000","last_fullsized":"2024-03-28T13:50:36.191773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'796","last_scrub_stamp":"2024-03-28T13:50:36.191649+0000","last_deep_scrub":"29'796","last_deep_scrub_stamp":"2024-03-28T13:50:36.191649+0000","last_clean_scrub_stamp":"2024-03-28T13:50:36.191649+0000","objects_scrubbed":3,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:39:29.454913+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":734,"num_write_kb":4434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"29'769","reported_seq":856,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:53.308832+0000","last_change":"2024-03-28T13:50:53.308882+0000","last_active":"2024-03-28T13:50:53.308832+0000","last_peered":"2024-03-28T13:50:53.308832+0000","last_clean":"2024-03-28T13:50:53.308832+0000","last_became_active":"2024-03-28T12:42:07.898853+0000","last_became_peered":"2024-03-28T12:42:07.898853+0000","last_unstale":"2024-03-28T13:50:53.308832+0000","last_undegraded":"2024-03-28T13:50:53.308832+0000","last_fullsized":"2024-03-28T13:50:53.308832+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'769","last_scrub_stamp":"2024-03-28T13:50:53.308669+0000","last_deep_scrub":"29'769","last_deep_scrub_stamp":"2024-03-28T13:50:53.308669+0000","last_clean_scrub_stamp":"2024-03-28T13:50:53.308669+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:47:46.855239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":96622,"num_write":756,"num_write_kb":72915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"29'187","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:33.814913+0000","last_change":"2024-03-28T13:50:33.814955+0000","last_active":"2024-03-28T13:50:33.814913+0000","last_peered":"2024-03-28T13:50:33.814913+0000","last_clean":"2024-03-28T13:50:33.814913+0000","last_became_active":"2024-03-28T12:42:01.964442+0000","last_became_peered":"2024-03-28T12:42:01.964442+0000","last_unstale":"2024-03-28T13:50:33.814913+0000","last_undegraded":"2024-03-28T13:50:33.814913+0000","last_fullsized":"2024-03-28T13:50:33.814913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'187","last_scrub_stamp":"2024-03-28T13:50:33.814786+0000","last_deep_scrub":"29'187","last_deep_scrub_stamp":"2024-03-28T13:50:33.814786+0000","last_clean_scrub_stamp":"2024-03-28T13:50:33.814786+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:17:12.873229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'910","reported_seq":976,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:36.625061+0000","last_change":"2024-03-28T13:50:36.625113+0000","last_active":"2024-03-28T13:50:36.625061+0000","last_peered":"2024-03-28T13:50:36.625061+0000","last_clean":"2024-03-28T13:50:36.625061+0000","last_became_active":"2024-03-28T12:42:00.153292+0000","last_became_peered":"2024-03-28T12:42:00.153292+0000","last_unstale":"2024-03-28T13:50:36.625061+0000","last_undegraded":"2024-03-28T13:50:36.625061+0000","last_fullsized":"2024-03-28T13:50:36.625061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'910","last_scrub_stamp":"2024-03-28T13:50:36.624986+0000","last_deep_scrub":"29'910","last_deep_scrub_stamp":"2024-03-28T13:50:36.624986+0000","last_clean_scrub_stamp":"2024-03-28T13:50:36.624986+0000","objects_scrubbed":3,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:39:45.015909+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1005,"num_write_kb":4546,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"29'806","reported_seq":895,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:37.698842+0000","last_change":"2024-03-28T13:50:37.698864+0000","last_active":"2024-03-28T13:50:37.698842+0000","last_peered":"2024-03-28T13:50:37.698842+0000","last_clean":"2024-03-28T13:50:37.698842+0000","last_became_active":"2024-03-28T12:42:07.899780+0000","last_became_peered":"2024-03-28T12:42:07.899780+0000","last_unstale":"2024-03-28T13:50:37.698842+0000","last_undegraded":"2024-03-28T13:50:37.698842+0000","last_fullsized":"2024-03-28T13:50:37.698842+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'806","last_scrub_stamp":"2024-03-28T13:50:37.698770+0000","last_deep_scrub":"29'806","last_deep_scrub_stamp":"2024-03-28T13:50:37.698770+0000","last_clean_scrub_stamp":"2024-03-28T13:50:37.698770+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:13:56.984576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":86897,"num_write":794,"num_write_kb":118337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"29'234","reported_seq":298,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:50.255020+0000","last_change":"2024-03-28T13:50:50.255058+0000","last_active":"2024-03-28T13:50:50.255020+0000","last_peered":"2024-03-28T13:50:50.255020+0000","last_clean":"2024-03-28T13:50:50.255020+0000","last_became_active":"2024-03-28T12:42:01.961938+0000","last_became_peered":"2024-03-28T12:42:01.961938+0000","last_unstale":"2024-03-28T13:50:50.255020+0000","last_undegraded":"2024-03-28T13:50:50.255020+0000","last_fullsized":"2024-03-28T13:50:50.255020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'234","last_scrub_stamp":"2024-03-28T13:50:50.254915+0000","last_deep_scrub":"29'234","last_deep_scrub_stamp":"2024-03-28T13:50:50.254915+0000","last_clean_scrub_stamp":"2024-03-28T13:50:50.254915+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:01:42.510829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'487","reported_seq":553,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:37.170121+0000","last_change":"2024-03-28T13:50:37.170167+0000","last_active":"2024-03-28T13:50:37.170121+0000","last_peered":"2024-03-28T13:50:37.170121+0000","last_clean":"2024-03-28T13:50:37.170121+0000","last_became_active":"2024-03-28T12:42:00.131064+0000","last_became_peered":"2024-03-28T12:42:00.131064+0000","last_unstale":"2024-03-28T13:50:37.170121+0000","last_undegraded":"2024-03-28T13:50:37.170121+0000","last_fullsized":"2024-03-28T13:50:37.170121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'487","last_scrub_stamp":"2024-03-28T13:50:37.170058+0000","last_deep_scrub":"29'487","last_deep_scrub_stamp":"2024-03-28T13:50:37.170058+0000","last_clean_scrub_stamp":"2024-03-28T13:50:37.170058+0000","objects_scrubbed":10,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:46:14.955083+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":8385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"29'776","reported_seq":867,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:51.948742+0000","last_change":"2024-03-28T13:50:51.948823+0000","last_active":"2024-03-28T13:50:51.948742+0000","last_peered":"2024-03-28T13:50:51.948742+0000","last_clean":"2024-03-28T13:50:51.948742+0000","last_became_active":"2024-03-28T12:42:07.886685+0000","last_became_peered":"2024-03-28T12:42:07.886685+0000","last_unstale":"2024-03-28T13:50:51.948742+0000","last_undegraded":"2024-03-28T13:50:51.948742+0000","last_fullsized":"2024-03-28T13:50:51.948742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'776","last_scrub_stamp":"2024-03-28T13:50:51.948563+0000","last_deep_scrub":"29'776","last_deep_scrub_stamp":"2024-03-28T13:50:51.948563+0000","last_clean_scrub_stamp":"2024-03-28T13:50:51.948563+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:42:44.113149+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":115085,"num_write":757,"num_write_kb":114512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'216","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:32.710688+0000","last_change":"2024-03-28T13:50:32.710726+0000","last_active":"2024-03-28T13:50:32.710688+0000","last_peered":"2024-03-28T13:50:32.710688+0000","last_clean":"2024-03-28T13:50:32.710688+0000","last_became_active":"2024-03-28T12:42:01.960102+0000","last_became_peered":"2024-03-28T12:42:01.960102+0000","last_unstale":"2024-03-28T13:50:32.710688+0000","last_undegraded":"2024-03-28T13:50:32.710688+0000","last_fullsized":"2024-03-28T13:50:32.710688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'216","last_scrub_stamp":"2024-03-28T13:50:32.710580+0000","last_deep_scrub":"29'216","last_deep_scrub_stamp":"2024-03-28T13:50:32.710580+0000","last_clean_scrub_stamp":"2024-03-28T13:50:32.710580+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:43:35.159119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"29'67","reported_seq":132,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:31.598221+0000","last_change":"2024-03-28T13:50:31.598267+0000","last_active":"2024-03-28T13:50:31.598221+0000","last_peered":"2024-03-28T13:50:31.598221+0000","last_clean":"2024-03-28T13:50:31.598221+0000","last_became_active":"2024-03-28T12:42:00.144572+0000","last_became_peered":"2024-03-28T12:42:00.144572+0000","last_unstale":"2024-03-28T13:50:31.598221+0000","last_undegraded":"2024-03-28T13:50:31.598221+0000","last_fullsized":"2024-03-28T13:50:31.598221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'67","last_scrub_stamp":"2024-03-28T13:50:31.598128+0000","last_deep_scrub":"29'67","last_deep_scrub_stamp":"2024-03-28T13:50:31.598128+0000","last_clean_scrub_stamp":"2024-03-28T13:50:31.598128+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:26:32.514801+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"29'777","reported_seq":847,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:50.939039+0000","last_change":"2024-03-28T13:50:50.939084+0000","last_active":"2024-03-28T13:50:50.939039+0000","last_peered":"2024-03-28T13:50:50.939039+0000","last_clean":"2024-03-28T13:50:50.939039+0000","last_became_active":"2024-03-28T12:42:07.884760+0000","last_became_peered":"2024-03-28T12:42:07.884760+0000","last_unstale":"2024-03-28T13:50:50.939039+0000","last_undegraded":"2024-03-28T13:50:50.939039+0000","last_fullsized":"2024-03-28T13:50:50.939039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'777","last_scrub_stamp":"2024-03-28T13:50:50.938922+0000","last_deep_scrub":"29'777","last_deep_scrub_stamp":"2024-03-28T13:50:50.938922+0000","last_clean_scrub_stamp":"2024-03-28T13:50:50.938922+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:44:08.400290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":41596,"num_write":756,"num_write_kb":91419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'203","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:34.322383+0000","last_change":"2024-03-28T13:50:34.322404+0000","last_active":"2024-03-28T13:50:34.322383+0000","last_peered":"2024-03-28T13:50:34.322383+0000","last_clean":"2024-03-28T13:50:34.322383+0000","last_became_active":"2024-03-28T12:42:01.936080+0000","last_became_peered":"2024-03-28T12:42:01.936080+0000","last_unstale":"2024-03-28T13:50:34.322383+0000","last_undegraded":"2024-03-28T13:50:34.322383+0000","last_fullsized":"2024-03-28T13:50:34.322383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'203","last_scrub_stamp":"2024-03-28T13:50:34.322311+0000","last_deep_scrub":"29'203","last_deep_scrub_stamp":"2024-03-28T13:50:34.322311+0000","last_clean_scrub_stamp":"2024-03-28T13:50:34.322311+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:09:54.413320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"29'59","reported_seq":125,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:48.230702+0000","last_change":"2024-03-28T13:50:48.230728+0000","last_active":"2024-03-28T13:50:48.230702+0000","last_peered":"2024-03-28T13:50:48.230702+0000","last_clean":"2024-03-28T13:50:48.230702+0000","last_became_active":"2024-03-28T12:42:00.138555+0000","last_became_peered":"2024-03-28T12:42:00.138555+0000","last_unstale":"2024-03-28T13:50:48.230702+0000","last_undegraded":"2024-03-28T13:50:48.230702+0000","last_fullsized":"2024-03-28T13:50:48.230702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'59","last_scrub_stamp":"2024-03-28T13:50:48.230645+0000","last_deep_scrub":"29'59","last_deep_scrub_stamp":"2024-03-28T13:50:48.230645+0000","last_clean_scrub_stamp":"2024-03-28T13:50:48.230645+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:55:22.484835+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"29'757","reported_seq":867,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:48.599533+0000","last_change":"2024-03-28T13:50:48.599555+0000","last_active":"2024-03-28T13:50:48.599533+0000","last_peered":"2024-03-28T13:50:48.599533+0000","last_clean":"2024-03-28T13:50:48.599533+0000","last_became_active":"2024-03-28T12:42:07.939396+0000","last_became_peered":"2024-03-28T12:42:07.939396+0000","last_unstale":"2024-03-28T13:50:48.599533+0000","last_undegraded":"2024-03-28T13:50:48.599533+0000","last_fullsized":"2024-03-28T13:50:48.599533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'757","last_scrub_stamp":"2024-03-28T13:50:48.599458+0000","last_deep_scrub":"29'757","last_deep_scrub_stamp":"2024-03-28T13:50:48.599458+0000","last_clean_scrub_stamp":"2024-03-28T13:50:48.599458+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:48:41.684795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":181074,"num_write":742,"num_write_kb":169009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"29'212","reported_seq":275,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:38.592081+0000","last_change":"2024-03-28T13:50:38.592190+0000","last_active":"2024-03-28T13:50:38.592081+0000","last_peered":"2024-03-28T13:50:38.592081+0000","last_clean":"2024-03-28T13:50:38.592081+0000","last_became_active":"2024-03-28T12:42:01.799594+0000","last_became_peered":"2024-03-28T12:42:01.799594+0000","last_unstale":"2024-03-28T13:50:38.592081+0000","last_undegraded":"2024-03-28T13:50:38.592081+0000","last_fullsized":"2024-03-28T13:50:38.592081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'212","last_scrub_stamp":"2024-03-28T13:50:38.591819+0000","last_deep_scrub":"29'212","last_deep_scrub_stamp":"2024-03-28T13:50:38.591819+0000","last_clean_scrub_stamp":"2024-03-28T13:50:38.591819+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:17:17.650263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'351","reported_seq":415,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:37.854173+0000","last_change":"2024-03-28T13:50:37.854224+0000","last_active":"2024-03-28T13:50:37.854173+0000","last_peered":"2024-03-28T13:50:37.854173+0000","last_clean":"2024-03-28T13:50:37.854173+0000","last_became_active":"2024-03-28T12:42:00.142913+0000","last_became_peered":"2024-03-28T12:42:00.142913+0000","last_unstale":"2024-03-28T13:50:37.854173+0000","last_undegraded":"2024-03-28T13:50:37.854173+0000","last_fullsized":"2024-03-28T13:50:37.854173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'351","last_scrub_stamp":"2024-03-28T13:50:37.854058+0000","last_deep_scrub":"29'351","last_deep_scrub_stamp":"2024-03-28T13:50:37.854058+0000","last_clean_scrub_stamp":"2024-03-28T13:50:37.854058+0000","objects_scrubbed":8,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:09:39.401689+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":8326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"29'745","reported_seq":828,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:56.247373+0000","last_change":"2024-03-28T13:50:56.247396+0000","last_active":"2024-03-28T13:50:56.247373+0000","last_peered":"2024-03-28T13:50:56.247373+0000","last_clean":"2024-03-28T13:50:56.247373+0000","last_became_active":"2024-03-28T12:42:07.938081+0000","last_became_peered":"2024-03-28T12:42:07.938081+0000","last_unstale":"2024-03-28T13:50:56.247373+0000","last_undegraded":"2024-03-28T13:50:56.247373+0000","last_fullsized":"2024-03-28T13:50:56.247373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'745","last_scrub_stamp":"2024-03-28T13:50:56.247305+0000","last_deep_scrub":"29'745","last_deep_scrub_stamp":"2024-03-28T13:50:56.247305+0000","last_clean_scrub_stamp":"2024-03-28T13:50:56.247305+0000","objects_scrubbed":0,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:43:44.287910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":86453,"num_write":732,"num_write_kb":138137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'202","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:38.607760+0000","last_change":"2024-03-28T13:50:38.607801+0000","last_active":"2024-03-28T13:50:38.607760+0000","last_peered":"2024-03-28T13:50:38.607760+0000","last_clean":"2024-03-28T13:50:38.607760+0000","last_became_active":"2024-03-28T12:42:01.938251+0000","last_became_peered":"2024-03-28T12:42:01.938251+0000","last_unstale":"2024-03-28T13:50:38.607760+0000","last_undegraded":"2024-03-28T13:50:38.607760+0000","last_fullsized":"2024-03-28T13:50:38.607760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'202","last_scrub_stamp":"2024-03-28T13:50:38.607628+0000","last_deep_scrub":"29'202","last_deep_scrub_stamp":"2024-03-28T13:50:38.607628+0000","last_clean_scrub_stamp":"2024-03-28T13:50:38.607628+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:58:52.930462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'891","reported_seq":956,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:31.831440+0000","last_change":"2024-03-28T13:50:31.831475+0000","last_active":"2024-03-28T13:50:31.831440+0000","last_peered":"2024-03-28T13:50:31.831440+0000","last_clean":"2024-03-28T13:50:31.831440+0000","last_became_active":"2024-03-28T12:42:00.140832+0000","last_became_peered":"2024-03-28T12:42:00.140832+0000","last_unstale":"2024-03-28T13:50:31.831440+0000","last_undegraded":"2024-03-28T13:50:31.831440+0000","last_fullsized":"2024-03-28T13:50:31.831440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'891","last_scrub_stamp":"2024-03-28T13:50:31.831379+0000","last_deep_scrub":"29'891","last_deep_scrub_stamp":"2024-03-28T13:50:31.831379+0000","last_clean_scrub_stamp":"2024-03-28T13:50:31.831379+0000","objects_scrubbed":8,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:36:22.487878+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":844,"num_write_kb":12856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"29'810","reported_seq":909,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:50.080380+0000","last_change":"2024-03-28T13:50:50.080432+0000","last_active":"2024-03-28T13:50:50.080380+0000","last_peered":"2024-03-28T13:50:50.080380+0000","last_clean":"2024-03-28T13:50:50.080380+0000","last_became_active":"2024-03-28T12:42:07.936606+0000","last_became_peered":"2024-03-28T12:42:07.936606+0000","last_unstale":"2024-03-28T13:50:50.080380+0000","last_undegraded":"2024-03-28T13:50:50.080380+0000","last_fullsized":"2024-03-28T13:50:50.080380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'810","last_scrub_stamp":"2024-03-28T13:50:50.080263+0000","last_deep_scrub":"29'810","last_deep_scrub_stamp":"2024-03-28T13:50:50.080263+0000","last_clean_scrub_stamp":"2024-03-28T13:50:50.080263+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:27:23.169165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":136867,"num_write":788,"num_write_kb":148031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"29'206","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:51.301846+0000","last_change":"2024-03-28T13:50:51.301886+0000","last_active":"2024-03-28T13:50:51.301846+0000","last_peered":"2024-03-28T13:50:51.301846+0000","last_clean":"2024-03-28T13:50:51.301846+0000","last_became_active":"2024-03-28T12:42:01.962546+0000","last_became_peered":"2024-03-28T12:42:01.962546+0000","last_unstale":"2024-03-28T13:50:51.301846+0000","last_undegraded":"2024-03-28T13:50:51.301846+0000","last_fullsized":"2024-03-28T13:50:51.301846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'206","last_scrub_stamp":"2024-03-28T13:50:51.301743+0000","last_deep_scrub":"29'206","last_deep_scrub_stamp":"2024-03-28T13:50:51.301743+0000","last_clean_scrub_stamp":"2024-03-28T13:50:51.301743+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:39:34.300465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'1095","reported_seq":1158,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:36.824652+0000","last_change":"2024-03-28T13:50:36.824721+0000","last_active":"2024-03-28T13:50:36.824652+0000","last_peered":"2024-03-28T13:50:36.824652+0000","last_clean":"2024-03-28T13:50:36.824652+0000","last_became_active":"2024-03-28T12:42:00.138233+0000","last_became_peered":"2024-03-28T12:42:00.138233+0000","last_unstale":"2024-03-28T13:50:36.824652+0000","last_undegraded":"2024-03-28T13:50:36.824652+0000","last_fullsized":"2024-03-28T13:50:36.824652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1095","last_scrub_stamp":"2024-03-28T13:50:36.824535+0000","last_deep_scrub":"29'1095","last_deep_scrub_stamp":"2024-03-28T13:50:36.824535+0000","last_clean_scrub_stamp":"2024-03-28T13:50:36.824535+0000","objects_scrubbed":5,"log_size":1095,"log_dups_size":0,"ondisk_log_size":1095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:56:31.983876+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":5033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"29'724","reported_seq":805,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:44.769943+0000","last_change":"2024-03-28T13:50:44.770003+0000","last_active":"2024-03-28T13:50:44.769943+0000","last_peered":"2024-03-28T13:50:44.769943+0000","last_clean":"2024-03-28T13:50:44.769943+0000","last_became_active":"2024-03-28T12:42:07.906334+0000","last_became_peered":"2024-03-28T12:42:07.906334+0000","last_unstale":"2024-03-28T13:50:44.769943+0000","last_undegraded":"2024-03-28T13:50:44.769943+0000","last_fullsized":"2024-03-28T13:50:44.769943+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'724","last_scrub_stamp":"2024-03-28T13:50:44.769796+0000","last_deep_scrub":"29'724","last_deep_scrub_stamp":"2024-03-28T13:50:44.769796+0000","last_clean_scrub_stamp":"2024-03-28T13:50:44.769796+0000","objects_scrubbed":0,"log_size":724,"log_dups_size":0,"ondisk_log_size":724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:21:49.520187+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":82415,"num_write":704,"num_write_kb":118989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"29'201","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:43.914368+0000","last_change":"2024-03-28T13:50:43.914487+0000","last_active":"2024-03-28T13:50:43.914368+0000","last_peered":"2024-03-28T13:50:43.914368+0000","last_clean":"2024-03-28T13:50:43.914368+0000","last_became_active":"2024-03-28T12:42:01.805284+0000","last_became_peered":"2024-03-28T12:42:01.805284+0000","last_unstale":"2024-03-28T13:50:43.914368+0000","last_undegraded":"2024-03-28T13:50:43.914368+0000","last_fullsized":"2024-03-28T13:50:43.914368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'201","last_scrub_stamp":"2024-03-28T13:50:43.914164+0000","last_deep_scrub":"29'201","last_deep_scrub_stamp":"2024-03-28T13:50:43.914164+0000","last_clean_scrub_stamp":"2024-03-28T13:50:43.914164+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:37:27.415635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"29'404","reported_seq":468,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:33.602958+0000","last_change":"2024-03-28T13:50:33.603011+0000","last_active":"2024-03-28T13:50:33.602958+0000","last_peered":"2024-03-28T13:50:33.602958+0000","last_clean":"2024-03-28T13:50:33.602958+0000","last_became_active":"2024-03-28T12:42:00.147407+0000","last_became_peered":"2024-03-28T12:42:00.147407+0000","last_unstale":"2024-03-28T13:50:33.602958+0000","last_undegraded":"2024-03-28T13:50:33.602958+0000","last_fullsized":"2024-03-28T13:50:33.602958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'404","last_scrub_stamp":"2024-03-28T13:50:33.602852+0000","last_deep_scrub":"29'404","last_deep_scrub_stamp":"2024-03-28T13:50:33.602852+0000","last_clean_scrub_stamp":"2024-03-28T13:50:33.602852+0000","objects_scrubbed":3,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:18:00.280941+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'847","reported_seq":936,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:43.813145+0000","last_change":"2024-03-28T13:50:43.813188+0000","last_active":"2024-03-28T13:50:43.813145+0000","last_peered":"2024-03-28T13:50:43.813145+0000","last_clean":"2024-03-28T13:50:43.813145+0000","last_became_active":"2024-03-28T12:42:07.899628+0000","last_became_peered":"2024-03-28T12:42:07.899628+0000","last_unstale":"2024-03-28T13:50:43.813145+0000","last_undegraded":"2024-03-28T13:50:43.813145+0000","last_fullsized":"2024-03-28T13:50:43.813145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'847","last_scrub_stamp":"2024-03-28T13:50:43.813058+0000","last_deep_scrub":"29'847","last_deep_scrub_stamp":"2024-03-28T13:50:43.813058+0000","last_clean_scrub_stamp":"2024-03-28T13:50:43.813058+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:42:37.671568+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":75354,"num_write":826,"num_write_kb":110616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'214","reported_seq":276,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:35.813541+0000","last_change":"2024-03-28T13:50:35.813580+0000","last_active":"2024-03-28T13:50:35.813541+0000","last_peered":"2024-03-28T13:50:35.813541+0000","last_clean":"2024-03-28T13:50:35.813541+0000","last_became_active":"2024-03-28T12:42:01.964830+0000","last_became_peered":"2024-03-28T12:42:01.964830+0000","last_unstale":"2024-03-28T13:50:35.813541+0000","last_undegraded":"2024-03-28T13:50:35.813541+0000","last_fullsized":"2024-03-28T13:50:35.813541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'214","last_scrub_stamp":"2024-03-28T13:50:35.813434+0000","last_deep_scrub":"29'214","last_deep_scrub_stamp":"2024-03-28T13:50:35.813434+0000","last_clean_scrub_stamp":"2024-03-28T13:50:35.813434+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:46:13.598459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"29'65","reported_seq":128,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:31.736787+0000","last_change":"2024-03-28T13:50:31.736833+0000","last_active":"2024-03-28T13:50:31.736787+0000","last_peered":"2024-03-28T13:50:31.736787+0000","last_clean":"2024-03-28T13:50:31.736787+0000","last_became_active":"2024-03-28T12:42:00.141602+0000","last_became_peered":"2024-03-28T12:42:00.141602+0000","last_unstale":"2024-03-28T13:50:31.736787+0000","last_undegraded":"2024-03-28T13:50:31.736787+0000","last_fullsized":"2024-03-28T13:50:31.736787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'65","last_scrub_stamp":"2024-03-28T13:50:31.736685+0000","last_deep_scrub":"29'65","last_deep_scrub_stamp":"2024-03-28T13:50:31.736685+0000","last_clean_scrub_stamp":"2024-03-28T13:50:31.736685+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:26:31.273470+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"29'910","reported_seq":1041,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:49.069435+0000","last_change":"2024-03-28T13:50:49.069479+0000","last_active":"2024-03-28T13:50:49.069435+0000","last_peered":"2024-03-28T13:50:49.069435+0000","last_clean":"2024-03-28T13:50:49.069435+0000","last_became_active":"2024-03-28T12:42:07.935525+0000","last_became_peered":"2024-03-28T12:42:07.935525+0000","last_unstale":"2024-03-28T13:50:49.069435+0000","last_undegraded":"2024-03-28T13:50:49.069435+0000","last_fullsized":"2024-03-28T13:50:49.069435+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'910","last_scrub_stamp":"2024-03-28T13:50:49.069318+0000","last_deep_scrub":"29'910","last_deep_scrub_stamp":"2024-03-28T13:50:49.069318+0000","last_clean_scrub_stamp":"2024-03-28T13:50:49.069318+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:24:11.014845+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":257511,"num_write":888,"num_write_kb":259792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"29'811","reported_seq":921,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:48.035424+0000","last_change":"2024-03-28T13:50:48.035579+0000","last_active":"2024-03-28T13:50:48.035424+0000","last_peered":"2024-03-28T13:50:48.035424+0000","last_clean":"2024-03-28T13:50:48.035424+0000","last_became_active":"2024-03-28T12:42:07.881527+0000","last_became_peered":"2024-03-28T12:42:07.881527+0000","last_unstale":"2024-03-28T13:50:48.035424+0000","last_undegraded":"2024-03-28T13:50:48.035424+0000","last_fullsized":"2024-03-28T13:50:48.035424+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'811","last_scrub_stamp":"2024-03-28T13:50:48.035211+0000","last_deep_scrub":"29'811","last_deep_scrub_stamp":"2024-03-28T13:50:48.035211+0000","last_clean_scrub_stamp":"2024-03-28T13:50:48.035211+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:08:30.995420+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":165977,"num_write":788,"num_write_kb":136221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"29'216","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:43.101905+0000","last_change":"2024-03-28T13:50:43.101951+0000","last_active":"2024-03-28T13:50:43.101905+0000","last_peered":"2024-03-28T13:50:43.101905+0000","last_clean":"2024-03-28T13:50:43.101905+0000","last_became_active":"2024-03-28T12:42:01.957991+0000","last_became_peered":"2024-03-28T12:42:01.957991+0000","last_unstale":"2024-03-28T13:50:43.101905+0000","last_undegraded":"2024-03-28T13:50:43.101905+0000","last_fullsized":"2024-03-28T13:50:43.101905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'216","last_scrub_stamp":"2024-03-28T13:50:43.101789+0000","last_deep_scrub":"29'216","last_deep_scrub_stamp":"2024-03-28T13:50:43.101789+0000","last_clean_scrub_stamp":"2024-03-28T13:50:43.101789+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:52:43.675008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"29'1723","reported_seq":1788,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:44.326627+0000","last_change":"2024-03-28T13:50:44.326687+0000","last_active":"2024-03-28T13:50:44.326627+0000","last_peered":"2024-03-28T13:50:44.326627+0000","last_clean":"2024-03-28T13:50:44.326627+0000","last_became_active":"2024-03-28T12:42:00.132663+0000","last_became_peered":"2024-03-28T12:42:00.132663+0000","last_unstale":"2024-03-28T13:50:44.326627+0000","last_undegraded":"2024-03-28T13:50:44.326627+0000","last_fullsized":"2024-03-28T13:50:44.326627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1723","last_scrub_stamp":"2024-03-28T13:50:44.326525+0000","last_deep_scrub":"29'1723","last_deep_scrub_stamp":"2024-03-28T13:50:44.326525+0000","last_clean_scrub_stamp":"2024-03-28T13:50:44.326525+0000","objects_scrubbed":4,"log_size":1723,"log_dups_size":0,"ondisk_log_size":1723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:37:49.968352+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1652,"num_write_kb":13078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'750","reported_seq":837,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:54.293285+0000","last_change":"2024-03-28T13:50:54.293329+0000","last_active":"2024-03-28T13:50:54.293285+0000","last_peered":"2024-03-28T13:50:54.293285+0000","last_clean":"2024-03-28T13:50:54.293285+0000","last_became_active":"2024-03-28T12:42:07.901398+0000","last_became_peered":"2024-03-28T12:42:07.901398+0000","last_unstale":"2024-03-28T13:50:54.293285+0000","last_undegraded":"2024-03-28T13:50:54.293285+0000","last_fullsized":"2024-03-28T13:50:54.293285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'750","last_scrub_stamp":"2024-03-28T13:50:54.293150+0000","last_deep_scrub":"29'750","last_deep_scrub_stamp":"2024-03-28T13:50:54.293150+0000","last_clean_scrub_stamp":"2024-03-28T13:50:54.293150+0000","objects_scrubbed":0,"log_size":750,"log_dups_size":0,"ondisk_log_size":750,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:47:57.744802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":90732,"num_write":732,"num_write_kb":110234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"29'226","reported_seq":289,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:45.896641+0000","last_change":"2024-03-28T13:50:45.896705+0000","last_active":"2024-03-28T13:50:45.896641+0000","last_peered":"2024-03-28T13:50:45.896641+0000","last_clean":"2024-03-28T13:50:45.896641+0000","last_became_active":"2024-03-28T12:42:01.810142+0000","last_became_peered":"2024-03-28T12:42:01.810142+0000","last_unstale":"2024-03-28T13:50:45.896641+0000","last_undegraded":"2024-03-28T13:50:45.896641+0000","last_fullsized":"2024-03-28T13:50:45.896641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'226","last_scrub_stamp":"2024-03-28T13:50:45.896454+0000","last_deep_scrub":"29'226","last_deep_scrub_stamp":"2024-03-28T13:50:45.896454+0000","last_clean_scrub_stamp":"2024-03-28T13:50:45.896454+0000","objects_scrubbed":0,"log_size":226,"log_dups_size":0,"ondisk_log_size":226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:57:12.078606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"29'121","reported_seq":185,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:36.623496+0000","last_change":"2024-03-28T13:50:36.623548+0000","last_active":"2024-03-28T13:50:36.623496+0000","last_peered":"2024-03-28T13:50:36.623496+0000","last_clean":"2024-03-28T13:50:36.623496+0000","last_became_active":"2024-03-28T12:42:00.142006+0000","last_became_peered":"2024-03-28T12:42:00.142006+0000","last_unstale":"2024-03-28T13:50:36.623496+0000","last_undegraded":"2024-03-28T13:50:36.623496+0000","last_fullsized":"2024-03-28T13:50:36.623496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'121","last_scrub_stamp":"2024-03-28T13:50:36.623374+0000","last_deep_scrub":"29'121","last_deep_scrub_stamp":"2024-03-28T13:50:36.623374+0000","last_clean_scrub_stamp":"2024-03-28T13:50:36.623374+0000","objects_scrubbed":3,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:36:27.279873+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":4134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'745","reported_seq":809,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:49.274472+0000","last_change":"2024-03-28T13:50:49.274529+0000","last_active":"2024-03-28T13:50:49.274472+0000","last_peered":"2024-03-28T13:50:49.274472+0000","last_clean":"2024-03-28T13:50:49.274472+0000","last_became_active":"2024-03-28T12:42:00.143474+0000","last_became_peered":"2024-03-28T12:42:00.143474+0000","last_unstale":"2024-03-28T13:50:49.274472+0000","last_undegraded":"2024-03-28T13:50:49.274472+0000","last_fullsized":"2024-03-28T13:50:49.274472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'745","last_scrub_stamp":"2024-03-28T13:50:49.274362+0000","last_deep_scrub":"29'745","last_deep_scrub_stamp":"2024-03-28T13:50:49.274362+0000","last_clean_scrub_stamp":"2024-03-28T13:50:49.274362+0000","objects_scrubbed":6,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:13:12.624060+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":680,"num_write_kb":12641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"29'186","reported_seq":248,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:41.143472+0000","last_change":"2024-03-28T13:50:41.143524+0000","last_active":"2024-03-28T13:50:41.143472+0000","last_peered":"2024-03-28T13:50:41.143472+0000","last_clean":"2024-03-28T13:50:41.143472+0000","last_became_active":"2024-03-28T12:42:01.937612+0000","last_became_peered":"2024-03-28T12:42:01.937612+0000","last_unstale":"2024-03-28T13:50:41.143472+0000","last_undegraded":"2024-03-28T13:50:41.143472+0000","last_fullsized":"2024-03-28T13:50:41.143472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'186","last_scrub_stamp":"2024-03-28T13:50:41.143327+0000","last_deep_scrub":"29'186","last_deep_scrub_stamp":"2024-03-28T13:50:41.143327+0000","last_clean_scrub_stamp":"2024-03-28T13:50:41.143327+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:09:22.609068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"29'736","reported_seq":817,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:46.063226+0000","last_change":"2024-03-28T13:50:46.063271+0000","last_active":"2024-03-28T13:50:46.063226+0000","last_peered":"2024-03-28T13:50:46.063226+0000","last_clean":"2024-03-28T13:50:46.063226+0000","last_became_active":"2024-03-28T12:42:07.869628+0000","last_became_peered":"2024-03-28T12:42:07.869628+0000","last_unstale":"2024-03-28T13:50:46.063226+0000","last_undegraded":"2024-03-28T13:50:46.063226+0000","last_fullsized":"2024-03-28T13:50:46.063226+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'736","last_scrub_stamp":"2024-03-28T13:50:46.063105+0000","last_deep_scrub":"29'736","last_deep_scrub_stamp":"2024-03-28T13:50:46.063105+0000","last_clean_scrub_stamp":"2024-03-28T13:50:46.063105+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:21:50.813496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":78605,"num_write":708,"num_write_kb":126589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"29'201","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:40.901839+0000","last_change":"2024-03-28T13:50:40.901894+0000","last_active":"2024-03-28T13:50:40.901839+0000","last_peered":"2024-03-28T13:50:40.901839+0000","last_clean":"2024-03-28T13:50:40.901839+0000","last_became_active":"2024-03-28T12:42:00.146052+0000","last_became_peered":"2024-03-28T12:42:00.146052+0000","last_unstale":"2024-03-28T13:50:40.901839+0000","last_undegraded":"2024-03-28T13:50:40.901839+0000","last_fullsized":"2024-03-28T13:50:40.901839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'201","last_scrub_stamp":"2024-03-28T13:50:40.901731+0000","last_deep_scrub":"29'201","last_deep_scrub_stamp":"2024-03-28T13:50:40.901731+0000","last_clean_scrub_stamp":"2024-03-28T13:50:40.901731+0000","objects_scrubbed":3,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:10:00.992740+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195321,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":4156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"29'206","reported_seq":266,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:35.703096+0000","last_change":"2024-03-28T13:50:35.703137+0000","last_active":"2024-03-28T13:50:35.703096+0000","last_peered":"2024-03-28T13:50:35.703096+0000","last_clean":"2024-03-28T13:50:35.703096+0000","last_became_active":"2024-03-28T12:42:01.965598+0000","last_became_peered":"2024-03-28T12:42:01.965598+0000","last_unstale":"2024-03-28T13:50:35.703096+0000","last_undegraded":"2024-03-28T13:50:35.703096+0000","last_fullsized":"2024-03-28T13:50:35.703096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'206","last_scrub_stamp":"2024-03-28T13:50:35.702974+0000","last_deep_scrub":"29'206","last_deep_scrub_stamp":"2024-03-28T13:50:35.702974+0000","last_clean_scrub_stamp":"2024-03-28T13:50:35.702974+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:21:07.012456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"29'725","reported_seq":805,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:45.787333+0000","last_change":"2024-03-28T13:50:45.787372+0000","last_active":"2024-03-28T13:50:45.787333+0000","last_peered":"2024-03-28T13:50:45.787333+0000","last_clean":"2024-03-28T13:50:45.787333+0000","last_became_active":"2024-03-28T12:42:15.360743+0000","last_became_peered":"2024-03-28T12:42:15.360743+0000","last_unstale":"2024-03-28T13:50:45.787333+0000","last_undegraded":"2024-03-28T13:50:45.787333+0000","last_fullsized":"2024-03-28T13:50:45.787333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'725","last_scrub_stamp":"2024-03-28T13:50:45.787254+0000","last_deep_scrub":"29'725","last_deep_scrub_stamp":"2024-03-28T13:50:45.787254+0000","last_clean_scrub_stamp":"2024-03-28T13:50:45.787254+0000","objects_scrubbed":0,"log_size":725,"log_dups_size":0,"ondisk_log_size":725,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:53:07.829345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":88364,"num_write":704,"num_write_kb":127819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,0],"acting":[2,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"29'220","reported_seq":287,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:34.765658+0000","last_change":"2024-03-28T13:50:34.765658+0000","last_active":"2024-03-28T13:50:34.765658+0000","last_peered":"2024-03-28T13:50:34.765658+0000","last_clean":"2024-03-28T13:50:34.765658+0000","last_became_active":"2024-03-28T12:42:01.964468+0000","last_became_peered":"2024-03-28T12:42:01.964468+0000","last_unstale":"2024-03-28T13:50:34.765658+0000","last_undegraded":"2024-03-28T13:50:34.765658+0000","last_fullsized":"2024-03-28T13:50:34.765658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'220","last_scrub_stamp":"2024-03-28T13:50:34.765503+0000","last_deep_scrub":"29'220","last_deep_scrub_stamp":"2024-03-28T13:50:34.765503+0000","last_clean_scrub_stamp":"2024-03-28T13:50:34.765503+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T19:42:28.624013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"29'218","reported_seq":284,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:40.833604+0000","last_change":"2024-03-28T13:50:40.833604+0000","last_active":"2024-03-28T13:50:40.833604+0000","last_peered":"2024-03-28T13:50:40.833604+0000","last_clean":"2024-03-28T13:50:40.833604+0000","last_became_active":"2024-03-28T12:42:01.958333+0000","last_became_peered":"2024-03-28T12:42:01.958333+0000","last_unstale":"2024-03-28T13:50:40.833604+0000","last_undegraded":"2024-03-28T13:50:40.833604+0000","last_fullsized":"2024-03-28T13:50:40.833604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'218","last_scrub_stamp":"2024-03-28T13:50:40.833452+0000","last_deep_scrub":"29'218","last_deep_scrub_stamp":"2024-03-28T13:50:40.833452+0000","last_clean_scrub_stamp":"2024-03-28T13:50:40.833452+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:36:31.489951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"29'235","reported_seq":303,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:35.297619+0000","last_change":"2024-03-28T13:50:35.297619+0000","last_active":"2024-03-28T13:50:35.297619+0000","last_peered":"2024-03-28T13:50:35.297619+0000","last_clean":"2024-03-28T13:50:35.297619+0000","last_became_active":"2024-03-28T12:42:01.805288+0000","last_became_peered":"2024-03-28T12:42:01.805288+0000","last_unstale":"2024-03-28T13:50:35.297619+0000","last_undegraded":"2024-03-28T13:50:35.297619+0000","last_fullsized":"2024-03-28T13:50:35.297619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'235","last_scrub_stamp":"2024-03-28T13:50:35.297512+0000","last_deep_scrub":"29'235","last_deep_scrub_stamp":"2024-03-28T13:50:35.297512+0000","last_clean_scrub_stamp":"2024-03-28T13:50:35.297512+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:08:54.781591+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"29'204","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:35.838358+0000","last_change":"2024-03-28T13:50:35.838401+0000","last_active":"2024-03-28T13:50:35.838358+0000","last_peered":"2024-03-28T13:50:35.838358+0000","last_clean":"2024-03-28T13:50:35.838358+0000","last_became_active":"2024-03-28T12:42:01.946859+0000","last_became_peered":"2024-03-28T12:42:01.946859+0000","last_unstale":"2024-03-28T13:50:35.838358+0000","last_undegraded":"2024-03-28T13:50:35.838358+0000","last_fullsized":"2024-03-28T13:50:35.838358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'204","last_scrub_stamp":"2024-03-28T13:50:35.838236+0000","last_deep_scrub":"29'204","last_deep_scrub_stamp":"2024-03-28T13:50:35.838236+0000","last_clean_scrub_stamp":"2024-03-28T13:50:35.838236+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:17:28.913297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"29'187","reported_seq":252,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:40.549622+0000","last_change":"2024-03-28T13:50:40.549667+0000","last_active":"2024-03-28T13:50:40.549622+0000","last_peered":"2024-03-28T13:50:40.549622+0000","last_clean":"2024-03-28T13:50:40.549622+0000","last_became_active":"2024-03-28T12:42:01.934578+0000","last_became_peered":"2024-03-28T12:42:01.934578+0000","last_unstale":"2024-03-28T13:50:40.549622+0000","last_undegraded":"2024-03-28T13:50:40.549622+0000","last_fullsized":"2024-03-28T13:50:40.549622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'187","last_scrub_stamp":"2024-03-28T13:50:40.549517+0000","last_deep_scrub":"29'187","last_deep_scrub_stamp":"2024-03-28T13:50:40.549517+0000","last_clean_scrub_stamp":"2024-03-28T13:50:40.549517+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:22:49.623382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"29'208","reported_seq":273,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:42.536929+0000","last_change":"2024-03-28T13:50:42.536970+0000","last_active":"2024-03-28T13:50:42.536929+0000","last_peered":"2024-03-28T13:50:42.536929+0000","last_clean":"2024-03-28T13:50:42.536929+0000","last_became_active":"2024-03-28T12:42:01.945804+0000","last_became_peered":"2024-03-28T12:42:01.945804+0000","last_unstale":"2024-03-28T13:50:42.536929+0000","last_undegraded":"2024-03-28T13:50:42.536929+0000","last_fullsized":"2024-03-28T13:50:42.536929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'208","last_scrub_stamp":"2024-03-28T13:50:42.536820+0000","last_deep_scrub":"29'208","last_deep_scrub_stamp":"2024-03-28T13:50:42.536820+0000","last_clean_scrub_stamp":"2024-03-28T13:50:42.536820+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T23:18:09.214909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"29'244","reported_seq":309,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:38.820735+0000","last_change":"2024-03-28T13:50:38.820772+0000","last_active":"2024-03-28T13:50:38.820735+0000","last_peered":"2024-03-28T13:50:38.820735+0000","last_clean":"2024-03-28T13:50:38.820735+0000","last_became_active":"2024-03-28T12:42:01.969078+0000","last_became_peered":"2024-03-28T12:42:01.969078+0000","last_unstale":"2024-03-28T13:50:38.820735+0000","last_undegraded":"2024-03-28T13:50:38.820735+0000","last_fullsized":"2024-03-28T13:50:38.820735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'244","last_scrub_stamp":"2024-03-28T13:50:38.820600+0000","last_deep_scrub":"29'244","last_deep_scrub_stamp":"2024-03-28T13:50:38.820600+0000","last_clean_scrub_stamp":"2024-03-28T13:50:38.820600+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:54:27.669069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"29'195","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:46.892557+0000","last_change":"2024-03-28T13:50:46.892613+0000","last_active":"2024-03-28T13:50:46.892557+0000","last_peered":"2024-03-28T13:50:46.892557+0000","last_clean":"2024-03-28T13:50:46.892557+0000","last_became_active":"2024-03-28T12:42:01.958074+0000","last_became_peered":"2024-03-28T12:42:01.958074+0000","last_unstale":"2024-03-28T13:50:46.892557+0000","last_undegraded":"2024-03-28T13:50:46.892557+0000","last_fullsized":"2024-03-28T13:50:46.892557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'195","last_scrub_stamp":"2024-03-28T13:50:46.892386+0000","last_deep_scrub":"29'195","last_deep_scrub_stamp":"2024-03-28T13:50:46.892386+0000","last_clean_scrub_stamp":"2024-03-28T13:50:46.892386+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:59:26.672952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"29'219","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:33.334355+0000","last_change":"2024-03-28T13:50:33.334395+0000","last_active":"2024-03-28T13:50:33.334355+0000","last_peered":"2024-03-28T13:50:33.334355+0000","last_clean":"2024-03-28T13:50:33.334355+0000","last_became_active":"2024-03-28T12:42:01.811548+0000","last_became_peered":"2024-03-28T12:42:01.811548+0000","last_unstale":"2024-03-28T13:50:33.334355+0000","last_undegraded":"2024-03-28T13:50:33.334355+0000","last_fullsized":"2024-03-28T13:50:33.334355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'219","last_scrub_stamp":"2024-03-28T13:50:33.334243+0000","last_deep_scrub":"29'219","last_deep_scrub_stamp":"2024-03-28T13:50:33.334243+0000","last_clean_scrub_stamp":"2024-03-28T13:50:33.334243+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:39:05.836540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"29'207","reported_seq":272,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:47.907902+0000","last_change":"2024-03-28T13:50:47.907946+0000","last_active":"2024-03-28T13:50:47.907902+0000","last_peered":"2024-03-28T13:50:47.907902+0000","last_clean":"2024-03-28T13:50:47.907902+0000","last_became_active":"2024-03-28T12:42:01.958942+0000","last_became_peered":"2024-03-28T12:42:01.958942+0000","last_unstale":"2024-03-28T13:50:47.907902+0000","last_undegraded":"2024-03-28T13:50:47.907902+0000","last_fullsized":"2024-03-28T13:50:47.907902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'207","last_scrub_stamp":"2024-03-28T13:50:47.907791+0000","last_deep_scrub":"29'207","last_deep_scrub_stamp":"2024-03-28T13:50:47.907791+0000","last_clean_scrub_stamp":"2024-03-28T13:50:47.907791+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:39:59.881602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"29'214","reported_seq":277,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:34.662168+0000","last_change":"2024-03-28T13:50:34.662206+0000","last_active":"2024-03-28T13:50:34.662168+0000","last_peered":"2024-03-28T13:50:34.662168+0000","last_clean":"2024-03-28T13:50:34.662168+0000","last_became_active":"2024-03-28T12:42:01.965526+0000","last_became_peered":"2024-03-28T12:42:01.965526+0000","last_unstale":"2024-03-28T13:50:34.662168+0000","last_undegraded":"2024-03-28T13:50:34.662168+0000","last_fullsized":"2024-03-28T13:50:34.662168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'214","last_scrub_stamp":"2024-03-28T13:50:34.662088+0000","last_deep_scrub":"29'214","last_deep_scrub_stamp":"2024-03-28T13:50:34.662088+0000","last_clean_scrub_stamp":"2024-03-28T13:50:34.662088+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:25:23.516267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'216","reported_seq":281,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:45.106526+0000","last_change":"2024-03-28T13:50:45.106567+0000","last_active":"2024-03-28T13:50:45.106526+0000","last_peered":"2024-03-28T13:50:45.106526+0000","last_clean":"2024-03-28T13:50:45.106526+0000","last_became_active":"2024-03-28T12:42:01.960325+0000","last_became_peered":"2024-03-28T12:42:01.960325+0000","last_unstale":"2024-03-28T13:50:45.106526+0000","last_undegraded":"2024-03-28T13:50:45.106526+0000","last_fullsized":"2024-03-28T13:50:45.106526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'216","last_scrub_stamp":"2024-03-28T13:50:45.106422+0000","last_deep_scrub":"29'216","last_deep_scrub_stamp":"2024-03-28T13:50:45.106422+0000","last_clean_scrub_stamp":"2024-03-28T13:50:45.106422+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:48:38.191760+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'221","reported_seq":285,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:41.598477+0000","last_change":"2024-03-28T13:50:41.598519+0000","last_active":"2024-03-28T13:50:41.598477+0000","last_peered":"2024-03-28T13:50:41.598477+0000","last_clean":"2024-03-28T13:50:41.598477+0000","last_became_active":"2024-03-28T12:42:01.959801+0000","last_became_peered":"2024-03-28T12:42:01.959801+0000","last_unstale":"2024-03-28T13:50:41.598477+0000","last_undegraded":"2024-03-28T13:50:41.598477+0000","last_fullsized":"2024-03-28T13:50:41.598477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'221","last_scrub_stamp":"2024-03-28T13:50:41.598366+0000","last_deep_scrub":"29'221","last_deep_scrub_stamp":"2024-03-28T13:50:41.598366+0000","last_clean_scrub_stamp":"2024-03-28T13:50:41.598366+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:53:03.640458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"29'203","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:37.327444+0000","last_change":"2024-03-28T13:50:37.327481+0000","last_active":"2024-03-28T13:50:37.327444+0000","last_peered":"2024-03-28T13:50:37.327444+0000","last_clean":"2024-03-28T13:50:37.327444+0000","last_became_active":"2024-03-28T12:42:01.788431+0000","last_became_peered":"2024-03-28T12:42:01.788431+0000","last_unstale":"2024-03-28T13:50:37.327444+0000","last_undegraded":"2024-03-28T13:50:37.327444+0000","last_fullsized":"2024-03-28T13:50:37.327444+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'203","last_scrub_stamp":"2024-03-28T13:50:37.327369+0000","last_deep_scrub":"29'203","last_deep_scrub_stamp":"2024-03-28T13:50:37.327369+0000","last_clean_scrub_stamp":"2024-03-28T13:50:37.327369+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T14:37:20.828841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'205","reported_seq":267,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:41.841536+0000","last_change":"2024-03-28T13:50:41.841598+0000","last_active":"2024-03-28T13:50:41.841536+0000","last_peered":"2024-03-28T13:50:41.841536+0000","last_clean":"2024-03-28T13:50:41.841536+0000","last_became_active":"2024-03-28T12:42:01.959832+0000","last_became_peered":"2024-03-28T12:42:01.959832+0000","last_unstale":"2024-03-28T13:50:41.841536+0000","last_undegraded":"2024-03-28T13:50:41.841536+0000","last_fullsized":"2024-03-28T13:50:41.841536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'205","last_scrub_stamp":"2024-03-28T13:50:41.841367+0000","last_deep_scrub":"29'205","last_deep_scrub_stamp":"2024-03-28T13:50:41.841367+0000","last_clean_scrub_stamp":"2024-03-28T13:50:41.841367+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:42:04.943963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"29'206","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:36.293534+0000","last_change":"2024-03-28T13:50:36.293571+0000","last_active":"2024-03-28T13:50:36.293534+0000","last_peered":"2024-03-28T13:50:36.293534+0000","last_clean":"2024-03-28T13:50:36.293534+0000","last_became_active":"2024-03-28T12:42:01.936175+0000","last_became_peered":"2024-03-28T12:42:01.936175+0000","last_unstale":"2024-03-28T13:50:36.293534+0000","last_undegraded":"2024-03-28T13:50:36.293534+0000","last_fullsized":"2024-03-28T13:50:36.293534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'206","last_scrub_stamp":"2024-03-28T13:50:36.293432+0000","last_deep_scrub":"29'206","last_deep_scrub_stamp":"2024-03-28T13:50:36.293432+0000","last_clean_scrub_stamp":"2024-03-28T13:50:36.293432+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:59:41.923918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'218","reported_seq":282,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:38.311897+0000","last_change":"2024-03-28T13:50:38.311933+0000","last_active":"2024-03-28T13:50:38.311897+0000","last_peered":"2024-03-28T13:50:38.311897+0000","last_clean":"2024-03-28T13:50:38.311897+0000","last_became_active":"2024-03-28T12:42:01.959791+0000","last_became_peered":"2024-03-28T12:42:01.959791+0000","last_unstale":"2024-03-28T13:50:38.311897+0000","last_undegraded":"2024-03-28T13:50:38.311897+0000","last_fullsized":"2024-03-28T13:50:38.311897+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'218","last_scrub_stamp":"2024-03-28T13:50:38.311822+0000","last_deep_scrub":"29'218","last_deep_scrub_stamp":"2024-03-28T13:50:38.311822+0000","last_clean_scrub_stamp":"2024-03-28T13:50:38.311822+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:53:08.002669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"29'218","reported_seq":287,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:52.946974+0000","last_change":"2024-03-28T13:50:52.947038+0000","last_active":"2024-03-28T13:50:52.946974+0000","last_peered":"2024-03-28T13:50:52.946974+0000","last_clean":"2024-03-28T13:50:52.946974+0000","last_became_active":"2024-03-28T12:42:15.232678+0000","last_became_peered":"2024-03-28T12:42:15.232678+0000","last_unstale":"2024-03-28T13:50:52.946974+0000","last_undegraded":"2024-03-28T13:50:52.946974+0000","last_fullsized":"2024-03-28T13:50:52.946974+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'218","last_scrub_stamp":"2024-03-28T13:50:52.946793+0000","last_deep_scrub":"29'218","last_deep_scrub_stamp":"2024-03-28T13:50:52.946793+0000","last_clean_scrub_stamp":"2024-03-28T13:50:52.946793+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:45:51.181926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'215","reported_seq":278,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:43.583698+0000","last_change":"2024-03-28T13:50:43.583757+0000","last_active":"2024-03-28T13:50:43.583698+0000","last_peered":"2024-03-28T13:50:43.583698+0000","last_clean":"2024-03-28T13:50:43.583698+0000","last_became_active":"2024-03-28T12:42:01.947869+0000","last_became_peered":"2024-03-28T12:42:01.947869+0000","last_unstale":"2024-03-28T13:50:43.583698+0000","last_undegraded":"2024-03-28T13:50:43.583698+0000","last_fullsized":"2024-03-28T13:50:43.583698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'215","last_scrub_stamp":"2024-03-28T13:50:43.583513+0000","last_deep_scrub":"29'215","last_deep_scrub_stamp":"2024-03-28T13:50:43.583513+0000","last_clean_scrub_stamp":"2024-03-28T13:50:43.583513+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:54:32.431982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"29'199","reported_seq":261,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:41.556258+0000","last_change":"2024-03-28T13:50:41.556309+0000","last_active":"2024-03-28T13:50:41.556258+0000","last_peered":"2024-03-28T13:50:41.556258+0000","last_clean":"2024-03-28T13:50:41.556258+0000","last_became_active":"2024-03-28T12:42:01.939756+0000","last_became_peered":"2024-03-28T12:42:01.939756+0000","last_unstale":"2024-03-28T13:50:41.556258+0000","last_undegraded":"2024-03-28T13:50:41.556258+0000","last_fullsized":"2024-03-28T13:50:41.556258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'199","last_scrub_stamp":"2024-03-28T13:50:41.556149+0000","last_deep_scrub":"29'199","last_deep_scrub_stamp":"2024-03-28T13:50:41.556149+0000","last_clean_scrub_stamp":"2024-03-28T13:50:41.556149+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:20:59.713845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"29'184","reported_seq":246,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:42.601585+0000","last_change":"2024-03-28T13:50:42.601629+0000","last_active":"2024-03-28T13:50:42.601585+0000","last_peered":"2024-03-28T13:50:42.601585+0000","last_clean":"2024-03-28T13:50:42.601585+0000","last_became_active":"2024-03-28T12:42:01.960012+0000","last_became_peered":"2024-03-28T12:42:01.960012+0000","last_unstale":"2024-03-28T13:50:42.601585+0000","last_undegraded":"2024-03-28T13:50:42.601585+0000","last_fullsized":"2024-03-28T13:50:42.601585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'184","last_scrub_stamp":"2024-03-28T13:50:42.601453+0000","last_deep_scrub":"29'184","last_deep_scrub_stamp":"2024-03-28T13:50:42.601453+0000","last_clean_scrub_stamp":"2024-03-28T13:50:42.601453+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T01:08:25.561662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"29'189","reported_seq":251,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:37.580569+0000","last_change":"2024-03-28T13:50:37.580589+0000","last_active":"2024-03-28T13:50:37.580569+0000","last_peered":"2024-03-28T13:50:37.580569+0000","last_clean":"2024-03-28T13:50:37.580569+0000","last_became_active":"2024-03-28T12:42:01.936999+0000","last_became_peered":"2024-03-28T12:42:01.936999+0000","last_unstale":"2024-03-28T13:50:37.580569+0000","last_undegraded":"2024-03-28T13:50:37.580569+0000","last_fullsized":"2024-03-28T13:50:37.580569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'189","last_scrub_stamp":"2024-03-28T13:50:37.580499+0000","last_deep_scrub":"29'189","last_deep_scrub_stamp":"2024-03-28T13:50:37.580499+0000","last_clean_scrub_stamp":"2024-03-28T13:50:37.580499+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:52:38.153719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"29'206","reported_seq":268,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:43.563523+0000","last_change":"2024-03-28T13:50:43.563566+0000","last_active":"2024-03-28T13:50:43.563523+0000","last_peered":"2024-03-28T13:50:43.563523+0000","last_clean":"2024-03-28T13:50:43.563523+0000","last_became_active":"2024-03-28T12:42:01.961694+0000","last_became_peered":"2024-03-28T12:42:01.961694+0000","last_unstale":"2024-03-28T13:50:43.563523+0000","last_undegraded":"2024-03-28T13:50:43.563523+0000","last_fullsized":"2024-03-28T13:50:43.563523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'206","last_scrub_stamp":"2024-03-28T13:50:43.563444+0000","last_deep_scrub":"29'206","last_deep_scrub_stamp":"2024-03-28T13:50:43.563444+0000","last_clean_scrub_stamp":"2024-03-28T13:50:43.563444+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:24:05.508972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"29'210","reported_seq":271,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:36.732821+0000","last_change":"2024-03-28T13:50:36.732841+0000","last_active":"2024-03-28T13:50:36.732821+0000","last_peered":"2024-03-28T13:50:36.732821+0000","last_clean":"2024-03-28T13:50:36.732821+0000","last_became_active":"2024-03-28T12:42:01.966629+0000","last_became_peered":"2024-03-28T12:42:01.966629+0000","last_unstale":"2024-03-28T13:50:36.732821+0000","last_undegraded":"2024-03-28T13:50:36.732821+0000","last_fullsized":"2024-03-28T13:50:36.732821+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'210","last_scrub_stamp":"2024-03-28T13:50:36.732755+0000","last_deep_scrub":"29'210","last_deep_scrub_stamp":"2024-03-28T13:50:36.732755+0000","last_clean_scrub_stamp":"2024-03-28T13:50:36.732755+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:53:38.646085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"29'193","reported_seq":255,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:37.886685+0000","last_change":"2024-03-28T13:50:37.886741+0000","last_active":"2024-03-28T13:50:37.886685+0000","last_peered":"2024-03-28T13:50:37.886685+0000","last_clean":"2024-03-28T13:50:37.886685+0000","last_became_active":"2024-03-28T12:42:01.934130+0000","last_became_peered":"2024-03-28T12:42:01.934130+0000","last_unstale":"2024-03-28T13:50:37.886685+0000","last_undegraded":"2024-03-28T13:50:37.886685+0000","last_fullsized":"2024-03-28T13:50:37.886685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'193","last_scrub_stamp":"2024-03-28T13:50:37.886530+0000","last_deep_scrub":"29'193","last_deep_scrub_stamp":"2024-03-28T13:50:37.886530+0000","last_clean_scrub_stamp":"2024-03-28T13:50:37.886530+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T15:52:20.007960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"29'209","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:39.581562+0000","last_change":"2024-03-28T13:50:39.581583+0000","last_active":"2024-03-28T13:50:39.581562+0000","last_peered":"2024-03-28T13:50:39.581562+0000","last_clean":"2024-03-28T13:50:39.581562+0000","last_became_active":"2024-03-28T12:42:01.939962+0000","last_became_peered":"2024-03-28T12:42:01.939962+0000","last_unstale":"2024-03-28T13:50:39.581562+0000","last_undegraded":"2024-03-28T13:50:39.581562+0000","last_fullsized":"2024-03-28T13:50:39.581562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'209","last_scrub_stamp":"2024-03-28T13:50:39.581492+0000","last_deep_scrub":"29'209","last_deep_scrub_stamp":"2024-03-28T13:50:39.581492+0000","last_clean_scrub_stamp":"2024-03-28T13:50:39.581492+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T20:48:32.666830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"29'195","reported_seq":256,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:36.798220+0000","last_change":"2024-03-28T13:50:36.798256+0000","last_active":"2024-03-28T13:50:36.798220+0000","last_peered":"2024-03-28T13:50:36.798220+0000","last_clean":"2024-03-28T13:50:36.798220+0000","last_became_active":"2024-03-28T12:42:01.964888+0000","last_became_peered":"2024-03-28T12:42:01.964888+0000","last_unstale":"2024-03-28T13:50:36.798220+0000","last_undegraded":"2024-03-28T13:50:36.798220+0000","last_fullsized":"2024-03-28T13:50:36.798220+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'195","last_scrub_stamp":"2024-03-28T13:50:36.798144+0000","last_deep_scrub":"29'195","last_deep_scrub_stamp":"2024-03-28T13:50:36.798144+0000","last_clean_scrub_stamp":"2024-03-28T13:50:36.798144+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T16:42:43.944065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"29'209","reported_seq":270,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:29.531549+0000","last_change":"2024-03-28T13:50:29.531590+0000","last_active":"2024-03-28T13:50:29.531549+0000","last_peered":"2024-03-28T13:50:29.531549+0000","last_clean":"2024-03-28T13:50:29.531549+0000","last_became_active":"2024-03-28T12:42:01.939448+0000","last_became_peered":"2024-03-28T12:42:01.939448+0000","last_unstale":"2024-03-28T13:50:29.531549+0000","last_undegraded":"2024-03-28T13:50:29.531549+0000","last_fullsized":"2024-03-28T13:50:29.531549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'209","last_scrub_stamp":"2024-03-28T13:50:29.531432+0000","last_deep_scrub":"29'209","last_deep_scrub_stamp":"2024-03-28T13:50:29.531432+0000","last_clean_scrub_stamp":"2024-03-28T13:50:29.531432+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T22:17:08.589875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"29'196","reported_seq":264,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:32.821491+0000","last_change":"2024-03-28T13:50:32.821512+0000","last_active":"2024-03-28T13:50:32.821491+0000","last_peered":"2024-03-28T13:50:32.821491+0000","last_clean":"2024-03-28T13:50:32.821491+0000","last_became_active":"2024-03-28T12:42:01.960511+0000","last_became_peered":"2024-03-28T12:42:01.960511+0000","last_unstale":"2024-03-28T13:50:32.821491+0000","last_undegraded":"2024-03-28T13:50:32.821491+0000","last_fullsized":"2024-03-28T13:50:32.821491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'196","last_scrub_stamp":"2024-03-28T13:50:32.821421+0000","last_deep_scrub":"29'196","last_deep_scrub_stamp":"2024-03-28T13:50:32.821421+0000","last_clean_scrub_stamp":"2024-03-28T13:50:32.821421+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T17:41:55.924017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'197","reported_seq":265,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:44.922148+0000","last_change":"2024-03-28T13:50:44.922148+0000","last_active":"2024-03-28T13:50:44.922148+0000","last_peered":"2024-03-28T13:50:44.922148+0000","last_clean":"2024-03-28T13:50:44.922148+0000","last_became_active":"2024-03-28T12:42:01.805168+0000","last_became_peered":"2024-03-28T12:42:01.805168+0000","last_unstale":"2024-03-28T13:50:44.922148+0000","last_undegraded":"2024-03-28T13:50:44.922148+0000","last_fullsized":"2024-03-28T13:50:44.922148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'197","last_scrub_stamp":"2024-03-28T13:50:44.921939+0000","last_deep_scrub":"29'197","last_deep_scrub_stamp":"2024-03-28T13:50:44.921939+0000","last_clean_scrub_stamp":"2024-03-28T13:50:44.921939+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T21:53:14.612785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"29'215","reported_seq":283,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:42.930008+0000","last_change":"2024-03-28T13:50:42.930008+0000","last_active":"2024-03-28T13:50:42.930008+0000","last_peered":"2024-03-28T13:50:42.930008+0000","last_clean":"2024-03-28T13:50:42.930008+0000","last_became_active":"2024-03-28T12:42:01.805382+0000","last_became_peered":"2024-03-28T12:42:01.805382+0000","last_unstale":"2024-03-28T13:50:42.930008+0000","last_undegraded":"2024-03-28T13:50:42.930008+0000","last_fullsized":"2024-03-28T13:50:42.930008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'215","last_scrub_stamp":"2024-03-28T13:50:42.929759+0000","last_deep_scrub":"29'215","last_deep_scrub_stamp":"2024-03-28T13:50:42.929759+0000","last_clean_scrub_stamp":"2024-03-28T13:50:42.929759+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-30T00:59:48.560245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"29'212","reported_seq":279,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-28T13:50:30.575994+0000","last_change":"2024-03-28T13:50:30.575994+0000","last_active":"2024-03-28T13:50:30.575994+0000","last_peered":"2024-03-28T13:50:30.575994+0000","last_clean":"2024-03-28T13:50:30.575994+0000","last_became_active":"2024-03-28T12:42:01.938408+0000","last_became_peered":"2024-03-28T12:42:01.938408+0000","last_unstale":"2024-03-28T13:50:30.575994+0000","last_undegraded":"2024-03-28T13:50:30.575994+0000","last_fullsized":"2024-03-28T13:50:30.575994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'212","last_scrub_stamp":"2024-03-28T13:50:30.575871+0000","last_deep_scrub":"29'212","last_deep_scrub_stamp":"2024-03-28T13:50:30.575871+0000","last_clean_scrub_stamp":"2024-03-28T13:50:30.575871+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T18:39:23.839134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1106,"num_read_kb":3440531,"num_write":24390,"num_write_kb":4237056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25020,"ondisk_log_size":25020,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13266,"ondisk_log_size":13266,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":189203695,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":1437,"num_read_kb":2622,"num_write":24288,"num_write_kb":197888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":164986880,"data_stored":378407390,"data_compressed":51376166,"data_compressed_allocated":66838528,"data_compressed_original":280502272,"omap_allocated":0,"internal_metadata":0},"log_size":21704,"ondisk_log_size":21704,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66494,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510278,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99252,"kb_used_data":9836,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94272588,"statfs":{"total":96636764160,"available":96535130112,"internally_reserved":0,"allocated":10072064,"data_stored":26859525,"data_compressed":3937950,"data_compressed_allocated":4919296,"data_compressed_original":21925888,"omap_allocated":1590,"internal_metadata":91552202},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510278,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":85192,"kb_used_data":13760,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94286648,"statfs":{"total":96636764160,"available":96549527552,"internally_reserved":0,"allocated":14090240,"data_stored":32569481,"data_compressed":4547476,"data_compressed_allocated":5951488,"data_compressed_original":24629248,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510278,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127140,"kb_used_data":19676,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94244700,"statfs":{"total":96636764160,"available":96506572800,"internally_reserved":0,"allocated":20148224,"data_stored":50460553,"data_compressed":7401383,"data_compressed_allocated":9674752,"data_compressed_original":40218624,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510277,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80360,"kb_used_data":13088,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94291480,"statfs":{"total":96636764160,"available":96554475520,"internally_reserved":0,"allocated":13402112,"data_stored":33681567,"data_compressed":4660285,"data_compressed_allocated":6107136,"data_compressed_original":26583040,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510277,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120852,"kb_used_data":21708,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94250988,"statfs":{"total":96636764160,"available":96513011712,"internally_reserved":0,"allocated":22228992,"data_stored":38466913,"data_compressed":4150831,"data_compressed_allocated":5660672,"data_compressed_original":22102016,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510279,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":144996,"kb_used_data":29212,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94226844,"statfs":{"total":96636764160,"available":96488288256,"internally_reserved":0,"allocated":29913088,"data_stored":67238591,"data_compressed":8806079,"data_compressed_allocated":11505664,"data_compressed_original":49045504,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542984,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":155132,"kb_used_data":33780,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94216708,"statfs":{"total":96636764160,"available":96477908992,"internally_reserved":0,"allocated":34590720,"data_stored":84015987,"data_compressed":11869280,"data_compressed_allocated":15233024,"data_compressed_original":64880640,"omap_allocated":1593,"internal_metadata":124254663},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575687,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":125892,"kb_used_data":22588,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94245948,"statfs":{"total":96636764160,"available":96507850752,"internally_reserved":0,"allocated":23130112,"data_stored":47306669,"data_compressed":6069376,"data_compressed_allocated":7876608,"data_compressed_original":32264192,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33247,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29605888,"data_stored":67112196,"data_compressed":8806079,"data_compressed_allocated":11505664,"data_compressed_original":49045504,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21856256,"data_stored":37750150,"data_compressed":4117584,"data_compressed_allocated":5615616,"data_compressed_original":21528576,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13094912,"data_stored":33555172,"data_compressed":4660285,"data_compressed_allocated":6107136,"data_compressed_original":26583040,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34283520,"data_stored":83889592,"data_compressed":11869280,"data_compressed_allocated":15233024,"data_compressed_original":64880640,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19841024,"data_stored":50334158,"data_compressed":7401383,"data_compressed_allocated":9674752,"data_compressed_original":40218624,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":22757376,"data_stored":46589906,"data_compressed":6036129,"data_compressed_allocated":7831552,"data_compressed_original":31690752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13783040,"data_stored":32443086,"data_compressed":4547476,"data_compressed_allocated":5951488,"data_compressed_original":24629248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9764864,"data_stored":26733130,"data_compressed":3937950,"data_compressed_allocated":4919296,"data_compressed_original":21925888,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-28T13:50:58.205 DEBUG:teuthology.orchestra.run.smithi076:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-28T13:50:58.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.378+0000 7f1195600640 1 Processor -- start 2024-03-28T13:50:58.380 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.378+0000 7f1195600640 1 -- start start 2024-03-28T13:50:58.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.382+0000 7f1195600640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f11901527c0 0x7f11900cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:58.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.382+0000 7f1195600640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f11900c9720 0x7f1190071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:58.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.382+0000 7f1195600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f11900720f0 0x7f1190158870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:58.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.382+0000 7f1195600640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f11900cb920 con 0x7f11901527c0 2024-03-28T13:50:58.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.382+0000 7f1195600640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f11900c3070 con 0x7f11900c9720 2024-03-28T13:50:58.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.382+0000 7f1195600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f11900c3350 con 0x7f11900720f0 2024-03-28T13:50:58.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.382+0000 7f118fe00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f11901527c0 0x7f11900cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:58.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.382+0000 7f118fe00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f11901527c0 0x7f11900cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33350/0 (socket says 172.21.15.76:33350) 2024-03-28T13:50:58.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.382+0000 7f118fe00640 1 -- 172.21.15.76:0/2714055089 learned_addr learned my addr 172.21.15.76:0/2714055089 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:58.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.382+0000 7f118f400640 1 --2- 172.21.15.76:0/2714055089 >> v2:172.21.15.111:3300/0 conn(0x7f11900c9720 0x7f1190071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:58.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.382+0000 7f1194c00640 1 --2- 172.21.15.76:0/2714055089 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f11900720f0 0x7f1190158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:58.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.386+0000 7f118fe00640 1 -- 172.21.15.76:0/2714055089 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f11900720f0 msgr2=0x7f1190158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:58.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.386+0000 7f118fe00640 1 --2- 172.21.15.76:0/2714055089 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f11900720f0 0x7f1190158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:58.385 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.386+0000 7f118fe00640 1 -- 172.21.15.76:0/2714055089 >> v2:172.21.15.111:3300/0 conn(0x7f11900c9720 msgr2=0x7f1190071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:58.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.386+0000 7f118fe00640 1 --2- 172.21.15.76:0/2714055089 >> v2:172.21.15.111:3300/0 conn(0x7f11900c9720 0x7f1190071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:58.386 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.386+0000 7f118fe00640 1 -- 172.21.15.76:0/2714055089 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11900c3630 con 0x7f11901527c0 2024-03-28T13:50:58.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.390+0000 7f118fe00640 1 --2- 172.21.15.76:0/2714055089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11901527c0 0x7f11900cb290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1190070970 tx=0x7f118001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05da98ce8d9f273 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:58.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.394+0000 7f118ea00640 1 -- 172.21.15.76:0/2714055089 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11800b1070 con 0x7f11901527c0 2024-03-28T13:50:58.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.394+0000 7f118ea00640 1 -- 172.21.15.76:0/2714055089 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11800ac620 con 0x7f11901527c0 2024-03-28T13:50:58.394 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.394+0000 7f118ea00640 1 -- 172.21.15.76:0/2714055089 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11800ac9f0 con 0x7f11901527c0 2024-03-28T13:50:58.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.394+0000 7f1195600640 1 -- 172.21.15.76:0/2714055089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11901527c0 msgr2=0x7f11900cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:58.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.394+0000 7f1195600640 1 --2- 172.21.15.76:0/2714055089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11901527c0 0x7f11900cb290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1190070970 tx=0x7f118001c4f0 comp rx=0 tx=0).stop 2024-03-28T13:50:58.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.394+0000 7f1195600640 1 -- 172.21.15.76:0/2714055089 shutdown_connections 2024-03-28T13:50:58.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.394+0000 7f1195600640 1 --2- 172.21.15.76:0/2714055089 >> v2:172.21.15.111:3300/0 conn(0x7f11900c9720 0x7f1190071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:58.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.394+0000 7f1195600640 1 --2- 172.21.15.76:0/2714055089 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f11900720f0 0x7f1190158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:58.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.394+0000 7f1195600640 1 --2- 172.21.15.76:0/2714055089 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11901527c0 0x7f11900cb290 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:58.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.394+0000 7f1195600640 1 -- 172.21.15.76:0/2714055089 >> 172.21.15.76:0/2714055089 conn(0x7f119006bba0 msgr2=0x7f119006ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:58.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.394+0000 7f1195600640 1 -- 172.21.15.76:0/2714055089 shutdown_connections 2024-03-28T13:50:58.395 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.394+0000 7f1195600640 1 -- 172.21.15.76:0/2714055089 wait complete. 2024-03-28T13:50:58.397 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.398+0000 7f1195600640 1 Processor -- start 2024-03-28T13:50:58.398 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.398+0000 7f1195600640 1 -- start start 2024-03-28T13:50:58.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.398+0000 7f1195600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11900720f0 0x7f119014db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:58.399 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.398+0000 7f1195600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f11900c9720 0x7f11901f4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:58.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.398+0000 7f1195600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f11901527c0 0x7f11900c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:58.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.398+0000 7f1195600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f11900c3bf0 con 0x7f11900720f0 2024-03-28T13:50:58.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.398+0000 7f1195600640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1190152ba0 con 0x7f11901527c0 2024-03-28T13:50:58.400 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.398+0000 7f1195600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f11900c3d70 con 0x7f11900c9720 2024-03-28T13:50:58.401 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.398+0000 7f118fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11900720f0 0x7f119014db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:58.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.398+0000 7f118fe00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11900720f0 0x7f119014db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33354/0 (socket says 172.21.15.76:33354) 2024-03-28T13:50:58.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.398+0000 7f118fe00640 1 -- 172.21.15.76:0/3103525630 learned_addr learned my addr 172.21.15.76:0/3103525630 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:58.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.398+0000 7f1194c00640 1 --2- 172.21.15.76:0/3103525630 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f11901527c0 0x7f11900c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:58.402 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.398+0000 7f118f400640 1 --2- 172.21.15.76:0/3103525630 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f11900c9720 0x7f11901f4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:58.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.402+0000 7f118fe00640 1 -- 172.21.15.76:0/3103525630 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f11900c9720 msgr2=0x7f11901f4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:58.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.402+0000 7f118fe00640 1 --2- 172.21.15.76:0/3103525630 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f11900c9720 0x7f11901f4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:58.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.402+0000 7f118fe00640 1 -- 172.21.15.76:0/3103525630 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f11901527c0 msgr2=0x7f11900c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:58.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.402+0000 7f118fe00640 1 --2- 172.21.15.76:0/3103525630 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f11901527c0 0x7f11900c7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:58.404 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.402+0000 7f118fe00640 1 -- 172.21.15.76:0/3103525630 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119014f500 con 0x7f11900720f0 2024-03-28T13:50:58.407 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.406+0000 7f118fe00640 1 --2- 172.21.15.76:0/3103525630 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11900720f0 0x7f119014db00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f11800af040 tx=0x7f1180019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:58.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.410+0000 7f1187e00640 1 -- 172.21.15.76:0/3103525630 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11800b1040 con 0x7f11900720f0 2024-03-28T13:50:58.410 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.410+0000 7f1195600640 1 -- 172.21.15.76:0/3103525630 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11900b2d00 con 0x7f11900720f0 2024-03-28T13:50:58.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.410+0000 7f1195600640 1 -- 172.21.15.76:0/3103525630 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119014fa60 con 0x7f11900720f0 2024-03-28T13:50:58.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.410+0000 7f1195600640 1 -- 172.21.15.76:0/3103525630 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11900686e0 con 0x7f11900720f0 2024-03-28T13:50:58.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.410+0000 7f1187e00640 1 -- 172.21.15.76:0/3103525630 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11800ba070 con 0x7f11900720f0 2024-03-28T13:50:58.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.410+0000 7f1187e00640 1 -- 172.21.15.76:0/3103525630 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11800bf660 con 0x7f11900720f0 2024-03-28T13:50:58.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.698+0000 7f1187e00640 1 -- 172.21.15.76:0/3103525630 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f11800bf800 con 0x7f11900720f0 2024-03-28T13:50:58.697 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.698+0000 7f1187e00640 1 --2- 172.21.15.76:0/3103525630 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1170067fc0 0x7f117006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:58.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.698+0000 7f118f400640 1 --2- 172.21.15.76:0/3103525630 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1170067fc0 0x7f117006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:58.698 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.698+0000 7f118f400640 1 --2- 172.21.15.76:0/3103525630 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1170067fc0 0x7f117006a480 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f119014c230 tx=0x7f117c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:58.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.722+0000 7f1187e00640 1 -- 172.21.15.76:0/3103525630 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f11800eedf0 con 0x7f11900720f0 2024-03-28T13:50:58.721 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.722+0000 7f1187e00640 1 -- 172.21.15.76:0/3103525630 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f119014f500 con 0x7f11900720f0 2024-03-28T13:50:58.974 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:58.974+0000 7f1195600640 1 -- 172.21.15.76:0/3103525630 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f119014d720 con 0x7f11900720f0 2024-03-28T13:50:59.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.222+0000 7f1187e00640 1 -- 172.21.15.76:0/3103525630 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f1180016110 con 0x7f11900720f0 2024-03-28T13:50:59.224 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.222+0000 7f1187e00640 1 -- 172.21.15.76:0/3103525630 <== mon.0 v2:172.21.15.76:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f11800ace30 con 0x7f11900720f0 2024-03-28T13:50:59.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.226+0000 7f1195600640 1 -- 172.21.15.76:0/3103525630 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1170067fc0 msgr2=0x7f117006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:59.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.226+0000 7f1195600640 1 --2- 172.21.15.76:0/3103525630 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1170067fc0 0x7f117006a480 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f119014c230 tx=0x7f117c009190 comp rx=0 tx=0).stop 2024-03-28T13:50:59.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.226+0000 7f1195600640 1 -- 172.21.15.76:0/3103525630 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11900720f0 msgr2=0x7f119014db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:59.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.226+0000 7f1195600640 1 --2- 172.21.15.76:0/3103525630 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11900720f0 0x7f119014db00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f11800af040 tx=0x7f1180019290 comp rx=0 tx=0).stop 2024-03-28T13:50:59.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.226+0000 7f1195600640 1 -- 172.21.15.76:0/3103525630 shutdown_connections 2024-03-28T13:50:59.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.226+0000 7f1195600640 1 --2- 172.21.15.76:0/3103525630 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f1170067fc0 0x7f117006a480 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:59.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.226+0000 7f1195600640 1 --2- 172.21.15.76:0/3103525630 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f11901527c0 0x7f11900c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:59.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.226+0000 7f1195600640 1 --2- 172.21.15.76:0/3103525630 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f11900c9720 0x7f11901f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:59.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.226+0000 7f1195600640 1 --2- 172.21.15.76:0/3103525630 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f11900720f0 0x7f119014db00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:59.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.226+0000 7f1195600640 1 -- 172.21.15.76:0/3103525630 >> 172.21.15.76:0/3103525630 conn(0x7f119006bba0 msgr2=0x7f119006dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:59.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.226+0000 7f1195600640 1 -- 172.21.15.76:0/3103525630 shutdown_connections 2024-03-28T13:50:59.227 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.226+0000 7f1195600640 1 -- 172.21.15.76:0/3103525630 wait complete. 2024-03-28T13:50:59.247 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-28T13:50:59.247 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T13:50:59.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.430+0000 7fb775600640 1 Processor -- start 2024-03-28T13:50:59.433 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.434+0000 7fb775600640 1 -- start start 2024-03-28T13:50:59.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.434+0000 7fb775600640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb770152650 0x7fb770071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:59.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.434+0000 7fb775600640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fb7700c8a40 0x7fb7700720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:59.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.434+0000 7fb775600640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb770159370 con 0x7fb7700cb290 2024-03-28T13:50:59.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.434+0000 7fb775600640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fb77015bb70 con 0x7fb7700c8a40 2024-03-28T13:50:59.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.434+0000 7fb775600640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fb7701587f0 con 0x7fb770152650 2024-03-28T13:50:59.434 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.434+0000 7fb76f400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fb7700c8a40 0x7fb7700720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:59.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.434+0000 7fb76f400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fb7700c8a40 0x7fb7700720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33368/0 (socket says 172.21.15.76:33368) 2024-03-28T13:50:59.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.434+0000 7fb76fe00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb770152650 0x7fb770071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:59.435 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.434+0000 7fb76f400640 1 -- 172.21.15.76:0/964860125 learned_addr learned my addr 172.21.15.76:0/964860125 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:59.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.438+0000 7fb76f400640 1 -- 172.21.15.76:0/964860125 >> v2:172.21.15.111:3300/0 conn(0x7fb770152650 msgr2=0x7fb770071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:50:59.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.438+0000 7fb76f400640 1 --2- 172.21.15.76:0/964860125 >> v2:172.21.15.111:3300/0 conn(0x7fb770152650 0x7fb770071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:59.438 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.438+0000 7fb76f400640 1 -- 172.21.15.76:0/964860125 >> v1:172.21.15.76:6789/0 conn(0x7fb7700cb290 legacy=0x7fb77015c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:59.439 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.438+0000 7fb76f400640 1 -- 172.21.15.76:0/964860125 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb770158ad0 con 0x7fb7700c8a40 2024-03-28T13:50:59.447 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.442+0000 7fb76f400640 1 --2- 172.21.15.76:0/964860125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7700c8a40 0x7fb7700720f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb7700cb220 tx=0x7fb75c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84488a1b5ba61009 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:59.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.446+0000 7fb76ea00640 1 -- 172.21.15.76:0/964860125 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0ab610 con 0x7fb7700c8a40 2024-03-28T13:50:59.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.446+0000 7fb76ea00640 1 -- 172.21.15.76:0/964860125 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb75c0b0070 con 0x7fb7700c8a40 2024-03-28T13:50:59.448 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.446+0000 7fb76ea00640 1 -- 172.21.15.76:0/964860125 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0ab9f0 con 0x7fb7700c8a40 2024-03-28T13:50:59.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.450+0000 7fb775600640 1 -- 172.21.15.76:0/964860125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7700c8a40 msgr2=0x7fb7700720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:59.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.450+0000 7fb775600640 1 --2- 172.21.15.76:0/964860125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7700c8a40 0x7fb7700720f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb7700cb220 tx=0x7fb75c01c520 comp rx=0 tx=0).stop 2024-03-28T13:50:59.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.450+0000 7fb775600640 1 -- 172.21.15.76:0/964860125 shutdown_connections 2024-03-28T13:50:59.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.450+0000 7fb775600640 1 --2- 172.21.15.76:0/964860125 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb7700c8a40 0x7fb7700720f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:59.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.450+0000 7fb775600640 1 --2- 172.21.15.76:0/964860125 >> v2:172.21.15.111:3300/0 conn(0x7fb770152650 0x7fb770071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:59.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.450+0000 7fb775600640 1 -- 172.21.15.76:0/964860125 >> 172.21.15.76:0/964860125 conn(0x7fb77006bc50 msgr2=0x7fb77006ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:50:59.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.450+0000 7fb775600640 1 -- 172.21.15.76:0/964860125 shutdown_connections 2024-03-28T13:50:59.449 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.450+0000 7fb775600640 1 -- 172.21.15.76:0/964860125 wait complete. 2024-03-28T13:50:59.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.450+0000 7fb775600640 1 Processor -- start 2024-03-28T13:50:59.451 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.450+0000 7fb775600640 1 -- start start 2024-03-28T13:50:59.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.450+0000 7fb775600640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7700cb290 0x7fb7700ce150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:59.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.450+0000 7fb775600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb770152650 0x7fb770160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:59.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.450+0000 7fb775600640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb7701613f0 0x7fb770154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:59.452 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.450+0000 7fb775600640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fb770152bb0 con 0x7fb770152650 2024-03-28T13:50:59.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.450+0000 7fb775600640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb770152a30 con 0x7fb7700cb290 2024-03-28T13:50:59.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.450+0000 7fb775600640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb77015c710 con 0x7fb7701613f0 2024-03-28T13:50:59.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.454+0000 7fb76f400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb770152650 0x7fb770160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:59.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.454+0000 7fb76f400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb770152650 0x7fb770160eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33382/0 (socket says 172.21.15.76:33382) 2024-03-28T13:50:59.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.454+0000 7fb76f400640 1 -- 172.21.15.76:0/2056726478 learned_addr learned my addr 172.21.15.76:0/2056726478 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:50:59.453 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.454+0000 7fb76fe00640 1 --2- 172.21.15.76:0/2056726478 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7700cb290 0x7fb7700ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:59.456 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.454+0000 7fb774c00640 1 --2- 172.21.15.76:0/2056726478 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb7701613f0 0x7fb770154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:59.457 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.458+0000 7fb76f400640 1 -- 172.21.15.76:0/2056726478 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb7701613f0 msgr2=0x7fb770154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:59.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.458+0000 7fb76f400640 1 --2- 172.21.15.76:0/2056726478 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb7701613f0 0x7fb770154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:59.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.458+0000 7fb76f400640 1 -- 172.21.15.76:0/2056726478 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7700cb290 msgr2=0x7fb7700ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:50:59.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.458+0000 7fb76f400640 1 --2- 172.21.15.76:0/2056726478 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7700cb290 0x7fb7700ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:50:59.458 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.458+0000 7fb76f400640 1 -- 172.21.15.76:0/2056726478 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77006ced0 con 0x7fb770152650 2024-03-28T13:50:59.459 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.458+0000 7fb76f400640 1 --2- 172.21.15.76:0/2056726478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb770152650 0x7fb770160eb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb75c01a150 tx=0x7fb75c01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:59.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.462+0000 7fb767e00640 1 -- 172.21.15.76:0/2056726478 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0be5f0 con 0x7fb770152650 2024-03-28T13:50:59.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.462+0000 7fb775600640 1 -- 172.21.15.76:0/2056726478 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7701f7950 con 0x7fb770152650 2024-03-28T13:50:59.462 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.462+0000 7fb775600640 1 -- 172.21.15.76:0/2056726478 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb77006cbf0 con 0x7fb770152650 2024-03-28T13:50:59.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.462+0000 7fb767e00640 1 -- 172.21.15.76:0/2056726478 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb75c0b0030 con 0x7fb770152650 2024-03-28T13:50:59.463 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.462+0000 7fb767e00640 1 -- 172.21.15.76:0/2056726478 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0be990 con 0x7fb770152650 2024-03-28T13:50:59.464 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.462+0000 7fb775600640 1 -- 172.21.15.76:0/2056726478 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7480052a0 con 0x7fb770152650 2024-03-28T13:50:59.483 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.482+0000 7fb767e00640 1 -- 172.21.15.76:0/2056726478 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fb75c0beb30 con 0x7fb770152650 2024-03-28T13:50:59.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.486+0000 7fb767e00640 1 --2- 172.21.15.76:0/2056726478 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb750067fc0 0x7fb75006a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:50:59.485 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.486+0000 7fb76fe00640 1 --2- 172.21.15.76:0/2056726478 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb750067fc0 0x7fb75006a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:50:59.486 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.486+0000 7fb76fe00640 1 --2- 172.21.15.76:0/2056726478 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb750067fc0 0x7fb75006a480 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb760009ac0 tx=0x7fb760009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:50:59.487 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.486+0000 7fb767e00640 1 -- 172.21.15.76:0/2056726478 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7fb75c0eef20 con 0x7fb770152650 2024-03-28T13:50:59.765 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:50:59.765+0000 7fb767e00640 1 -- 172.21.15.76:0/2056726478 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fb75c0c4060 con 0x7fb770152650 2024-03-28T13:51:00.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.113+0000 7fb775600640 1 -- 172.21.15.76:0/2056726478 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb748005590 con 0x7fb770152650 2024-03-28T13:51:00.139 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.137+0000 7fb767e00640 1 -- 172.21.15.76:0/2056726478 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6916 (secure 0 0 0) 0x7fb75c0a8050 con 0x7fb770152650 2024-03-28T13:51:00.139 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T13:51:00.140 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/335301918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":335301918},{"type":"v1","addr":"172.21.15.111:6835","nonce":335301918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T12:42:00.776505+0000","modified":"2024-03-28T13:17:47.764728+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4264,"mds_1":4258,"mds_2":4251,"mds_3":4248,"mds_4":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"e","rank":4,"incarnation":16,"state":"up:active","state_seq":18,"addr":"172.21.15.76:6837/1786218285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1786218285},{"type":"v1","addr":"172.21.15.76:6837","nonce":1786218285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4248":{"gid":4248,"name":"a","rank":3,"incarnation":14,"state":"up:active","state_seq":18,"addr":"172.21.15.76:6839/2729208421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":2729208421},{"type":"v1","addr":"172.21.15.76:6839","nonce":2729208421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4251":{"gid":4251,"name":"b","rank":2,"incarnation":12,"state":"up:active","state_seq":17,"addr":"172.21.15.111:6837/4176441330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":4176441330},{"type":"v1","addr":"172.21.15.111:6837","nonce":4176441330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4258":{"gid":4258,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":18,"addr":"172.21.15.111:6833/3175932821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":3175932821},{"type":"v1","addr":"172.21.15.111:6833","nonce":3175932821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":540,"addr":"172.21.15.76:6835/544947706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":544947706},{"type":"v1","addr":"172.21.15.76:6835","nonce":544947706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4264,"qdb_cluster":[4245,4258,4248,4251,4264]},"id":1}]} 2024-03-28T13:51:00.140 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 19 2024-03-28T13:51:00.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.141+0000 7fb775600640 1 -- 172.21.15.76:0/2056726478 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb750067fc0 msgr2=0x7fb75006a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:00.141 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.141+0000 7fb775600640 1 --2- 172.21.15.76:0/2056726478 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb750067fc0 0x7fb75006a480 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb760009ac0 tx=0x7fb760009190 comp rx=0 tx=0).stop 2024-03-28T13:51:00.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.141+0000 7fb775600640 1 -- 172.21.15.76:0/2056726478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb770152650 msgr2=0x7fb770160eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:00.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.141+0000 7fb775600640 1 --2- 172.21.15.76:0/2056726478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb770152650 0x7fb770160eb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb75c01a150 tx=0x7fb75c01ad60 comp rx=0 tx=0).stop 2024-03-28T13:51:00.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.141+0000 7fb775600640 1 -- 172.21.15.76:0/2056726478 shutdown_connections 2024-03-28T13:51:00.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.141+0000 7fb775600640 1 --2- 172.21.15.76:0/2056726478 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fb750067fc0 0x7fb75006a480 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:00.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.141+0000 7fb775600640 1 --2- 172.21.15.76:0/2056726478 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb7701613f0 0x7fb770154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:00.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.141+0000 7fb775600640 1 --2- 172.21.15.76:0/2056726478 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fb770152650 0x7fb770160eb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:00.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.141+0000 7fb775600640 1 --2- 172.21.15.76:0/2056726478 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7700cb290 0x7fb7700ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:00.142 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.141+0000 7fb775600640 1 -- 172.21.15.76:0/2056726478 >> 172.21.15.76:0/2056726478 conn(0x7fb77006bc50 msgr2=0x7fb770157d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:51:00.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.141+0000 7fb775600640 1 -- 172.21.15.76:0/2056726478 shutdown_connections 2024-03-28T13:51:00.143 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.141+0000 7fb775600640 1 -- 172.21.15.76:0/2056726478 wait complete. 2024-03-28T13:51:00.164 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-28T13:51:00.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.349+0000 7f9d9f200640 1 Processor -- start 2024-03-28T13:51:00.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.349+0000 7f9d9f200640 1 -- start start 2024-03-28T13:51:00.352 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.353+0000 7f9d9f200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9da0154940 0x7f9da006fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:00.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.353+0000 7f9d9f200640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f9da006eb90 0x7f9da00c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:00.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.353+0000 7f9d9f200640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9da0154d20 con 0x7f9da006efb0 2024-03-28T13:51:00.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.353+0000 7f9d9f200640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f9da0070610 con 0x7f9da006eb90 2024-03-28T13:51:00.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.353+0000 7f9d9f200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f9da00c4140 con 0x7f9da0154940 2024-03-28T13:51:00.353 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.353+0000 7f9d9d400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f9da006eb90 0x7f9da00c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:00.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.353+0000 7f9d9de00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9da0154940 0x7f9da006fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:00.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.353+0000 7f9d9d400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f9da006eb90 0x7f9da00c9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33386/0 (socket says 172.21.15.76:33386) 2024-03-28T13:51:00.354 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.353+0000 7f9d9d400640 1 -- 172.21.15.76:0/3130869296 learned_addr learned my addr 172.21.15.76:0/3130869296 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:51:00.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.357+0000 7f9d9de00640 1 -- 172.21.15.76:0/3130869296 >> v2:172.21.15.76:3300/0 conn(0x7f9da006eb90 msgr2=0x7f9da00c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:51:00.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.357+0000 7f9d9de00640 1 --2- 172.21.15.76:0/3130869296 >> v2:172.21.15.76:3300/0 conn(0x7f9da006eb90 0x7f9da00c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:00.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.357+0000 7f9d9de00640 1 -- 172.21.15.76:0/3130869296 >> v1:172.21.15.76:6789/0 conn(0x7f9da006efb0 legacy=0x7f9da015a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:00.358 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.357+0000 7f9d9de00640 1 -- 172.21.15.76:0/3130869296 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da0070380 con 0x7f9da0154940 2024-03-28T13:51:00.364 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.361+0000 7f9d9de00640 1 --2- 172.21.15.76:0/3130869296 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9da0154940 0x7f9da006fe40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9d900097c0 tx=0x7f9d9001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69b3716360e665ee server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:00.368 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.365+0000 7f9d9ca00640 1 -- 172.21.15.76:0/3130869296 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d900b0070 con 0x7f9da0154940 2024-03-28T13:51:00.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.369+0000 7f9d9ca00640 1 -- 172.21.15.76:0/3130869296 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9d900ab600 con 0x7f9da0154940 2024-03-28T13:51:00.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.369+0000 7f9d9ca00640 1 -- 172.21.15.76:0/3130869296 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d900ab9f0 con 0x7f9da0154940 2024-03-28T13:51:00.373 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.373+0000 7f9d9f200640 1 -- 172.21.15.76:0/3130869296 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9da0154940 msgr2=0x7f9da006fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:00.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.373+0000 7f9d9f200640 1 --2- 172.21.15.76:0/3130869296 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9da0154940 0x7f9da006fe40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9d900097c0 tx=0x7f9d9001c410 comp rx=0 tx=0).stop 2024-03-28T13:51:00.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.373+0000 7f9d9f200640 1 -- 172.21.15.76:0/3130869296 shutdown_connections 2024-03-28T13:51:00.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.373+0000 7f9d9f200640 1 --2- 172.21.15.76:0/3130869296 >> v2:172.21.15.76:3300/0 conn(0x7f9da006eb90 0x7f9da00c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:00.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.373+0000 7f9d9f200640 1 --2- 172.21.15.76:0/3130869296 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9da0154940 0x7f9da006fe40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:00.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.373+0000 7f9d9f200640 1 -- 172.21.15.76:0/3130869296 >> 172.21.15.76:0/3130869296 conn(0x7f9da0070c10 msgr2=0x7f9da0071020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:51:00.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.373+0000 7f9d9f200640 1 -- 172.21.15.76:0/3130869296 shutdown_connections 2024-03-28T13:51:00.374 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.373+0000 7f9d9f200640 1 -- 172.21.15.76:0/3130869296 wait complete. 2024-03-28T13:51:00.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.373+0000 7f9d9f200640 1 Processor -- start 2024-03-28T13:51:00.375 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.373+0000 7f9d9f200640 1 -- start start 2024-03-28T13:51:00.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.373+0000 7f9d9f200640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9da006eb90 0x7f9da01f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:00.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.373+0000 7f9d9f200640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9da006efb0 0x7f9da00c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:00.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.373+0000 7f9d9f200640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9da0154940 0x7f9da01507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:00.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.373+0000 7f9d9f200640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f9da0167700 con 0x7f9da006efb0 2024-03-28T13:51:00.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.373+0000 7f9d9f200640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9da00c3dd0 con 0x7f9da0154940 2024-03-28T13:51:00.376 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.373+0000 7f9d9f200640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f9da0167880 con 0x7f9da006eb90 2024-03-28T13:51:00.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.377+0000 7f9d9d400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9da006efb0 0x7f9da00c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:00.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.377+0000 7f9d9de00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9da006eb90 0x7f9da01f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:00.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.377+0000 7f9d9d400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9da006efb0 0x7f9da00c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:33394/0 (socket says 172.21.15.76:33394) 2024-03-28T13:51:00.377 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.377+0000 7f9d9d400640 1 -- 172.21.15.76:0/2297295944 learned_addr learned my addr 172.21.15.76:0/2297295944 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:51:00.378 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.377+0000 7f9d9e800640 1 --2- 172.21.15.76:0/2297295944 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9da0154940 0x7f9da01507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:00.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.381+0000 7f9d9d400640 1 -- 172.21.15.76:0/2297295944 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9da006eb90 msgr2=0x7f9da01f42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:00.381 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.381+0000 7f9d9d400640 1 --2- 172.21.15.76:0/2297295944 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9da006eb90 0x7f9da01f42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:00.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.381+0000 7f9d9d400640 1 -- 172.21.15.76:0/2297295944 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9da0154940 msgr2=0x7f9da01507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:00.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.381+0000 7f9d9d400640 1 --2- 172.21.15.76:0/2297295944 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9da0154940 0x7f9da01507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:00.382 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.381+0000 7f9d9d400640 1 -- 172.21.15.76:0/2297295944 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da01f47f0 con 0x7f9da006efb0 2024-03-28T13:51:00.383 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.381+0000 7f9d9d400640 1 --2- 172.21.15.76:0/2297295944 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9da006efb0 0x7f9da00c8b40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00e8c0 tx=0x7f9d8c00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:00.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.385+0000 7f9d96000640 1 -- 172.21.15.76:0/2297295944 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c017070 con 0x7f9da006efb0 2024-03-28T13:51:00.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.385+0000 7f9d96000640 1 -- 172.21.15.76:0/2297295944 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9d8c00c940 con 0x7f9da006efb0 2024-03-28T13:51:00.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.385+0000 7f9d96000640 1 -- 172.21.15.76:0/2297295944 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c00cd50 con 0x7f9da006efb0 2024-03-28T13:51:00.388 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.385+0000 7f9d9f200640 1 -- 172.21.15.76:0/2297295944 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9da00c7800 con 0x7f9da006efb0 2024-03-28T13:51:00.389 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.385+0000 7f9d9f200640 1 -- 172.21.15.76:0/2297295944 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9da00c7aa0 con 0x7f9da006efb0 2024-03-28T13:51:00.390 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.389+0000 7f9d9f200640 1 -- 172.21.15.76:0/2297295944 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9da0068df0 con 0x7f9da006efb0 2024-03-28T13:51:00.409 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.409+0000 7f9d96000640 1 -- 172.21.15.76:0/2297295944 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f9d8c01a070 con 0x7f9da006efb0 2024-03-28T13:51:00.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.409+0000 7f9d96000640 1 --2- 172.21.15.76:0/2297295944 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9d80068040 0x7f9d8006a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:00.411 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.409+0000 7f9d9de00640 1 --2- 172.21.15.76:0/2297295944 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9d80068040 0x7f9d8006a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:00.412 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.409+0000 7f9d9de00640 1 --2- 172.21.15.76:0/2297295944 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9d80068040 0x7f9d8006a500 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9d900ad000 tx=0x7f9d90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:00.413 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.413+0000 7f9d96000640 1 -- 172.21.15.76:0/2297295944 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7f9d8c054e60 con 0x7f9da006efb0 2024-03-28T13:51:00.708 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.705+0000 7f9d96000640 1 -- 172.21.15.76:0/2297295944 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f9d8c056dc0 con 0x7f9da006efb0 2024-03-28T13:51:00.991 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:00.989+0000 7f9d9f200640 1 -- 172.21.15.76:0/2297295944 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9da0145060 con 0x7f9da006efb0 2024-03-28T13:51:01.026 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.025+0000 7f9d96000640 1 -- 172.21.15.76:0/2297295944 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6916 (secure 0 0 0) 0x7f9d8c05b0c0 con 0x7f9da006efb0 2024-03-28T13:51:01.027 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T13:51:01.027 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6835/335301918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6834","nonce":335301918},{"type":"v1","addr":"172.21.15.111:6835","nonce":335301918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-28T12:42:00.776505+0000","modified":"2024-03-28T13:17:47.764728+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4264,"mds_1":4258,"mds_2":4251,"mds_3":4248,"mds_4":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"e","rank":4,"incarnation":16,"state":"up:active","state_seq":18,"addr":"172.21.15.76:6837/1786218285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6836","nonce":1786218285},{"type":"v1","addr":"172.21.15.76:6837","nonce":1786218285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4248":{"gid":4248,"name":"a","rank":3,"incarnation":14,"state":"up:active","state_seq":18,"addr":"172.21.15.76:6839/2729208421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6838","nonce":2729208421},{"type":"v1","addr":"172.21.15.76:6839","nonce":2729208421}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4251":{"gid":4251,"name":"b","rank":2,"incarnation":12,"state":"up:active","state_seq":17,"addr":"172.21.15.111:6837/4176441330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6836","nonce":4176441330},{"type":"v1","addr":"172.21.15.111:6837","nonce":4176441330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4258":{"gid":4258,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":18,"addr":"172.21.15.111:6833/3175932821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":3175932821},{"type":"v1","addr":"172.21.15.111:6833","nonce":3175932821}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4264":{"gid":4264,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":540,"addr":"172.21.15.76:6835/544947706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6834","nonce":544947706},{"type":"v1","addr":"172.21.15.76:6835","nonce":544947706}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4264,"qdb_cluster":[4245,4258,4248,4251,4264]},"id":1}]} 2024-03-28T13:51:01.027 INFO:teuthology.orchestra.run.smithi076.stderr:dumped fsmap epoch 19 2024-03-28T13:51:01.029 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.029+0000 7f9d9f200640 1 -- 172.21.15.76:0/2297295944 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9d80068040 msgr2=0x7f9d8006a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:01.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.029+0000 7f9d9f200640 1 --2- 172.21.15.76:0/2297295944 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9d80068040 0x7f9d8006a500 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9d900ad000 tx=0x7f9d90008040 comp rx=0 tx=0).stop 2024-03-28T13:51:01.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.029+0000 7f9d9f200640 1 -- 172.21.15.76:0/2297295944 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9da006efb0 msgr2=0x7f9da00c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:01.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.029+0000 7f9d9f200640 1 --2- 172.21.15.76:0/2297295944 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9da006efb0 0x7f9da00c8b40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00e8c0 tx=0x7f9d8c00ed80 comp rx=0 tx=0).stop 2024-03-28T13:51:01.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.029+0000 7f9d9f200640 1 -- 172.21.15.76:0/2297295944 shutdown_connections 2024-03-28T13:51:01.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.029+0000 7f9d9f200640 1 --2- 172.21.15.76:0/2297295944 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9d80068040 0x7f9d8006a500 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:01.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.029+0000 7f9d9f200640 1 --2- 172.21.15.76:0/2297295944 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9da0154940 0x7f9da01507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:01.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.029+0000 7f9d9f200640 1 --2- 172.21.15.76:0/2297295944 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f9da006efb0 0x7f9da00c8b40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:01.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.029+0000 7f9d9f200640 1 --2- 172.21.15.76:0/2297295944 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9da006eb90 0x7f9da01f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:01.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.029+0000 7f9d9f200640 1 -- 172.21.15.76:0/2297295944 >> 172.21.15.76:0/2297295944 conn(0x7f9da0070c10 msgr2=0x7f9da0153a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:51:01.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.029+0000 7f9d9f200640 1 -- 172.21.15.76:0/2297295944 shutdown_connections 2024-03-28T13:51:01.030 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.029+0000 7f9d9f200640 1 -- 172.21.15.76:0/2297295944 wait complete. 2024-03-28T13:51:01.050 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-28T13:51:01.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.193+0000 7ff29a000640 1 Processor -- start 2024-03-28T13:51:01.194 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.193+0000 7ff29a000640 1 -- start start 2024-03-28T13:51:01.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.193+0000 7ff29a000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff29415b850 0x7ff2940c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:01.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.193+0000 7ff29a000640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff29415bc70 con 0x7ff2940c76a0 2024-03-28T13:51:01.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.193+0000 7ff29a000640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff29415c780 con 0x7ff2940723e0 2024-03-28T13:51:01.195 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.193+0000 7ff29a000640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7ff294159280 con 0x7ff29415b850 2024-03-28T13:51:01.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.193+0000 7ff293e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7ff29415b850 0x7ff2940c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:01.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.193+0000 7ff299600640 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7ff2940723e0 0x7ff294162be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.76:50562/0 (socket says 172.21.15.76:50562) 2024-03-28T13:51:01.196 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.193+0000 7ff299600640 1 -- 172.21.15.76:0/1429484664 learned_addr learned my addr 172.21.15.76:0/1429484664 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:51:01.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.197+0000 7ff293e00640 1 -- 172.21.15.76:0/1429484664 >> v1:172.21.15.111:6789/0 conn(0x7ff2940723e0 legacy=0x7ff294162be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:01.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.197+0000 7ff293e00640 1 -- 172.21.15.76:0/1429484664 >> v1:172.21.15.76:6789/0 conn(0x7ff2940c76a0 legacy=0x7ff294158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:01.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.197+0000 7ff293e00640 1 -- 172.21.15.76:0/1429484664 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29415bee0 con 0x7ff29415b850 2024-03-28T13:51:01.209 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.209+0000 7ff293e00640 1 --2- 172.21.15.76:0/1429484664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff29415b850 0x7ff2940c94d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff2800097c0 tx=0x7ff28001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ecbb1d1e2e1a702 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:01.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.213+0000 7ff293400640 1 -- 172.21.15.76:0/1429484664 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2800b5070 con 0x7ff29415b850 2024-03-28T13:51:01.214 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.213+0000 7ff293400640 1 -- 172.21.15.76:0/1429484664 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff2800a8990 con 0x7ff29415b850 2024-03-28T13:51:01.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.213+0000 7ff293400640 1 -- 172.21.15.76:0/1429484664 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2800a8d80 con 0x7ff29415b850 2024-03-28T13:51:01.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.213+0000 7ff29a000640 1 -- 172.21.15.76:0/1429484664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff29415b850 msgr2=0x7ff2940c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:01.215 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.213+0000 7ff29a000640 1 --2- 172.21.15.76:0/1429484664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff29415b850 0x7ff2940c94d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff2800097c0 tx=0x7ff28001ec90 comp rx=0 tx=0).stop 2024-03-28T13:51:01.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.213+0000 7ff29a000640 1 -- 172.21.15.76:0/1429484664 shutdown_connections 2024-03-28T13:51:01.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.213+0000 7ff29a000640 1 --2- 172.21.15.76:0/1429484664 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff29415b850 0x7ff2940c94d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:01.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.213+0000 7ff29a000640 1 -- 172.21.15.76:0/1429484664 >> 172.21.15.76:0/1429484664 conn(0x7ff29406e4e0 msgr2=0x7ff29406e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:51:01.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.213+0000 7ff29a000640 1 -- 172.21.15.76:0/1429484664 shutdown_connections 2024-03-28T13:51:01.216 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.213+0000 7ff29a000640 1 -- 172.21.15.76:0/1429484664 wait complete. 2024-03-28T13:51:01.217 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.217+0000 7ff29a000640 1 Processor -- start 2024-03-28T13:51:01.218 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.217+0000 7ff29a000640 1 -- start start 2024-03-28T13:51:01.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.217+0000 7ff29a000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2940723e0 0x7ff294155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:01.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.217+0000 7ff29a000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2940c76a0 0x7ff294141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:01.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.217+0000 7ff29a000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff29415b850 0x7ff2940c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:01.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.217+0000 7ff29a000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7ff29415c4a0 con 0x7ff29415b850 2024-03-28T13:51:01.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.217+0000 7ff29a000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff2941586e0 con 0x7ff2940c76a0 2024-03-28T13:51:01.219 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.217+0000 7ff29a000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff294158370 con 0x7ff2940723e0 2024-03-28T13:51:01.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.217+0000 7ff293e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2940c76a0 0x7ff294141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:01.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.217+0000 7ff299600640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff29415b850 0x7ff2940c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:01.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.217+0000 7ff298c00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2940723e0 0x7ff294155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:01.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.217+0000 7ff293e00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2940c76a0 0x7ff294141070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.76:55192/0 (socket says 172.21.15.76:55192) 2024-03-28T13:51:01.220 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.217+0000 7ff293e00640 1 -- 172.21.15.76:0/3968040517 learned_addr learned my addr 172.21.15.76:0/3968040517 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:51:01.225 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.225+0000 7ff299600640 1 -- 172.21.15.76:0/3968040517 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2940723e0 msgr2=0x7ff294155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:01.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.225+0000 7ff299600640 1 --2- 172.21.15.76:0/3968040517 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2940723e0 0x7ff294155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:01.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.225+0000 7ff299600640 1 -- 172.21.15.76:0/3968040517 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2940c76a0 msgr2=0x7ff294141070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:01.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.225+0000 7ff299600640 1 --2- 172.21.15.76:0/3968040517 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2940c76a0 0x7ff294141070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:01.226 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.225+0000 7ff299600640 1 -- 172.21.15.76:0/3968040517 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff294153800 con 0x7ff29415b850 2024-03-28T13:51:01.228 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.229+0000 7ff299600640 1 --2- 172.21.15.76:0/3968040517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff29415b850 0x7ff2940c41e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00caa0 tx=0x7ff28c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:01.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.233+0000 7ff290c00640 1 -- 172.21.15.76:0/3968040517 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c017070 con 0x7ff29415b850 2024-03-28T13:51:01.233 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.233+0000 7ff290c00640 1 -- 172.21.15.76:0/3968040517 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff28c00ac00 con 0x7ff29415b850 2024-03-28T13:51:01.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.233+0000 7ff290c00640 1 -- 172.21.15.76:0/3968040517 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c012400 con 0x7ff29415b850 2024-03-28T13:51:01.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.233+0000 7ff29a000640 1 -- 172.21.15.76:0/3968040517 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff294153aa0 con 0x7ff29415b850 2024-03-28T13:51:01.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.233+0000 7ff29a000640 1 -- 172.21.15.76:0/3968040517 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff294154000 con 0x7ff29415b850 2024-03-28T13:51:01.234 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.233+0000 7ff29a000640 1 -- 172.21.15.76:0/3968040517 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff294068df0 con 0x7ff29415b850 2024-03-28T13:51:01.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.261+0000 7ff290c00640 1 -- 172.21.15.76:0/3968040517 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7ff28c01a070 con 0x7ff29415b850 2024-03-28T13:51:01.264 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.265+0000 7ff290c00640 1 --2- 172.21.15.76:0/3968040517 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff274068010 0x7ff27406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:01.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.265+0000 7ff298c00640 1 --2- 172.21.15.76:0/3968040517 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff274068010 0x7ff27406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:01.265 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.265+0000 7ff298c00640 1 --2- 172.21.15.76:0/3968040517 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff274068010 0x7ff27406a4d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff288001810 tx=0x7ff288009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:01.269 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.269+0000 7ff290c00640 1 -- 172.21.15.76:0/3968040517 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7ff28c054b00 con 0x7ff29415b850 2024-03-28T13:51:01.542 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.541+0000 7ff290c00640 1 -- 172.21.15.76:0/3968040517 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7ff28c021020 con 0x7ff29415b850 2024-03-28T13:51:01.830 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.829+0000 7ff29a000640 1 -- 172.21.15.76:0/3968040517 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2940c6d80 con 0x7ff29415b850 2024-03-28T13:51:01.871 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.869+0000 7ff290c00640 1 -- 172.21.15.76:0/3968040517 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18798 (secure 0 0 0) 0x7ff28c056800 con 0x7ff29415b850 2024-03-28T13:51:01.872 INFO:teuthology.orchestra.run.smithi076.stdout: 2024-03-28T13:51:01.872 INFO:teuthology.orchestra.run.smithi076.stdout:{"epoch":29,"fsid":"ed125c42-99c2-4574-a55f-ea7172f89d9c","created":"2024-03-28T12:41:06.153972+0000","modified":"2024-03-28T12:42:15.156639+0000","last_up_change":"2024-03-28T12:41:23.027601+0000","last_in_change":"2024-03-28T12:41:13.906798+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-28T12:41:23.389090+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-28T12:41:58.010965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-28T12:41:59.698601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-28T12:42:05.363180+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"de27b51a-d060-4851-bd73-57aa86a82e7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6818","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6819","nonce":1923047176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6820","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6821","nonce":1923047176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6824","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6825","nonce":1923047176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6822","nonce":1923047176},{"type":"v1","addr":"172.21.15.76:6823","nonce":1923047176}]},"public_addr":"172.21.15.76:6819/1923047176","cluster_addr":"172.21.15.76:6821/1923047176","heartbeat_back_addr":"172.21.15.76:6825/1923047176","heartbeat_front_addr":"172.21.15.76:6823/1923047176","state":["exists","up"]},{"osd":1,"uuid":"344bf573-27c7-4ed4-82ed-23f41520eefe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6826","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6827","nonce":3991688226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6828","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6829","nonce":3991688226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6832","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6833","nonce":3991688226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6830","nonce":3991688226},{"type":"v1","addr":"172.21.15.76:6831","nonce":3991688226}]},"public_addr":"172.21.15.76:6827/3991688226","cluster_addr":"172.21.15.76:6829/3991688226","heartbeat_back_addr":"172.21.15.76:6833/3991688226","heartbeat_front_addr":"172.21.15.76:6831/3991688226","state":["exists","up"]},{"osd":2,"uuid":"479e5f83-9f98-4dc4-964a-1d254a2eb578","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6802","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6803","nonce":2048416202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6804","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6805","nonce":2048416202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6808","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6809","nonce":2048416202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6806","nonce":2048416202},{"type":"v1","addr":"172.21.15.76:6807","nonce":2048416202}]},"public_addr":"172.21.15.76:6803/2048416202","cluster_addr":"172.21.15.76:6805/2048416202","heartbeat_back_addr":"172.21.15.76:6809/2048416202","heartbeat_front_addr":"172.21.15.76:6807/2048416202","state":["exists","up"]},{"osd":3,"uuid":"64fb6a90-7551-4929-b702-e3a82f4b3c51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6810","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6811","nonce":2409656853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6812","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6813","nonce":2409656853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6816","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6817","nonce":2409656853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.76:6814","nonce":2409656853},{"type":"v1","addr":"172.21.15.76:6815","nonce":2409656853}]},"public_addr":"172.21.15.76:6811/2409656853","cluster_addr":"172.21.15.76:6813/2409656853","heartbeat_back_addr":"172.21.15.76:6817/2409656853","heartbeat_front_addr":"172.21.15.76:6815/2409656853","state":["exists","up"]},{"osd":4,"uuid":"9b274d52-59b5-4434-aff3-0ded0c4e714b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6810","nonce":3817953131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6814","nonce":3817953131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6821","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6823","nonce":3817953131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6817","nonce":3817953131},{"type":"v1","addr":"172.21.15.111:6819","nonce":3817953131}]},"public_addr":"172.21.15.111:6810/3817953131","cluster_addr":"172.21.15.111:6814/3817953131","heartbeat_back_addr":"172.21.15.111:6823/3817953131","heartbeat_front_addr":"172.21.15.111:6819/3817953131","state":["exists","up"]},{"osd":5,"uuid":"3d302c0a-5fc6-4892-a418-4ba3eaee0ea6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6801","nonce":189114011}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6803","nonce":189114011}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6807","nonce":189114011}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":189114011},{"type":"v1","addr":"172.21.15.111:6805","nonce":189114011}]},"public_addr":"172.21.15.111:6801/189114011","cluster_addr":"172.21.15.111:6803/189114011","heartbeat_back_addr":"172.21.15.111:6807/189114011","heartbeat_front_addr":"172.21.15.111:6805/189114011","state":["exists","up"]},{"osd":6,"uuid":"86e70c00-4b63-47bd-9232-d233b63427df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6825","nonce":4275101548}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6827","nonce":4275101548}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6831","nonce":4275101548}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4275101548},{"type":"v1","addr":"172.21.15.111:6829","nonce":4275101548}]},"public_addr":"172.21.15.111:6825/4275101548","cluster_addr":"172.21.15.111:6827/4275101548","heartbeat_back_addr":"172.21.15.111:6831/4275101548","heartbeat_front_addr":"172.21.15.111:6829/4275101548","state":["exists","up"]},{"osd":7,"uuid":"57701a91-c7ae-435e-9172-09e848747718","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6809","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6811","nonce":1094587541}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6813","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6815","nonce":1094587541}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6822","nonce":1094587541}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1094587541},{"type":"v1","addr":"172.21.15.111:6818","nonce":1094587541}]},"public_addr":"172.21.15.111:6811/1094587541","cluster_addr":"172.21.15.111:6815/1094587541","heartbeat_back_addr":"172.21.15.111:6822/1094587541","heartbeat_front_addr":"172.21.15.111:6818/1094587541","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.781861+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.855800+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.653569+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.602228+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.707515+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.503228+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.791336+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-28T12:41:19.693319+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.1","mappings":[{"from":3,"to":4}]},{"pgid":"4.6","mappings":[{"from":7,"to":0}]},{"pgid":"4.d","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":3,"to":5}]},{"pgid":"4.1d","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-28T13:51:01.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.873+0000 7ff29a000640 1 -- 172.21.15.76:0/3968040517 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff274068010 msgr2=0x7ff27406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:01.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.873+0000 7ff29a000640 1 --2- 172.21.15.76:0/3968040517 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff274068010 0x7ff27406a4d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff288001810 tx=0x7ff288009040 comp rx=0 tx=0).stop 2024-03-28T13:51:01.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.873+0000 7ff29a000640 1 -- 172.21.15.76:0/3968040517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff29415b850 msgr2=0x7ff2940c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:01.874 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.873+0000 7ff29a000640 1 --2- 172.21.15.76:0/3968040517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff29415b850 0x7ff2940c41e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00caa0 tx=0x7ff28c00cf60 comp rx=0 tx=0).stop 2024-03-28T13:51:01.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.873+0000 7ff29a000640 1 -- 172.21.15.76:0/3968040517 shutdown_connections 2024-03-28T13:51:01.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.873+0000 7ff29a000640 1 --2- 172.21.15.76:0/3968040517 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7ff274068010 0x7ff27406a4d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:01.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.873+0000 7ff29a000640 1 --2- 172.21.15.76:0/3968040517 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7ff29415b850 0x7ff2940c41e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:01.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.873+0000 7ff29a000640 1 --2- 172.21.15.76:0/3968040517 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2940c76a0 0x7ff294141070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:01.875 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.873+0000 7ff29a000640 1 --2- 172.21.15.76:0/3968040517 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2940723e0 0x7ff294155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:01.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.873+0000 7ff29a000640 1 -- 172.21.15.76:0/3968040517 >> 172.21.15.76:0/3968040517 conn(0x7ff29406e4e0 msgr2=0x7ff294158b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:51:01.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.873+0000 7ff29a000640 1 -- 172.21.15.76:0/3968040517 shutdown_connections 2024-03-28T13:51:01.876 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:01.873+0000 7ff29a000640 1 -- 172.21.15.76:0/3968040517 wait complete. 2024-03-28T13:51:01.895 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-28T13:51:02.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.073+0000 7eff5be00640 1 Processor -- start 2024-03-28T13:51:02.076 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.073+0000 7eff5be00640 1 -- start start 2024-03-28T13:51:02.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.077+0000 7eff5be00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7eff5c1528d0 0x7eff5c070810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:02.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.077+0000 7eff5be00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff5c06b5a0 con 0x7eff5c1524f0 2024-03-28T13:51:02.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.077+0000 7eff5be00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff5c1583d0 con 0x7eff5c0c95a0 2024-03-28T13:51:02.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.077+0000 7eff5be00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7eff5c15c8a0 con 0x7eff5c1528d0 2024-03-28T13:51:02.077 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.077+0000 7eff5aa00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7eff5c1524f0 0x7eff5c158bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:50216/0 (socket says 172.21.15.76:50216) 2024-03-28T13:51:02.078 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.077+0000 7eff5aa00640 1 -- 172.21.15.76:0/292946382 learned_addr learned my addr 172.21.15.76:0/292946382 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:51:02.079 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.077+0000 7eff5a000640 1 --2- 172.21.15.76:0/292946382 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7eff5c1528d0 0x7eff5c070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:02.081 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.081+0000 7eff59600640 1 -- 172.21.15.76:0/292946382 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1800863446 0 0) 0x7eff5c06b5a0 con 0x7eff5c1524f0 2024-03-28T13:51:02.082 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.081+0000 7eff59600640 1 -- 172.21.15.76:0/292946382 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff40003530 con 0x7eff5c1524f0 2024-03-28T13:51:02.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.081+0000 7eff5a000640 1 -- 172.21.15.76:0/292946382 >> v1:172.21.15.111:6789/0 conn(0x7eff5c0c95a0 legacy=0x7eff5c162d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:51:02.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.081+0000 7eff5a000640 1 -- 172.21.15.76:0/292946382 >> v1:172.21.15.76:6789/0 conn(0x7eff5c1524f0 legacy=0x7eff5c158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:02.083 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.081+0000 7eff5a000640 1 -- 172.21.15.76:0/292946382 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5c0c81a0 con 0x7eff5c1528d0 2024-03-28T13:51:02.089 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.089+0000 7eff5a000640 1 --2- 172.21.15.76:0/292946382 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7eff5c1528d0 0x7eff5c070810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7eff480097f0 tx=0x7eff4801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bf4fe71930651b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:02.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.093+0000 7eff59600640 1 -- 172.21.15.76:0/292946382 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff480b0070 con 0x7eff5c1528d0 2024-03-28T13:51:02.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.093+0000 7eff59600640 1 -- 172.21.15.76:0/292946382 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7eff480ab600 con 0x7eff5c1528d0 2024-03-28T13:51:02.095 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.093+0000 7eff59600640 1 -- 172.21.15.76:0/292946382 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff480ab9f0 con 0x7eff5c1528d0 2024-03-28T13:51:02.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.093+0000 7eff5be00640 1 -- 172.21.15.76:0/292946382 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7eff5c1528d0 msgr2=0x7eff5c070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:02.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.093+0000 7eff5be00640 1 --2- 172.21.15.76:0/292946382 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7eff5c1528d0 0x7eff5c070810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7eff480097f0 tx=0x7eff4801c410 comp rx=0 tx=0).stop 2024-03-28T13:51:02.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.093+0000 7eff5be00640 1 -- 172.21.15.76:0/292946382 shutdown_connections 2024-03-28T13:51:02.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.093+0000 7eff5be00640 1 --2- 172.21.15.76:0/292946382 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7eff5c1528d0 0x7eff5c070810 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:02.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.093+0000 7eff5be00640 1 -- 172.21.15.76:0/292946382 >> 172.21.15.76:0/292946382 conn(0x7eff5c073520 msgr2=0x7eff5c0ccf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:51:02.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.093+0000 7eff5be00640 1 -- 172.21.15.76:0/292946382 shutdown_connections 2024-03-28T13:51:02.096 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.093+0000 7eff5be00640 1 -- 172.21.15.76:0/292946382 wait complete. 2024-03-28T13:51:02.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.097+0000 7eff5be00640 1 Processor -- start 2024-03-28T13:51:02.099 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.097+0000 7eff5be00640 1 -- start start 2024-03-28T13:51:02.100 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.097+0000 7eff5be00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff5c0c95a0 0x7eff5c15ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:02.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.097+0000 7eff5be00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7eff5c1524f0 0x7eff5c0cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:02.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.097+0000 7eff5be00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7eff5c1528d0 0x7eff5c144390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:02.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.097+0000 7eff5be00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c070d50 con 0x7eff5c1524f0 2024-03-28T13:51:02.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.097+0000 7eff5be00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7eff5c0c7970 con 0x7eff5c0c95a0 2024-03-28T13:51:02.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.097+0000 7eff5be00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7eff5c070ed0 con 0x7eff5c1528d0 2024-03-28T13:51:02.101 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.101+0000 7eff5a000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7eff5c1524f0 0x7eff5c0cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:02.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.101+0000 7eff5b400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7eff5c1528d0 0x7eff5c144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:02.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.101+0000 7eff5b400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7eff5c1528d0 0x7eff5c144390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.76:41350/0 (socket says 172.21.15.76:41350) 2024-03-28T13:51:02.102 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.101+0000 7eff5b400640 1 -- 172.21.15.76:0/1291440751 learned_addr learned my addr 172.21.15.76:0/1291440751 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:51:02.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.105+0000 7eff5b400640 1 -- 172.21.15.76:0/1291440751 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff5c0c95a0 msgr2=0x7eff5c15ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:02.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.105+0000 7eff5b400640 1 --2- 172.21.15.76:0/1291440751 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff5c0c95a0 0x7eff5c15ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:02.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.105+0000 7eff5b400640 1 -- 172.21.15.76:0/1291440751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7eff5c1524f0 msgr2=0x7eff5c0cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:02.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.105+0000 7eff5b400640 1 --2- 172.21.15.76:0/1291440751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7eff5c1524f0 0x7eff5c0cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:02.107 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.105+0000 7eff5b400640 1 -- 172.21.15.76:0/1291440751 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5c0cb240 con 0x7eff5c1528d0 2024-03-28T13:51:02.110 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.109+0000 7eff5b400640 1 --2- 172.21.15.76:0/1291440751 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7eff5c1528d0 0x7eff5c144390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff5400c780 tx=0x7eff5400cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:02.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.113+0000 7eff52a00640 1 -- 172.21.15.76:0/1291440751 <== mon.2 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff54017070 con 0x7eff5c1528d0 2024-03-28T13:51:02.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.113+0000 7eff52a00640 1 -- 172.21.15.76:0/1291440751 <== mon.2 v2:172.21.15.111:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7eff54003db0 con 0x7eff5c1528d0 2024-03-28T13:51:02.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.113+0000 7eff52a00640 1 -- 172.21.15.76:0/1291440751 <== mon.2 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff540052d0 con 0x7eff5c1528d0 2024-03-28T13:51:02.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.113+0000 7eff5be00640 1 -- 172.21.15.76:0/1291440751 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff5c143a70 con 0x7eff5c1528d0 2024-03-28T13:51:02.117 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.117+0000 7eff5be00640 1 -- 172.21.15.76:0/1291440751 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7eff5c163e40 con 0x7eff5c1528d0 2024-03-28T13:51:02.118 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.117+0000 7eff5be00640 1 -- 172.21.15.76:0/1291440751 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff5c068df0 con 0x7eff5c1528d0 2024-03-28T13:51:02.154 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.153+0000 7eff52a00640 1 -- 172.21.15.76:0/1291440751 <== mon.2 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7eff5401a070 con 0x7eff5c1528d0 2024-03-28T13:51:02.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.153+0000 7eff52a00640 1 --2- 172.21.15.76:0/1291440751 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7eff3c068010 0x7eff3c06a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:02.155 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.153+0000 7eff5aa00640 1 --2- 172.21.15.76:0/1291440751 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7eff3c068010 0x7eff3c06a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:02.156 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.153+0000 7eff5aa00640 1 --2- 172.21.15.76:0/1291440751 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7eff3c068010 0x7eff3c06a4d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7eff4c007fd0 tx=0x7eff4c007900 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:02.158 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.157+0000 7eff52a00640 1 -- 172.21.15.76:0/1291440751 <== mon.2 v2:172.21.15.111:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6706+0+0 (secure 0 0 0) 0x7eff54054420 con 0x7eff5c1528d0 2024-03-28T13:51:02.482 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.481+0000 7eff52a00640 1 -- 172.21.15.76:0/1291440751 <== mon.2 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7eff54021020 con 0x7eff5c1528d0 2024-03-28T13:51:02.703 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:02.701+0000 7eff5be00640 1 -- 172.21.15.76:0/1291440751 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7eff5c155da0 con 0x7eff5c1528d0 2024-03-28T13:51:03.011 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.009+0000 7eff52a00640 1 -- 172.21.15.76:0/1291440751 <== mon.2 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7eff54056120 con 0x7eff5c1528d0 2024-03-28T13:51:03.011 INFO:teuthology.orchestra.run.smithi076.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-28T13:51:03.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.013+0000 7eff5be00640 1 -- 172.21.15.76:0/1291440751 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7eff3c068010 msgr2=0x7eff3c06a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:03.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.013+0000 7eff5be00640 1 --2- 172.21.15.76:0/1291440751 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7eff3c068010 0x7eff3c06a4d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7eff4c007fd0 tx=0x7eff4c007900 comp rx=0 tx=0).stop 2024-03-28T13:51:03.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.013+0000 7eff5be00640 1 -- 172.21.15.76:0/1291440751 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7eff5c1528d0 msgr2=0x7eff5c144390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:03.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.013+0000 7eff5be00640 1 --2- 172.21.15.76:0/1291440751 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7eff5c1528d0 0x7eff5c144390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff5400c780 tx=0x7eff5400cc40 comp rx=0 tx=0).stop 2024-03-28T13:51:03.014 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.013+0000 7eff5be00640 1 -- 172.21.15.76:0/1291440751 shutdown_connections 2024-03-28T13:51:03.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.013+0000 7eff5be00640 1 --2- 172.21.15.76:0/1291440751 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7eff3c068010 0x7eff3c06a4d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:03.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.013+0000 7eff5be00640 1 --2- 172.21.15.76:0/1291440751 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7eff5c1528d0 0x7eff5c144390 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:03.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.013+0000 7eff5be00640 1 --2- 172.21.15.76:0/1291440751 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7eff5c1524f0 0x7eff5c0cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:03.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.013+0000 7eff5be00640 1 --2- 172.21.15.76:0/1291440751 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7eff5c0c95a0 0x7eff5c15ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:03.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.013+0000 7eff5be00640 1 -- 172.21.15.76:0/1291440751 >> 172.21.15.76:0/1291440751 conn(0x7eff5c073520 msgr2=0x7eff5c1511a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:51:03.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.013+0000 7eff5be00640 1 -- 172.21.15.76:0/1291440751 shutdown_connections 2024-03-28T13:51:03.015 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.013+0000 7eff5be00640 1 -- 172.21.15.76:0/1291440751 wait complete. 2024-03-28T13:51:03.045 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-28T13:51:03.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.273+0000 7fd83ec00640 1 Processor -- start 2024-03-28T13:51:03.276 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.273+0000 7fd83ec00640 1 -- start start 2024-03-28T13:51:03.277 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.277+0000 7fd83ec00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd8380cab80 0x7fd8380cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:03.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.277+0000 7fd83ec00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd838158680 con 0x7fd838152800 2024-03-28T13:51:03.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.277+0000 7fd83ec00640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8380cb4f0 con 0x7fd8380cea30 2024-03-28T13:51:03.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.277+0000 7fd83ec00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7fd838159550 con 0x7fd8380cab80 2024-03-28T13:51:03.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.277+0000 7fd83cc00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd8380cab80 0x7fd8380cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:03.278 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.277+0000 7fd837e00640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7fd838152800 0x7fd8380c97e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:43044/0 (socket says 172.21.15.76:43044) 2024-03-28T13:51:03.279 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.277+0000 7fd837e00640 1 -- 172.21.15.76:0/1515043068 learned_addr learned my addr 172.21.15.76:0/1515043068 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:51:03.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.281+0000 7fd836a00640 1 -- 172.21.15.76:0/1515043068 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2265613243 0 0) 0x7fd838158680 con 0x7fd838152800 2024-03-28T13:51:03.282 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.281+0000 7fd836a00640 1 -- 172.21.15.76:0/1515043068 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd81c003530 con 0x7fd838152800 2024-03-28T13:51:03.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.281+0000 7fd83cc00640 1 -- 172.21.15.76:0/1515043068 >> v1:172.21.15.111:6789/0 conn(0x7fd8380cea30 legacy=0x7fd838071d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:03.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.281+0000 7fd83cc00640 1 -- 172.21.15.76:0/1515043068 >> v1:172.21.15.76:6789/0 conn(0x7fd838152800 legacy=0x7fd8380c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:03.283 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.281+0000 7fd83cc00640 1 -- 172.21.15.76:0/1515043068 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd838158940 con 0x7fd8380cab80 2024-03-28T13:51:03.288 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.285+0000 7fd83cc00640 1 --2- 172.21.15.76:0/1515043068 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8380cab80 0x7fd8380cafb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd830009d90 tx=0x7fd83001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d6eb87caa6bb82a server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:03.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.293+0000 7fd836a00640 1 -- 172.21.15.76:0/1515043068 <== mon.1 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8300b2070 con 0x7fd8380cab80 2024-03-28T13:51:03.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.293+0000 7fd836a00640 1 -- 172.21.15.76:0/1515043068 <== mon.1 v2:172.21.15.111:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd8300a5920 con 0x7fd8380cab80 2024-03-28T13:51:03.295 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.293+0000 7fd836a00640 1 -- 172.21.15.76:0/1515043068 <== mon.1 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8300a5d10 con 0x7fd8380cab80 2024-03-28T13:51:03.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.293+0000 7fd83ec00640 1 -- 172.21.15.76:0/1515043068 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8380cab80 msgr2=0x7fd8380cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:03.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.293+0000 7fd83ec00640 1 --2- 172.21.15.76:0/1515043068 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8380cab80 0x7fd8380cafb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd830009d90 tx=0x7fd83001c970 comp rx=0 tx=0).stop 2024-03-28T13:51:03.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.293+0000 7fd83ec00640 1 -- 172.21.15.76:0/1515043068 shutdown_connections 2024-03-28T13:51:03.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.293+0000 7fd83ec00640 1 --2- 172.21.15.76:0/1515043068 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8380cab80 0x7fd8380cafb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:03.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.293+0000 7fd83ec00640 1 -- 172.21.15.76:0/1515043068 >> 172.21.15.76:0/1515043068 conn(0x7fd838071540 msgr2=0x7fd838070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:51:03.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.293+0000 7fd83ec00640 1 -- 172.21.15.76:0/1515043068 shutdown_connections 2024-03-28T13:51:03.296 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.293+0000 7fd83ec00640 1 -- 172.21.15.76:0/1515043068 wait complete. 2024-03-28T13:51:03.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.297+0000 7fd83ec00640 1 Processor -- start 2024-03-28T13:51:03.298 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.297+0000 7fd83ec00640 1 -- start start 2024-03-28T13:51:03.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.297+0000 7fd83ec00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8380cab80 0x7fd8380b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:03.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.297+0000 7fd83ec00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd8380cea30 0x7fd8380cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:03.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.297+0000 7fd83ec00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd838152800 0x7fd8380cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:03.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.297+0000 7fd83ec00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fd838072410 con 0x7fd8380cea30 2024-03-28T13:51:03.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.297+0000 7fd83ec00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd8380c8d00 con 0x7fd8380cab80 2024-03-28T13:51:03.299 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.297+0000 7fd83ec00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd838072590 con 0x7fd838152800 2024-03-28T13:51:03.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.297+0000 7fd837400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd8380cea30 0x7fd8380cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:03.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.297+0000 7fd837400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd8380cea30 0x7fd8380cd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46152/0 (socket says 172.21.15.76:46152) 2024-03-28T13:51:03.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.297+0000 7fd837400640 1 -- 172.21.15.76:0/2103327986 learned_addr learned my addr 172.21.15.76:0/2103327986 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:51:03.300 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.297+0000 7fd83cc00640 1 --2- 172.21.15.76:0/2103327986 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd838152800 0x7fd8380cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:03.302 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.301+0000 7fd837e00640 1 --2- 172.21.15.76:0/2103327986 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8380cab80 0x7fd8380b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:03.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.301+0000 7fd837400640 1 -- 172.21.15.76:0/2103327986 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd838152800 msgr2=0x7fd8380cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:03.303 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.301+0000 7fd837400640 1 --2- 172.21.15.76:0/2103327986 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd838152800 0x7fd8380cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:03.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.301+0000 7fd837400640 1 -- 172.21.15.76:0/2103327986 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8380cab80 msgr2=0x7fd8380b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:03.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.301+0000 7fd837400640 1 --2- 172.21.15.76:0/2103327986 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8380cab80 0x7fd8380b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:03.304 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.301+0000 7fd837400640 1 -- 172.21.15.76:0/2103327986 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8380cce00 con 0x7fd8380cea30 2024-03-28T13:51:03.306 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.305+0000 7fd837400640 1 --2- 172.21.15.76:0/2103327986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd8380cea30 0x7fd8380cd6b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd82400c530 tx=0x7fd82400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.309+0000 7fd82fe00640 1 -- 172.21.15.76:0/2103327986 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824016020 con 0x7fd8380cea30 2024-03-28T13:51:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.309+0000 7fd82fe00640 1 -- 172.21.15.76:0/2103327986 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd824005220 con 0x7fd8380cea30 2024-03-28T13:51:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.309+0000 7fd83ec00640 1 -- 172.21.15.76:0/2103327986 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd838147530 con 0x7fd8380cea30 2024-03-28T13:51:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.309+0000 7fd82fe00640 1 -- 172.21.15.76:0/2103327986 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824007030 con 0x7fd8380cea30 2024-03-28T13:51:03.311 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.309+0000 7fd83ec00640 1 -- 172.21.15.76:0/2103327986 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd838147af0 con 0x7fd8380cea30 2024-03-28T13:51:03.312 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.309+0000 7fd83ec00640 1 -- 172.21.15.76:0/2103327986 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8380686e0 con 0x7fd8380cea30 2024-03-28T13:51:03.331 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.329+0000 7fd82fe00640 1 -- 172.21.15.76:0/2103327986 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fd8240071d0 con 0x7fd8380cea30 2024-03-28T13:51:03.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.329+0000 7fd82fe00640 1 --2- 172.21.15.76:0/2103327986 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd818067ff0 0x7fd81806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:03.332 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.329+0000 7fd837e00640 1 --2- 172.21.15.76:0/2103327986 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd818067ff0 0x7fd81806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:03.333 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.333+0000 7fd837e00640 1 --2- 172.21.15.76:0/2103327986 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd818067ff0 0x7fd81806a4b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd8280011f0 tx=0x7fd828009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:03.334 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.333+0000 7fd82fe00640 1 -- 172.21.15.76:0/2103327986 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7136+0+0 (secure 0 0 0) 0x7fd824054dc0 con 0x7fd8380cea30 2024-03-28T13:51:03.591 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.589+0000 7fd82fe00640 1 -- 172.21.15.76:0/2103327986 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fd824020020 con 0x7fd8380cea30 2024-03-28T13:51:03.818 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:03.817+0000 7fd83ec00640 1 -- 172.21.15.76:0/2103327986 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd8380c8a60 con 0x7fd8380cea30 2024-03-28T13:51:04.366 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.365+0000 7fd82fe00640 1 -- 172.21.15.76:0/2103327986 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7fd8240074c0 con 0x7fd8380cea30 2024-03-28T13:51:04.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.365+0000 7fd83ec00640 1 -- 172.21.15.76:0/2103327986 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd818067ff0 msgr2=0x7fd81806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:04.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.365+0000 7fd83ec00640 1 --2- 172.21.15.76:0/2103327986 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd818067ff0 0x7fd81806a4b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd8280011f0 tx=0x7fd828009040 comp rx=0 tx=0).stop 2024-03-28T13:51:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.365+0000 7fd83ec00640 1 -- 172.21.15.76:0/2103327986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd8380cea30 msgr2=0x7fd8380cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.365+0000 7fd83ec00640 1 --2- 172.21.15.76:0/2103327986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd8380cea30 0x7fd8380cd6b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd82400c530 tx=0x7fd82400c9f0 comp rx=0 tx=0).stop 2024-03-28T13:51:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.365+0000 7fd83ec00640 1 -- 172.21.15.76:0/2103327986 shutdown_connections 2024-03-28T13:51:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.365+0000 7fd83ec00640 1 --2- 172.21.15.76:0/2103327986 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fd818067ff0 0x7fd81806a4b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.365+0000 7fd83ec00640 1 --2- 172.21.15.76:0/2103327986 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd838152800 0x7fd8380cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.365+0000 7fd83ec00640 1 --2- 172.21.15.76:0/2103327986 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fd8380cea30 0x7fd8380cd6b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.365+0000 7fd83ec00640 1 --2- 172.21.15.76:0/2103327986 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8380cab80 0x7fd8380b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.365+0000 7fd83ec00640 1 -- 172.21.15.76:0/2103327986 >> 172.21.15.76:0/2103327986 conn(0x7fd838071540 msgr2=0x7fd838151650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:51:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.365+0000 7fd83ec00640 1 -- 172.21.15.76:0/2103327986 shutdown_connections 2024-03-28T13:51:04.372 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.369+0000 7fd83ec00640 1 -- 172.21.15.76:0/2103327986 wait complete. 2024-03-28T13:51:04.398 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-28T13:51:04.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.617+0000 7f908c400640 1 Processor -- start 2024-03-28T13:51:04.617 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.617+0000 7f908c400640 1 -- start start 2024-03-28T13:51:04.618 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.617+0000 7f908c400640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f90841590a0 0x7f90840cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:04.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.617+0000 7f908c400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f90840c4680 0x7f90840ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:04.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.617+0000 7f908c400640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90841621c0 con 0x7f90840c9e80 2024-03-28T13:51:04.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.617+0000 7f908c400640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7f9084162460 con 0x7f90841590a0 2024-03-28T13:51:04.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.617+0000 7f908c400640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f9084162740 con 0x7f90840c4680 2024-03-28T13:51:04.619 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.617+0000 7f9089a00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f90841590a0 0x7f90840cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:04.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.617+0000 7f9089a00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7f90841590a0 0x7f90840cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46162/0 (socket says 172.21.15.76:46162) 2024-03-28T13:51:04.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.617+0000 7f9089a00640 1 -- 172.21.15.76:0/2949355130 learned_addr learned my addr 172.21.15.76:0/2949355130 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:51:04.620 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.617+0000 7f908a400640 1 --2- 172.21.15.76:0/2949355130 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f90840c4680 0x7f90840ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:04.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.621+0000 7f9089a00640 1 -- 172.21.15.76:0/2949355130 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f90840c4680 msgr2=0x7f90840ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:51:04.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.621+0000 7f9089a00640 1 --2- 172.21.15.76:0/2949355130 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f90840c4680 0x7f90840ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:04.622 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.621+0000 7f9089a00640 1 -- 172.21.15.76:0/2949355130 >> v1:172.21.15.111:6789/0 conn(0x7f90840c9e80 legacy=0x7f90840c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:04.623 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.621+0000 7f9089a00640 1 -- 172.21.15.76:0/2949355130 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9084162a20 con 0x7f90841590a0 2024-03-28T13:51:04.627 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.625+0000 7f9089a00640 1 --2- 172.21.15.76:0/2949355130 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90841590a0 0x7f90840cdef0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9078009870 tx=0x7f907801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34252ca218c010b server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:04.630 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.629+0000 7f9083e00640 1 -- 172.21.15.76:0/2949355130 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90780b5070 con 0x7f90841590a0 2024-03-28T13:51:04.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.629+0000 7f9083e00640 1 -- 172.21.15.76:0/2949355130 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f90780a8a50 con 0x7f90841590a0 2024-03-28T13:51:04.631 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.629+0000 7f9083e00640 1 -- 172.21.15.76:0/2949355130 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90780a8e40 con 0x7f90841590a0 2024-03-28T13:51:04.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.629+0000 7f908c400640 1 -- 172.21.15.76:0/2949355130 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90841590a0 msgr2=0x7f90840cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:04.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.629+0000 7f908c400640 1 --2- 172.21.15.76:0/2949355130 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90841590a0 0x7f90840cdef0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9078009870 tx=0x7f907801ed50 comp rx=0 tx=0).stop 2024-03-28T13:51:04.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.629+0000 7f908c400640 1 -- 172.21.15.76:0/2949355130 shutdown_connections 2024-03-28T13:51:04.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.629+0000 7f908c400640 1 --2- 172.21.15.76:0/2949355130 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f90840c4680 0x7f90840ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:04.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.629+0000 7f908c400640 1 --2- 172.21.15.76:0/2949355130 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90841590a0 0x7f90840cdef0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:04.632 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.629+0000 7f908c400640 1 -- 172.21.15.76:0/2949355130 >> 172.21.15.76:0/2949355130 conn(0x7f9084067330 msgr2=0x7f9084067740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:51:04.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.629+0000 7f908c400640 1 -- 172.21.15.76:0/2949355130 shutdown_connections 2024-03-28T13:51:04.633 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.629+0000 7f908c400640 1 -- 172.21.15.76:0/2949355130 wait complete. 2024-03-28T13:51:04.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.633+0000 7f908c400640 1 Processor -- start 2024-03-28T13:51:04.635 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.633+0000 7f908c400640 1 -- start start 2024-03-28T13:51:04.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.633+0000 7f908c400640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90840c4680 0x7f90841f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:04.636 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.633+0000 7f908c400640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f90840c9e80 0x7f9084155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:04.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.633+0000 7f908c400640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f90841590a0 0x7f90840ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:04.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.633+0000 7f908c400640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f908415ed30 con 0x7f90840c4680 2024-03-28T13:51:04.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.633+0000 7f908c400640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f908415ebb0 con 0x7f90841590a0 2024-03-28T13:51:04.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.633+0000 7f908c400640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f908415eeb0 con 0x7f90840c9e80 2024-03-28T13:51:04.637 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.637+0000 7f9089a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90840c4680 0x7f90841f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:04.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.637+0000 7f9089a00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90840c4680 0x7f90841f55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46172/0 (socket says 172.21.15.76:46172) 2024-03-28T13:51:04.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.637+0000 7f9089a00640 1 -- 172.21.15.76:0/1583967146 learned_addr learned my addr 172.21.15.76:0/1583967146 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:51:04.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.637+0000 7f908a400640 1 --2- 172.21.15.76:0/1583967146 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f90841590a0 0x7f90840ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:04.638 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.637+0000 7f9089000640 1 --2- 172.21.15.76:0/1583967146 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f90840c9e80 0x7f9084155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:04.642 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.641+0000 7f9089a00640 1 -- 172.21.15.76:0/1583967146 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f90840c9e80 msgr2=0x7f9084155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:04.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.641+0000 7f9089a00640 1 --2- 172.21.15.76:0/1583967146 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f90840c9e80 0x7f9084155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:04.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.641+0000 7f9089a00640 1 -- 172.21.15.76:0/1583967146 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f90841590a0 msgr2=0x7f90840ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:04.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.641+0000 7f9089a00640 1 --2- 172.21.15.76:0/1583967146 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f90841590a0 0x7f90840ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:04.643 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.641+0000 7f9089a00640 1 -- 172.21.15.76:0/1583967146 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90841542a0 con 0x7f90840c4680 2024-03-28T13:51:04.646 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.645+0000 7f9089a00640 1 --2- 172.21.15.76:0/1583967146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90840c4680 0x7f90841f55a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f90780b3040 tx=0x7f907801baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:04.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.649+0000 7f9081600640 1 -- 172.21.15.76:0/1583967146 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90780c0070 con 0x7f90840c4680 2024-03-28T13:51:04.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.649+0000 7f9081600640 1 -- 172.21.15.76:0/1583967146 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f90780ae770 con 0x7f90840c4680 2024-03-28T13:51:04.650 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.649+0000 7f9081600640 1 -- 172.21.15.76:0/1583967146 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90780b5070 con 0x7f90840c4680 2024-03-28T13:51:04.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.649+0000 7f908c400640 1 -- 172.21.15.76:0/1583967146 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90840cbfb0 con 0x7f90840c4680 2024-03-28T13:51:04.651 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.649+0000 7f908c400640 1 -- 172.21.15.76:0/1583967146 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90840cc570 con 0x7f90840c4680 2024-03-28T13:51:04.652 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.649+0000 7f908c400640 1 -- 172.21.15.76:0/1583967146 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9084068860 con 0x7f90840c4680 2024-03-28T13:51:04.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.681+0000 7f9081600640 1 -- 172.21.15.76:0/1583967146 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f90780c3070 con 0x7f90840c4680 2024-03-28T13:51:04.681 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.681+0000 7f9081600640 1 --2- 172.21.15.76:0/1583967146 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9064068010 0x7f906406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:04.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.681+0000 7f9089000640 1 --2- 172.21.15.76:0/1583967146 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9064068010 0x7f906406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:04.682 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.681+0000 7f9089000640 1 --2- 172.21.15.76:0/1583967146 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9064068010 0x7f906406a4d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f90840cdca0 tx=0x7f9070009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:04.686 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.685+0000 7f9081600640 1 -- 172.21.15.76:0/1583967146 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 7136+0+0 (secure 0 0 0) 0x7f90780f23a0 con 0x7f90840c4680 2024-03-28T13:51:04.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:04.933+0000 7f9081600640 1 -- 172.21.15.76:0/1583967146 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f90780ca080 con 0x7f90840c4680 2024-03-28T13:51:05.108 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.105+0000 7f908c400640 1 -- 172.21.15.76:0/1583967146 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f908406e540 con 0x7f90840c4680 2024-03-28T13:51:05.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e is failed for ~0s 2024-03-28T13:51:05.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-03-28T13:51:05.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-03-28T13:51:05.529 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.529+0000 7f9081600640 1 -- 172.21.15.76:0/1583967146 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) ==== 181+0+0 (secure 0 0 0) 0x7f90780188b0 con 0x7f90840c4680 2024-03-28T13:51:05.529 INFO:teuthology.orchestra.run.smithi076.stderr:pool 'cephfs_metadata' removed 2024-03-28T13:51:05.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.529+0000 7f908c400640 1 -- 172.21.15.76:0/1583967146 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9064068010 msgr2=0x7f906406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:05.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.529+0000 7f908c400640 1 --2- 172.21.15.76:0/1583967146 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9064068010 0x7f906406a4d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f90840cdca0 tx=0x7f9070009040 comp rx=0 tx=0).stop 2024-03-28T13:51:05.531 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.529+0000 7f908c400640 1 -- 172.21.15.76:0/1583967146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90840c4680 msgr2=0x7f90841f55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:05.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.529+0000 7f908c400640 1 --2- 172.21.15.76:0/1583967146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90840c4680 0x7f90841f55a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f90780b3040 tx=0x7f907801baf0 comp rx=0 tx=0).stop 2024-03-28T13:51:05.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.529+0000 7f908c400640 1 -- 172.21.15.76:0/1583967146 shutdown_connections 2024-03-28T13:51:05.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.529+0000 7f908c400640 1 --2- 172.21.15.76:0/1583967146 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f9064068010 0x7f906406a4d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:05.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.529+0000 7f908c400640 1 --2- 172.21.15.76:0/1583967146 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f90841590a0 0x7f90840ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:05.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.529+0000 7f908c400640 1 --2- 172.21.15.76:0/1583967146 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f90840c9e80 0x7f9084155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:05.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.529+0000 7f908c400640 1 --2- 172.21.15.76:0/1583967146 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f90840c4680 0x7f90841f55a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:05.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.529+0000 7f908c400640 1 -- 172.21.15.76:0/1583967146 >> 172.21.15.76:0/1583967146 conn(0x7f9084067330 msgr2=0x7f9084074e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:51:05.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.529+0000 7f908c400640 1 -- 172.21.15.76:0/1583967146 shutdown_connections 2024-03-28T13:51:05.532 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.529+0000 7f908c400640 1 -- 172.21.15.76:0/1583967146 wait complete. 2024-03-28T13:51:05.554 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-28T13:51:05.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.737+0000 7f77eaa00640 1 Processor -- start 2024-03-28T13:51:05.737 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.737+0000 7f77eaa00640 1 -- start start 2024-03-28T13:51:05.738 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.737+0000 7f77eaa00640 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f77e406c940 0x7f77e40c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:05.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.737+0000 7f77eaa00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f77e40cdeb0 0x7f77e40ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:05.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.737+0000 7f77eaa00640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77e415a7d0 con 0x7f77e41549f0 2024-03-28T13:51:05.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.737+0000 7f77eaa00640 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 -- 0x7f77e40c90d0 con 0x7f77e406c940 2024-03-28T13:51:05.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.737+0000 7f77eaa00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f77e415aa90 con 0x7f77e40cdeb0 2024-03-28T13:51:05.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.737+0000 7f77e9600640 1 --1- >> v1:172.21.15.76:6789/0 conn(0x7f77e41549f0 0x7f77e406ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.76:6789/0 says I am v1:172.21.15.76:43046/0 (socket says 172.21.15.76:43046) 2024-03-28T13:51:05.739 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.737+0000 7f77e9600640 1 -- 172.21.15.76:0/2851727058 learned_addr learned my addr 172.21.15.76:0/2851727058 (peer_addr_for_me v1:172.21.15.76:0/0) 2024-03-28T13:51:05.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.737+0000 7f77e8c00640 1 --2- 172.21.15.76:0/2851727058 >> v2:172.21.15.111:3300/0 conn(0x7f77e406c940 0x7f77e40c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:05.740 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.737+0000 7f77ea000640 1 --2- 172.21.15.76:0/2851727058 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f77e40cdeb0 0x7f77e40ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:05.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.741+0000 7f77e3e00640 1 -- 172.21.15.76:0/2851727058 <== mon.0 v1:172.21.15.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1090286336 0 0) 0x7f77e415a7d0 con 0x7f77e41549f0 2024-03-28T13:51:05.742 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.741+0000 7f77e3e00640 1 -- 172.21.15.76:0/2851727058 --> v1:172.21.15.76:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77cc003530 con 0x7f77e41549f0 2024-03-28T13:51:05.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.745+0000 7f77e3e00640 1 -- 172.21.15.76:0/2851727058 <== mon.0 v1:172.21.15.76:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 802684728 0 0) 0x7f77cc003530 con 0x7f77e41549f0 2024-03-28T13:51:05.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.745+0000 7f77e3e00640 1 -- 172.21.15.76:0/2851727058 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f77e40cdeb0 msgr2=0x7f77e40ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:51:05.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.745+0000 7f77e3e00640 1 --2- 172.21.15.76:0/2851727058 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f77e40cdeb0 0x7f77e40ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:05.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.745+0000 7f77e3e00640 1 -- 172.21.15.76:0/2851727058 >> v2:172.21.15.111:3300/0 conn(0x7f77e406c940 msgr2=0x7f77e40c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:51:05.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.745+0000 7f77e3e00640 1 --2- 172.21.15.76:0/2851727058 >> v2:172.21.15.111:3300/0 conn(0x7f77e406c940 0x7f77e40c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:05.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.745+0000 7f77e3e00640 1 -- 172.21.15.76:0/2851727058 --> v1:172.21.15.76:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e415ad70 con 0x7f77e41549f0 2024-03-28T13:51:05.746 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.745+0000 7f77e3e00640 1 -- 172.21.15.76:0/2851727058 <== mon.0 v1:172.21.15.76:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1872483444 0 0) 0x7f77d8001680 con 0x7f77e41549f0 2024-03-28T13:51:05.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.745+0000 7f77e3e00640 1 -- 172.21.15.76:0/2851727058 >> v1:172.21.15.76:6789/0 conn(0x7f77e41549f0 legacy=0x7f77e406ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:05.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.745+0000 7f77e3e00640 1 --2- 172.21.15.76:0/2851727058 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc0039c0 0x7f77cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:05.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.745+0000 7f77e3e00640 1 --2- 172.21.15.76:0/2851727058 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77cc004810 0x7f77cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:05.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.745+0000 7f77e3e00640 1 --2- 172.21.15.76:0/2851727058 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f77e40cdeb0 0x7f77cc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:05.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.745+0000 7f77e3e00640 1 -- 172.21.15.76:0/2851727058 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f77e40c90d0 con 0x7f77cc004810 2024-03-28T13:51:05.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.745+0000 7f77e3e00640 1 -- 172.21.15.76:0/2851727058 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f77e415aa90 con 0x7f77cc0039c0 2024-03-28T13:51:05.747 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.745+0000 7f77e3e00640 1 -- 172.21.15.76:0/2851727058 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f77cc00ba20 con 0x7f77e40cdeb0 2024-03-28T13:51:05.748 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.749+0000 7f77e8c00640 1 --2- 172.21.15.76:0/2851727058 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77cc004810 0x7f77cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:05.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.749+0000 7f77e8c00640 1 -- 172.21.15.76:0/2851727058 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f77e40cdeb0 msgr2=0x7f77cc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:51:05.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.749+0000 7f77e8c00640 1 --2- 172.21.15.76:0/2851727058 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f77e40cdeb0 0x7f77cc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:05.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.749+0000 7f77e8c00640 1 -- 172.21.15.76:0/2851727058 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc0039c0 msgr2=0x7f77cc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:51:05.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.749+0000 7f77e8c00640 1 --2- 172.21.15.76:0/2851727058 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc0039c0 0x7f77cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:05.751 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.749+0000 7f77e8c00640 1 -- 172.21.15.76:0/2851727058 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77cc003530 con 0x7f77cc004810 2024-03-28T13:51:05.755 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.753+0000 7f77e8c00640 1 --2- 172.21.15.76:0/2851727058 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77cc004810 0x7f77cc004c90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009b10 tx=0x7f77d001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798a4e526810a043 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:05.757 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.757+0000 7f77e3e00640 1 -- 172.21.15.76:0/2851727058 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d00096b0 con 0x7f77cc004810 2024-03-28T13:51:05.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.757+0000 7f77e3e00640 1 -- 172.21.15.76:0/2851727058 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f77d00a64a0 con 0x7f77cc004810 2024-03-28T13:51:05.759 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.757+0000 7f77e3e00640 1 -- 172.21.15.76:0/2851727058 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d00a68b0 con 0x7f77cc004810 2024-03-28T13:51:05.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.757+0000 7f77eaa00640 1 -- 172.21.15.76:0/2851727058 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77cc004810 msgr2=0x7f77cc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:05.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.757+0000 7f77eaa00640 1 --2- 172.21.15.76:0/2851727058 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77cc004810 0x7f77cc004c90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009b10 tx=0x7f77d001cab0 comp rx=0 tx=0).stop 2024-03-28T13:51:05.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.757+0000 7f77ea000640 1 -- 172.21.15.76:0/2851727058 reap_dead start 2024-03-28T13:51:05.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.757+0000 7f77eaa00640 1 -- 172.21.15.76:0/2851727058 shutdown_connections 2024-03-28T13:51:05.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.757+0000 7f77eaa00640 1 -- 172.21.15.76:0/2851727058 >> 172.21.15.76:0/2851727058 conn(0x7f77e4067330 msgr2=0x7f77e4067740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:51:05.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.757+0000 7f77eaa00640 1 -- 172.21.15.76:0/2851727058 shutdown_connections 2024-03-28T13:51:05.760 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.757+0000 7f77eaa00640 1 -- 172.21.15.76:0/2851727058 wait complete. 2024-03-28T13:51:05.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.761+0000 7f77eaa00640 1 Processor -- start 2024-03-28T13:51:05.761 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.761+0000 7f77eaa00640 1 -- start start 2024-03-28T13:51:05.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.761+0000 7f77eaa00640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc004810 0x7f77e415dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:05.762 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.761+0000 7f77eaa00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77e414b030 0x7f77e414b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:05.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.761+0000 7f77eaa00640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f77e4149300 0x7f77e4149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:05.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.761+0000 7f77eaa00640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7f77e4154dd0 con 0x7f77e414b030 2024-03-28T13:51:05.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.761+0000 7f77eaa00640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f77e40ce6d0 con 0x7f77cc004810 2024-03-28T13:51:05.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.761+0000 7f77eaa00640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7f77e4154f50 con 0x7f77e4149300 2024-03-28T13:51:05.763 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.761+0000 7f77e8c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77e414b030 0x7f77e414b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:05.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.761+0000 7f77e8c00640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77e414b030 0x7f77e414b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46180/0 (socket says 172.21.15.76:46180) 2024-03-28T13:51:05.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.761+0000 7f77e8c00640 1 -- 172.21.15.76:0/4067140117 learned_addr learned my addr 172.21.15.76:0/4067140117 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:51:05.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.761+0000 7f77ea000640 1 --2- 172.21.15.76:0/4067140117 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f77e4149300 0x7f77e4149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:05.764 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.761+0000 7f77e9600640 1 --2- 172.21.15.76:0/4067140117 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc004810 0x7f77e415dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:05.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.765+0000 7f77e8c00640 1 -- 172.21.15.76:0/4067140117 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f77e4149300 msgr2=0x7f77e4149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:05.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.765+0000 7f77e8c00640 1 --2- 172.21.15.76:0/4067140117 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f77e4149300 0x7f77e4149740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:05.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.765+0000 7f77e8c00640 1 -- 172.21.15.76:0/4067140117 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc004810 msgr2=0x7f77e415dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:05.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.765+0000 7f77e8c00640 1 --2- 172.21.15.76:0/4067140117 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc004810 0x7f77e415dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:05.767 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.765+0000 7f77e8c00640 1 -- 172.21.15.76:0/4067140117 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e40c4ca0 con 0x7f77e414b030 2024-03-28T13:51:05.769 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.769+0000 7f77e8c00640 1 --2- 172.21.15.76:0/4067140117 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77e414b030 0x7f77e414b470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f77d0006f90 tx=0x7f77cc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:05.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.773+0000 7f77e1600640 1 -- 172.21.15.76:0/4067140117 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d00c0070 con 0x7f77e414b030 2024-03-28T13:51:05.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.773+0000 7f77e1600640 1 -- 172.21.15.76:0/4067140117 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f77d000f000 con 0x7f77e414b030 2024-03-28T13:51:05.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.773+0000 7f77e1600640 1 -- 172.21.15.76:0/4067140117 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d00a6dd0 con 0x7f77e414b030 2024-03-28T13:51:05.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.773+0000 7f77eaa00640 1 -- 172.21.15.76:0/4067140117 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e40b06d0 con 0x7f77e414b030 2024-03-28T13:51:05.774 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.773+0000 7f77eaa00640 1 -- 172.21.15.76:0/4067140117 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e414d0b0 con 0x7f77e414b030 2024-03-28T13:51:05.775 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.773+0000 7f77eaa00640 1 -- 172.21.15.76:0/4067140117 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e406c4e0 con 0x7f77e414b030 2024-03-28T13:51:05.792 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.793+0000 7f77e1600640 1 -- 172.21.15.76:0/4067140117 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7f77d00c3070 con 0x7f77e414b030 2024-03-28T13:51:05.793 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.793+0000 7f77e1600640 1 --2- 172.21.15.76:0/4067140117 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f77c4068010 0x7f77c406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:05.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.793+0000 7f77e9600640 1 --2- 172.21.15.76:0/4067140117 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f77c4068010 0x7f77c406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:05.794 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.793+0000 7f77e9600640 1 --2- 172.21.15.76:0/4067140117 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f77c4068010 0x7f77c406a4d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f77d8001c40 tx=0x7f77d8001bd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:05.798 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:05.793+0000 7f77e1600640 1 -- 172.21.15.76:0/4067140117 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6698+0+0 (secure 0 0 0) 0x7f77d00eea10 con 0x7f77e414b030 2024-03-28T13:51:06.034 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.033+0000 7f77e1600640 1 -- 172.21.15.76:0/4067140117 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7f77d00cb020 con 0x7f77e414b030 2024-03-28T13:51:06.231 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.229+0000 7f77eaa00640 1 -- 172.21.15.76:0/4067140117 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f77e40c9840 con 0x7f77e414b030 2024-03-28T13:51:06.729 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.729+0000 7f77e1600640 1 -- 172.21.15.76:0/4067140117 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) ==== 169+0+0 (secure 0 0 0) 0x7f77d00ac020 con 0x7f77e414b030 2024-03-28T13:51:06.730 INFO:teuthology.orchestra.run.smithi076.stderr:pool 'cephfs_data' removed 2024-03-28T13:51:06.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.729+0000 7f77eaa00640 1 -- 172.21.15.76:0/4067140117 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f77c4068010 msgr2=0x7f77c406a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:06.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.729+0000 7f77eaa00640 1 --2- 172.21.15.76:0/4067140117 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f77c4068010 0x7f77c406a4d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f77d8001c40 tx=0x7f77d8001bd0 comp rx=0 tx=0).stop 2024-03-28T13:51:06.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.729+0000 7f77eaa00640 1 -- 172.21.15.76:0/4067140117 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77e414b030 msgr2=0x7f77e414b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:06.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.729+0000 7f77eaa00640 1 --2- 172.21.15.76:0/4067140117 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77e414b030 0x7f77e414b470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f77d0006f90 tx=0x7f77cc005840 comp rx=0 tx=0).stop 2024-03-28T13:51:06.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.729+0000 7f77eaa00640 1 -- 172.21.15.76:0/4067140117 shutdown_connections 2024-03-28T13:51:06.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.729+0000 7f77eaa00640 1 --2- 172.21.15.76:0/4067140117 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7f77c4068010 0x7f77c406a4d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:06.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.729+0000 7f77eaa00640 1 --2- 172.21.15.76:0/4067140117 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f77e4149300 0x7f77e4149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:06.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.729+0000 7f77eaa00640 1 --2- 172.21.15.76:0/4067140117 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7f77e414b030 0x7f77e414b470 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:06.732 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.729+0000 7f77eaa00640 1 --2- 172.21.15.76:0/4067140117 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc004810 0x7f77e415dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:06.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.729+0000 7f77eaa00640 1 -- 172.21.15.76:0/4067140117 >> 172.21.15.76:0/4067140117 conn(0x7f77e4067330 msgr2=0x7f77e40cc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:51:06.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.729+0000 7f77eaa00640 1 -- 172.21.15.76:0/4067140117 shutdown_connections 2024-03-28T13:51:06.733 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.729+0000 7f77eaa00640 1 -- 172.21.15.76:0/4067140117 wait complete. 2024-03-28T13:51:06.752 DEBUG:teuthology.orchestra.run.smithi076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-03-28T13:51:06.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.913+0000 7fdb1f000640 1 Processor -- start 2024-03-28T13:51:06.915 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.913+0000 7fdb1f000640 1 -- start start 2024-03-28T13:51:06.916 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.913+0000 7fdb1f000640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fdb1806ec30 0x7fdb18158270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:06.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.913+0000 7fdb1f000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb1806f010 0x7fdb18072150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:06.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.913+0000 7fdb1f000640 1 -- --> v1:172.21.15.76:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb181577d0 con 0x7fdb180c7fa0 2024-03-28T13:51:06.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.913+0000 7fdb1f000640 1 -- --> v2:172.21.15.76:3300/0 -- mon_getmap magic: 0 -- 0x7fdb18157de0 con 0x7fdb1806ec30 2024-03-28T13:51:06.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.913+0000 7fdb1f000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fdb180c31a0 con 0x7fdb1806f010 2024-03-28T13:51:06.917 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.917+0000 7fdb17e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fdb1806ec30 0x7fdb18158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:06.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.917+0000 7fdb17e00640 1 --2- >> v2:172.21.15.76:3300/0 conn(0x7fdb1806ec30 0x7fdb18158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46188/0 (socket says 172.21.15.76:46188) 2024-03-28T13:51:06.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.917+0000 7fdb17e00640 1 -- 172.21.15.76:0/2771586888 learned_addr learned my addr 172.21.15.76:0/2771586888 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:51:06.918 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.917+0000 7fdb1d000640 1 --2- 172.21.15.76:0/2771586888 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb1806f010 0x7fdb18072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:06.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.917+0000 7fdb17e00640 1 -- 172.21.15.76:0/2771586888 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb1806f010 msgr2=0x7fdb18072150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-28T13:51:06.920 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.917+0000 7fdb17e00640 1 --2- 172.21.15.76:0/2771586888 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb1806f010 0x7fdb18072150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:06.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.917+0000 7fdb17e00640 1 -- 172.21.15.76:0/2771586888 >> v1:172.21.15.76:6789/0 conn(0x7fdb180c7fa0 legacy=0x7fdb181514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:06.921 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.917+0000 7fdb17e00640 1 -- 172.21.15.76:0/2771586888 --> v2:172.21.15.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb180c74d0 con 0x7fdb1806ec30 2024-03-28T13:51:06.925 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.925+0000 7fdb17e00640 1 --2- 172.21.15.76:0/2771586888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb1806ec30 0x7fdb18158270 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdb181579a0 tx=0x7fdb0801f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605523a1e9d99c3d server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:06.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.929+0000 7fdb16a00640 1 -- 172.21.15.76:0/2771586888 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb080b4070 con 0x7fdb1806ec30 2024-03-28T13:51:06.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.929+0000 7fdb16a00640 1 -- 172.21.15.76:0/2771586888 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdb080af400 con 0x7fdb1806ec30 2024-03-28T13:51:06.930 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.929+0000 7fdb16a00640 1 -- 172.21.15.76:0/2771586888 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb080af7f0 con 0x7fdb1806ec30 2024-03-28T13:51:06.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.929+0000 7fdb1f000640 1 -- 172.21.15.76:0/2771586888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb1806ec30 msgr2=0x7fdb18158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:06.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.929+0000 7fdb1f000640 1 --2- 172.21.15.76:0/2771586888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb1806ec30 0x7fdb18158270 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdb181579a0 tx=0x7fdb0801f200 comp rx=0 tx=0).stop 2024-03-28T13:51:06.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.929+0000 7fdb1f000640 1 -- 172.21.15.76:0/2771586888 shutdown_connections 2024-03-28T13:51:06.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.929+0000 7fdb1f000640 1 --2- 172.21.15.76:0/2771586888 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb1806f010 0x7fdb18072150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:06.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.929+0000 7fdb1f000640 1 --2- 172.21.15.76:0/2771586888 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb1806ec30 0x7fdb18158270 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:06.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.929+0000 7fdb1f000640 1 -- 172.21.15.76:0/2771586888 >> 172.21.15.76:0/2771586888 conn(0x7fdb180c8ad0 msgr2=0x7fdb180c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:51:06.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.929+0000 7fdb1f000640 1 -- 172.21.15.76:0/2771586888 shutdown_connections 2024-03-28T13:51:06.931 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.929+0000 7fdb1f000640 1 -- 172.21.15.76:0/2771586888 wait complete. 2024-03-28T13:51:06.932 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.929+0000 7fdb1f000640 1 Processor -- start 2024-03-28T13:51:06.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.929+0000 7fdb1f000640 1 -- start start 2024-03-28T13:51:06.933 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.933+0000 7fdb1f000640 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb1806ec30 0x7fdb181f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:06.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.933+0000 7fdb1f000640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb1806f010 0x7fdb18147cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:06.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.933+0000 7fdb1f000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb180c7fa0 0x7fdb18146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:06.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.933+0000 7fdb1f000640 1 -- --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_getmap magic: 0 -- 0x7fdb18151bc0 con 0x7fdb180c7fa0 2024-03-28T13:51:06.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.933+0000 7fdb1f000640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fdb180c77b0 con 0x7fdb1806f010 2024-03-28T13:51:06.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.933+0000 7fdb1f000640 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 -- 0x7fdb18151d40 con 0x7fdb1806ec30 2024-03-28T13:51:06.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.933+0000 7fdb1d000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb180c7fa0 0x7fdb18146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:06.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.933+0000 7fdb1d000640 1 --2- >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb180c7fa0 0x7fdb18146f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.76:3300/0 says I am v2:172.21.15.76:46200/0 (socket says 172.21.15.76:46200) 2024-03-28T13:51:06.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.933+0000 7fdb1d000640 1 -- 172.21.15.76:0/4171951388 learned_addr learned my addr 172.21.15.76:0/4171951388 (peer_addr_for_me v2:172.21.15.76:0/0) 2024-03-28T13:51:06.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.933+0000 7fdb17400640 1 --2- 172.21.15.76:0/4171951388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb1806f010 0x7fdb18147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:06.935 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.933+0000 7fdb17e00640 1 --2- 172.21.15.76:0/4171951388 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb1806ec30 0x7fdb181f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:06.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.937+0000 7fdb1d000640 1 -- 172.21.15.76:0/4171951388 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb1806ec30 msgr2=0x7fdb181f40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:06.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.937+0000 7fdb1d000640 1 --2- 172.21.15.76:0/4171951388 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb1806ec30 0x7fdb181f40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:06.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.937+0000 7fdb1d000640 1 -- 172.21.15.76:0/4171951388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb1806f010 msgr2=0x7fdb18147cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:06.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.937+0000 7fdb1d000640 1 --2- 172.21.15.76:0/4171951388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb1806f010 0x7fdb18147cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:06.938 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.937+0000 7fdb1d000640 1 -- 172.21.15.76:0/4171951388 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb181f1080 con 0x7fdb180c7fa0 2024-03-28T13:51:06.940 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.937+0000 7fdb1d000640 1 --2- 172.21.15.76:0/4171951388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb180c7fa0 0x7fdb18146f00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000e8b0 tx=0x7fdb1000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:06.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.941+0000 7fdb0fe00640 1 -- 172.21.15.76:0/4171951388 <== mon.0 v2:172.21.15.76:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb10017070 con 0x7fdb180c7fa0 2024-03-28T13:51:06.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.941+0000 7fdb0fe00640 1 -- 172.21.15.76:0/4171951388 <== mon.0 v2:172.21.15.76:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fdb1000c940 con 0x7fdb180c7fa0 2024-03-28T13:51:06.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.941+0000 7fdb0fe00640 1 -- 172.21.15.76:0/4171951388 <== mon.0 v2:172.21.15.76:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1000cd30 con 0x7fdb180c7fa0 2024-03-28T13:51:06.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.941+0000 7fdb1f000640 1 -- 172.21.15.76:0/4171951388 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb18145970 con 0x7fdb180c7fa0 2024-03-28T13:51:06.944 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.941+0000 7fdb1f000640 1 -- 172.21.15.76:0/4171951388 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb181f02c0 con 0x7fdb180c7fa0 2024-03-28T13:51:06.945 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.945+0000 7fdb1f000640 1 -- 172.21.15.76:0/4171951388 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb18068860 con 0x7fdb180c7fa0 2024-03-28T13:51:06.962 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.961+0000 7fdb0fe00640 1 -- 172.21.15.76:0/4171951388 <== mon.0 v2:172.21.15.76:3300/0 4 ==== mgrmap(e 5) ==== 87803+0+0 (secure 0 0 0) 0x7fdb1001a070 con 0x7fdb180c7fa0 2024-03-28T13:51:06.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.961+0000 7fdb0fe00640 1 --2- 172.21.15.76:0/4171951388 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdaf8067ff0 0x7fdaf806a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-28T13:51:06.963 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.961+0000 7fdb17e00640 1 --2- 172.21.15.76:0/4171951388 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdaf8067ff0 0x7fdaf806a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-28T13:51:06.964 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:06.961+0000 7fdb17e00640 1 --2- 172.21.15.76:0/4171951388 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdaf8067ff0 0x7fdaf806a4b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdb080b1000 tx=0x7fdb080aa000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-28T13:51:07.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:07.197+0000 7fdb0fe00640 1 -- 172.21.15.76:0/4171951388 <== mon.0 v2:172.21.15.76:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6255+0+0 (secure 0 0 0) 0x7fdb10054eb0 con 0x7fdb180c7fa0 2024-03-28T13:51:07.200 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:07.197+0000 7fdb0fe00640 1 -- 172.21.15.76:0/4171951388 <== mon.0 v2:172.21.15.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179117 (secure 0 0 0) 0x7fdb10056e10 con 0x7fdb180c7fa0 2024-03-28T13:51:07.371 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:07.369+0000 7fdb1f000640 1 -- 172.21.15.76:0/4171951388 --> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdb180c6e90 con 0x7fdb180c7fa0 2024-03-28T13:51:07.934 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:07.933+0000 7fdb0fe00640 1 -- 172.21.15.76:0/4171951388 <== mon.0 v2:172.21.15.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) ==== 178+0+0 (secure 0 0 0) 0x7fdb1005b110 con 0x7fdb180c7fa0 2024-03-28T13:51:07.934 INFO:teuthology.orchestra.run.smithi076.stderr:pool 'cephfs_data_ec' removed 2024-03-28T13:51:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:07.933+0000 7fdb1f000640 1 -- 172.21.15.76:0/4171951388 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdaf8067ff0 msgr2=0x7fdaf806a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:07.933+0000 7fdb1f000640 1 --2- 172.21.15.76:0/4171951388 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdaf8067ff0 0x7fdaf806a4b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdb080b1000 tx=0x7fdb080aa000 comp rx=0 tx=0).stop 2024-03-28T13:51:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:07.933+0000 7fdb1f000640 1 -- 172.21.15.76:0/4171951388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb180c7fa0 msgr2=0x7fdb18146f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-28T13:51:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:07.933+0000 7fdb1f000640 1 --2- 172.21.15.76:0/4171951388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb180c7fa0 0x7fdb18146f00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000e8b0 tx=0x7fdb1000ed70 comp rx=0 tx=0).stop 2024-03-28T13:51:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:07.933+0000 7fdb1f000640 1 -- 172.21.15.76:0/4171951388 shutdown_connections 2024-03-28T13:51:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:07.933+0000 7fdb1f000640 1 --2- 172.21.15.76:0/4171951388 >> [v2:172.21.15.76:6800/1313648511,v1:172.21.15.76:6801/1313648511] conn(0x7fdaf8067ff0 0x7fdaf806a4b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:07.933+0000 7fdb1f000640 1 --2- 172.21.15.76:0/4171951388 >> [v2:172.21.15.76:3300/0,v1:172.21.15.76:6789/0] conn(0x7fdb180c7fa0 0x7fdb18146f00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:07.933+0000 7fdb1f000640 1 --2- 172.21.15.76:0/4171951388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb1806f010 0x7fdb18147cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:07.933+0000 7fdb1f000640 1 --2- 172.21.15.76:0/4171951388 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb1806ec30 0x7fdb181f40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-28T13:51:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:07.933+0000 7fdb1f000640 1 -- 172.21.15.76:0/4171951388 >> 172.21.15.76:0/4171951388 conn(0x7fdb180c8ad0 msgr2=0x7fdb18155530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-28T13:51:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:07.937+0000 7fdb1f000640 1 -- 172.21.15.76:0/4171951388 shutdown_connections 2024-03-28T13:51:07.937 INFO:teuthology.orchestra.run.smithi076.stderr:2024-03-28T13:51:07.937+0000 7fdb1f000640 1 -- 172.21.15.76:0/4171951388 wait complete. 2024-03-28T13:51:07.964 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-28T13:51:07.964 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-28T13:51:07.964 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:51:07.965 INFO:tasks.ceph.mds.a:Stopped 2024-03-28T13:51:07.965 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-28T13:51:07.965 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:51:07.965 INFO:tasks.ceph.mds.c:Stopped 2024-03-28T13:51:07.965 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-03-28T13:51:07.965 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:51:07.965 INFO:tasks.ceph.mds.e:Stopped 2024-03-28T13:51:07.965 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-28T13:51:07.965 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:51:07.965 INFO:tasks.ceph.mds.b:Stopped 2024-03-28T13:51:07.966 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-28T13:51:07.966 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:51:07.994 INFO:tasks.ceph.mds.d.smithi111.stderr:2024-03-28T13:51:07.969+0000 b9ed640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d (PID: 32125) UID: 0 2024-03-28T13:51:07.996 INFO:tasks.ceph.mds.d.smithi111.stderr:2024-03-28T13:51:07.969+0000 b9ed640 -1 mds.d *** got signal Terminated *** 2024-03-28T13:51:11.876 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~7s 2024-03-28T13:51:11.877 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.e has been restored 2024-03-28T13:51:11.877 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-03-28T13:51:14.068 INFO:tasks.ceph.mds.d:Stopped 2024-03-28T13:51:14.068 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-03-28T13:51:14.068 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:51:14.068 INFO:tasks.ceph.mds.f:Stopped 2024-03-28T13:51:14.068 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-28T13:51:14.069 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-28T13:51:14.069 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:51:14.070 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-03-28T13:51:14.069+0000 7efe0a200640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 27938) UID: 0 2024-03-28T13:51:14.070 INFO:tasks.ceph.osd.0.smithi076.stderr:2024-03-28T13:51:14.069+0000 7efe0a200640 -1 osd.0 34 *** Got signal Terminated *** 2024-03-28T13:51:18.086 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-03-28T13:51:18.086 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-03-28T13:51:20.171 INFO:tasks.ceph.osd.0:Stopped 2024-03-28T13:51:20.172 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-28T13:51:20.172 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:51:20.173 INFO:tasks.ceph.osd.1.smithi076.stderr:2024-03-28T13:51:20.173+0000 7fb345a00640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 27940) UID: 0 2024-03-28T13:51:20.173 INFO:tasks.ceph.osd.1.smithi076.stderr:2024-03-28T13:51:20.173+0000 7fb345a00640 -1 osd.1 35 *** Got signal Terminated *** 2024-03-28T13:51:22.814 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:51:22.818 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:51:24.195 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-03-28T13:51:24.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-03-28T13:51:26.274 INFO:tasks.ceph.osd.1:Stopped 2024-03-28T13:51:26.274 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-28T13:51:26.274 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:51:26.275 INFO:tasks.ceph.osd.2.smithi076.stderr:2024-03-28T13:51:26.273+0000 7f4396c00640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 27942) UID: 0 2024-03-28T13:51:26.275 INFO:tasks.ceph.osd.2.smithi076.stderr:2024-03-28T13:51:26.273+0000 7f4396c00640 -1 osd.2 37 *** Got signal Terminated *** 2024-03-28T13:51:30.204 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-03-28T13:51:30.204 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-03-28T13:51:32.376 INFO:tasks.ceph.osd.2:Stopped 2024-03-28T13:51:32.376 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-28T13:51:32.377 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:51:32.378 INFO:tasks.ceph.osd.3.smithi076.stderr:2024-03-28T13:51:32.381+0000 7f02a3600640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 27945) UID: 0 2024-03-28T13:51:32.378 INFO:tasks.ceph.osd.3.smithi076.stderr:2024-03-28T13:51:32.381+0000 7f02a3600640 -1 osd.3 38 *** Got signal Terminated *** 2024-03-28T13:51:36.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-03-28T13:51:36.112 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-03-28T13:51:38.478 INFO:tasks.ceph.osd.3:Stopped 2024-03-28T13:51:38.479 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-28T13:51:38.479 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:51:38.480 INFO:tasks.ceph.osd.4.smithi111.stderr:2024-03-28T13:51:38.476+0000 7ffb9ffeb640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 28476) UID: 0 2024-03-28T13:51:38.480 INFO:tasks.ceph.osd.4.smithi111.stderr:2024-03-28T13:51:38.476+0000 7ffb9ffeb640 -1 osd.4 39 *** Got signal Terminated *** 2024-03-28T13:51:41.919 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-03-28T13:51:41.920 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-03-28T13:51:44.580 INFO:tasks.ceph.osd.4:Stopped 2024-03-28T13:51:44.581 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-28T13:51:44.581 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:51:44.582 INFO:tasks.ceph.osd.5.smithi111.stderr:2024-03-28T13:51:44.580+0000 7f228c964640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 28478) UID: 0 2024-03-28T13:51:44.582 INFO:tasks.ceph.osd.5.smithi111.stderr:2024-03-28T13:51:44.580+0000 7f228c964640 -1 osd.5 40 *** Got signal Terminated *** 2024-03-28T13:51:47.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-03-28T13:51:47.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-03-28T13:51:50.682 INFO:tasks.ceph.osd.5:Stopped 2024-03-28T13:51:50.683 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-28T13:51:50.683 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:51:50.684 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-03-28T13:51:50.680+0000 7f3d3ca58640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 28480) UID: 0 2024-03-28T13:51:50.684 INFO:tasks.ceph.osd.6.smithi111.stderr:2024-03-28T13:51:50.680+0000 7f3d3ca58640 -1 osd.6 41 *** Got signal Terminated *** 2024-03-28T13:51:53.209 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:51:53.213 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:51:53.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-03-28T13:51:53.232 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-03-28T13:51:56.785 INFO:tasks.ceph.osd.6:Stopped 2024-03-28T13:51:56.786 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-28T13:51:56.786 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:51:56.787 INFO:tasks.ceph.osd.7.smithi111.stderr:2024-03-28T13:51:56.784+0000 7f457ec02640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 28481) UID: 0 2024-03-28T13:51:56.787 INFO:tasks.ceph.osd.7.smithi111.stderr:2024-03-28T13:51:56.784+0000 7f457ec02640 -1 osd.7 41 *** Got signal Terminated *** 2024-03-28T13:51:58.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-03-28T13:51:58.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-03-28T13:52:02.890 INFO:tasks.ceph.osd.7:Stopped 2024-03-28T13:52:02.890 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-28T13:52:02.890 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-28T13:52:02.890 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:52:02.891 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T13:52:02.892+0000 7fea8b400640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 27749) UID: 0 2024-03-28T13:52:02.891 INFO:tasks.ceph.mgr.y.smithi076.stderr:2024-03-28T13:52:02.892+0000 7fea8b400640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-03-28T13:52:02.951 INFO:tasks.ceph.mgr.y:Stopped 2024-03-28T13:52:02.951 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-28T13:52:02.951 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:52:02.981 INFO:tasks.ceph.mgr.x:Stopped 2024-03-28T13:52:02.981 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-28T13:52:02.981 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-28T13:52:02.981 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:52:03.007 INFO:tasks.ceph.mon.a.smithi076.stderr:2024-03-28T13:52:02.996+0000 a38f640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 27744) UID: 0 2024-03-28T13:52:03.007 INFO:tasks.ceph.mon.a.smithi076.stderr:2024-03-28T13:52:03.000+0000 a38f640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-28T13:52:03.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-03-28T13:52:03.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-03-28T13:52:09.083 INFO:tasks.ceph.mon.a:Stopped 2024-03-28T13:52:09.083 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-28T13:52:09.083 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:52:09.124 INFO:tasks.ceph.mon.b.smithi111.stderr:2024-03-28T13:52:09.092+0000 a38f640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 28150) UID: 0 2024-03-28T13:52:09.125 INFO:tasks.ceph.mon.b.smithi111.stderr:2024-03-28T13:52:09.096+0000 a38f640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-03-28T13:52:09.142 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~5s 2024-03-28T13:52:14.247 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-03-28T13:52:14.247 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-03-28T13:52:15.185 INFO:tasks.ceph.mon.b:Stopped 2024-03-28T13:52:15.186 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-28T13:52:15.186 INFO:teuthology.orchestra.run:waiting for 300 2024-03-28T13:52:15.239 INFO:tasks.ceph.mon.c.smithi111.stderr:2024-03-28T13:52:15.196+0000 a38f640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 28153) UID: 0 2024-03-28T13:52:15.239 INFO:tasks.ceph.mon.c.smithi111.stderr:2024-03-28T13:52:15.200+0000 a38f640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-03-28T13:52:19.248 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-03-28T13:52:19.248 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-03-28T13:52:21.288 INFO:tasks.ceph.mon.c:Stopped 2024-03-28T13:52:21.288 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-28T13:52:21.288 DEBUG:teuthology.orchestra.run.smithi076:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-03-28T13:52:21.325 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi076.front.sepia.ceph.com 2024-03-28T13:52:21.325 DEBUG:teuthology.orchestra.run.smithi076:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-28T13:52:21.569 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi076.front.sepia.ceph.com 2024-03-28T13:52:21.569 DEBUG:teuthology.orchestra.run.smithi076:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-28T13:52:21.775 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi076.front.sepia.ceph.com 2024-03-28T13:52:21.775 DEBUG:teuthology.orchestra.run.smithi076:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-28T13:52:21.971 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi076.front.sepia.ceph.com 2024-03-28T13:52:21.971 DEBUG:teuthology.orchestra.run.smithi076:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-28T13:52:22.198 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi111.front.sepia.ceph.com 2024-03-28T13:52:22.199 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-28T13:52:22.503 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi111.front.sepia.ceph.com 2024-03-28T13:52:22.503 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-28T13:52:22.642 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi111.front.sepia.ceph.com 2024-03-28T13:52:22.642 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-28T13:52:22.806 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi111.front.sepia.ceph.com 2024-03-28T13:52:22.806 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-28T13:52:22.999 INFO:tasks.ceph:Archiving mon data... 2024-03-28T13:52:23.000 DEBUG:teuthology.misc:Transferring archived files from smithi076:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627784/data/mon.a.tgz 2024-03-28T13:52:23.001 DEBUG:teuthology.orchestra.run.smithi076:> mktemp 2024-03-28T13:52:23.009 INFO:teuthology.orchestra.run.smithi076.stdout:/tmp/tmp.In05uzeUON 2024-03-28T13:52:23.010 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.In05uzeUON 2024-03-28T13:52:23.137 DEBUG:teuthology.orchestra.run.smithi076:> sudo chmod 0666 /tmp/tmp.In05uzeUON 2024-03-28T13:52:23.216 DEBUG:teuthology.orchestra.remote:smithi076:/tmp/tmp.In05uzeUON is 369KB 2024-03-28T13:52:23.262 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:52:23.283 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:52:23.329 DEBUG:teuthology.orchestra.run.smithi076:> rm -fr /tmp/tmp.In05uzeUON 2024-03-28T13:52:23.338 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627784/data/mon.b.tgz 2024-03-28T13:52:23.338 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-03-28T13:52:23.378 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.VXmJji8QzB 2024-03-28T13:52:23.378 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.VXmJji8QzB 2024-03-28T13:52:23.510 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.VXmJji8QzB 2024-03-28T13:52:23.578 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.VXmJji8QzB is 383KB 2024-03-28T13:52:23.640 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.VXmJji8QzB 2024-03-28T13:52:23.645 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627784/data/mon.c.tgz 2024-03-28T13:52:23.645 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-03-28T13:52:23.690 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.V7e3QPT6y3 2024-03-28T13:52:23.690 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.V7e3QPT6y3 2024-03-28T13:52:23.824 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.V7e3QPT6y3 2024-03-28T13:52:23.886 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.V7e3QPT6y3 is 384KB 2024-03-28T13:52:23.948 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.V7e3QPT6y3 2024-03-28T13:52:23.953 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-28T13:52:23.953 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-28T13:52:23.956 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-28T13:52:24.248 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-03-28T13:52:24.385 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_PossiblyLost calloc __trans_list_add 2024-03-28T13:52:24.715 INFO:tasks.ceph:Archiving crash dumps... 2024-03-28T13:52:24.717 DEBUG:teuthology.misc:Transferring archived files from smithi076:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627784/remote/smithi076/crash 2024-03-28T13:52:24.718 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-28T13:52:24.739 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627784/remote/smithi111/crash 2024-03-28T13:52:24.740 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-28T13:52:24.755 INFO:tasks.ceph:Shutting down logrotate 2024-03-28T13:52:24.755 DEBUG:teuthology.orchestra.run.smithi076:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:52:24.787 DEBUG:teuthology.orchestra.run.smithi111:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-28T13:52:24.838 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-28T13:52:24.859 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-28T13:52:24.894 INFO:tasks.ceph:Compressing logs... 2024-03-28T13:52:24.895 DEBUG:teuthology.orchestra.run.smithi076:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-28T13:52:24.902 DEBUG:teuthology.orchestra.run.smithi111:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-28T13:52:24.930 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33460.log 2024-03-28T13:52:24.931 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32204.log 2024-03-28T13:52:24.932 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34241.log 2024-03-28T13:52:24.932 INFO:teuthology.orchestra.run.smithi076.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33460.log.gz 2024-03-28T13:52:24.933 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33929.log 2024-03-28T13:52:24.933 INFO:teuthology.orchestra.run.smithi076.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32204.log.gz 2024-03-28T13:52:24.934 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.34241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28068.log 2024-03-28T13:52:24.934 INFO:teuthology.orchestra.run.smithi076.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34241.log.gz 2024-03-28T13:52:24.934 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33929.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-28T13:52:24.935 INFO:teuthology.orchestra.run.smithi076.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33929.log.gz 2024-03-28T13:52:24.935 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.28068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33215.log 2024-03-28T13:52:24.935 INFO:teuthology.orchestra.run.smithi076.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.28068.log.gz 2024-03-28T13:52:24.936 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33574.log 2024-03-28T13:52:24.939 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36094.log 2024-03-28T13:52:24.939 INFO:teuthology.orchestra.run.smithi076.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33215.log.gz 2024-03-28T13:52:24.939 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31874.log 2024-03-28T13:52:24.939 INFO:teuthology.orchestra.run.smithi076.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33574.log.gz 2024-03-28T13:52:24.939 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.36094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31692.log 2024-03-28T13:52:24.939 INFO:teuthology.orchestra.run.smithi076.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36094.log.gz 2024-03-28T13:52:24.941 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.31874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33047.log 2024-03-28T13:52:24.941 INFO:teuthology.orchestra.run.smithi076.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31874.log.gz 2024-03-28T13:52:24.941 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.31692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33504.log 2024-03-28T13:52:24.941 INFO:teuthology.orchestra.run.smithi076.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31692.log.gz 2024-03-28T13:52:24.943 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33047.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33047.log.gz 2024-03-28T13:52:24.943 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35599.log 2024-03-28T13:52:24.943 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32334.log 2024-03-28T13:52:24.943 INFO:teuthology.orchestra.run.smithi076.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33504.log.gz 2024-03-28T13:52:24.943 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34495.log 2024-03-28T13:52:24.943 INFO:teuthology.orchestra.run.smithi076.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35599.log.gz 2024-03-28T13:52:24.944 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33454.log 2024-03-28T13:52:24.945 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.34495.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.32334.log.gz 2024-03-28T13:52:24.945 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-28T13:52:24.945 INFO:teuthology.orchestra.run.smithi076.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.34495.log.gz 2024-03-28T13:52:24.946 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33278.log 2024-03-28T13:52:24.946 INFO:teuthology.orchestra.run.smithi076.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33454.log.gz 2024-03-28T13:52:24.946 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36120.log 2024-03-28T13:52:24.947 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35729.log 2024-03-28T13:52:24.948 INFO:teuthology.orchestra.run.smithi076.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33278.log.gz 2024-03-28T13:52:24.948 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.36120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33981.log 2024-03-28T13:52:24.948 INFO:teuthology.orchestra.run.smithi076.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36120.log.gz 2024-03-28T13:52:24.949 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33262.log 2024-03-28T13:52:24.949 INFO:teuthology.orchestra.run.smithi076.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35729.log.gz 2024-03-28T13:52:24.950 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32888.log 2024-03-28T13:52:24.950 INFO:teuthology.orchestra.run.smithi076.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33981.log.gz 2024-03-28T13:52:24.951 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33877.log 2024-03-28T13:52:24.951 INFO:teuthology.orchestra.run.smithi076.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33262.log.gz 2024-03-28T13:52:24.952 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32995.log 2024-03-28T13:52:24.952 INFO:teuthology.orchestra.run.smithi076.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32888.log.gz 2024-03-28T13:52:24.953 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32033.log 2024-03-28T13:52:24.953 INFO:teuthology.orchestra.run.smithi076.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33877.log.gz 2024-03-28T13:52:24.954 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31601.log 2024-03-28T13:52:24.954 INFO:teuthology.orchestra.run.smithi076.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32995.log.gz 2024-03-28T13:52:24.955 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34672.log 2024-03-28T13:52:24.955 INFO:teuthology.orchestra.run.smithi076.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32033.log.gz 2024-03-28T13:52:24.956 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.31601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32857.log 2024-03-28T13:52:24.956 INFO:teuthology.orchestra.run.smithi076.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31601.log.gz 2024-03-28T13:52:24.957 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.0.34672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34672.log.gz 2024-03-28T13:52:24.957 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-28T13:52:24.958 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32152.log 2024-03-28T13:52:24.958 INFO:teuthology.orchestra.run.smithi076.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32857.log.gz 2024-03-28T13:52:24.959 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34215.log 2024-03-28T13:52:24.960 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28321.log 2024-03-28T13:52:24.962 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33470.log 2024-03-28T13:52:24.962 INFO:teuthology.orchestra.run.smithi076.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32152.log.gz 2024-03-28T13:52:24.962 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.34215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32727.log 2024-03-28T13:52:24.962 INFO:teuthology.orchestra.run.smithi076.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34215.log.gz 2024-03-28T13:52:24.963 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-28T13:52:24.963 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.28321.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-28T13:52:24.963 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.7.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.28321.log.gz 2024-03-28T13:52:24.963 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28376.log 2024-03-28T13:52:24.963 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-28T13:52:24.963 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.28376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28273.log 2024-03-28T13:52:24.964 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.6.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28376.log.gz 2024-03-28T13:52:24.964 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28297.log 2024-03-28T13:52:24.967 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34111.log 2024-03-28T13:52:24.967 INFO:teuthology.orchestra.run.smithi076.stderr: 88.3%/var/log/ceph/ceph-client.admin.32727.log: -- replaced with /var/log/ceph/ceph-client.admin.33470.log.gz 2024-03-28T13:52:24.967 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34556.log 2024-03-28T13:52:24.968 INFO:teuthology.orchestra.run.smithi076.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32727.log.gz 2024-03-28T13:52:24.968 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.34111.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.34111.log.gz --verbose 2024-03-28T13:52:24.968 INFO:teuthology.orchestra.run.smithi076.stderr: -- /var/log/ceph/ceph-mon.a.log 2024-03-28T13:52:24.968 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.34556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31900.log 2024-03-28T13:52:24.968 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-mon.a.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34556.log.gz 2024-03-28T13:52:24.968 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33270.log 2024-03-28T13:52:24.968 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.28273.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28273.log.gz 2024-03-28T13:52:24.969 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-28T13:52:24.969 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-03-28T13:52:24.969 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.28297.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-28T13:52:24.969 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28400.log 2024-03-28T13:52:24.969 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28297.log.gz 2024-03-28T13:52:24.969 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-28T13:52:24.969 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28449.log 2024-03-28T13:52:24.969 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.28400.log: /var/log/ceph/ceph-mon.c.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28400.log.gz 2024-03-28T13:52:24.969 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-28T13:52:24.969 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.28449.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28449.log.gz 2024-03-28T13:52:24.969 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-28T13:52:24.971 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.31900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33264.log 2024-03-28T13:52:24.971 INFO:teuthology.orchestra.run.smithi076.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31900.log.gz 2024-03-28T13:52:24.971 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35397.log 2024-03-28T13:52:24.971 INFO:teuthology.orchestra.run.smithi076.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33270.log.gz 2024-03-28T13:52:24.971 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34445.log 2024-03-28T13:52:24.971 INFO:teuthology.orchestra.run.smithi076.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33264.log.gz 2024-03-28T13:52:24.972 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph.audit.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-28T13:52:24.972 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-03-28T13:52:24.972 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36146.log 2024-03-28T13:52:24.972 INFO:teuthology.orchestra.run.smithi076.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35397.log.gz 2024-03-28T13:52:24.973 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.34445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35859.log 2024-03-28T13:52:24.973 INFO:teuthology.orchestra.run.smithi076.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.34445.log.gz 2024-03-28T13:52:24.974 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.36146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36198.log 2024-03-28T13:52:24.974 INFO:teuthology.orchestra.run.smithi076.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36146.log.gz 2024-03-28T13:52:24.975 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33774.log 2024-03-28T13:52:24.975 INFO:teuthology.orchestra.run.smithi076.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35859.log.gz 2024-03-28T13:52:24.976 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.36198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31981.log 2024-03-28T13:52:24.976 INFO:teuthology.orchestra.run.smithi076.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36198.log.gz 2024-03-28T13:52:24.977 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33765.log 2024-03-28T13:52:24.978 INFO:teuthology.orchestra.run.smithi076.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33774.log.gz 2024-03-28T13:52:24.978 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.31981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35755.log 2024-03-28T13:52:24.979 INFO:teuthology.orchestra.run.smithi076.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31981.log.gz 2024-03-28T13:52:24.979 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mds.d.log: 93.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-28T13:52:24.980 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34343.log 2024-03-28T13:52:24.980 INFO:teuthology.orchestra.run.smithi076.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33765.log.gz 2024-03-28T13:52:24.980 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31929.log 2024-03-28T13:52:24.981 INFO:teuthology.orchestra.run.smithi076.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35755.log.gz 2024-03-28T13:52:24.982 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2024-03-28T13:52:24.983 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.34343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31756.log 2024-03-28T13:52:24.983 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.31929.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.34343.log.gz 2024-03-28T13:52:24.983 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36250.log 2024-03-28T13:52:24.983 INFO:teuthology.orchestra.run.smithi076.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31929.log.gz 2024-03-28T13:52:24.984 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/valgrind/mon.c.log: 91.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-03-28T13:52:24.984 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2024-03-28T13:52:24.985 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.31756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33276.log 2024-03-28T13:52:24.985 INFO:teuthology.orchestra.run.smithi076.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31756.log.gz 2024-03-28T13:52:24.986 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.36250.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36250.log.gz 2024-03-28T13:52:24.986 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33769.log 2024-03-28T13:52:24.987 INFO:teuthology.orchestra.run.smithi076.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33276.log.gz 2024-03-28T13:52:24.987 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35937.log 2024-03-28T13:52:24.988 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/valgrind/mds.f.log: 93.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-28T13:52:24.988 INFO:teuthology.orchestra.run.smithi111.stderr: 95.4% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-03-28T13:52:24.989 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2024-03-28T13:52:24.989 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-03-28T13:52:24.990 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33769.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-28T13:52:24.990 INFO:teuthology.orchestra.run.smithi076.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33769.log.gz 2024-03-28T13:52:24.990 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33186.log 2024-03-28T13:52:24.991 INFO:teuthology.orchestra.run.smithi076.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35937.log.gz 2024-03-28T13:52:24.991 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32674.log 2024-03-28T13:52:24.992 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/valgrind/mds.d.log: 57.6% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2024-03-28T13:52:24.992 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-28T13:52:24.992 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/valgrind/mon.b.log: 91.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-03-28T13:52:24.992 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-28T13:52:24.993 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34267.log 2024-03-28T13:52:24.993 INFO:teuthology.orchestra.run.smithi076.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33186.log.gz 2024-03-28T13:52:24.994 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27751.log 2024-03-28T13:52:24.994 INFO:teuthology.orchestra.run.smithi076.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32674.log.gz 2024-03-28T13:52:24.994 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mds.b.log: 95.4% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-03-28T13:52:24.994 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-28T13:52:24.995 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.34267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36015.log 2024-03-28T13:52:24.995 INFO:teuthology.orchestra.run.smithi076.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34267.log.gz 2024-03-28T13:52:24.997 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.27751.log: /var/log/ceph/ceph-client.admin.36015.log: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.27751.log.gz 2024-03-28T13:52:24.997 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34163.log 2024-03-28T13:52:24.997 INFO:teuthology.orchestra.run.smithi076.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36015.log.gz 2024-03-28T13:52:24.998 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35573.log 2024-03-28T13:52:25.000 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.34163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33277.log 2024-03-28T13:52:25.000 INFO:teuthology.orchestra.run.smithi076.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34163.log.gz 2024-03-28T13:52:25.001 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35573.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35573.log.gz 2024-03-28T13:52:25.002 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33277.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33277.log.gz 2024-03-28T13:52:25.002 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33955.log 2024-03-28T13:52:25.003 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33099.log 2024-03-28T13:52:25.005 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32700.log 2024-03-28T13:52:25.005 INFO:teuthology.orchestra.run.smithi076.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33955.log.gz 2024-03-28T13:52:25.006 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33099.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33099.log.gz 2024-03-28T13:52:25.007 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32700.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32700.log.gz 2024-03-28T13:52:25.008 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35807.log 2024-03-28T13:52:25.009 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33160.log 2024-03-28T13:52:25.010 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35521.log 2024-03-28T13:52:25.010 INFO:teuthology.orchestra.run.smithi076.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35807.log.gz 2024-03-28T13:52:25.012 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31811.log 2024-03-28T13:52:25.012 INFO:teuthology.orchestra.run.smithi076.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33160.log.gz 2024-03-28T13:52:25.013 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35521.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35521.log.gz 2024-03-28T13:52:25.014 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mon.b.log: 95.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-28T13:52:25.014 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28425.log 2024-03-28T13:52:25.015 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36224.log 2024-03-28T13:52:25.015 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.31811.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31811.log.gz 2024-03-28T13:52:25.015 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33465.log 2024-03-28T13:52:25.016 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.36224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36276.log 2024-03-28T13:52:25.016 INFO:teuthology.orchestra.run.smithi076.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36224.log.gz 2024-03-28T13:52:25.017 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33465.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33465.log.gz 2024-03-28T13:52:25.018 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.36276.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36276.log.gz 2024-03-28T13:52:25.019 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-28T13:52:25.020 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34059.log 2024-03-28T13:52:25.021 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32914.log 2024-03-28T13:52:25.023 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.34059.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34059.log.gz 2024-03-28T13:52:25.023 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32914.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32914.log.gz 2024-03-28T13:52:25.024 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35989.log 2024-03-28T13:52:25.025 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31666.log 2024-03-28T13:52:25.027 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35989.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35989.log.gz 2024-03-28T13:52:25.027 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.31666.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31666.log.gz 2024-03-28T13:52:25.028 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34085.log 2024-03-28T13:52:25.029 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33721.log 2024-03-28T13:52:25.030 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28352.log 2024-03-28T13:52:25.031 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.28425.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28425.log.gz 2024-03-28T13:52:25.031 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.34085.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34085.log.gz 2024-03-28T13:52:25.032 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33721.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33721.log.gz 2024-03-28T13:52:25.032 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33903.log 2024-03-28T13:52:25.033 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27949.log 2024-03-28T13:52:25.035 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33903.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33903.log.gz 2024-03-28T13:52:25.036 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.27949.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27949.log.gz 2024-03-28T13:52:25.036 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35625.log 2024-03-28T13:52:25.037 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35371.log 2024-03-28T13:52:25.039 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35625.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35625.log.gz 2024-03-28T13:52:25.040 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35371.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35371.log.gz 2024-03-28T13:52:25.040 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32256.log 2024-03-28T13:52:25.041 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35963.log 2024-03-28T13:52:25.043 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32256.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32256.log.gz 2024-03-28T13:52:25.044 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35963.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35963.log.gz 2024-03-28T13:52:25.044 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33851.log 2024-03-28T13:52:25.046 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32622.log 2024-03-28T13:52:25.047 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.28352.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28352.log.gz 2024-03-28T13:52:25.047 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33851.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33851.log.gz 2024-03-28T13:52:25.048 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32622.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32622.log.gz 2024-03-28T13:52:25.048 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32230.log 2024-03-28T13:52:25.050 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35833.log 2024-03-28T13:52:25.052 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32230.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32230.log.gz 2024-03-28T13:52:25.052 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35833.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35833.log.gz 2024-03-28T13:52:25.053 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-28T13:52:25.054 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33450.log 2024-03-28T13:52:25.057 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.33450.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33450.log.gz 2024-03-28T13:52:25.057 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32831.log 2024-03-28T13:52:25.060 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32831.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32831.log.gz 2024-03-28T13:52:25.060 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34293.log 2024-03-28T13:52:25.063 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.34293.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.34293.log.gz 2024-03-28T13:52:25.063 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35451.log 2024-03-28T13:52:25.064 INFO:teuthology.orchestra.run.smithi076.stderr: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-28T13:52:25.064 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33718.log 2024-03-28T13:52:25.066 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35451.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35451.log.gz 2024-03-28T13:52:25.066 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32648.log 2024-03-28T13:52:25.067 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33718.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33718.log.gz 2024-03-28T13:52:25.069 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32648.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32648.log.gz 2024-03-28T13:52:25.069 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34189.log 2024-03-28T13:52:25.070 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32124.log 2024-03-28T13:52:25.072 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.34189.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34189.log.gz 2024-03-28T13:52:25.072 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32124.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32124.log.gz 2024-03-28T13:52:25.073 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34033.log 2024-03-28T13:52:25.074 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32967.log 2024-03-28T13:52:25.076 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.34033.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34033.log.gz 2024-03-28T13:52:25.077 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32967.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32967.log.gz 2024-03-28T13:52:25.077 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35651.log 2024-03-28T13:52:25.078 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35885.log 2024-03-28T13:52:25.080 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35651.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35651.log.gz 2024-03-28T13:52:25.081 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35885.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35885.log.gz 2024-03-28T13:52:25.082 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35319.log 2024-03-28T13:52:25.082 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32308.log 2024-03-28T13:52:25.084 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35319.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35319.log.gz 2024-03-28T13:52:25.085 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32308.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32308.log.gz 2024-03-28T13:52:25.085 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32085.log 2024-03-28T13:52:25.087 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32282.log 2024-03-28T13:52:25.088 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32085.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32085.log.gz 2024-03-28T13:52:25.089 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33265.log 2024-03-28T13:52:25.090 INFO:teuthology.orchestra.run.smithi076.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32282.log.gz 2024-03-28T13:52:25.090 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34007.log 2024-03-28T13:52:25.092 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33265.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33265.log.gz 2024-03-28T13:52:25.093 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.34007.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34007.log.gz 2024-03-28T13:52:25.093 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35911.log 2024-03-28T13:52:25.094 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-28T13:52:25.096 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35911.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35911.log.gz 2024-03-28T13:52:25.098 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph.audit.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-28T13:52:25.098 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35677.log 2024-03-28T13:52:25.099 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-28T13:52:25.101 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35677.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35677.log.gz 2024-03-28T13:52:25.105 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32007.log 2024-03-28T13:52:25.111 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-28T13:52:25.111 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32007.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32007.log.gz 2024-03-28T13:52:25.116 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34137.log 2024-03-28T13:52:25.117 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32178.log 2024-03-28T13:52:25.118 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.34137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32059.log 2024-03-28T13:52:25.119 INFO:teuthology.orchestra.run.smithi076.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34137.log.gz 2024-03-28T13:52:25.120 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32178.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32178.log.gz 2024-03-28T13:52:25.121 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32779.log 2024-03-28T13:52:25.123 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32059.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32059.log.gz 2024-03-28T13:52:25.129 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35547.log 2024-03-28T13:52:25.129 INFO:teuthology.orchestra.run.smithi076.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32779.log.gz 2024-03-28T13:52:25.130 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35345.log 2024-03-28T13:52:25.131 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35547.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35547.log.gz 2024-03-28T13:52:25.137 INFO:teuthology.orchestra.run.smithi076.stderr:gzip/var/log/ceph/ceph-client.admin.35345.log: -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2024-03-28T13:52:25.137 INFO:teuthology.orchestra.run.smithi076.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35345.log.gz 2024-03-28T13:52:25.139 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-03-28T13:52:25.145 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/valgrind/mds.a.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-03-28T13:52:25.146 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/valgrind/mon.a.log: 91.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-03-28T13:52:25.149 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5/var/log/ceph/valgrind/mds.c.log: --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-03-28T13:52:25.150 INFO:teuthology.orchestra.run.smithi076.stderr: 95.3% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-03-28T13:52:25.158 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36068.log 2024-03-28T13:52:25.161 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/valgrind/mds.e.log: 95.3% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2024-03-28T13:52:25.163 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.36068.log: 95.2% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2024-03-28T13:52:25.163 INFO:teuthology.orchestra.run.smithi076.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36068.log.gz 2024-03-28T13:52:25.165 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33669.log 2024-03-28T13:52:25.169 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31637.log 2024-03-28T13:52:25.171 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33669.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33669.log.gz 2024-03-28T13:52:25.174 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32384.log 2024-03-28T13:52:25.175 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.31637.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.31637.log.gz 2024-03-28T13:52:25.177 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35495.log/var/log/ceph/ceph-client.admin.32384.log: 2024-03-28T13:52:25.177 INFO:teuthology.orchestra.run.smithi076.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32384.log.gz 2024-03-28T13:52:25.181 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36172.log 2024-03-28T13:52:25.182 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35495.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35495.log.gz 2024-03-28T13:52:25.185 INFO:teuthology.orchestra.run.smithi076.stderr:gzip/var/log/ceph/ceph-client.admin.36172.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33673.log 2024-03-28T13:52:25.188 INFO:teuthology.orchestra.run.smithi076.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36172.log.gz 2024-03-28T13:52:25.189 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22945.log 2024-03-28T13:52:25.191 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33673.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33673.log.gz 2024-03-28T13:52:25.194 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph.tmp-client.admin.22945.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22945.log.gz 2024-03-28T13:52:25.196 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35781.log 2024-03-28T13:52:25.201 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31955.log 2024-03-28T13:52:25.203 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35781.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35781.log.gz 2024-03-28T13:52:25.205 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32753.log 2024-03-28T13:52:25.207 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.31955.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31955.log.gz 2024-03-28T13:52:25.208 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32512.log 2024-03-28T13:52:25.214 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34393.log 2024-03-28T13:52:25.214 INFO:teuthology.orchestra.run.smithi076.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32753.log.gz 2024-03-28T13:52:25.216 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32512.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.32512.log.gz 2024-03-28T13:52:25.217 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35703.log 2024-03-28T13:52:25.219 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.34393.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.34393.log.gz 2024-03-28T13:52:25.221 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33073.log 2024-03-28T13:52:25.223 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35703.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35703.log.gz 2024-03-28T13:52:25.226 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33073.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33073.log.gz 2024-03-28T13:52:25.229 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33510.log 2024-03-28T13:52:25.233 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36044.log 2024-03-28T13:52:25.235 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33510.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33510.log.gz 2024-03-28T13:52:25.237 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32940.log 2024-03-28T13:52:25.238 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.36044.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36044.log.gz 2024-03-28T13:52:25.240 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32596.log 2024-03-28T13:52:25.241 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33125.log 2024-03-28T13:52:25.241 INFO:teuthology.orchestra.run.smithi076.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32940.log.gz 2024-03-28T13:52:25.242 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32596.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32596.log.gz 2024-03-28T13:52:25.245 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-03-28T13:52:25.247 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33125.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33125.log.gz 2024-03-28T13:52:25.248 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32570.log 2024-03-28T13:52:25.256 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32570.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32570.log.gz 2024-03-28T13:52:25.256 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33266.log 2024-03-28T13:52:25.257 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35425.log 2024-03-28T13:52:25.259 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33266.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33266.log.gz 2024-03-28T13:52:25.261 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32805.log 2024-03-28T13:52:25.262 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.35425.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35425.log.gz 2024-03-28T13:52:25.265 INFO:teuthology.orchestra.run.smithi076.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33021.log 2024-03-28T13:52:25.267 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.32805.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32805.log.gz 2024-03-28T13:52:25.271 INFO:teuthology.orchestra.run.smithi076.stderr:/var/log/ceph/ceph-client.admin.33021.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33021.log.gz 2024-03-28T13:52:25.420 INFO:teuthology.orchestra.run.smithi111.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-28T13:52:25.433 INFO:teuthology.orchestra.run.smithi111.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-03-28T13:52:25.652 INFO:teuthology.orchestra.run.smithi076.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-28T13:52:25.759 INFO:teuthology.orchestra.run.smithi076.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-28T13:52:25.779 INFO:teuthology.orchestra.run.smithi076.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-03-28T13:52:25.854 INFO:teuthology.orchestra.run.smithi111.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-28T13:52:26.475 INFO:teuthology.orchestra.run.smithi111.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-28T13:52:27.272 INFO:teuthology.orchestra.run.smithi076.stderr: 89.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-28T13:52:33.962 INFO:teuthology.orchestra.run.smithi076.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-28T13:52:34.320 INFO:teuthology.orchestra.run.smithi111.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-28T13:52:34.625 INFO:teuthology.orchestra.run.smithi111.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-28T13:52:34.935 INFO:teuthology.orchestra.run.smithi076.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-28T13:52:35.138 INFO:teuthology.orchestra.run.smithi111.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-28T13:52:36.708 INFO:teuthology.orchestra.run.smithi111.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-28T13:52:36.710 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-03-28T13:52:36.710 INFO:teuthology.orchestra.run.smithi111.stderr:real 0m11.766s 2024-03-28T13:52:36.710 INFO:teuthology.orchestra.run.smithi111.stderr:user 0m42.859s 2024-03-28T13:52:36.710 INFO:teuthology.orchestra.run.smithi111.stderr:sys 0m1.423s 2024-03-28T13:52:37.942 INFO:teuthology.orchestra.run.smithi076.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-28T13:52:38.646 INFO:teuthology.orchestra.run.smithi076.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-28T13:53:26.708 INFO:teuthology.orchestra.run.smithi076.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-28T13:53:26.709 INFO:teuthology.orchestra.run.smithi076.stderr: 2024-03-28T13:53:26.709 INFO:teuthology.orchestra.run.smithi076.stderr:real 1m1.804s 2024-03-28T13:53:26.710 INFO:teuthology.orchestra.run.smithi076.stderr:user 1m43.260s 2024-03-28T13:53:26.710 INFO:teuthology.orchestra.run.smithi076.stderr:sys 0m7.893s 2024-03-28T13:53:26.711 INFO:tasks.ceph:Archiving logs... 2024-03-28T13:53:26.711 DEBUG:teuthology.misc:Transferring archived files from smithi076:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627784/remote/smithi076/log 2024-03-28T13:53:26.712 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-28T13:53:40.211 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627784/remote/smithi111/log 2024-03-28T13:53:40.212 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-28T13:53:46.326 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_PossiblyLost calloc __trans_list_add 2024-03-28T13:53:46.328 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-28T13:53:46.340 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e0e48ba6ee8c8b4c8f38d3b879d6eafbbb1efc15/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_PossiblyLost calloc __trans_list_add 2024-03-28T13:53:46.340 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-28T13:53:46.341 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-28T13:53:46.344 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-28T13:53:46.413 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-28T13:53:46.425 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-28T13:53:46.426 DEBUG:teuthology.orchestra.run.smithi076:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-28T13:53:46.429 DEBUG:teuthology.orchestra.run.smithi111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-28T13:53:46.442 INFO:teuthology.orchestra.run.smithi111.stdout: remote refid st t when poll reach delay offset jitter 2024-03-28T13:53:46.442 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================== 2024-03-28T13:53:46.443 INFO:teuthology.orchestra.run.smithi111.stdout:*hv01.front.sepi 44.4.53.2 2 u 51 64 377 0.086 -1.540 0.082 2024-03-28T13:53:46.443 INFO:teuthology.orchestra.run.smithi111.stdout:+hv02.front.sepi 96.245.170.99 3 u 15 64 377 0.088 +0.467 0.088 2024-03-28T13:53:46.443 INFO:teuthology.orchestra.run.smithi111.stdout:+hv03.front.sepi 74.6.168.72 3 u 34 64 377 0.063 -0.717 0.061 2024-03-28T13:53:46.443 INFO:teuthology.orchestra.run.smithi111.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-03-28T13:53:46.444 INFO:teuthology.orchestra.run.smithi076.stdout: remote refid st t when poll reach delay offset jitter 2024-03-28T13:53:46.444 INFO:teuthology.orchestra.run.smithi076.stdout:============================================================================== 2024-03-28T13:53:46.444 INFO:teuthology.orchestra.run.smithi076.stdout:*hv01.front.sepi 44.4.53.2 2 u 39 128 377 0.081 -3.256 0.292 2024-03-28T13:53:46.444 INFO:teuthology.orchestra.run.smithi076.stdout:+hv02.front.sepi 96.245.170.99 3 u 99 128 377 0.084 -1.422 0.345 2024-03-28T13:53:46.444 INFO:teuthology.orchestra.run.smithi076.stdout:+hv03.front.sepi 74.6.168.72 3 u 96 128 377 0.077 -2.754 0.388 2024-03-28T13:53:46.444 INFO:teuthology.orchestra.run.smithi076.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-03-28T13:53:46.445 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-28T13:53:46.460 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-28T13:53:46.460 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-28T13:53:46.478 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-28T13:53:46.494 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-28T13:53:46.506 INFO:teuthology.task.internal:Duration was 5347.230549 seconds 2024-03-28T13:53:46.506 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-28T13:53:46.520 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-28T13:53:46.521 DEBUG:teuthology.orchestra.run.smithi076:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-28T13:53:46.524 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-28T13:53:46.646 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-28T13:53:46.646 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi076.front.sepia.ceph.com 2024-03-28T13:53:46.646 DEBUG:teuthology.orchestra.run.smithi076:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-28T13:53:46.666 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi111.front.sepia.ceph.com 2024-03-28T13:53:46.667 DEBUG:teuthology.orchestra.run.smithi111:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-28T13:53:46.677 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-28T13:53:46.677 DEBUG:teuthology.orchestra.run.smithi076:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-28T13:53:46.710 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-28T13:53:46.749 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-28T13:53:46.749 DEBUG:teuthology.orchestra.run.smithi076:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-28T13:53:46.791 DEBUG:teuthology.orchestra.run.smithi111:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-28T13:53:46.861 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-28T13:53:46.872 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-28T13:53:46.872 DEBUG:teuthology.orchestra.run.smithi076:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-28T13:53:46.892 DEBUG:teuthology.orchestra.run.smithi111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-28T13:53:46.903 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-28T13:53:46.915 DEBUG:teuthology.orchestra.run.smithi076:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-28T13:53:46.939 DEBUG:teuthology.orchestra.run.smithi111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-28T13:53:46.953 INFO:teuthology.orchestra.run.smithi076.stdout:kernel.core_pattern = core 2024-03-28T13:53:46.954 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = core 2024-03-28T13:53:46.976 DEBUG:teuthology.orchestra.run.smithi076:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-28T13:53:47.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T13:53:47.023 DEBUG:teuthology.orchestra.run.smithi111:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-28T13:53:47.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-28T13:53:47.028 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-28T13:53:47.038 INFO:teuthology.task.internal:Transferring archived files... 2024-03-28T13:53:47.038 DEBUG:teuthology.misc:Transferring archived files from smithi076:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627784/remote/smithi076 2024-03-28T13:53:47.038 DEBUG:teuthology.orchestra.run.smithi076:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-28T13:53:47.093 DEBUG:teuthology.misc:Transferring archived files from smithi111:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627784/remote/smithi111 2024-03-28T13:53:47.093 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-28T13:53:47.114 INFO:teuthology.task.internal:Removing archive directory... 2024-03-28T13:53:47.114 DEBUG:teuthology.orchestra.run.smithi076:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-28T13:53:47.139 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-28T13:53:47.166 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-28T13:53:47.178 INFO:teuthology.task.internal:Not uploading archives. 2024-03-28T13:53:47.178 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-28T13:53:47.192 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-28T13:53:47.192 DEBUG:teuthology.orchestra.run.smithi076:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-28T13:53:47.195 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-28T13:53:47.200 INFO:teuthology.orchestra.run.smithi076.stdout: 655432 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 28 13:53 /home/ubuntu/cephtest 2024-03-28T13:53:47.214 INFO:teuthology.orchestra.run.smithi111.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 28 13:53 /home/ubuntu/cephtest 2024-03-28T13:53:47.215 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-28T13:53:47.228 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-28T13:53:47.243 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_PossiblyLost calloc __trans_list_add 2024-03-28T13:53:47.244 INFO:teuthology.nuke:Checking targets against current locks 2024-03-28T13:53:47.270 DEBUG:teuthology.nuke:shortname: smithi076 2024-03-28T13:53:47.270 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-28T13:53:47.295 DEBUG:teuthology.nuke:shortname: smithi111 2024-03-28T13:53:47.296 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-28T13:53:47.299 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi076.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-28 12:14:37.059966', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKoVmuWtstY1F4pmLD7TPY+oHB/CloLT8YY5gHm7dEB8VWk/9iZCnaTXaYD2Tk8Wu046YyZSIUllyuA2kemHSA0='} 2024-03-28T13:53:47.320 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-28_07:14:07-fs-wip-batrick-testing-20240327.230800-distro-default-smithi/7627784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-28 12:14:37.058227', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBfQWoGPgePB57Hor7i65p0t39xO2uMXVtp++yXP/eOgqz74SrpH/MpsUTir+Z2ZyZ+H/9SR1yOA352WOHAbyNs='} 2024-03-28T13:53:47.349 INFO:teuthology.orchestra.console.smithi076:Power off 2024-03-28T13:53:47.349 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-28T13:53:47.371 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off 2024-03-28T13:53:47.372 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T13:53:47.385 INFO:teuthology.orchestra.console.smithi111:Power off 2024-03-28T13:53:47.385 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-28T13:53:47.395 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-03-28T13:53:47.409 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2024-03-28T13:53:47.409 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T13:53:47.430 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-03-28T13:53:51.396 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T13:53:51.432 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T13:53:51.505 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-03-28T13:53:51.542 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-03-28T13:53:55.508 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T13:53:55.543 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T13:53:55.618 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-03-28T13:53:55.654 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-03-28T13:53:55.719 INFO:teuthology.orchestra.console.smithi076:Power off completed 2024-03-28T13:53:59.655 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-28T13:53:59.764 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-03-28T13:53:59.865 INFO:teuthology.orchestra.console.smithi111:Power off completed 2024-03-28T13:53:59.970 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/5 tasks/fsstress validater/valgrind} duration: 5347.230548620224 failure_reason: 'valgrind error: Leak_PossiblyLost calloc __trans_list_add ' flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2024-03-28T13:53:59.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-28T13:54:00.068 INFO:teuthology.run:FAIL